Sep 09 23:06:16.613547 ip-10-0-132-204 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Sep 09 23:06:16.613723 ip-10-0-132-204 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Sep 09 23:06:16.613819 ip-10-0-132-204 systemd[1]: kubelet.service: Failed with result 'resources'. Sep 09 23:06:16.614294 ip-10-0-132-204 systemd[1]: Failed to start Kubernetes Kubelet. Sep 09 23:06:26.839270 ip-10-0-132-204 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Sep 09 23:06:26.839282 ip-10-0-132-204 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot d7128709b7a14494b735ba2e5a02aede -- Sep 09 23:08:11.497634 ip-10-0-132-204 systemd[1]: Starting Kubernetes Kubelet... Sep 09 23:08:11.937941 ip-10-0-132-204 kubenswrapper[2561]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 09 23:08:11.937941 ip-10-0-132-204 kubenswrapper[2561]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Sep 09 23:08:11.937941 ip-10-0-132-204 kubenswrapper[2561]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 09 23:08:11.937941 ip-10-0-132-204 kubenswrapper[2561]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Sep 09 23:08:11.937941 ip-10-0-132-204 kubenswrapper[2561]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 09 23:08:11.939127 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:11.939045 2561 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Sep 09 23:08:11.944321 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.944300 2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 09 23:08:11.944321 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.944319 2561 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 09 23:08:11.944321 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.944325 2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 09 23:08:11.944321 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.944329 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 09 23:08:11.944576 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.944333 2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 09 23:08:11.944576 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.944337 2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 09 23:08:11.944576 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.944341 2561 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 09 23:08:11.944576 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.944345 2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 09 23:08:11.944576 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.944349 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 09 23:08:11.944576 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.944353 2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 09 23:08:11.944576 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.944357 2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 09 23:08:11.944576 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.944360 2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 09 23:08:11.944576 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.944380 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 09 23:08:11.944576 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.944385 2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 09 23:08:11.944576 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.944388 2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 09 23:08:11.944576 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.944392 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 09 23:08:11.944576 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.944396 2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 09 23:08:11.944576 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.944399 2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 09 23:08:11.944576 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.944404 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 09 23:08:11.944576 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.944407 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 09 23:08:11.944576 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.944411 2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 09 23:08:11.944576 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.944415 2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 09 23:08:11.944576 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.944419 2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 09 23:08:11.944576 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.944422 2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 09 23:08:11.945389 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.944426 2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 09 23:08:11.945389 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.944430 2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 09 23:08:11.945389 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.944433 2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 09 23:08:11.945389 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.944437 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 09 23:08:11.945389 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.944441 2561 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 09 23:08:11.945389 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.944445 2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 09 23:08:11.945389 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.944448 2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 09 23:08:11.945389 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.944452 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 09 23:08:11.945389 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.944457 2561 feature_gate.go:328] unrecognized feature gate: Example Sep 09 23:08:11.945389 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.944462 2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 09 23:08:11.945389 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.944469 2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 09 23:08:11.945389 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.944474 2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 09 23:08:11.945389 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.944479 2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 09 23:08:11.945389 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.944484 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 09 23:08:11.945389 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.944489 2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 09 23:08:11.945389 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.944493 2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 09 23:08:11.945389 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.944498 2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 09 23:08:11.945389 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.944502 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 09 23:08:11.945389 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.944507 2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 09 23:08:11.946193 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.944511 2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 09 23:08:11.946193 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.944515 2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 09 23:08:11.946193 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.944519 2561 feature_gate.go:328] unrecognized feature gate: Example2 Sep 09 23:08:11.946193 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.944523 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 09 23:08:11.946193 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.944527 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 09 23:08:11.946193 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.944531 2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 09 23:08:11.946193 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.944535 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 09 23:08:11.946193 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.944540 2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 09 23:08:11.946193 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.944544 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 09 23:08:11.946193 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.944548 2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 09 23:08:11.946193 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.944553 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 09 23:08:11.946193 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.944557 2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 09 23:08:11.946193 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.944561 2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 09 23:08:11.946193 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.944565 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 09 23:08:11.946193 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.944570 2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 09 23:08:11.946193 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.944574 2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 09 23:08:11.946193 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.944578 2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 09 23:08:11.946193 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.944582 2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 09 23:08:11.946193 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.944585 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 09 23:08:11.946193 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.944590 2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 09 23:08:11.947059 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.944594 2561 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 09 23:08:11.947059 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.944598 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 09 23:08:11.947059 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.944604 2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 09 23:08:11.947059 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.944610 2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 09 23:08:11.947059 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.944615 2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 09 23:08:11.947059 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.944619 2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 09 23:08:11.947059 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.944624 2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 09 23:08:11.947059 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.944629 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 09 23:08:11.947059 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.944633 2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 09 23:08:11.947059 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.944637 2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 09 23:08:11.947059 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.944641 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 09 23:08:11.947059 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.944645 2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 09 23:08:11.947059 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.944649 2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 09 23:08:11.947059 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.944654 2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 09 23:08:11.947059 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.944658 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 09 23:08:11.947059 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.944662 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 09 23:08:11.947059 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.944666 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 09 23:08:11.947059 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.944671 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 09 23:08:11.947059 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.944675 2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 09 23:08:11.947059 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.944679 2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 09 23:08:11.947995 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.944684 2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 09 23:08:11.947995 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.944689 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 09 23:08:11.947995 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.944697 2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 09 23:08:11.947995 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.944704 2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 09 23:08:11.947995 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.944709 2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 09 23:08:11.947995 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.944714 2561 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 09 23:08:11.947995 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.944719 2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 09 23:08:11.947995 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.944723 2561 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 09 23:08:11.947995 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.944727 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 09 23:08:11.947995 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.944732 2561 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 09 23:08:11.947995 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.944736 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 09 23:08:11.947995 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.944741 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 09 23:08:11.947995 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.944745 2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 09 23:08:11.947995 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.944749 2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 09 23:08:11.947995 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.944753 2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 09 23:08:11.947995 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.944757 2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 09 23:08:11.947995 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.945950 2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 09 23:08:11.947995 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.945961 2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 09 23:08:11.947995 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.945968 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 09 23:08:11.947995 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.945972 2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 09 23:08:11.948878 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.945976 2561 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 09 23:08:11.948878 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.945981 2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 09 23:08:11.948878 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.945985 2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 09 23:08:11.948878 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.945989 2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 09 23:08:11.948878 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.945993 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 09 23:08:11.948878 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.945997 2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 09 23:08:11.948878 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.946001 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 09 23:08:11.948878 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.946005 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 09 23:08:11.948878 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.946010 2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 09 23:08:11.948878 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.946013 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 09 23:08:11.948878 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.946018 2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 09 23:08:11.948878 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.946022 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 09 23:08:11.948878 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.946027 2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 09 23:08:11.948878 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.946033 2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 09 23:08:11.948878 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.946037 2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 09 23:08:11.948878 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.946041 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 09 23:08:11.948878 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.946045 2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 09 23:08:11.948878 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.946049 2561 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 09 23:08:11.948878 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.946053 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 09 23:08:11.948878 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.946057 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 09 23:08:11.949474 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.946061 2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 09 23:08:11.949474 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.946065 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 09 23:08:11.949474 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.946069 2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 09 23:08:11.949474 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.946073 2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 09 23:08:11.949474 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.946077 2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 09 23:08:11.949474 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.946081 2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 09 23:08:11.949474 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.946085 2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 09 23:08:11.949474 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.946090 2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 09 23:08:11.949474 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.946095 2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 09 23:08:11.949474 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.946099 2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 09 23:08:11.949474 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.946105 2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 09 23:08:11.949474 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.946109 2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 09 23:08:11.949474 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.946113 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 09 23:08:11.949474 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.946117 2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 09 23:08:11.949474 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.946121 2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 09 23:08:11.949474 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.946125 2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 09 23:08:11.949474 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.946132 2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 09 23:08:11.949474 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.946139 2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 09 23:08:11.949474 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.946144 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 09 23:08:11.950030 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.946148 2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 09 23:08:11.950030 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.946153 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 09 23:08:11.950030 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.946158 2561 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 09 23:08:11.950030 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.946166 2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 09 23:08:11.950030 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.946172 2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 09 23:08:11.950030 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.946177 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 09 23:08:11.950030 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.946182 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 09 23:08:11.950030 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.946188 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 09 23:08:11.950030 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.946192 2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 09 23:08:11.950030 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.946196 2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 09 23:08:11.950030 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.946200 2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 09 23:08:11.950030 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.946204 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 09 23:08:11.950030 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.946208 2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 09 23:08:11.950030 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.946213 2561 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 09 23:08:11.950030 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.946217 2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 09 23:08:11.950030 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.946221 2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 09 23:08:11.950030 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.946225 2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 09 23:08:11.950030 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.946229 2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 09 23:08:11.950030 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.946233 2561 feature_gate.go:328] unrecognized feature gate: Example Sep 09 23:08:11.950030 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.946238 2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 09 23:08:11.950548 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.946242 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 09 23:08:11.950548 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.946246 2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 09 23:08:11.950548 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.946251 2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 09 23:08:11.950548 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.946256 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 09 23:08:11.950548 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.946260 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 09 23:08:11.950548 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.946266 2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 09 23:08:11.950548 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.946271 2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 09 23:08:11.950548 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.946275 2561 feature_gate.go:328] unrecognized feature gate: Example2 Sep 09 23:08:11.950548 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.946279 2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 09 23:08:11.950548 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.946283 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 09 23:08:11.950548 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.946287 2561 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 09 23:08:11.950548 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.946291 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 09 23:08:11.950548 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.946295 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 09 23:08:11.950548 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.946299 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 09 23:08:11.950548 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.946303 2561 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 09 23:08:11.950548 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.946307 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 09 23:08:11.950548 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.946311 2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 09 23:08:11.950548 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.946316 2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 09 23:08:11.950548 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.946319 2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 09 23:08:11.950548 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.946324 2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 09 23:08:11.951139 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.946329 2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 09 23:08:11.951139 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.946333 2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 09 23:08:11.951139 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.946337 2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 09 23:08:11.951139 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.946341 2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 09 23:08:11.951139 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.946345 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 09 23:08:11.951139 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.946349 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 09 23:08:11.951139 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.946352 2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 09 23:08:11.951139 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.946357 2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 09 23:08:11.951139 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.946361 2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 09 23:08:11.951139 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.946385 2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 09 23:08:11.951139 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.946389 2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 09 23:08:11.951139 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.946393 2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 09 23:08:11.951139 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.946397 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 09 23:08:11.951139 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.946402 2561 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 09 23:08:11.951139 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.946408 2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 09 23:08:11.951139 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.946413 2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 09 23:08:11.951139 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.947013 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 09 23:08:11.951139 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.947022 2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 09 23:08:11.951139 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.947026 2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 09 23:08:11.951808 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.947032 2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 09 23:08:11.951808 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.947036 2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 09 23:08:11.951808 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.947040 2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 09 23:08:11.951808 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.947045 2561 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 09 23:08:11.951808 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.947049 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 09 23:08:11.951808 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.947053 2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 09 23:08:11.951808 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.947057 2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 09 23:08:11.951808 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.947060 2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 09 23:08:11.951808 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.947064 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 09 23:08:11.951808 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.947068 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 09 23:08:11.951808 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.947072 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 09 23:08:11.951808 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.947077 2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 09 23:08:11.951808 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.947083 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 09 23:08:11.951808 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.947088 2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 09 23:08:11.951808 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.947092 2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 09 23:08:11.951808 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.947096 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 09 23:08:11.951808 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.947100 2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 09 23:08:11.951808 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.947104 2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 09 23:08:11.951808 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.947108 2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 09 23:08:11.952317 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.947112 2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 09 23:08:11.952317 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.947116 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 09 23:08:11.952317 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.947120 2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 09 23:08:11.952317 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.947125 2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 09 23:08:11.952317 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.947129 2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 09 23:08:11.952317 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.947133 2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 09 23:08:11.952317 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.947138 2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 09 23:08:11.952317 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.947143 2561 feature_gate.go:328] unrecognized feature gate: Example2 Sep 09 23:08:11.952317 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.947148 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 09 23:08:11.952317 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.947152 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 09 23:08:11.952317 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.947156 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 09 23:08:11.952317 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.947160 2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 09 23:08:11.952317 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.947164 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 09 23:08:11.952317 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.947168 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 09 23:08:11.952317 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.947172 2561 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 09 23:08:11.952317 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.947176 2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 09 23:08:11.952317 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.947180 2561 feature_gate.go:328] unrecognized feature gate: Example Sep 09 23:08:11.952317 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.947184 2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 09 23:08:11.952317 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.947188 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 09 23:08:11.952317 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.947192 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 09 23:08:11.952317 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.947196 2561 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 09 23:08:11.952855 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.947200 2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 09 23:08:11.952855 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.947204 2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 09 23:08:11.952855 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.947208 2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 09 23:08:11.952855 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.947212 2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 09 23:08:11.952855 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.947216 2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 09 23:08:11.952855 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.947225 2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 09 23:08:11.952855 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.947231 2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 09 23:08:11.952855 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.947237 2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 09 23:08:11.952855 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.947243 2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 09 23:08:11.952855 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.947247 2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 09 23:08:11.952855 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.947255 2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 09 23:08:11.952855 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.947259 2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 09 23:08:11.952855 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.947263 2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 09 23:08:11.952855 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.947266 2561 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 09 23:08:11.952855 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.947270 2561 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 09 23:08:11.952855 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.947274 2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 09 23:08:11.952855 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.947278 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 09 23:08:11.952855 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.947283 2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 09 23:08:11.952855 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.947287 2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 09 23:08:11.953421 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.947291 2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 09 23:08:11.953421 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.947295 2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 09 23:08:11.953421 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.947300 2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 09 23:08:11.953421 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.947303 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 09 23:08:11.953421 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.947307 2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 09 23:08:11.953421 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.947312 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 09 23:08:11.953421 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.947316 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 09 23:08:11.953421 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.947320 2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 09 23:08:11.953421 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.947324 2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 09 23:08:11.953421 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.947328 2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 09 23:08:11.953421 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.947332 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 09 23:08:11.953421 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.947336 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 09 23:08:11.953421 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.947340 2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 09 23:08:11.953421 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.947346 2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 09 23:08:11.953421 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.947350 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 09 23:08:11.953421 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.947354 2561 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 09 23:08:11.953421 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.947359 2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 09 23:08:11.953421 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.947383 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 09 23:08:11.953421 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.947387 2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 09 23:08:11.953421 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.947391 2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 09 23:08:11.953935 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.947396 2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 09 23:08:11.953935 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.947400 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 09 23:08:11.953935 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.947404 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 09 23:08:11.953935 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.947410 2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 09 23:08:11.953935 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.947415 2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 09 23:08:11.953935 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.947420 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 09 23:08:11.953935 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.947424 2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 09 23:08:11.953935 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.947428 2561 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 09 23:08:11.953935 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.947432 2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 09 23:08:11.953935 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.947436 2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 09 23:08:11.953935 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.947440 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 09 23:08:11.953935 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.947444 2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 09 23:08:11.953935 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.947448 2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 09 23:08:11.953935 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.947452 2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 09 23:08:11.953935 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.947456 2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 09 23:08:11.953935 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.947460 2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 09 23:08:11.953935 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.947465 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 09 23:08:11.953935 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:11.947561 2561 flags.go:64] FLAG: --address="0.0.0.0" Sep 09 23:08:11.953935 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:11.947611 2561 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Sep 09 23:08:11.953935 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:11.947620 2561 flags.go:64] FLAG: --anonymous-auth="true" Sep 09 23:08:11.954426 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:11.947629 2561 flags.go:64] FLAG: --application-metrics-count-limit="100" Sep 09 23:08:11.954426 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:11.947635 2561 flags.go:64] FLAG: --authentication-token-webhook="false" Sep 09 23:08:11.954426 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:11.947640 2561 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Sep 09 23:08:11.954426 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:11.947646 2561 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Sep 09 23:08:11.954426 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:11.947652 2561 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Sep 09 23:08:11.954426 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:11.947657 2561 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Sep 09 23:08:11.954426 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:11.947663 2561 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Sep 09 23:08:11.954426 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:11.947668 2561 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Sep 09 23:08:11.954426 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:11.947673 2561 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Sep 09 23:08:11.954426 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:11.947686 2561 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Sep 09 23:08:11.954426 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:11.947692 2561 flags.go:64] FLAG: --cgroup-root="" Sep 09 23:08:11.954426 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:11.947696 2561 flags.go:64] FLAG: --cgroups-per-qos="true" Sep 09 23:08:11.954426 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:11.947701 2561 flags.go:64] FLAG: --client-ca-file="" Sep 09 23:08:11.954426 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:11.947708 2561 flags.go:64] FLAG: --cloud-provider="external" Sep 09 23:08:11.954426 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:11.947712 2561 flags.go:64] FLAG: --cluster-dns="[]" Sep 09 23:08:11.954426 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:11.947721 2561 flags.go:64] FLAG: --cluster-domain="" Sep 09 23:08:11.954426 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:11.947726 2561 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Sep 09 23:08:11.954426 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:11.947731 2561 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Sep 09 23:08:11.954426 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:11.947736 2561 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Sep 09 23:08:11.954426 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:11.947741 2561 flags.go:64] FLAG: --container-log-max-files="5" Sep 09 23:08:11.954426 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:11.947747 2561 flags.go:64] FLAG: --container-log-max-size="10Mi" Sep 09 23:08:11.954426 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:11.947751 2561 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Sep 09 23:08:11.954426 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:11.947756 2561 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Sep 09 23:08:11.954988 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:11.947761 2561 flags.go:64] FLAG: --containerd-namespace="k8s.io" Sep 09 23:08:11.954988 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:11.947766 2561 flags.go:64] FLAG: --contention-profiling="false" Sep 09 23:08:11.954988 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:11.947771 2561 flags.go:64] FLAG: --cpu-cfs-quota="true" Sep 09 23:08:11.954988 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:11.947775 2561 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Sep 09 23:08:11.954988 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:11.947780 2561 flags.go:64] FLAG: --cpu-manager-policy="none" Sep 09 23:08:11.954988 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:11.947784 2561 flags.go:64] FLAG: --cpu-manager-policy-options="" Sep 09 23:08:11.954988 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:11.947790 2561 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Sep 09 23:08:11.954988 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:11.947795 2561 flags.go:64] FLAG: --enable-controller-attach-detach="true" Sep 09 23:08:11.954988 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:11.947799 2561 flags.go:64] FLAG: --enable-debugging-handlers="true" Sep 09 23:08:11.954988 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:11.947806 2561 flags.go:64] FLAG: --enable-load-reader="false" Sep 09 23:08:11.954988 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:11.947810 2561 flags.go:64] FLAG: --enable-server="true" Sep 09 23:08:11.954988 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:11.947815 2561 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Sep 09 23:08:11.954988 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:11.947820 2561 flags.go:64] FLAG: --event-burst="100" Sep 09 23:08:11.954988 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:11.947825 2561 flags.go:64] FLAG: --event-qps="50" Sep 09 23:08:11.954988 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:11.947830 2561 flags.go:64] FLAG: --event-storage-age-limit="default=0" Sep 09 23:08:11.954988 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:11.947835 2561 flags.go:64] FLAG: --event-storage-event-limit="default=0" Sep 09 23:08:11.954988 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:11.947840 2561 flags.go:64] FLAG: --eviction-hard="" Sep 09 23:08:11.954988 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:11.947845 2561 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Sep 09 23:08:11.954988 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:11.947849 2561 flags.go:64] FLAG: --eviction-minimum-reclaim="" Sep 09 23:08:11.954988 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:11.947854 2561 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Sep 09 23:08:11.954988 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:11.947858 2561 flags.go:64] FLAG: --eviction-soft="" Sep 09 23:08:11.954988 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:11.947863 2561 flags.go:64] FLAG: --eviction-soft-grace-period="" Sep 09 23:08:11.954988 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:11.947867 2561 flags.go:64] FLAG: --exit-on-lock-contention="false" Sep 09 23:08:11.954988 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:11.947874 2561 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Sep 09 23:08:11.954988 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:11.947882 2561 flags.go:64] FLAG: --experimental-mounter-path="" Sep 09 23:08:11.955667 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:11.947887 2561 flags.go:64] FLAG: --fail-cgroupv1="false" Sep 09 23:08:11.955667 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:11.947892 2561 flags.go:64] FLAG: --fail-swap-on="true" Sep 09 23:08:11.955667 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:11.947897 2561 flags.go:64] FLAG: --feature-gates="" Sep 09 23:08:11.955667 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:11.947902 2561 flags.go:64] FLAG: --file-check-frequency="20s" Sep 09 23:08:11.955667 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:11.947907 2561 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Sep 09 23:08:11.955667 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:11.947911 2561 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Sep 09 23:08:11.955667 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:11.947916 2561 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Sep 09 23:08:11.955667 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:11.947921 2561 flags.go:64] FLAG: --healthz-port="10248" Sep 09 23:08:11.955667 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:11.947926 2561 flags.go:64] FLAG: --help="false" Sep 09 23:08:11.955667 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:11.947930 2561 flags.go:64] FLAG: --hostname-override="ip-10-0-132-204.ec2.internal" Sep 09 23:08:11.955667 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:11.947935 2561 flags.go:64] FLAG: --housekeeping-interval="10s" Sep 09 23:08:11.955667 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:11.947940 2561 flags.go:64] FLAG: --http-check-frequency="20s" Sep 09 23:08:11.955667 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:11.947944 2561 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Sep 09 23:08:11.955667 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:11.947950 2561 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Sep 09 23:08:11.955667 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:11.947955 2561 flags.go:64] FLAG: --image-gc-high-threshold="85" Sep 09 23:08:11.955667 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:11.947960 2561 flags.go:64] FLAG: --image-gc-low-threshold="80" Sep 09 23:08:11.955667 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:11.947966 2561 flags.go:64] FLAG: --image-service-endpoint="" Sep 09 23:08:11.955667 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:11.947970 2561 flags.go:64] FLAG: --kernel-memcg-notification="false" Sep 09 23:08:11.955667 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:11.947975 2561 flags.go:64] FLAG: --kube-api-burst="100" Sep 09 23:08:11.955667 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:11.947980 2561 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Sep 09 23:08:11.955667 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:11.947985 2561 flags.go:64] FLAG: --kube-api-qps="50" Sep 09 23:08:11.955667 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:11.947990 2561 flags.go:64] FLAG: --kube-reserved="" Sep 09 23:08:11.955667 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:11.947994 2561 flags.go:64] FLAG: --kube-reserved-cgroup="" Sep 09 23:08:11.955667 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:11.947998 2561 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Sep 09 23:08:11.956271 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:11.948002 2561 flags.go:64] FLAG: --kubelet-cgroups="" Sep 09 23:08:11.956271 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:11.948006 2561 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Sep 09 23:08:11.956271 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:11.948011 2561 flags.go:64] FLAG: --lock-file="" Sep 09 23:08:11.956271 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:11.948015 2561 flags.go:64] FLAG: --log-cadvisor-usage="false" Sep 09 23:08:11.956271 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:11.948019 2561 flags.go:64] FLAG: --log-flush-frequency="5s" Sep 09 23:08:11.956271 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:11.948024 2561 flags.go:64] FLAG: --log-json-info-buffer-size="0" Sep 09 23:08:11.956271 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:11.948033 2561 flags.go:64] FLAG: --log-json-split-stream="false" Sep 09 23:08:11.956271 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:11.948040 2561 flags.go:64] FLAG: --log-text-info-buffer-size="0" Sep 09 23:08:11.956271 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:11.948045 2561 flags.go:64] FLAG: --log-text-split-stream="false" Sep 09 23:08:11.956271 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:11.948049 2561 flags.go:64] FLAG: --logging-format="text" Sep 09 23:08:11.956271 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:11.948054 2561 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Sep 09 23:08:11.956271 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:11.948059 2561 flags.go:64] FLAG: --make-iptables-util-chains="true" Sep 09 23:08:11.956271 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:11.948064 2561 flags.go:64] FLAG: --manifest-url="" Sep 09 23:08:11.956271 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:11.948068 2561 flags.go:64] FLAG: --manifest-url-header="" Sep 09 23:08:11.956271 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:11.948075 2561 flags.go:64] FLAG: --max-housekeeping-interval="15s" Sep 09 23:08:11.956271 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:11.948079 2561 flags.go:64] FLAG: --max-open-files="1000000" Sep 09 23:08:11.956271 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:11.948086 2561 flags.go:64] FLAG: --max-pods="110" Sep 09 23:08:11.956271 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:11.948090 2561 flags.go:64] FLAG: --maximum-dead-containers="-1" Sep 09 23:08:11.956271 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:11.948095 2561 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Sep 09 23:08:11.956271 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:11.948100 2561 flags.go:64] FLAG: --memory-manager-policy="None" Sep 09 23:08:11.956271 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:11.948104 2561 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Sep 09 23:08:11.956271 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:11.948109 2561 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Sep 09 23:08:11.956271 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:11.948113 2561 flags.go:64] FLAG: --node-ip="0.0.0.0" Sep 09 23:08:11.956271 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:11.948118 2561 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Sep 09 23:08:11.956271 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:11.948130 2561 flags.go:64] FLAG: --node-status-max-images="50" Sep 09 23:08:11.956956 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:11.948136 2561 flags.go:64] FLAG: --node-status-update-frequency="10s" Sep 09 23:08:11.956956 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:11.948141 2561 flags.go:64] FLAG: --oom-score-adj="-999" Sep 09 23:08:11.956956 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:11.948146 2561 flags.go:64] FLAG: --pod-cidr="" Sep 09 23:08:11.956956 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:11.948150 2561 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8ccbacc999dbf9abad8f4009240188312b683f36ced4763eed166c1500c164b1" Sep 09 23:08:11.956956 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:11.948158 2561 flags.go:64] FLAG: --pod-manifest-path="" Sep 09 23:08:11.956956 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:11.948163 2561 flags.go:64] FLAG: --pod-max-pids="-1" Sep 09 23:08:11.956956 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:11.948167 2561 flags.go:64] FLAG: --pods-per-core="0" Sep 09 23:08:11.956956 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:11.948172 2561 flags.go:64] FLAG: --port="10250" Sep 09 23:08:11.956956 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:11.948176 2561 flags.go:64] FLAG: --protect-kernel-defaults="false" Sep 09 23:08:11.956956 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:11.948181 2561 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0593cac1b9de45853" Sep 09 23:08:11.956956 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:11.948186 2561 flags.go:64] FLAG: --qos-reserved="" Sep 09 23:08:11.956956 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:11.948191 2561 flags.go:64] FLAG: --read-only-port="10255" Sep 09 23:08:11.956956 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:11.948195 2561 flags.go:64] FLAG: --register-node="true" Sep 09 23:08:11.956956 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:11.948200 2561 flags.go:64] FLAG: --register-with-taints="" Sep 09 23:08:11.956956 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:11.948206 2561 flags.go:64] FLAG: --registry-burst="10" Sep 09 23:08:11.956956 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:11.948213 2561 flags.go:64] FLAG: --registry-qps="5" Sep 09 23:08:11.956956 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:11.948218 2561 flags.go:64] FLAG: --reserved-cpus="" Sep 09 23:08:11.956956 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:11.948222 2561 flags.go:64] FLAG: --reserved-memory="" Sep 09 23:08:11.956956 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:11.948228 2561 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Sep 09 23:08:11.956956 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:11.948233 2561 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Sep 09 23:08:11.956956 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:11.948238 2561 flags.go:64] FLAG: --rotate-certificates="false" Sep 09 23:08:11.956956 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:11.948242 2561 flags.go:64] FLAG: --rotate-server-certificates="false" Sep 09 23:08:11.956956 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:11.948247 2561 flags.go:64] FLAG: --runonce="false" Sep 09 23:08:11.956956 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:11.948251 2561 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Sep 09 23:08:11.956956 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:11.948256 2561 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Sep 09 23:08:11.957689 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:11.948261 2561 flags.go:64] FLAG: --seccomp-default="false" Sep 09 23:08:11.957689 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:11.948265 2561 flags.go:64] FLAG: --serialize-image-pulls="true" Sep 09 23:08:11.957689 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:11.948270 2561 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Sep 09 23:08:11.957689 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:11.948275 2561 flags.go:64] FLAG: --storage-driver-db="cadvisor" Sep 09 23:08:11.957689 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:11.948280 2561 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Sep 09 23:08:11.957689 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:11.948285 2561 flags.go:64] FLAG: --storage-driver-password="root" Sep 09 23:08:11.957689 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:11.948291 2561 flags.go:64] FLAG: --storage-driver-secure="false" Sep 09 23:08:11.957689 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:11.948296 2561 flags.go:64] FLAG: --storage-driver-table="stats" Sep 09 23:08:11.957689 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:11.948300 2561 flags.go:64] FLAG: --storage-driver-user="root" Sep 09 23:08:11.957689 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:11.948305 2561 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Sep 09 23:08:11.957689 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:11.948309 2561 flags.go:64] FLAG: --sync-frequency="1m0s" Sep 09 23:08:11.957689 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:11.948314 2561 flags.go:64] FLAG: --system-cgroups="" Sep 09 23:08:11.957689 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:11.948318 2561 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Sep 09 23:08:11.957689 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:11.948327 2561 flags.go:64] FLAG: --system-reserved-cgroup="" Sep 09 23:08:11.957689 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:11.948332 2561 flags.go:64] FLAG: --tls-cert-file="" Sep 09 23:08:11.957689 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:11.948336 2561 flags.go:64] FLAG: --tls-cipher-suites="[]" Sep 09 23:08:11.957689 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:11.948343 2561 flags.go:64] FLAG: --tls-min-version="" Sep 09 23:08:11.957689 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:11.948347 2561 flags.go:64] FLAG: --tls-private-key-file="" Sep 09 23:08:11.957689 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:11.948352 2561 flags.go:64] FLAG: --topology-manager-policy="none" Sep 09 23:08:11.957689 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:11.948357 2561 flags.go:64] FLAG: --topology-manager-policy-options="" Sep 09 23:08:11.957689 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:11.948380 2561 flags.go:64] FLAG: --topology-manager-scope="container" Sep 09 23:08:11.957689 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:11.948385 2561 flags.go:64] FLAG: --v="2" Sep 09 23:08:11.957689 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:11.948393 2561 flags.go:64] FLAG: --version="false" Sep 09 23:08:11.957689 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:11.948406 2561 flags.go:64] FLAG: --vmodule="" Sep 09 23:08:11.957689 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:11.948412 2561 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Sep 09 23:08:11.958278 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:11.948417 2561 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Sep 09 23:08:11.958278 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.948593 2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 09 23:08:11.958278 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.948599 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 09 23:08:11.958278 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.948605 2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 09 23:08:11.958278 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.948609 2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 09 23:08:11.958278 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.948613 2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 09 23:08:11.958278 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.948618 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 09 23:08:11.958278 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.948622 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 09 23:08:11.958278 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.948626 2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 09 23:08:11.958278 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.948630 2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 09 23:08:11.958278 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.948634 2561 feature_gate.go:328] unrecognized feature gate: Example Sep 09 23:08:11.958278 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.948638 2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 09 23:08:11.958278 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.948642 2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 09 23:08:11.958278 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.948648 2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 09 23:08:11.958278 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.948652 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 09 23:08:11.958278 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.948656 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 09 23:08:11.958278 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.948660 2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 09 23:08:11.958278 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.948664 2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 09 23:08:11.958278 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.948668 2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 09 23:08:11.958278 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.948672 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 09 23:08:11.958787 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.948676 2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 09 23:08:11.958787 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.948681 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 09 23:08:11.958787 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.948685 2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 09 23:08:11.958787 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.948689 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 09 23:08:11.958787 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.948694 2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 09 23:08:11.958787 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.948698 2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 09 23:08:11.958787 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.948702 2561 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 09 23:08:11.958787 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.948706 2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 09 23:08:11.958787 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.948710 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 09 23:08:11.958787 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.948715 2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 09 23:08:11.958787 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.948719 2561 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 09 23:08:11.958787 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.948726 2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 09 23:08:11.958787 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.948733 2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 09 23:08:11.958787 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.948738 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 09 23:08:11.958787 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.948743 2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 09 23:08:11.958787 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.948748 2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 09 23:08:11.958787 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.948752 2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 09 23:08:11.958787 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.948756 2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 09 23:08:11.958787 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.948760 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 09 23:08:11.958787 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.948764 2561 feature_gate.go:328] unrecognized feature gate: Example2 Sep 09 23:08:11.959263 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.948768 2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 09 23:08:11.959263 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.948772 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 09 23:08:11.959263 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.948776 2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 09 23:08:11.959263 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.948780 2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 09 23:08:11.959263 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.948784 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 09 23:08:11.959263 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.948790 2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 09 23:08:11.959263 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.948794 2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 09 23:08:11.959263 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.948798 2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 09 23:08:11.959263 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.948803 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 09 23:08:11.959263 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.948807 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 09 23:08:11.959263 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.948811 2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 09 23:08:11.959263 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.948815 2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 09 23:08:11.959263 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.948822 2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 09 23:08:11.959263 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.948827 2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 09 23:08:11.959263 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.948832 2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 09 23:08:11.959263 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.948836 2561 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 09 23:08:11.959263 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.948840 2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 09 23:08:11.959263 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.948845 2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 09 23:08:11.959263 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.948849 2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 09 23:08:11.959758 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.948853 2561 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 09 23:08:11.959758 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.948857 2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 09 23:08:11.959758 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.948863 2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 09 23:08:11.959758 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.948866 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 09 23:08:11.959758 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.948870 2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 09 23:08:11.959758 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.948875 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 09 23:08:11.959758 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.948879 2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 09 23:08:11.959758 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.948882 2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 09 23:08:11.959758 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.948886 2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 09 23:08:11.959758 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.948889 2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 09 23:08:11.959758 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.948893 2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 09 23:08:11.959758 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.948897 2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 09 23:08:11.959758 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.948900 2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 09 23:08:11.959758 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.948904 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 09 23:08:11.959758 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.948908 2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 09 23:08:11.959758 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.948912 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 09 23:08:11.959758 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.948916 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 09 23:08:11.959758 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.948920 2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 09 23:08:11.959758 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.948926 2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 09 23:08:11.959758 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.948930 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 09 23:08:11.960243 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.948934 2561 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 09 23:08:11.960243 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.948938 2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 09 23:08:11.960243 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.948942 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 09 23:08:11.960243 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.948946 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 09 23:08:11.960243 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.948950 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 09 23:08:11.960243 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.948954 2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 09 23:08:11.960243 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.948958 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 09 23:08:11.960243 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.948962 2561 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 09 23:08:11.960243 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.948966 2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 09 23:08:11.960243 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.948970 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 09 23:08:11.960243 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.948974 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 09 23:08:11.960243 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.948978 2561 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 09 23:08:11.960243 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.948985 2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 09 23:08:11.960243 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.948990 2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 09 23:08:11.960243 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.948996 2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 09 23:08:11.960243 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.949000 2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 09 23:08:11.960243 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.949004 2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 09 23:08:11.960243 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.949008 2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 09 23:08:11.960243 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.949013 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 09 23:08:11.960727 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.949018 2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 09 23:08:11.960727 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.949022 2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 09 23:08:11.960727 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:11.949813 2561 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 09 23:08:11.960727 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:11.958263 2561 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Sep 09 23:08:11.960727 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:11.958404 2561 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Sep 09 23:08:11.960727 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:11.959317 2561 watchdog_linux.go:95] "Systemd watchdog is not enabled" Sep 09 23:08:11.960727 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:11.959324 2561 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Sep 09 23:08:11.960727 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.959402 2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 09 23:08:11.960727 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.959409 2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 09 23:08:11.960727 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.959412 2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 09 23:08:11.960727 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.959416 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 09 23:08:11.960727 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.959418 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 09 23:08:11.960727 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.959421 2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 09 23:08:11.960727 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.959424 2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 09 23:08:11.960727 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.959426 2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 09 23:08:11.961138 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.959429 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 09 23:08:11.961138 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.959431 2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 09 23:08:11.961138 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.959434 2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 09 23:08:11.961138 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.959437 2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 09 23:08:11.961138 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.959439 2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 09 23:08:11.961138 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.959442 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 09 23:08:11.961138 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.959444 2561 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 09 23:08:11.961138 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.959446 2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 09 23:08:11.961138 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.959449 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 09 23:08:11.961138 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.959451 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 09 23:08:11.961138 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.959454 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 09 23:08:11.961138 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.959456 2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 09 23:08:11.961138 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.959459 2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 09 23:08:11.961138 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.959461 2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 09 23:08:11.961138 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.959464 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 09 23:08:11.961138 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.959466 2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 09 23:08:11.961138 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.959471 2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 09 23:08:11.961138 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.959474 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 09 23:08:11.961138 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.959477 2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 09 23:08:11.961626 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.959481 2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 09 23:08:11.961626 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.959484 2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 09 23:08:11.961626 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.959487 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 09 23:08:11.961626 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.959491 2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 09 23:08:11.961626 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.959495 2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 09 23:08:11.961626 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.959498 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 09 23:08:11.961626 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.959500 2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 09 23:08:11.961626 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.959503 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 09 23:08:11.961626 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.959506 2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 09 23:08:11.961626 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.959508 2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 09 23:08:11.961626 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.959512 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 09 23:08:11.961626 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.959515 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 09 23:08:11.961626 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.959517 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 09 23:08:11.961626 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.959520 2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 09 23:08:11.961626 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.959523 2561 feature_gate.go:328] unrecognized feature gate: Example2 Sep 09 23:08:11.961626 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.959525 2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 09 23:08:11.961626 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.959528 2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 09 23:08:11.961626 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.959530 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 09 23:08:11.961626 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.959533 2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 09 23:08:11.962080 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.959535 2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 09 23:08:11.962080 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.959538 2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 09 23:08:11.962080 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.959540 2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 09 23:08:11.962080 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.959542 2561 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 09 23:08:11.962080 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.959545 2561 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 09 23:08:11.962080 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.959547 2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 09 23:08:11.962080 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.959550 2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 09 23:08:11.962080 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.959553 2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 09 23:08:11.962080 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.959555 2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 09 23:08:11.962080 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.959558 2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 09 23:08:11.962080 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.959560 2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 09 23:08:11.962080 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.959563 2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 09 23:08:11.962080 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.959566 2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 09 23:08:11.962080 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.959569 2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 09 23:08:11.962080 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.959572 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 09 23:08:11.962080 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.959575 2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 09 23:08:11.962080 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.959578 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 09 23:08:11.962080 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.959580 2561 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 09 23:08:11.962080 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.959583 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 09 23:08:11.962080 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.959586 2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 09 23:08:11.962584 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.959588 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 09 23:08:11.962584 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.959590 2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 09 23:08:11.962584 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.959593 2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 09 23:08:11.962584 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.959595 2561 feature_gate.go:328] unrecognized feature gate: Example Sep 09 23:08:11.962584 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.959598 2561 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 09 23:08:11.962584 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.959600 2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 09 23:08:11.962584 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.959602 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 09 23:08:11.962584 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.959605 2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 09 23:08:11.962584 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.959607 2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 09 23:08:11.962584 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.959609 2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 09 23:08:11.962584 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.959612 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 09 23:08:11.962584 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.959614 2561 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 09 23:08:11.962584 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.959617 2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 09 23:08:11.962584 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.959619 2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 09 23:08:11.962584 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.959621 2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 09 23:08:11.962584 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.959623 2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 09 23:08:11.962584 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.959626 2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 09 23:08:11.962584 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.959628 2561 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 09 23:08:11.962584 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.959630 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 09 23:08:11.962584 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.959633 2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 09 23:08:11.963059 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.959635 2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 09 23:08:11.963059 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.959638 2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 09 23:08:11.963059 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.959642 2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 09 23:08:11.963059 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.959645 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 09 23:08:11.963059 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.959648 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 09 23:08:11.963059 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.959651 2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 09 23:08:11.963059 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.959653 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 09 23:08:11.963059 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.959656 2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 09 23:08:11.963059 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.959658 2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 09 23:08:11.963059 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.959661 2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 09 23:08:11.963059 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.959663 2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 09 23:08:11.963059 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.959665 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 09 23:08:11.963059 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.959668 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 09 23:08:11.963059 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:11.959673 2561 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 09 23:08:11.963059 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.959827 2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 09 23:08:11.963457 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.959831 2561 feature_gate.go:328] unrecognized feature gate: Example2 Sep 09 23:08:11.963457 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.959833 2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 09 23:08:11.963457 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.959836 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 09 23:08:11.963457 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.959840 2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 09 23:08:11.963457 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.959843 2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 09 23:08:11.963457 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.959846 2561 feature_gate.go:328] unrecognized feature gate: Example Sep 09 23:08:11.963457 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.959849 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 09 23:08:11.963457 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.959851 2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 09 23:08:11.963457 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.959854 2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 09 23:08:11.963457 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.959857 2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 09 23:08:11.963457 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.959860 2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 09 23:08:11.963457 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.959862 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 09 23:08:11.963457 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.959865 2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 09 23:08:11.963457 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.959868 2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 09 23:08:11.963457 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.959870 2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 09 23:08:11.963457 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.959873 2561 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 09 23:08:11.963457 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.959875 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 09 23:08:11.963457 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.959878 2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 09 23:08:11.963457 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.959880 2561 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 09 23:08:11.963915 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.959883 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 09 23:08:11.963915 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.959885 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 09 23:08:11.963915 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.959887 2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 09 23:08:11.963915 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.959890 2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 09 23:08:11.963915 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.959893 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 09 23:08:11.963915 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.959895 2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 09 23:08:11.963915 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.959898 2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 09 23:08:11.963915 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.959901 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 09 23:08:11.963915 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.959904 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 09 23:08:11.963915 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.959906 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 09 23:08:11.963915 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.959908 2561 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 09 23:08:11.963915 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.959911 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 09 23:08:11.963915 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.959913 2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 09 23:08:11.963915 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.959916 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 09 23:08:11.963915 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.959918 2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 09 23:08:11.963915 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.959920 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 09 23:08:11.963915 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.959923 2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 09 23:08:11.963915 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.959925 2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 09 23:08:11.963915 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.959927 2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 09 23:08:11.964394 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.959931 2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 09 23:08:11.964394 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.959934 2561 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 09 23:08:11.964394 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.959937 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 09 23:08:11.964394 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.959940 2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 09 23:08:11.964394 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.959943 2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 09 23:08:11.964394 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.959945 2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 09 23:08:11.964394 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.959948 2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 09 23:08:11.964394 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.959950 2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 09 23:08:11.964394 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.959953 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 09 23:08:11.964394 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.959956 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 09 23:08:11.964394 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.959959 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 09 23:08:11.964394 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.959961 2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 09 23:08:11.964394 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.959964 2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 09 23:08:11.964394 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.959966 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 09 23:08:11.964394 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.959968 2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 09 23:08:11.964394 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.959971 2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 09 23:08:11.964394 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.959973 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 09 23:08:11.964394 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.959982 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 09 23:08:11.964394 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.959984 2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 09 23:08:11.964853 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.959987 2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 09 23:08:11.964853 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.959989 2561 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 09 23:08:11.964853 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.959991 2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 09 23:08:11.964853 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.959994 2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 09 23:08:11.964853 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.959996 2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 09 23:08:11.964853 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.959999 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 09 23:08:11.964853 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.960001 2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 09 23:08:11.964853 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.960003 2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 09 23:08:11.964853 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.960006 2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 09 23:08:11.964853 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.960008 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 09 23:08:11.964853 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.960010 2561 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 09 23:08:11.964853 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.960014 2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 09 23:08:11.964853 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.960017 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 09 23:08:11.964853 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.960020 2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 09 23:08:11.964853 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.960022 2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 09 23:08:11.964853 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.960025 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 09 23:08:11.964853 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.960027 2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 09 23:08:11.964853 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.960029 2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 09 23:08:11.964853 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.960032 2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 09 23:08:11.964853 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.960035 2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 09 23:08:11.965342 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.960037 2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 09 23:08:11.965342 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.960039 2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 09 23:08:11.965342 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.960042 2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 09 23:08:11.965342 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.960044 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 09 23:08:11.965342 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.960047 2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 09 23:08:11.965342 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.960049 2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 09 23:08:11.965342 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.960051 2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 09 23:08:11.965342 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.960054 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 09 23:08:11.965342 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.960056 2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 09 23:08:11.965342 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.960059 2561 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 09 23:08:11.965342 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.960061 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 09 23:08:11.965342 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.960070 2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 09 23:08:11.965342 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.960072 2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 09 23:08:11.965342 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.960075 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 09 23:08:11.965342 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.960077 2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 09 23:08:11.965342 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.960080 2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 09 23:08:11.965342 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.960082 2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 09 23:08:11.965342 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.960084 2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 09 23:08:11.965342 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.960087 2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 09 23:08:11.965342 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.960089 2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 09 23:08:11.965881 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:11.960092 2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 09 23:08:11.965881 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:11.960096 2561 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 09 23:08:11.965881 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:11.960200 2561 server.go:962] "Client rotation is on, will bootstrap in background" Sep 09 23:08:11.965881 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:11.965299 2561 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Sep 09 23:08:11.966462 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:11.966448 2561 server.go:1019] "Starting client certificate rotation" Sep 09 23:08:11.966570 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:11.966555 2561 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Sep 09 23:08:11.966602 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:11.966596 2561 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Sep 09 23:08:11.970142 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:11.970129 2561 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Sep 09 23:08:11.971581 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:11.971554 2561 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Sep 09 23:08:11.988498 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:11.988471 2561 log.go:25] "Validated CRI v1 runtime API" Sep 09 23:08:11.991818 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:11.991797 2561 log.go:25] "Validated CRI v1 image API" Sep 09 23:08:11.992679 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:11.992664 2561 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Sep 09 23:08:11.998228 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:11.998201 2561 fs.go:135] Filesystem UUIDs: map[16a4c5a4-dcc3-47f6-9d8f-d7cd8e20edc7:/dev/nvme0n1p3 4e48256c-2cda-4205-8b23-c6de896c80e5:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2] Sep 09 23:08:11.998228 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:11.998220 2561 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Sep 09 23:08:11.998401 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:11.998385 2561 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Sep 09 23:08:12.004589 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:12.004481 2561 manager.go:216] Machine: {Timestamp:2026-09-09 23:08:12.003123435 +0000 UTC m=+0.378697487 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3059308 MemoryCapacity:32812163072 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2e2d42db140f7a16f2ed8d807cf6c7 SystemUUID:ec2e2d42-db14-0f7a-16f2-ed8d807cf6c7 BootID:d7128709-b7a1-4494-b735-ba2e5a02aede Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406081536 Type:vfs Inodes:4005391 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406081536 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:08:e2:d3:54:69 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:08:e2:d3:54:69 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:36:c7:11:bd:03:f3 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812163072 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Sep 09 23:08:12.004589 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:12.004583 2561 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Sep 09 23:08:12.004743 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:12.004684 2561 manager.go:232] Version: {KernelVersion:5.14.0-570.138.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260901-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Sep 09 23:08:12.008483 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:12.008460 2561 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Sep 09 23:08:12.008627 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:12.008485 2561 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-132-204.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Sep 09 23:08:12.009324 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:12.009314 2561 topology_manager.go:138] "Creating topology manager with none policy" Sep 09 23:08:12.009360 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:12.009325 2561 container_manager_linux.go:309] "Creating device plugin manager" Sep 09 23:08:12.009360 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:12.009333 2561 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Sep 09 23:08:12.009360 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:12.009346 2561 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Sep 09 23:08:12.011302 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:12.011292 2561 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Sep 09 23:08:12.016761 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:12.016749 2561 state_mem.go:36] "Initialized new in-memory state store" Sep 09 23:08:12.016874 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:12.016865 2561 server.go:1240] "Using root directory" path="/var/lib/kubelet" Sep 09 23:08:12.016908 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:12.016895 2561 kubelet.go:486] "Attempting to sync node with API server" Sep 09 23:08:12.016908 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:12.016904 2561 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Sep 09 23:08:12.016964 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:12.016918 2561 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Sep 09 23:08:12.016964 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:12.016931 2561 kubelet.go:398] "Adding apiserver pod source" Sep 09 23:08:12.016964 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:12.016939 2561 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Sep 09 23:08:12.017276 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:12.017264 2561 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Sep 09 23:08:12.017316 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:12.017286 2561 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Sep 09 23:08:12.020349 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:12.020334 2561 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.12-5.rhaos4.21.gitd1ec63c.el9" apiVersion="v1" Sep 09 23:08:12.021481 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:12.021455 2561 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-dj7lf" Sep 09 23:08:12.023280 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:12.023265 2561 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Sep 09 23:08:12.023341 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:12.023295 2561 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Sep 09 23:08:12.023464 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:12.023454 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Sep 09 23:08:12.023504 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:12.023469 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Sep 09 23:08:12.023504 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:12.023475 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Sep 09 23:08:12.023504 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:12.023481 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Sep 09 23:08:12.023504 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:12.023488 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Sep 09 23:08:12.023504 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:12.023493 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Sep 09 23:08:12.024119 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:12.024109 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Sep 09 23:08:12.024119 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:12.024118 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Sep 09 23:08:12.024178 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:12.024131 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Sep 09 23:08:12.024178 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:12.024148 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Sep 09 23:08:12.024178 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:12.024161 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Sep 09 23:08:12.024178 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:12.024168 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Sep 09 23:08:12.025911 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:12.025901 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Sep 09 23:08:12.025911 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:12.025911 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Sep 09 23:08:12.029882 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:12.029865 2561 server.go:1268] "Started kubelet" Sep 09 23:08:12.029968 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:12.029945 2561 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Sep 09 23:08:12.030033 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:12.029992 2561 server_v1.go:49] "podresources" method="list" useActivePods=true Sep 09 23:08:12.030817 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:12.030444 2561 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Sep 09 23:08:12.030994 ip-10-0-132-204 systemd[1]: Started Kubernetes Kubelet. Sep 09 23:08:12.031331 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:12.031307 2561 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-dj7lf" Sep 09 23:08:12.031656 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:12.031638 2561 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-132-204.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Sep 09 23:08:12.032071 ip-10-0-132-204 kubenswrapper[2561]: E0909 23:08:12.032038 2561 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Sep 09 23:08:12.032071 ip-10-0-132-204 kubenswrapper[2561]: E0909 23:08:12.032050 2561 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-132-204.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Sep 09 23:08:12.033437 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:12.033387 2561 server.go:310] "Adding debug handlers to kubelet server" Sep 09 23:08:12.035990 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:12.035956 2561 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Sep 09 23:08:12.039472 ip-10-0-132-204 kubenswrapper[2561]: E0909 23:08:12.039453 2561 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Sep 09 23:08:12.040117 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:12.040096 2561 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Sep 09 23:08:12.040117 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:12.040100 2561 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Sep 09 23:08:12.040268 ip-10-0-132-204 kubenswrapper[2561]: E0909 23:08:12.040200 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-204.ec2.internal\" not found" Sep 09 23:08:12.040900 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:12.040825 2561 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Sep 09 23:08:12.040900 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:12.040828 2561 volume_manager.go:311] "The desired_state_of_world populator starts" Sep 09 23:08:12.040900 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:12.040854 2561 volume_manager.go:313] "Starting Kubelet Volume Manager" Sep 09 23:08:12.041165 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:12.040965 2561 reconstruct.go:97] "Volume reconstruction finished" Sep 09 23:08:12.041165 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:12.040974 2561 reconciler.go:29] "Reconciler: start to sync state" Sep 09 23:08:12.041165 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:12.041114 2561 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Sep 09 23:08:12.041165 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:12.041128 2561 factory.go:55] Registering systemd factory Sep 09 23:08:12.041165 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:12.041137 2561 factory.go:223] Registration of the systemd container factory successfully Sep 09 23:08:12.041515 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:12.041474 2561 factory.go:153] Registering CRI-O factory Sep 09 23:08:12.041515 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:12.041486 2561 factory.go:223] Registration of the crio container factory successfully Sep 09 23:08:12.041515 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:12.041500 2561 factory.go:103] Registering Raw factory Sep 09 23:08:12.041515 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:12.041509 2561 manager.go:1196] Started watching for new ooms in manager Sep 09 23:08:12.041744 ip-10-0-132-204 kubenswrapper[2561]: E0909 23:08:12.040563 2561 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-132-204.ec2.internal.18d3c9bd5647f7fb default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-132-204.ec2.internal,UID:ip-10-0-132-204.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-132-204.ec2.internal,},FirstTimestamp:2026-09-09 23:08:12.029777915 +0000 UTC m=+0.405351968,LastTimestamp:2026-09-09 23:08:12.029777915 +0000 UTC m=+0.405351968,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-132-204.ec2.internal,}" Sep 09 23:08:12.041931 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:12.041916 2561 manager.go:349] Starting recovery of all containers Sep 09 23:08:12.051820 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:12.051803 2561 manager.go:354] Recovery completed Sep 09 23:08:12.054460 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:12.054430 2561 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Sep 09 23:08:12.056332 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:12.056317 2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 09 23:08:12.057251 ip-10-0-132-204 kubenswrapper[2561]: E0909 23:08:12.057237 2561 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-132-204.ec2.internal\" not found" node="ip-10-0-132-204.ec2.internal" Sep 09 23:08:12.060414 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:12.060399 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-204.ec2.internal" event="NodeHasSufficientMemory" Sep 09 23:08:12.060495 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:12.060433 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-204.ec2.internal" event="NodeHasNoDiskPressure" Sep 09 23:08:12.060495 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:12.060450 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-204.ec2.internal" event="NodeHasSufficientPID" Sep 09 23:08:12.061073 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:12.061056 2561 cpu_manager.go:222] "Starting CPU manager" policy="none" Sep 09 23:08:12.061073 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:12.061072 2561 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Sep 09 23:08:12.061219 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:12.061089 2561 state_mem.go:36] "Initialized new in-memory state store" Sep 09 23:08:12.061219 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:12.061062 2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 09 23:08:12.061895 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:12.061878 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-204.ec2.internal" event="NodeHasSufficientMemory" Sep 09 23:08:12.061997 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:12.061906 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-204.ec2.internal" event="NodeHasNoDiskPressure" Sep 09 23:08:12.061997 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:12.061915 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-204.ec2.internal" event="NodeHasSufficientPID" Sep 09 23:08:12.063130 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:12.063117 2561 policy_none.go:49] "None policy: Start" Sep 09 23:08:12.063186 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:12.063133 2561 memory_manager.go:187] "Starting memorymanager" policy="None" Sep 09 23:08:12.063186 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:12.063142 2561 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Sep 09 23:08:12.065191 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:12.065178 2561 policy_none.go:47] "Start" Sep 09 23:08:12.119564 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:12.108825 2561 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Sep 09 23:08:12.119564 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:12.109886 2561 manager.go:337] "Starting Device Plugin manager" Sep 09 23:08:12.119564 ip-10-0-132-204 kubenswrapper[2561]: E0909 23:08:12.109915 2561 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Sep 09 23:08:12.119564 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:12.109924 2561 server.go:87] "Starting device plugin registration server" Sep 09 23:08:12.119564 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:12.110149 2561 eviction_manager.go:189] "Eviction manager: starting control loop" Sep 09 23:08:12.119564 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:12.110151 2561 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Sep 09 23:08:12.119564 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:12.110161 2561 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Sep 09 23:08:12.119564 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:12.110195 2561 status_manager.go:244] "Starting to sync pod status with apiserver" Sep 09 23:08:12.119564 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:12.110216 2561 kubelet.go:2448] "Starting kubelet main sync loop" Sep 09 23:08:12.119564 ip-10-0-132-204 kubenswrapper[2561]: E0909 23:08:12.110254 2561 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Sep 09 23:08:12.119564 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:12.110339 2561 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Sep 09 23:08:12.119564 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:12.110426 2561 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Sep 09 23:08:12.119564 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:12.110434 2561 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Sep 09 23:08:12.119564 ip-10-0-132-204 kubenswrapper[2561]: E0909 23:08:12.111167 2561 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Sep 09 23:08:12.119564 ip-10-0-132-204 kubenswrapper[2561]: E0909 23:08:12.111216 2561 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-132-204.ec2.internal\" not found" Sep 09 23:08:12.119564 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:12.112886 2561 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Sep 09 23:08:12.211304 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:12.211211 2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 09 23:08:12.211304 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:12.211231 2561 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["kube-system/kube-apiserver-proxy-ip-10-0-132-204.ec2.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-204.ec2.internal"] Sep 09 23:08:12.211304 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:12.211300 2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 09 23:08:12.212184 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:12.212166 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-204.ec2.internal" event="NodeHasSufficientMemory" Sep 09 23:08:12.212265 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:12.212199 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-204.ec2.internal" event="NodeHasNoDiskPressure" Sep 09 23:08:12.212265 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:12.212211 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-204.ec2.internal" event="NodeHasSufficientPID" Sep 09 23:08:12.212265 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:12.212239 2561 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-132-204.ec2.internal" Sep 09 23:08:12.212898 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:12.212876 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-204.ec2.internal" event="NodeHasSufficientMemory" Sep 09 23:08:12.213069 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:12.212907 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-204.ec2.internal" event="NodeHasNoDiskPressure" Sep 09 23:08:12.213069 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:12.212921 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-204.ec2.internal" event="NodeHasSufficientPID" Sep 09 23:08:12.215295 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:12.215280 2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 09 23:08:12.215483 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:12.215455 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-204.ec2.internal" Sep 09 23:08:12.215545 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:12.215496 2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 09 23:08:12.215987 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:12.215969 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-204.ec2.internal" event="NodeHasSufficientMemory" Sep 09 23:08:12.216072 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:12.215994 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-204.ec2.internal" event="NodeHasNoDiskPressure" Sep 09 23:08:12.216072 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:12.216006 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-204.ec2.internal" event="NodeHasSufficientPID" Sep 09 23:08:12.216175 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:12.216161 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-204.ec2.internal" event="NodeHasSufficientMemory" Sep 09 23:08:12.216225 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:12.216186 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-204.ec2.internal" event="NodeHasNoDiskPressure" Sep 09 23:08:12.216225 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:12.216201 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-204.ec2.internal" event="NodeHasSufficientPID" Sep 09 23:08:12.218527 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:12.218511 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-204.ec2.internal" Sep 09 23:08:12.218613 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:12.218541 2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 09 23:08:12.219185 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:12.219164 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-204.ec2.internal" event="NodeHasSufficientMemory" Sep 09 23:08:12.219244 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:12.219196 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-204.ec2.internal" event="NodeHasNoDiskPressure" Sep 09 23:08:12.219244 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:12.219211 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-204.ec2.internal" event="NodeHasSufficientPID" Sep 09 23:08:12.220841 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:12.220828 2561 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-132-204.ec2.internal" Sep 09 23:08:12.220891 ip-10-0-132-204 kubenswrapper[2561]: E0909 23:08:12.220848 2561 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-132-204.ec2.internal\": node \"ip-10-0-132-204.ec2.internal\" not found" Sep 09 23:08:12.238454 ip-10-0-132-204 kubenswrapper[2561]: E0909 23:08:12.238428 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-204.ec2.internal\" not found" Sep 09 23:08:12.238940 ip-10-0-132-204 kubenswrapper[2561]: E0909 23:08:12.238928 2561 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-132-204.ec2.internal\" not found" node="ip-10-0-132-204.ec2.internal" Sep 09 23:08:12.242207 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:12.242179 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/0b1737cd5cce52c5c2776007824f9803-config\") pod \"kube-apiserver-proxy-ip-10-0-132-204.ec2.internal\" (UID: \"0b1737cd5cce52c5c2776007824f9803\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-204.ec2.internal" Sep 09 23:08:12.242295 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:12.242215 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/b36829d9c7d7ab19a8579fb50eedaa1b-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-204.ec2.internal\" (UID: \"b36829d9c7d7ab19a8579fb50eedaa1b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-204.ec2.internal" Sep 09 23:08:12.242295 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:12.242231 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b36829d9c7d7ab19a8579fb50eedaa1b-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-204.ec2.internal\" (UID: \"b36829d9c7d7ab19a8579fb50eedaa1b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-204.ec2.internal" Sep 09 23:08:12.243405 ip-10-0-132-204 kubenswrapper[2561]: E0909 23:08:12.243392 2561 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-132-204.ec2.internal\" not found" node="ip-10-0-132-204.ec2.internal" Sep 09 23:08:12.339158 ip-10-0-132-204 kubenswrapper[2561]: E0909 23:08:12.339125 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-204.ec2.internal\" not found" Sep 09 23:08:12.342409 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:12.342390 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/0b1737cd5cce52c5c2776007824f9803-config\") pod \"kube-apiserver-proxy-ip-10-0-132-204.ec2.internal\" (UID: \"0b1737cd5cce52c5c2776007824f9803\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-204.ec2.internal" Sep 09 23:08:12.342498 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:12.342421 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/b36829d9c7d7ab19a8579fb50eedaa1b-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-204.ec2.internal\" (UID: \"b36829d9c7d7ab19a8579fb50eedaa1b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-204.ec2.internal" Sep 09 23:08:12.342498 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:12.342446 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b36829d9c7d7ab19a8579fb50eedaa1b-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-204.ec2.internal\" (UID: \"b36829d9c7d7ab19a8579fb50eedaa1b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-204.ec2.internal" Sep 09 23:08:12.342581 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:12.342502 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/b36829d9c7d7ab19a8579fb50eedaa1b-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-204.ec2.internal\" (UID: \"b36829d9c7d7ab19a8579fb50eedaa1b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-204.ec2.internal" Sep 09 23:08:12.342581 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:12.342514 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/0b1737cd5cce52c5c2776007824f9803-config\") pod \"kube-apiserver-proxy-ip-10-0-132-204.ec2.internal\" (UID: \"0b1737cd5cce52c5c2776007824f9803\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-204.ec2.internal" Sep 09 23:08:12.342581 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:12.342502 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b36829d9c7d7ab19a8579fb50eedaa1b-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-204.ec2.internal\" (UID: \"b36829d9c7d7ab19a8579fb50eedaa1b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-204.ec2.internal" Sep 09 23:08:12.439460 ip-10-0-132-204 kubenswrapper[2561]: E0909 23:08:12.439436 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-204.ec2.internal\" not found" Sep 09 23:08:12.540201 ip-10-0-132-204 kubenswrapper[2561]: E0909 23:08:12.540119 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-204.ec2.internal\" not found" Sep 09 23:08:12.542324 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:12.542305 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-204.ec2.internal" Sep 09 23:08:12.547806 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:12.547705 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-204.ec2.internal" Sep 09 23:08:12.641292 ip-10-0-132-204 kubenswrapper[2561]: E0909 23:08:12.641259 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-204.ec2.internal\" not found" Sep 09 23:08:12.741704 ip-10-0-132-204 kubenswrapper[2561]: E0909 23:08:12.741672 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-204.ec2.internal\" not found" Sep 09 23:08:12.842161 ip-10-0-132-204 kubenswrapper[2561]: E0909 23:08:12.842094 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-204.ec2.internal\" not found" Sep 09 23:08:12.942611 ip-10-0-132-204 kubenswrapper[2561]: E0909 23:08:12.942580 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-204.ec2.internal\" not found" Sep 09 23:08:12.965876 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:12.965850 2561 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Sep 09 23:08:12.966028 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:12.966012 2561 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Sep 09 23:08:12.966065 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:12.966020 2561 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Sep 09 23:08:13.007690 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:13.007666 2561 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Sep 09 23:08:13.017710 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:13.017691 2561 apiserver.go:52] "Watching apiserver" Sep 09 23:08:13.027408 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:13.027387 2561 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Sep 09 23:08:13.028476 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:13.028454 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/multus-fnf6n","openshift-network-diagnostics/network-check-target-6s7s6","openshift-ovn-kubernetes/ovnkube-node-pl5tw","kube-system/konnectivity-agent-szqb4","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5ppxm","openshift-multus/network-metrics-daemon-ktqck","openshift-network-operator/iptables-alerter-lbv8f","kube-system/global-pull-secret-syncer-9dwkv","openshift-cluster-node-tuning-operator/tuned-792r8","openshift-dns/node-resolver-2vcdm","openshift-image-registry/node-ca-q2mnk","openshift-multus/multus-additional-cni-plugins-rzmhq"] Sep 09 23:08:13.030939 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:13.030916 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-fnf6n" Sep 09 23:08:13.033038 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:13.033014 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6s7s6" Sep 09 23:08:13.033122 ip-10-0-132-204 kubenswrapper[2561]: E0909 23:08:13.033091 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6s7s6" podUID="61cad06e-7668-4ada-82e5-a34a71bf52fb" Sep 09 23:08:13.033417 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:13.033400 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-hp2hq\"" Sep 09 23:08:13.033575 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:13.033558 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Sep 09 23:08:13.033634 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:13.033560 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Sep 09 23:08:13.034020 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:13.033588 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Sep 09 23:08:13.034020 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:13.033975 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Sep 09 23:08:13.035933 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:13.035905 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-pl5tw" Sep 09 23:08:13.038175 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:13.038150 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Sep 09 23:08:13.038276 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:13.038196 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Sep 09 23:08:13.038276 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:13.038210 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-47jvd\"" Sep 09 23:08:13.038393 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:13.038289 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-szqb4" Sep 09 23:08:13.038485 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:13.038465 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Sep 09 23:08:13.038541 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:13.038491 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Sep 09 23:08:13.038644 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:13.038629 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Sep 09 23:08:13.038697 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:13.038691 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Sep 09 23:08:13.040314 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:13.040293 2561 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-204.ec2.internal" Sep 09 23:08:13.040426 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:13.040314 2561 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Sep 09 23:08:13.040733 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:13.040716 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-lls7q\"" Sep 09 23:08:13.040882 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:13.040866 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Sep 09 23:08:13.040991 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:13.040976 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Sep 09 23:08:13.041046 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:13.040982 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5ppxm" Sep 09 23:08:13.041310 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:13.041275 2561 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-08 23:03:12 +0000 UTC" deadline="2028-06-10 20:49:32.72512252 +0000 UTC" Sep 09 23:08:13.041396 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:13.041308 2561 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15357h41m19.683817666s" Sep 09 23:08:13.043305 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:13.043287 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ktqck" Sep 09 23:08:13.043424 ip-10-0-132-204 kubenswrapper[2561]: E0909 23:08:13.043357 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ktqck" podUID="77df7cc0-0e7e-468f-89d9-b055af5de0b3" Sep 09 23:08:13.043424 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:13.043387 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Sep 09 23:08:13.043707 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:13.043571 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Sep 09 23:08:13.043707 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:13.043612 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Sep 09 23:08:13.043707 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:13.043571 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-d96fs\"" Sep 09 23:08:13.045705 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:13.045686 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-lbv8f" Sep 09 23:08:13.045811 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:13.045793 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a616cd8b-8bc4-4972-91bf-11f3e7ca7d44-cnibin\") pod \"multus-fnf6n\" (UID: \"a616cd8b-8bc4-4972-91bf-11f3e7ca7d44\") " pod="openshift-multus/multus-fnf6n" Sep 09 23:08:13.045878 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:13.045827 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/a616cd8b-8bc4-4972-91bf-11f3e7ca7d44-multus-socket-dir-parent\") pod \"multus-fnf6n\" (UID: \"a616cd8b-8bc4-4972-91bf-11f3e7ca7d44\") " pod="openshift-multus/multus-fnf6n" Sep 09 23:08:13.045878 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:13.045850 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ggxsd\" (UniqueName: \"kubernetes.io/projected/a616cd8b-8bc4-4972-91bf-11f3e7ca7d44-kube-api-access-ggxsd\") pod \"multus-fnf6n\" (UID: \"a616cd8b-8bc4-4972-91bf-11f3e7ca7d44\") " pod="openshift-multus/multus-fnf6n" Sep 09 23:08:13.045977 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:13.045878 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6942a2c5-1a59-4ea7-b78d-d131103de85f-var-lib-openvswitch\") pod \"ovnkube-node-pl5tw\" (UID: \"6942a2c5-1a59-4ea7-b78d-d131103de85f\") " pod="openshift-ovn-kubernetes/ovnkube-node-pl5tw" Sep 09 23:08:13.045977 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:13.045902 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6942a2c5-1a59-4ea7-b78d-d131103de85f-host-cni-bin\") pod \"ovnkube-node-pl5tw\" (UID: \"6942a2c5-1a59-4ea7-b78d-d131103de85f\") " pod="openshift-ovn-kubernetes/ovnkube-node-pl5tw" Sep 09 23:08:13.045977 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:13.045927 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/6942a2c5-1a59-4ea7-b78d-d131103de85f-host-cni-netd\") pod \"ovnkube-node-pl5tw\" (UID: \"6942a2c5-1a59-4ea7-b78d-d131103de85f\") " pod="openshift-ovn-kubernetes/ovnkube-node-pl5tw" Sep 09 23:08:13.045977 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:13.045965 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/1c4a374c-66ce-4af1-b989-7dfdd5b29b61-agent-certs\") pod \"konnectivity-agent-szqb4\" (UID: \"1c4a374c-66ce-4af1-b989-7dfdd5b29b61\") " pod="kube-system/konnectivity-agent-szqb4" Sep 09 23:08:13.046173 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:13.046007 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kfbnn\" (UniqueName: \"kubernetes.io/projected/a15b7bf5-58cb-458e-9d83-9cc1f9409987-kube-api-access-kfbnn\") pod \"aws-ebs-csi-driver-node-5ppxm\" (UID: \"a15b7bf5-58cb-458e-9d83-9cc1f9409987\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5ppxm" Sep 09 23:08:13.046173 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:13.046046 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a616cd8b-8bc4-4972-91bf-11f3e7ca7d44-cni-binary-copy\") pod \"multus-fnf6n\" (UID: \"a616cd8b-8bc4-4972-91bf-11f3e7ca7d44\") " pod="openshift-multus/multus-fnf6n" Sep 09 23:08:13.046173 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:13.046072 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a616cd8b-8bc4-4972-91bf-11f3e7ca7d44-host-var-lib-cni-bin\") pod \"multus-fnf6n\" (UID: \"a616cd8b-8bc4-4972-91bf-11f3e7ca7d44\") " pod="openshift-multus/multus-fnf6n" Sep 09 23:08:13.046173 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:13.046095 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a616cd8b-8bc4-4972-91bf-11f3e7ca7d44-etc-kubernetes\") pod \"multus-fnf6n\" (UID: \"a616cd8b-8bc4-4972-91bf-11f3e7ca7d44\") " pod="openshift-multus/multus-fnf6n" Sep 09 23:08:13.046173 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:13.046118 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6942a2c5-1a59-4ea7-b78d-d131103de85f-host-run-netns\") pod \"ovnkube-node-pl5tw\" (UID: \"6942a2c5-1a59-4ea7-b78d-d131103de85f\") " pod="openshift-ovn-kubernetes/ovnkube-node-pl5tw" Sep 09 23:08:13.046173 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:13.046139 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6942a2c5-1a59-4ea7-b78d-d131103de85f-run-openvswitch\") pod \"ovnkube-node-pl5tw\" (UID: \"6942a2c5-1a59-4ea7-b78d-d131103de85f\") " pod="openshift-ovn-kubernetes/ovnkube-node-pl5tw" Sep 09 23:08:13.046441 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:13.046182 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/6942a2c5-1a59-4ea7-b78d-d131103de85f-ovnkube-config\") pod \"ovnkube-node-pl5tw\" (UID: \"6942a2c5-1a59-4ea7-b78d-d131103de85f\") " pod="openshift-ovn-kubernetes/ovnkube-node-pl5tw" Sep 09 23:08:13.046441 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:13.046204 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/a15b7bf5-58cb-458e-9d83-9cc1f9409987-socket-dir\") pod \"aws-ebs-csi-driver-node-5ppxm\" (UID: \"a15b7bf5-58cb-458e-9d83-9cc1f9409987\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5ppxm" Sep 09 23:08:13.046441 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:13.046227 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/a15b7bf5-58cb-458e-9d83-9cc1f9409987-registration-dir\") pod \"aws-ebs-csi-driver-node-5ppxm\" (UID: \"a15b7bf5-58cb-458e-9d83-9cc1f9409987\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5ppxm" Sep 09 23:08:13.046441 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:13.046252 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/a616cd8b-8bc4-4972-91bf-11f3e7ca7d44-host-var-lib-cni-multus\") pod \"multus-fnf6n\" (UID: \"a616cd8b-8bc4-4972-91bf-11f3e7ca7d44\") " pod="openshift-multus/multus-fnf6n" Sep 09 23:08:13.046441 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:13.046273 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a616cd8b-8bc4-4972-91bf-11f3e7ca7d44-host-var-lib-kubelet\") pod \"multus-fnf6n\" (UID: \"a616cd8b-8bc4-4972-91bf-11f3e7ca7d44\") " pod="openshift-multus/multus-fnf6n" Sep 09 23:08:13.046441 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:13.046296 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/a616cd8b-8bc4-4972-91bf-11f3e7ca7d44-multus-daemon-config\") pod \"multus-fnf6n\" (UID: \"a616cd8b-8bc4-4972-91bf-11f3e7ca7d44\") " pod="openshift-multus/multus-fnf6n" Sep 09 23:08:13.046441 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:13.046348 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/a616cd8b-8bc4-4972-91bf-11f3e7ca7d44-host-run-multus-certs\") pod \"multus-fnf6n\" (UID: \"a616cd8b-8bc4-4972-91bf-11f3e7ca7d44\") " pod="openshift-multus/multus-fnf6n" Sep 09 23:08:13.046441 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:13.046421 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xkvm6\" (UniqueName: \"kubernetes.io/projected/61cad06e-7668-4ada-82e5-a34a71bf52fb-kube-api-access-xkvm6\") pod \"network-check-target-6s7s6\" (UID: \"61cad06e-7668-4ada-82e5-a34a71bf52fb\") " pod="openshift-network-diagnostics/network-check-target-6s7s6" Sep 09 23:08:13.046766 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:13.046451 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/6942a2c5-1a59-4ea7-b78d-d131103de85f-host-kubelet\") pod \"ovnkube-node-pl5tw\" (UID: \"6942a2c5-1a59-4ea7-b78d-d131103de85f\") " pod="openshift-ovn-kubernetes/ovnkube-node-pl5tw" Sep 09 23:08:13.046766 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:13.046476 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6942a2c5-1a59-4ea7-b78d-d131103de85f-host-slash\") pod \"ovnkube-node-pl5tw\" (UID: \"6942a2c5-1a59-4ea7-b78d-d131103de85f\") " pod="openshift-ovn-kubernetes/ovnkube-node-pl5tw" Sep 09 23:08:13.046766 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:13.046497 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6942a2c5-1a59-4ea7-b78d-d131103de85f-etc-openvswitch\") pod \"ovnkube-node-pl5tw\" (UID: \"6942a2c5-1a59-4ea7-b78d-d131103de85f\") " pod="openshift-ovn-kubernetes/ovnkube-node-pl5tw" Sep 09 23:08:13.046766 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:13.046518 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/6942a2c5-1a59-4ea7-b78d-d131103de85f-node-log\") pod \"ovnkube-node-pl5tw\" (UID: \"6942a2c5-1a59-4ea7-b78d-d131103de85f\") " pod="openshift-ovn-kubernetes/ovnkube-node-pl5tw" Sep 09 23:08:13.046766 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:13.046540 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6942a2c5-1a59-4ea7-b78d-d131103de85f-host-run-ovn-kubernetes\") pod \"ovnkube-node-pl5tw\" (UID: \"6942a2c5-1a59-4ea7-b78d-d131103de85f\") " pod="openshift-ovn-kubernetes/ovnkube-node-pl5tw" Sep 09 23:08:13.046766 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:13.046564 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/6942a2c5-1a59-4ea7-b78d-d131103de85f-env-overrides\") pod \"ovnkube-node-pl5tw\" (UID: \"6942a2c5-1a59-4ea7-b78d-d131103de85f\") " pod="openshift-ovn-kubernetes/ovnkube-node-pl5tw" Sep 09 23:08:13.046766 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:13.046586 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a616cd8b-8bc4-4972-91bf-11f3e7ca7d44-multus-cni-dir\") pod \"multus-fnf6n\" (UID: \"a616cd8b-8bc4-4972-91bf-11f3e7ca7d44\") " pod="openshift-multus/multus-fnf6n" Sep 09 23:08:13.046766 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:13.046610 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/6942a2c5-1a59-4ea7-b78d-d131103de85f-systemd-units\") pod \"ovnkube-node-pl5tw\" (UID: \"6942a2c5-1a59-4ea7-b78d-d131103de85f\") " pod="openshift-ovn-kubernetes/ovnkube-node-pl5tw" Sep 09 23:08:13.046766 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:13.046652 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/6942a2c5-1a59-4ea7-b78d-d131103de85f-run-systemd\") pod \"ovnkube-node-pl5tw\" (UID: \"6942a2c5-1a59-4ea7-b78d-d131103de85f\") " pod="openshift-ovn-kubernetes/ovnkube-node-pl5tw" Sep 09 23:08:13.046766 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:13.046673 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/6942a2c5-1a59-4ea7-b78d-d131103de85f-run-ovn\") pod \"ovnkube-node-pl5tw\" (UID: \"6942a2c5-1a59-4ea7-b78d-d131103de85f\") " pod="openshift-ovn-kubernetes/ovnkube-node-pl5tw" Sep 09 23:08:13.046766 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:13.046698 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6942a2c5-1a59-4ea7-b78d-d131103de85f-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-pl5tw\" (UID: \"6942a2c5-1a59-4ea7-b78d-d131103de85f\") " pod="openshift-ovn-kubernetes/ovnkube-node-pl5tw" Sep 09 23:08:13.046766 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:13.046722 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/6942a2c5-1a59-4ea7-b78d-d131103de85f-ovn-node-metrics-cert\") pod \"ovnkube-node-pl5tw\" (UID: \"6942a2c5-1a59-4ea7-b78d-d131103de85f\") " pod="openshift-ovn-kubernetes/ovnkube-node-pl5tw" Sep 09 23:08:13.046766 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:13.046745 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/77df7cc0-0e7e-468f-89d9-b055af5de0b3-metrics-certs\") pod \"network-metrics-daemon-ktqck\" (UID: \"77df7cc0-0e7e-468f-89d9-b055af5de0b3\") " pod="openshift-multus/network-metrics-daemon-ktqck" Sep 09 23:08:13.047309 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:13.046768 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tvs4h\" (UniqueName: \"kubernetes.io/projected/77df7cc0-0e7e-468f-89d9-b055af5de0b3-kube-api-access-tvs4h\") pod \"network-metrics-daemon-ktqck\" (UID: \"77df7cc0-0e7e-468f-89d9-b055af5de0b3\") " pod="openshift-multus/network-metrics-daemon-ktqck" Sep 09 23:08:13.047309 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:13.046846 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a616cd8b-8bc4-4972-91bf-11f3e7ca7d44-system-cni-dir\") pod \"multus-fnf6n\" (UID: \"a616cd8b-8bc4-4972-91bf-11f3e7ca7d44\") " pod="openshift-multus/multus-fnf6n" Sep 09 23:08:13.047309 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:13.046869 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/a616cd8b-8bc4-4972-91bf-11f3e7ca7d44-hostroot\") pod \"multus-fnf6n\" (UID: \"a616cd8b-8bc4-4972-91bf-11f3e7ca7d44\") " pod="openshift-multus/multus-fnf6n" Sep 09 23:08:13.047309 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:13.046893 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/6942a2c5-1a59-4ea7-b78d-d131103de85f-log-socket\") pod \"ovnkube-node-pl5tw\" (UID: \"6942a2c5-1a59-4ea7-b78d-d131103de85f\") " pod="openshift-ovn-kubernetes/ovnkube-node-pl5tw" Sep 09 23:08:13.047309 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:13.046931 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/6942a2c5-1a59-4ea7-b78d-d131103de85f-ovnkube-script-lib\") pod \"ovnkube-node-pl5tw\" (UID: \"6942a2c5-1a59-4ea7-b78d-d131103de85f\") " pod="openshift-ovn-kubernetes/ovnkube-node-pl5tw" Sep 09 23:08:13.047309 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:13.046969 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wlj5t\" (UniqueName: \"kubernetes.io/projected/6942a2c5-1a59-4ea7-b78d-d131103de85f-kube-api-access-wlj5t\") pod \"ovnkube-node-pl5tw\" (UID: \"6942a2c5-1a59-4ea7-b78d-d131103de85f\") " pod="openshift-ovn-kubernetes/ovnkube-node-pl5tw" Sep 09 23:08:13.047309 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:13.046999 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/a15b7bf5-58cb-458e-9d83-9cc1f9409987-kubelet-dir\") pod \"aws-ebs-csi-driver-node-5ppxm\" (UID: \"a15b7bf5-58cb-458e-9d83-9cc1f9409987\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5ppxm" Sep 09 23:08:13.047309 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:13.047030 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/a15b7bf5-58cb-458e-9d83-9cc1f9409987-device-dir\") pod \"aws-ebs-csi-driver-node-5ppxm\" (UID: \"a15b7bf5-58cb-458e-9d83-9cc1f9409987\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5ppxm" Sep 09 23:08:13.047309 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:13.047060 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/a616cd8b-8bc4-4972-91bf-11f3e7ca7d44-host-run-k8s-cni-cncf-io\") pod \"multus-fnf6n\" (UID: \"a616cd8b-8bc4-4972-91bf-11f3e7ca7d44\") " pod="openshift-multus/multus-fnf6n" Sep 09 23:08:13.047309 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:13.047081 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a616cd8b-8bc4-4972-91bf-11f3e7ca7d44-host-run-netns\") pod \"multus-fnf6n\" (UID: \"a616cd8b-8bc4-4972-91bf-11f3e7ca7d44\") " pod="openshift-multus/multus-fnf6n" Sep 09 23:08:13.047309 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:13.047102 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a616cd8b-8bc4-4972-91bf-11f3e7ca7d44-multus-conf-dir\") pod \"multus-fnf6n\" (UID: \"a616cd8b-8bc4-4972-91bf-11f3e7ca7d44\") " pod="openshift-multus/multus-fnf6n" Sep 09 23:08:13.047309 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:13.047118 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/1c4a374c-66ce-4af1-b989-7dfdd5b29b61-konnectivity-ca\") pod \"konnectivity-agent-szqb4\" (UID: \"1c4a374c-66ce-4af1-b989-7dfdd5b29b61\") " pod="kube-system/konnectivity-agent-szqb4" Sep 09 23:08:13.047309 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:13.047150 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/a15b7bf5-58cb-458e-9d83-9cc1f9409987-sys-fs\") pod \"aws-ebs-csi-driver-node-5ppxm\" (UID: \"a15b7bf5-58cb-458e-9d83-9cc1f9409987\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5ppxm" Sep 09 23:08:13.047309 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:13.047175 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/a15b7bf5-58cb-458e-9d83-9cc1f9409987-etc-selinux\") pod \"aws-ebs-csi-driver-node-5ppxm\" (UID: \"a15b7bf5-58cb-458e-9d83-9cc1f9409987\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5ppxm" Sep 09 23:08:13.047851 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:13.047834 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9dwkv" Sep 09 23:08:13.047907 ip-10-0-132-204 kubenswrapper[2561]: E0909 23:08:13.047891 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9dwkv" podUID="02b55bf2-2972-4487-b51d-9a361a0d2b13" Sep 09 23:08:13.048148 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:13.047990 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Sep 09 23:08:13.048148 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:13.048005 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Sep 09 23:08:13.048148 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:13.048047 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-8sz4w\"" Sep 09 23:08:13.048148 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:13.048058 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Sep 09 23:08:13.049830 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:13.049811 2561 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Sep 09 23:08:13.049903 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:13.049883 2561 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-204.ec2.internal" Sep 09 23:08:13.050136 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:13.050117 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-792r8" Sep 09 23:08:13.052069 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:13.052051 2561 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Sep 09 23:08:13.052069 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:13.052063 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Sep 09 23:08:13.052438 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:13.052408 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-pnwbt\"" Sep 09 23:08:13.052516 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:13.052481 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-2vcdm" Sep 09 23:08:13.052569 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:13.052409 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Sep 09 23:08:13.054629 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:13.054611 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-k6kfx\"" Sep 09 23:08:13.054823 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:13.054809 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Sep 09 23:08:13.054870 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:13.054831 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-q2mnk" Sep 09 23:08:13.054912 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:13.054878 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Sep 09 23:08:13.056902 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:13.056882 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Sep 09 23:08:13.057146 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:13.057125 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-pz5xr\"" Sep 09 23:08:13.057335 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:13.057322 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Sep 09 23:08:13.057397 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:13.057334 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Sep 09 23:08:13.057397 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:13.057384 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-132-204.ec2.internal"] Sep 09 23:08:13.057507 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:13.057492 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-rzmhq" Sep 09 23:08:13.059548 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:13.059533 2561 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Sep 09 23:08:13.059803 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:13.059785 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-204.ec2.internal"] Sep 09 23:08:13.059878 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:13.059866 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-wcrbr\"" Sep 09 23:08:13.060112 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:13.060094 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Sep 09 23:08:13.060200 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:13.060175 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Sep 09 23:08:13.071930 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:13.071912 2561 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-2c6fw" Sep 09 23:08:13.081791 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:13.081776 2561 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-2c6fw" Sep 09 23:08:13.131519 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:13.131497 2561 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Sep 09 23:08:13.142257 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:13.142241 2561 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Sep 09 23:08:13.148174 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:13.147993 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a616cd8b-8bc4-4972-91bf-11f3e7ca7d44-cni-binary-copy\") pod \"multus-fnf6n\" (UID: \"a616cd8b-8bc4-4972-91bf-11f3e7ca7d44\") " pod="openshift-multus/multus-fnf6n" Sep 09 23:08:13.148264 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:13.148186 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a616cd8b-8bc4-4972-91bf-11f3e7ca7d44-host-var-lib-cni-bin\") pod \"multus-fnf6n\" (UID: \"a616cd8b-8bc4-4972-91bf-11f3e7ca7d44\") " pod="openshift-multus/multus-fnf6n" Sep 09 23:08:13.148264 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:13.148212 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/a15b7bf5-58cb-458e-9d83-9cc1f9409987-socket-dir\") pod \"aws-ebs-csi-driver-node-5ppxm\" (UID: \"a15b7bf5-58cb-458e-9d83-9cc1f9409987\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5ppxm" Sep 09 23:08:13.148264 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:13.148233 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/a15b7bf5-58cb-458e-9d83-9cc1f9409987-registration-dir\") pod \"aws-ebs-csi-driver-node-5ppxm\" (UID: \"a15b7bf5-58cb-458e-9d83-9cc1f9409987\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5ppxm" Sep 09 23:08:13.148264 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:13.148260 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/505de87b-9cf1-4af8-815b-ed5f65ac6675-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-rzmhq\" (UID: \"505de87b-9cf1-4af8-815b-ed5f65ac6675\") " pod="openshift-multus/multus-additional-cni-plugins-rzmhq" Sep 09 23:08:13.148488 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:13.148286 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8r9hd\" (UniqueName: \"kubernetes.io/projected/505de87b-9cf1-4af8-815b-ed5f65ac6675-kube-api-access-8r9hd\") pod \"multus-additional-cni-plugins-rzmhq\" (UID: \"505de87b-9cf1-4af8-815b-ed5f65ac6675\") " pod="openshift-multus/multus-additional-cni-plugins-rzmhq" Sep 09 23:08:13.148488 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:13.148311 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/28a75ede-97c5-4801-b30b-96057670ce4c-etc-sysctl-d\") pod \"tuned-792r8\" (UID: \"28a75ede-97c5-4801-b30b-96057670ce4c\") " pod="openshift-cluster-node-tuning-operator/tuned-792r8" Sep 09 23:08:13.148488 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:13.148333 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/28a75ede-97c5-4801-b30b-96057670ce4c-etc-tuned\") pod \"tuned-792r8\" (UID: \"28a75ede-97c5-4801-b30b-96057670ce4c\") " pod="openshift-cluster-node-tuning-operator/tuned-792r8" Sep 09 23:08:13.148488 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:13.148359 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/a616cd8b-8bc4-4972-91bf-11f3e7ca7d44-host-var-lib-cni-multus\") pod \"multus-fnf6n\" (UID: \"a616cd8b-8bc4-4972-91bf-11f3e7ca7d44\") " pod="openshift-multus/multus-fnf6n" Sep 09 23:08:13.148488 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:13.148393 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/a616cd8b-8bc4-4972-91bf-11f3e7ca7d44-multus-daemon-config\") pod \"multus-fnf6n\" (UID: \"a616cd8b-8bc4-4972-91bf-11f3e7ca7d44\") " pod="openshift-multus/multus-fnf6n" Sep 09 23:08:13.148488 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:13.148407 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/a616cd8b-8bc4-4972-91bf-11f3e7ca7d44-host-run-multus-certs\") pod \"multus-fnf6n\" (UID: \"a616cd8b-8bc4-4972-91bf-11f3e7ca7d44\") " pod="openshift-multus/multus-fnf6n" Sep 09 23:08:13.148488 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:13.148425 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k2cc7\" (UniqueName: \"kubernetes.io/projected/28a75ede-97c5-4801-b30b-96057670ce4c-kube-api-access-k2cc7\") pod \"tuned-792r8\" (UID: \"28a75ede-97c5-4801-b30b-96057670ce4c\") " pod="openshift-cluster-node-tuning-operator/tuned-792r8" Sep 09 23:08:13.148488 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:13.148404 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0b1737cd5cce52c5c2776007824f9803.slice/crio-6444548d03f3e68b303f83d8aa71414f47278a150c5f0ab525a31fb314bac72a WatchSource:0}: Error finding container 6444548d03f3e68b303f83d8aa71414f47278a150c5f0ab525a31fb314bac72a: Status 404 returned error can't find the container with id 6444548d03f3e68b303f83d8aa71414f47278a150c5f0ab525a31fb314bac72a Sep 09 23:08:13.148488 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:13.148441 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cecbf40f-1a0a-4819-b677-6d38f3e0d3af-tmp-dir\") pod \"node-resolver-2vcdm\" (UID: \"cecbf40f-1a0a-4819-b677-6d38f3e0d3af\") " pod="openshift-dns/node-resolver-2vcdm" Sep 09 23:08:13.148488 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:13.148477 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tvs4h\" (UniqueName: \"kubernetes.io/projected/77df7cc0-0e7e-468f-89d9-b055af5de0b3-kube-api-access-tvs4h\") pod \"network-metrics-daemon-ktqck\" (UID: \"77df7cc0-0e7e-468f-89d9-b055af5de0b3\") " pod="openshift-multus/network-metrics-daemon-ktqck" Sep 09 23:08:13.148952 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:13.148512 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/6942a2c5-1a59-4ea7-b78d-d131103de85f-node-log\") pod \"ovnkube-node-pl5tw\" (UID: \"6942a2c5-1a59-4ea7-b78d-d131103de85f\") " pod="openshift-ovn-kubernetes/ovnkube-node-pl5tw" Sep 09 23:08:13.148952 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:13.148519 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/a616cd8b-8bc4-4972-91bf-11f3e7ca7d44-host-var-lib-cni-multus\") pod \"multus-fnf6n\" (UID: \"a616cd8b-8bc4-4972-91bf-11f3e7ca7d44\") " pod="openshift-multus/multus-fnf6n" Sep 09 23:08:13.148952 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:13.148543 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/28a75ede-97c5-4801-b30b-96057670ce4c-lib-modules\") pod \"tuned-792r8\" (UID: \"28a75ede-97c5-4801-b30b-96057670ce4c\") " pod="openshift-cluster-node-tuning-operator/tuned-792r8" Sep 09 23:08:13.148952 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:13.148569 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a616cd8b-8bc4-4972-91bf-11f3e7ca7d44-multus-cni-dir\") pod \"multus-fnf6n\" (UID: \"a616cd8b-8bc4-4972-91bf-11f3e7ca7d44\") " pod="openshift-multus/multus-fnf6n" Sep 09 23:08:13.148952 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:13.148593 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/6942a2c5-1a59-4ea7-b78d-d131103de85f-run-systemd\") pod \"ovnkube-node-pl5tw\" (UID: \"6942a2c5-1a59-4ea7-b78d-d131103de85f\") " pod="openshift-ovn-kubernetes/ovnkube-node-pl5tw" Sep 09 23:08:13.148952 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:13.148602 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a616cd8b-8bc4-4972-91bf-11f3e7ca7d44-cni-binary-copy\") pod \"multus-fnf6n\" (UID: \"a616cd8b-8bc4-4972-91bf-11f3e7ca7d44\") " pod="openshift-multus/multus-fnf6n" Sep 09 23:08:13.148952 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:13.148625 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/6942a2c5-1a59-4ea7-b78d-d131103de85f-run-ovn\") pod \"ovnkube-node-pl5tw\" (UID: \"6942a2c5-1a59-4ea7-b78d-d131103de85f\") " pod="openshift-ovn-kubernetes/ovnkube-node-pl5tw" Sep 09 23:08:13.148952 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:13.148648 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6942a2c5-1a59-4ea7-b78d-d131103de85f-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-pl5tw\" (UID: \"6942a2c5-1a59-4ea7-b78d-d131103de85f\") " pod="openshift-ovn-kubernetes/ovnkube-node-pl5tw" Sep 09 23:08:13.148952 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:13.148717 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/6942a2c5-1a59-4ea7-b78d-d131103de85f-run-systemd\") pod \"ovnkube-node-pl5tw\" (UID: \"6942a2c5-1a59-4ea7-b78d-d131103de85f\") " pod="openshift-ovn-kubernetes/ovnkube-node-pl5tw" Sep 09 23:08:13.148952 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:13.148764 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a616cd8b-8bc4-4972-91bf-11f3e7ca7d44-multus-cni-dir\") pod \"multus-fnf6n\" (UID: \"a616cd8b-8bc4-4972-91bf-11f3e7ca7d44\") " pod="openshift-multus/multus-fnf6n" Sep 09 23:08:13.148952 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:13.148770 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/a15b7bf5-58cb-458e-9d83-9cc1f9409987-registration-dir\") pod \"aws-ebs-csi-driver-node-5ppxm\" (UID: \"a15b7bf5-58cb-458e-9d83-9cc1f9409987\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5ppxm" Sep 09 23:08:13.148952 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:13.148793 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/6942a2c5-1a59-4ea7-b78d-d131103de85f-log-socket\") pod \"ovnkube-node-pl5tw\" (UID: \"6942a2c5-1a59-4ea7-b78d-d131103de85f\") " pod="openshift-ovn-kubernetes/ovnkube-node-pl5tw" Sep 09 23:08:13.148952 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:13.148806 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/a616cd8b-8bc4-4972-91bf-11f3e7ca7d44-host-run-multus-certs\") pod \"multus-fnf6n\" (UID: \"a616cd8b-8bc4-4972-91bf-11f3e7ca7d44\") " pod="openshift-multus/multus-fnf6n" Sep 09 23:08:13.148952 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:13.148820 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/6942a2c5-1a59-4ea7-b78d-d131103de85f-ovnkube-script-lib\") pod \"ovnkube-node-pl5tw\" (UID: \"6942a2c5-1a59-4ea7-b78d-d131103de85f\") " pod="openshift-ovn-kubernetes/ovnkube-node-pl5tw" Sep 09 23:08:13.148952 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:13.148842 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/a15b7bf5-58cb-458e-9d83-9cc1f9409987-kubelet-dir\") pod \"aws-ebs-csi-driver-node-5ppxm\" (UID: \"a15b7bf5-58cb-458e-9d83-9cc1f9409987\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5ppxm" Sep 09 23:08:13.148952 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:13.148856 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/a616cd8b-8bc4-4972-91bf-11f3e7ca7d44-multus-daemon-config\") pod \"multus-fnf6n\" (UID: \"a616cd8b-8bc4-4972-91bf-11f3e7ca7d44\") " pod="openshift-multus/multus-fnf6n" Sep 09 23:08:13.148952 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:13.148865 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/a15b7bf5-58cb-458e-9d83-9cc1f9409987-device-dir\") pod \"aws-ebs-csi-driver-node-5ppxm\" (UID: \"a15b7bf5-58cb-458e-9d83-9cc1f9409987\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5ppxm" Sep 09 23:08:13.149845 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:13.148890 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/02b55bf2-2972-4487-b51d-9a361a0d2b13-original-pull-secret\") pod \"global-pull-secret-syncer-9dwkv\" (UID: \"02b55bf2-2972-4487-b51d-9a361a0d2b13\") " pod="kube-system/global-pull-secret-syncer-9dwkv" Sep 09 23:08:13.149845 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:13.148896 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a616cd8b-8bc4-4972-91bf-11f3e7ca7d44-host-var-lib-cni-bin\") pod \"multus-fnf6n\" (UID: \"a616cd8b-8bc4-4972-91bf-11f3e7ca7d44\") " pod="openshift-multus/multus-fnf6n" Sep 09 23:08:13.149845 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:13.148914 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/28a75ede-97c5-4801-b30b-96057670ce4c-etc-kubernetes\") pod \"tuned-792r8\" (UID: \"28a75ede-97c5-4801-b30b-96057670ce4c\") " pod="openshift-cluster-node-tuning-operator/tuned-792r8" Sep 09 23:08:13.149845 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:13.148956 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/6942a2c5-1a59-4ea7-b78d-d131103de85f-log-socket\") pod \"ovnkube-node-pl5tw\" (UID: \"6942a2c5-1a59-4ea7-b78d-d131103de85f\") " pod="openshift-ovn-kubernetes/ovnkube-node-pl5tw" Sep 09 23:08:13.149845 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:13.148965 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/6942a2c5-1a59-4ea7-b78d-d131103de85f-node-log\") pod \"ovnkube-node-pl5tw\" (UID: \"6942a2c5-1a59-4ea7-b78d-d131103de85f\") " pod="openshift-ovn-kubernetes/ovnkube-node-pl5tw" Sep 09 23:08:13.149845 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:13.149029 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/a15b7bf5-58cb-458e-9d83-9cc1f9409987-socket-dir\") pod \"aws-ebs-csi-driver-node-5ppxm\" (UID: \"a15b7bf5-58cb-458e-9d83-9cc1f9409987\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5ppxm" Sep 09 23:08:13.149845 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:13.149051 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/6942a2c5-1a59-4ea7-b78d-d131103de85f-run-ovn\") pod \"ovnkube-node-pl5tw\" (UID: \"6942a2c5-1a59-4ea7-b78d-d131103de85f\") " pod="openshift-ovn-kubernetes/ovnkube-node-pl5tw" Sep 09 23:08:13.149845 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:13.149053 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6942a2c5-1a59-4ea7-b78d-d131103de85f-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-pl5tw\" (UID: \"6942a2c5-1a59-4ea7-b78d-d131103de85f\") " pod="openshift-ovn-kubernetes/ovnkube-node-pl5tw" Sep 09 23:08:13.149845 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:13.149070 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/28a75ede-97c5-4801-b30b-96057670ce4c-etc-sysctl-conf\") pod \"tuned-792r8\" (UID: \"28a75ede-97c5-4801-b30b-96057670ce4c\") " pod="openshift-cluster-node-tuning-operator/tuned-792r8" Sep 09 23:08:13.149845 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:13.149113 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/a15b7bf5-58cb-458e-9d83-9cc1f9409987-device-dir\") pod \"aws-ebs-csi-driver-node-5ppxm\" (UID: \"a15b7bf5-58cb-458e-9d83-9cc1f9409987\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5ppxm" Sep 09 23:08:13.149845 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:13.149112 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/a616cd8b-8bc4-4972-91bf-11f3e7ca7d44-host-run-k8s-cni-cncf-io\") pod \"multus-fnf6n\" (UID: \"a616cd8b-8bc4-4972-91bf-11f3e7ca7d44\") " pod="openshift-multus/multus-fnf6n" Sep 09 23:08:13.149845 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:13.149150 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a616cd8b-8bc4-4972-91bf-11f3e7ca7d44-host-run-netns\") pod \"multus-fnf6n\" (UID: \"a616cd8b-8bc4-4972-91bf-11f3e7ca7d44\") " pod="openshift-multus/multus-fnf6n" Sep 09 23:08:13.149845 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:13.149176 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a616cd8b-8bc4-4972-91bf-11f3e7ca7d44-multus-conf-dir\") pod \"multus-fnf6n\" (UID: \"a616cd8b-8bc4-4972-91bf-11f3e7ca7d44\") " pod="openshift-multus/multus-fnf6n" Sep 09 23:08:13.149845 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:13.149200 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/1c4a374c-66ce-4af1-b989-7dfdd5b29b61-konnectivity-ca\") pod \"konnectivity-agent-szqb4\" (UID: \"1c4a374c-66ce-4af1-b989-7dfdd5b29b61\") " pod="kube-system/konnectivity-agent-szqb4" Sep 09 23:08:13.149845 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:13.149226 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/a15b7bf5-58cb-458e-9d83-9cc1f9409987-sys-fs\") pod \"aws-ebs-csi-driver-node-5ppxm\" (UID: \"a15b7bf5-58cb-458e-9d83-9cc1f9409987\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5ppxm" Sep 09 23:08:13.149845 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:13.149312 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/02b55bf2-2972-4487-b51d-9a361a0d2b13-dbus\") pod \"global-pull-secret-syncer-9dwkv\" (UID: \"02b55bf2-2972-4487-b51d-9a361a0d2b13\") " pod="kube-system/global-pull-secret-syncer-9dwkv" Sep 09 23:08:13.149845 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:13.149327 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/a616cd8b-8bc4-4972-91bf-11f3e7ca7d44-host-run-k8s-cni-cncf-io\") pod \"multus-fnf6n\" (UID: \"a616cd8b-8bc4-4972-91bf-11f3e7ca7d44\") " pod="openshift-multus/multus-fnf6n" Sep 09 23:08:13.150507 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:13.149337 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/a15b7bf5-58cb-458e-9d83-9cc1f9409987-etc-selinux\") pod \"aws-ebs-csi-driver-node-5ppxm\" (UID: \"a15b7bf5-58cb-458e-9d83-9cc1f9409987\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5ppxm" Sep 09 23:08:13.150507 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:13.149383 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/505de87b-9cf1-4af8-815b-ed5f65ac6675-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-rzmhq\" (UID: \"505de87b-9cf1-4af8-815b-ed5f65ac6675\") " pod="openshift-multus/multus-additional-cni-plugins-rzmhq" Sep 09 23:08:13.150507 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:13.149392 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/a15b7bf5-58cb-458e-9d83-9cc1f9409987-sys-fs\") pod \"aws-ebs-csi-driver-node-5ppxm\" (UID: \"a15b7bf5-58cb-458e-9d83-9cc1f9409987\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5ppxm" Sep 09 23:08:13.150507 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:13.149410 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/28a75ede-97c5-4801-b30b-96057670ce4c-etc-modprobe-d\") pod \"tuned-792r8\" (UID: \"28a75ede-97c5-4801-b30b-96057670ce4c\") " pod="openshift-cluster-node-tuning-operator/tuned-792r8" Sep 09 23:08:13.150507 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:13.149434 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/a15b7bf5-58cb-458e-9d83-9cc1f9409987-kubelet-dir\") pod \"aws-ebs-csi-driver-node-5ppxm\" (UID: \"a15b7bf5-58cb-458e-9d83-9cc1f9409987\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5ppxm" Sep 09 23:08:13.150507 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:13.149474 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a616cd8b-8bc4-4972-91bf-11f3e7ca7d44-cnibin\") pod \"multus-fnf6n\" (UID: \"a616cd8b-8bc4-4972-91bf-11f3e7ca7d44\") " pod="openshift-multus/multus-fnf6n" Sep 09 23:08:13.150507 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:13.149502 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/a616cd8b-8bc4-4972-91bf-11f3e7ca7d44-multus-socket-dir-parent\") pod \"multus-fnf6n\" (UID: \"a616cd8b-8bc4-4972-91bf-11f3e7ca7d44\") " pod="openshift-multus/multus-fnf6n" Sep 09 23:08:13.150507 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:13.149540 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/6942a2c5-1a59-4ea7-b78d-d131103de85f-ovnkube-script-lib\") pod \"ovnkube-node-pl5tw\" (UID: \"6942a2c5-1a59-4ea7-b78d-d131103de85f\") " pod="openshift-ovn-kubernetes/ovnkube-node-pl5tw" Sep 09 23:08:13.150507 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:13.149480 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb36829d9c7d7ab19a8579fb50eedaa1b.slice/crio-be0535432a83c0736f9891854f6a9edbd28da39c456786623481ecc6373cf346 WatchSource:0}: Error finding container be0535432a83c0736f9891854f6a9edbd28da39c456786623481ecc6373cf346: Status 404 returned error can't find the container with id be0535432a83c0736f9891854f6a9edbd28da39c456786623481ecc6373cf346 Sep 09 23:08:13.150507 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:13.149542 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6942a2c5-1a59-4ea7-b78d-d131103de85f-var-lib-openvswitch\") pod \"ovnkube-node-pl5tw\" (UID: \"6942a2c5-1a59-4ea7-b78d-d131103de85f\") " pod="openshift-ovn-kubernetes/ovnkube-node-pl5tw" Sep 09 23:08:13.150507 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:13.149580 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6942a2c5-1a59-4ea7-b78d-d131103de85f-var-lib-openvswitch\") pod \"ovnkube-node-pl5tw\" (UID: \"6942a2c5-1a59-4ea7-b78d-d131103de85f\") " pod="openshift-ovn-kubernetes/ovnkube-node-pl5tw" Sep 09 23:08:13.150507 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:13.149617 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/a616cd8b-8bc4-4972-91bf-11f3e7ca7d44-multus-socket-dir-parent\") pod \"multus-fnf6n\" (UID: \"a616cd8b-8bc4-4972-91bf-11f3e7ca7d44\") " pod="openshift-multus/multus-fnf6n" Sep 09 23:08:13.150507 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:13.149662 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6942a2c5-1a59-4ea7-b78d-d131103de85f-host-cni-bin\") pod \"ovnkube-node-pl5tw\" (UID: \"6942a2c5-1a59-4ea7-b78d-d131103de85f\") " pod="openshift-ovn-kubernetes/ovnkube-node-pl5tw" Sep 09 23:08:13.150507 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:13.149670 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/a15b7bf5-58cb-458e-9d83-9cc1f9409987-etc-selinux\") pod \"aws-ebs-csi-driver-node-5ppxm\" (UID: \"a15b7bf5-58cb-458e-9d83-9cc1f9409987\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5ppxm" Sep 09 23:08:13.150507 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:13.149705 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a616cd8b-8bc4-4972-91bf-11f3e7ca7d44-multus-conf-dir\") pod \"multus-fnf6n\" (UID: \"a616cd8b-8bc4-4972-91bf-11f3e7ca7d44\") " pod="openshift-multus/multus-fnf6n" Sep 09 23:08:13.150507 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:13.149718 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/1c4a374c-66ce-4af1-b989-7dfdd5b29b61-agent-certs\") pod \"konnectivity-agent-szqb4\" (UID: \"1c4a374c-66ce-4af1-b989-7dfdd5b29b61\") " pod="kube-system/konnectivity-agent-szqb4" Sep 09 23:08:13.150507 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:13.149752 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a616cd8b-8bc4-4972-91bf-11f3e7ca7d44-cnibin\") pod \"multus-fnf6n\" (UID: \"a616cd8b-8bc4-4972-91bf-11f3e7ca7d44\") " pod="openshift-multus/multus-fnf6n" Sep 09 23:08:13.151247 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:13.149788 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/28a75ede-97c5-4801-b30b-96057670ce4c-host\") pod \"tuned-792r8\" (UID: \"28a75ede-97c5-4801-b30b-96057670ce4c\") " pod="openshift-cluster-node-tuning-operator/tuned-792r8" Sep 09 23:08:13.151247 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:13.149811 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/28a75ede-97c5-4801-b30b-96057670ce4c-tmp\") pod \"tuned-792r8\" (UID: \"28a75ede-97c5-4801-b30b-96057670ce4c\") " pod="openshift-cluster-node-tuning-operator/tuned-792r8" Sep 09 23:08:13.151247 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:13.149850 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a616cd8b-8bc4-4972-91bf-11f3e7ca7d44-etc-kubernetes\") pod \"multus-fnf6n\" (UID: \"a616cd8b-8bc4-4972-91bf-11f3e7ca7d44\") " pod="openshift-multus/multus-fnf6n" Sep 09 23:08:13.151247 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:13.149857 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6942a2c5-1a59-4ea7-b78d-d131103de85f-host-cni-bin\") pod \"ovnkube-node-pl5tw\" (UID: \"6942a2c5-1a59-4ea7-b78d-d131103de85f\") " pod="openshift-ovn-kubernetes/ovnkube-node-pl5tw" Sep 09 23:08:13.151247 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:13.149890 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6942a2c5-1a59-4ea7-b78d-d131103de85f-host-run-netns\") pod \"ovnkube-node-pl5tw\" (UID: \"6942a2c5-1a59-4ea7-b78d-d131103de85f\") " pod="openshift-ovn-kubernetes/ovnkube-node-pl5tw" Sep 09 23:08:13.151247 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:13.149933 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6942a2c5-1a59-4ea7-b78d-d131103de85f-run-openvswitch\") pod \"ovnkube-node-pl5tw\" (UID: \"6942a2c5-1a59-4ea7-b78d-d131103de85f\") " pod="openshift-ovn-kubernetes/ovnkube-node-pl5tw" Sep 09 23:08:13.151247 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:13.149993 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/6942a2c5-1a59-4ea7-b78d-d131103de85f-ovnkube-config\") pod \"ovnkube-node-pl5tw\" (UID: \"6942a2c5-1a59-4ea7-b78d-d131103de85f\") " pod="openshift-ovn-kubernetes/ovnkube-node-pl5tw" Sep 09 23:08:13.151247 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:13.150022 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/02b55bf2-2972-4487-b51d-9a361a0d2b13-kubelet-config\") pod \"global-pull-secret-syncer-9dwkv\" (UID: \"02b55bf2-2972-4487-b51d-9a361a0d2b13\") " pod="kube-system/global-pull-secret-syncer-9dwkv" Sep 09 23:08:13.151247 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:13.150027 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a616cd8b-8bc4-4972-91bf-11f3e7ca7d44-etc-kubernetes\") pod \"multus-fnf6n\" (UID: \"a616cd8b-8bc4-4972-91bf-11f3e7ca7d44\") " pod="openshift-multus/multus-fnf6n" Sep 09 23:08:13.151247 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:13.150060 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6942a2c5-1a59-4ea7-b78d-d131103de85f-run-openvswitch\") pod \"ovnkube-node-pl5tw\" (UID: \"6942a2c5-1a59-4ea7-b78d-d131103de85f\") " pod="openshift-ovn-kubernetes/ovnkube-node-pl5tw" Sep 09 23:08:13.151247 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:13.150117 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rvl5j\" (UniqueName: \"kubernetes.io/projected/cecbf40f-1a0a-4819-b677-6d38f3e0d3af-kube-api-access-rvl5j\") pod \"node-resolver-2vcdm\" (UID: \"cecbf40f-1a0a-4819-b677-6d38f3e0d3af\") " pod="openshift-dns/node-resolver-2vcdm" Sep 09 23:08:13.151247 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:13.150151 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a616cd8b-8bc4-4972-91bf-11f3e7ca7d44-host-var-lib-kubelet\") pod \"multus-fnf6n\" (UID: \"a616cd8b-8bc4-4972-91bf-11f3e7ca7d44\") " pod="openshift-multus/multus-fnf6n" Sep 09 23:08:13.151247 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:13.150159 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6942a2c5-1a59-4ea7-b78d-d131103de85f-host-run-netns\") pod \"ovnkube-node-pl5tw\" (UID: \"6942a2c5-1a59-4ea7-b78d-d131103de85f\") " pod="openshift-ovn-kubernetes/ovnkube-node-pl5tw" Sep 09 23:08:13.151247 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:13.150195 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/28a75ede-97c5-4801-b30b-96057670ce4c-etc-sysconfig\") pod \"tuned-792r8\" (UID: \"28a75ede-97c5-4801-b30b-96057670ce4c\") " pod="openshift-cluster-node-tuning-operator/tuned-792r8" Sep 09 23:08:13.151247 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:13.150212 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a616cd8b-8bc4-4972-91bf-11f3e7ca7d44-host-var-lib-kubelet\") pod \"multus-fnf6n\" (UID: \"a616cd8b-8bc4-4972-91bf-11f3e7ca7d44\") " pod="openshift-multus/multus-fnf6n" Sep 09 23:08:13.151247 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:13.150226 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/28a75ede-97c5-4801-b30b-96057670ce4c-run\") pod \"tuned-792r8\" (UID: \"28a75ede-97c5-4801-b30b-96057670ce4c\") " pod="openshift-cluster-node-tuning-operator/tuned-792r8" Sep 09 23:08:13.151247 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:13.150255 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/28a75ede-97c5-4801-b30b-96057670ce4c-var-lib-kubelet\") pod \"tuned-792r8\" (UID: \"28a75ede-97c5-4801-b30b-96057670ce4c\") " pod="openshift-cluster-node-tuning-operator/tuned-792r8" Sep 09 23:08:13.152003 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:13.150283 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/77df7cc0-0e7e-468f-89d9-b055af5de0b3-metrics-certs\") pod \"network-metrics-daemon-ktqck\" (UID: \"77df7cc0-0e7e-468f-89d9-b055af5de0b3\") " pod="openshift-multus/network-metrics-daemon-ktqck" Sep 09 23:08:13.152003 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:13.150332 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a616cd8b-8bc4-4972-91bf-11f3e7ca7d44-host-run-netns\") pod \"multus-fnf6n\" (UID: \"a616cd8b-8bc4-4972-91bf-11f3e7ca7d44\") " pod="openshift-multus/multus-fnf6n" Sep 09 23:08:13.152003 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:13.150455 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/505de87b-9cf1-4af8-815b-ed5f65ac6675-cnibin\") pod \"multus-additional-cni-plugins-rzmhq\" (UID: \"505de87b-9cf1-4af8-815b-ed5f65ac6675\") " pod="openshift-multus/multus-additional-cni-plugins-rzmhq" Sep 09 23:08:13.152003 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:13.150455 2561 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Sep 09 23:08:13.152003 ip-10-0-132-204 kubenswrapper[2561]: E0909 23:08:13.150576 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 09 23:08:13.152003 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:13.150574 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xkvm6\" (UniqueName: \"kubernetes.io/projected/61cad06e-7668-4ada-82e5-a34a71bf52fb-kube-api-access-xkvm6\") pod \"network-check-target-6s7s6\" (UID: \"61cad06e-7668-4ada-82e5-a34a71bf52fb\") " pod="openshift-network-diagnostics/network-check-target-6s7s6" Sep 09 23:08:13.152003 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:13.150601 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/6942a2c5-1a59-4ea7-b78d-d131103de85f-ovnkube-config\") pod \"ovnkube-node-pl5tw\" (UID: \"6942a2c5-1a59-4ea7-b78d-d131103de85f\") " pod="openshift-ovn-kubernetes/ovnkube-node-pl5tw" Sep 09 23:08:13.152003 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:13.150620 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/6942a2c5-1a59-4ea7-b78d-d131103de85f-host-kubelet\") pod \"ovnkube-node-pl5tw\" (UID: \"6942a2c5-1a59-4ea7-b78d-d131103de85f\") " pod="openshift-ovn-kubernetes/ovnkube-node-pl5tw" Sep 09 23:08:13.152003 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:13.150732 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6942a2c5-1a59-4ea7-b78d-d131103de85f-host-slash\") pod \"ovnkube-node-pl5tw\" (UID: \"6942a2c5-1a59-4ea7-b78d-d131103de85f\") " pod="openshift-ovn-kubernetes/ovnkube-node-pl5tw" Sep 09 23:08:13.152003 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:13.150743 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/6942a2c5-1a59-4ea7-b78d-d131103de85f-host-kubelet\") pod \"ovnkube-node-pl5tw\" (UID: \"6942a2c5-1a59-4ea7-b78d-d131103de85f\") " pod="openshift-ovn-kubernetes/ovnkube-node-pl5tw" Sep 09 23:08:13.152003 ip-10-0-132-204 kubenswrapper[2561]: E0909 23:08:13.150793 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/77df7cc0-0e7e-468f-89d9-b055af5de0b3-metrics-certs podName:77df7cc0-0e7e-468f-89d9-b055af5de0b3 nodeName:}" failed. No retries permitted until 2026-09-09 23:08:13.650771503 +0000 UTC m=+2.026345564 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/77df7cc0-0e7e-468f-89d9-b055af5de0b3-metrics-certs") pod "network-metrics-daemon-ktqck" (UID: "77df7cc0-0e7e-468f-89d9-b055af5de0b3") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 09 23:08:13.152003 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:13.150791 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/1c4a374c-66ce-4af1-b989-7dfdd5b29b61-konnectivity-ca\") pod \"konnectivity-agent-szqb4\" (UID: \"1c4a374c-66ce-4af1-b989-7dfdd5b29b61\") " pod="kube-system/konnectivity-agent-szqb4" Sep 09 23:08:13.152003 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:13.150796 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6942a2c5-1a59-4ea7-b78d-d131103de85f-host-slash\") pod \"ovnkube-node-pl5tw\" (UID: \"6942a2c5-1a59-4ea7-b78d-d131103de85f\") " pod="openshift-ovn-kubernetes/ovnkube-node-pl5tw" Sep 09 23:08:13.152003 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:13.150818 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6942a2c5-1a59-4ea7-b78d-d131103de85f-etc-openvswitch\") pod \"ovnkube-node-pl5tw\" (UID: \"6942a2c5-1a59-4ea7-b78d-d131103de85f\") " pod="openshift-ovn-kubernetes/ovnkube-node-pl5tw" Sep 09 23:08:13.152003 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:13.150858 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6942a2c5-1a59-4ea7-b78d-d131103de85f-etc-openvswitch\") pod \"ovnkube-node-pl5tw\" (UID: \"6942a2c5-1a59-4ea7-b78d-d131103de85f\") " pod="openshift-ovn-kubernetes/ovnkube-node-pl5tw" Sep 09 23:08:13.152003 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:13.150861 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6942a2c5-1a59-4ea7-b78d-d131103de85f-host-run-ovn-kubernetes\") pod \"ovnkube-node-pl5tw\" (UID: \"6942a2c5-1a59-4ea7-b78d-d131103de85f\") " pod="openshift-ovn-kubernetes/ovnkube-node-pl5tw" Sep 09 23:08:13.152003 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:13.150900 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6942a2c5-1a59-4ea7-b78d-d131103de85f-host-run-ovn-kubernetes\") pod \"ovnkube-node-pl5tw\" (UID: \"6942a2c5-1a59-4ea7-b78d-d131103de85f\") " pod="openshift-ovn-kubernetes/ovnkube-node-pl5tw" Sep 09 23:08:13.152981 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:13.150935 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/6942a2c5-1a59-4ea7-b78d-d131103de85f-env-overrides\") pod \"ovnkube-node-pl5tw\" (UID: \"6942a2c5-1a59-4ea7-b78d-d131103de85f\") " pod="openshift-ovn-kubernetes/ovnkube-node-pl5tw" Sep 09 23:08:13.152981 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:13.150964 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/6942a2c5-1a59-4ea7-b78d-d131103de85f-systemd-units\") pod \"ovnkube-node-pl5tw\" (UID: \"6942a2c5-1a59-4ea7-b78d-d131103de85f\") " pod="openshift-ovn-kubernetes/ovnkube-node-pl5tw" Sep 09 23:08:13.152981 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:13.151038 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/6942a2c5-1a59-4ea7-b78d-d131103de85f-systemd-units\") pod \"ovnkube-node-pl5tw\" (UID: \"6942a2c5-1a59-4ea7-b78d-d131103de85f\") " pod="openshift-ovn-kubernetes/ovnkube-node-pl5tw" Sep 09 23:08:13.152981 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:13.151063 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/6942a2c5-1a59-4ea7-b78d-d131103de85f-ovn-node-metrics-cert\") pod \"ovnkube-node-pl5tw\" (UID: \"6942a2c5-1a59-4ea7-b78d-d131103de85f\") " pod="openshift-ovn-kubernetes/ovnkube-node-pl5tw" Sep 09 23:08:13.152981 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:13.151093 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/387f7aa8-f4f6-4cee-9b6b-72409b5693c5-iptables-alerter-script\") pod \"iptables-alerter-lbv8f\" (UID: \"387f7aa8-f4f6-4cee-9b6b-72409b5693c5\") " pod="openshift-network-operator/iptables-alerter-lbv8f" Sep 09 23:08:13.152981 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:13.151222 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/28a75ede-97c5-4801-b30b-96057670ce4c-etc-systemd\") pod \"tuned-792r8\" (UID: \"28a75ede-97c5-4801-b30b-96057670ce4c\") " pod="openshift-cluster-node-tuning-operator/tuned-792r8" Sep 09 23:08:13.152981 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:13.151246 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/cecbf40f-1a0a-4819-b677-6d38f3e0d3af-hosts-file\") pod \"node-resolver-2vcdm\" (UID: \"cecbf40f-1a0a-4819-b677-6d38f3e0d3af\") " pod="openshift-dns/node-resolver-2vcdm" Sep 09 23:08:13.152981 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:13.151269 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a1511acb-caeb-42b1-be06-daa47d1973e3-host\") pod \"node-ca-q2mnk\" (UID: \"a1511acb-caeb-42b1-be06-daa47d1973e3\") " pod="openshift-image-registry/node-ca-q2mnk" Sep 09 23:08:13.152981 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:13.151321 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/a1511acb-caeb-42b1-be06-daa47d1973e3-serviceca\") pod \"node-ca-q2mnk\" (UID: \"a1511acb-caeb-42b1-be06-daa47d1973e3\") " pod="openshift-image-registry/node-ca-q2mnk" Sep 09 23:08:13.152981 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:13.151333 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/6942a2c5-1a59-4ea7-b78d-d131103de85f-env-overrides\") pod \"ovnkube-node-pl5tw\" (UID: \"6942a2c5-1a59-4ea7-b78d-d131103de85f\") " pod="openshift-ovn-kubernetes/ovnkube-node-pl5tw" Sep 09 23:08:13.152981 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:13.151344 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mztbt\" (UniqueName: \"kubernetes.io/projected/a1511acb-caeb-42b1-be06-daa47d1973e3-kube-api-access-mztbt\") pod \"node-ca-q2mnk\" (UID: \"a1511acb-caeb-42b1-be06-daa47d1973e3\") " pod="openshift-image-registry/node-ca-q2mnk" Sep 09 23:08:13.152981 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:13.151421 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a616cd8b-8bc4-4972-91bf-11f3e7ca7d44-system-cni-dir\") pod \"multus-fnf6n\" (UID: \"a616cd8b-8bc4-4972-91bf-11f3e7ca7d44\") " pod="openshift-multus/multus-fnf6n" Sep 09 23:08:13.152981 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:13.151457 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/a616cd8b-8bc4-4972-91bf-11f3e7ca7d44-hostroot\") pod \"multus-fnf6n\" (UID: \"a616cd8b-8bc4-4972-91bf-11f3e7ca7d44\") " pod="openshift-multus/multus-fnf6n" Sep 09 23:08:13.152981 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:13.151483 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wlj5t\" (UniqueName: \"kubernetes.io/projected/6942a2c5-1a59-4ea7-b78d-d131103de85f-kube-api-access-wlj5t\") pod \"ovnkube-node-pl5tw\" (UID: \"6942a2c5-1a59-4ea7-b78d-d131103de85f\") " pod="openshift-ovn-kubernetes/ovnkube-node-pl5tw" Sep 09 23:08:13.152981 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:13.151509 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/505de87b-9cf1-4af8-815b-ed5f65ac6675-cni-binary-copy\") pod \"multus-additional-cni-plugins-rzmhq\" (UID: \"505de87b-9cf1-4af8-815b-ed5f65ac6675\") " pod="openshift-multus/multus-additional-cni-plugins-rzmhq" Sep 09 23:08:13.152981 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:13.151523 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a616cd8b-8bc4-4972-91bf-11f3e7ca7d44-system-cni-dir\") pod \"multus-fnf6n\" (UID: \"a616cd8b-8bc4-4972-91bf-11f3e7ca7d44\") " pod="openshift-multus/multus-fnf6n" Sep 09 23:08:13.152981 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:13.151535 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/387f7aa8-f4f6-4cee-9b6b-72409b5693c5-host-slash\") pod \"iptables-alerter-lbv8f\" (UID: \"387f7aa8-f4f6-4cee-9b6b-72409b5693c5\") " pod="openshift-network-operator/iptables-alerter-lbv8f" Sep 09 23:08:13.153807 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:13.151565 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/a616cd8b-8bc4-4972-91bf-11f3e7ca7d44-hostroot\") pod \"multus-fnf6n\" (UID: \"a616cd8b-8bc4-4972-91bf-11f3e7ca7d44\") " pod="openshift-multus/multus-fnf6n" Sep 09 23:08:13.153807 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:13.151572 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/505de87b-9cf1-4af8-815b-ed5f65ac6675-system-cni-dir\") pod \"multus-additional-cni-plugins-rzmhq\" (UID: \"505de87b-9cf1-4af8-815b-ed5f65ac6675\") " pod="openshift-multus/multus-additional-cni-plugins-rzmhq" Sep 09 23:08:13.153807 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:13.151599 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ggxsd\" (UniqueName: \"kubernetes.io/projected/a616cd8b-8bc4-4972-91bf-11f3e7ca7d44-kube-api-access-ggxsd\") pod \"multus-fnf6n\" (UID: \"a616cd8b-8bc4-4972-91bf-11f3e7ca7d44\") " pod="openshift-multus/multus-fnf6n" Sep 09 23:08:13.153807 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:13.151620 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/6942a2c5-1a59-4ea7-b78d-d131103de85f-host-cni-netd\") pod \"ovnkube-node-pl5tw\" (UID: \"6942a2c5-1a59-4ea7-b78d-d131103de85f\") " pod="openshift-ovn-kubernetes/ovnkube-node-pl5tw" Sep 09 23:08:13.153807 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:13.151656 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/6942a2c5-1a59-4ea7-b78d-d131103de85f-host-cni-netd\") pod \"ovnkube-node-pl5tw\" (UID: \"6942a2c5-1a59-4ea7-b78d-d131103de85f\") " pod="openshift-ovn-kubernetes/ovnkube-node-pl5tw" Sep 09 23:08:13.153807 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:13.151745 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kfbnn\" (UniqueName: \"kubernetes.io/projected/a15b7bf5-58cb-458e-9d83-9cc1f9409987-kube-api-access-kfbnn\") pod \"aws-ebs-csi-driver-node-5ppxm\" (UID: \"a15b7bf5-58cb-458e-9d83-9cc1f9409987\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5ppxm" Sep 09 23:08:13.153807 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:13.151765 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/505de87b-9cf1-4af8-815b-ed5f65ac6675-tuning-conf-dir\") pod \"multus-additional-cni-plugins-rzmhq\" (UID: \"505de87b-9cf1-4af8-815b-ed5f65ac6675\") " pod="openshift-multus/multus-additional-cni-plugins-rzmhq" Sep 09 23:08:13.153807 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:13.151788 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hwrrs\" (UniqueName: \"kubernetes.io/projected/387f7aa8-f4f6-4cee-9b6b-72409b5693c5-kube-api-access-hwrrs\") pod \"iptables-alerter-lbv8f\" (UID: \"387f7aa8-f4f6-4cee-9b6b-72409b5693c5\") " pod="openshift-network-operator/iptables-alerter-lbv8f" Sep 09 23:08:13.153807 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:13.151801 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/28a75ede-97c5-4801-b30b-96057670ce4c-sys\") pod \"tuned-792r8\" (UID: \"28a75ede-97c5-4801-b30b-96057670ce4c\") " pod="openshift-cluster-node-tuning-operator/tuned-792r8" Sep 09 23:08:13.154585 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:13.154543 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/6942a2c5-1a59-4ea7-b78d-d131103de85f-ovn-node-metrics-cert\") pod \"ovnkube-node-pl5tw\" (UID: \"6942a2c5-1a59-4ea7-b78d-d131103de85f\") " pod="openshift-ovn-kubernetes/ovnkube-node-pl5tw" Sep 09 23:08:13.154757 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:13.154734 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/1c4a374c-66ce-4af1-b989-7dfdd5b29b61-agent-certs\") pod \"konnectivity-agent-szqb4\" (UID: \"1c4a374c-66ce-4af1-b989-7dfdd5b29b61\") " pod="kube-system/konnectivity-agent-szqb4" Sep 09 23:08:13.156753 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:13.156737 2561 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 09 23:08:13.160601 ip-10-0-132-204 kubenswrapper[2561]: E0909 23:08:13.159877 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 09 23:08:13.160601 ip-10-0-132-204 kubenswrapper[2561]: E0909 23:08:13.159893 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 09 23:08:13.160601 ip-10-0-132-204 kubenswrapper[2561]: E0909 23:08:13.159902 2561 projected.go:196] Error preparing data for projected volume kube-api-access-xkvm6 for pod openshift-network-diagnostics/network-check-target-6s7s6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 09 23:08:13.160601 ip-10-0-132-204 kubenswrapper[2561]: E0909 23:08:13.159948 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/61cad06e-7668-4ada-82e5-a34a71bf52fb-kube-api-access-xkvm6 podName:61cad06e-7668-4ada-82e5-a34a71bf52fb nodeName:}" failed. No retries permitted until 2026-09-09 23:08:13.659933939 +0000 UTC m=+2.035507979 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-xkvm6" (UniqueName: "kubernetes.io/projected/61cad06e-7668-4ada-82e5-a34a71bf52fb-kube-api-access-xkvm6") pod "network-check-target-6s7s6" (UID: "61cad06e-7668-4ada-82e5-a34a71bf52fb") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 09 23:08:13.160601 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:13.160398 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tvs4h\" (UniqueName: \"kubernetes.io/projected/77df7cc0-0e7e-468f-89d9-b055af5de0b3-kube-api-access-tvs4h\") pod \"network-metrics-daemon-ktqck\" (UID: \"77df7cc0-0e7e-468f-89d9-b055af5de0b3\") " pod="openshift-multus/network-metrics-daemon-ktqck" Sep 09 23:08:13.168011 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:13.167990 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wlj5t\" (UniqueName: \"kubernetes.io/projected/6942a2c5-1a59-4ea7-b78d-d131103de85f-kube-api-access-wlj5t\") pod \"ovnkube-node-pl5tw\" (UID: \"6942a2c5-1a59-4ea7-b78d-d131103de85f\") " pod="openshift-ovn-kubernetes/ovnkube-node-pl5tw" Sep 09 23:08:13.168152 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:13.168134 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ggxsd\" (UniqueName: \"kubernetes.io/projected/a616cd8b-8bc4-4972-91bf-11f3e7ca7d44-kube-api-access-ggxsd\") pod \"multus-fnf6n\" (UID: \"a616cd8b-8bc4-4972-91bf-11f3e7ca7d44\") " pod="openshift-multus/multus-fnf6n" Sep 09 23:08:13.168952 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:13.168927 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kfbnn\" (UniqueName: \"kubernetes.io/projected/a15b7bf5-58cb-458e-9d83-9cc1f9409987-kube-api-access-kfbnn\") pod \"aws-ebs-csi-driver-node-5ppxm\" (UID: \"a15b7bf5-58cb-458e-9d83-9cc1f9409987\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5ppxm" Sep 09 23:08:13.252772 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:13.252744 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/387f7aa8-f4f6-4cee-9b6b-72409b5693c5-iptables-alerter-script\") pod \"iptables-alerter-lbv8f\" (UID: \"387f7aa8-f4f6-4cee-9b6b-72409b5693c5\") " pod="openshift-network-operator/iptables-alerter-lbv8f" Sep 09 23:08:13.252772 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:13.252772 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/28a75ede-97c5-4801-b30b-96057670ce4c-etc-systemd\") pod \"tuned-792r8\" (UID: \"28a75ede-97c5-4801-b30b-96057670ce4c\") " pod="openshift-cluster-node-tuning-operator/tuned-792r8" Sep 09 23:08:13.253054 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:13.252787 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/cecbf40f-1a0a-4819-b677-6d38f3e0d3af-hosts-file\") pod \"node-resolver-2vcdm\" (UID: \"cecbf40f-1a0a-4819-b677-6d38f3e0d3af\") " pod="openshift-dns/node-resolver-2vcdm" Sep 09 23:08:13.253054 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:13.252810 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a1511acb-caeb-42b1-be06-daa47d1973e3-host\") pod \"node-ca-q2mnk\" (UID: \"a1511acb-caeb-42b1-be06-daa47d1973e3\") " pod="openshift-image-registry/node-ca-q2mnk" Sep 09 23:08:13.253054 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:13.252830 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/a1511acb-caeb-42b1-be06-daa47d1973e3-serviceca\") pod \"node-ca-q2mnk\" (UID: \"a1511acb-caeb-42b1-be06-daa47d1973e3\") " pod="openshift-image-registry/node-ca-q2mnk" Sep 09 23:08:13.253054 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:13.252853 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mztbt\" (UniqueName: \"kubernetes.io/projected/a1511acb-caeb-42b1-be06-daa47d1973e3-kube-api-access-mztbt\") pod \"node-ca-q2mnk\" (UID: \"a1511acb-caeb-42b1-be06-daa47d1973e3\") " pod="openshift-image-registry/node-ca-q2mnk" Sep 09 23:08:13.253054 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:13.252860 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/28a75ede-97c5-4801-b30b-96057670ce4c-etc-systemd\") pod \"tuned-792r8\" (UID: \"28a75ede-97c5-4801-b30b-96057670ce4c\") " pod="openshift-cluster-node-tuning-operator/tuned-792r8" Sep 09 23:08:13.253054 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:13.252878 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/505de87b-9cf1-4af8-815b-ed5f65ac6675-cni-binary-copy\") pod \"multus-additional-cni-plugins-rzmhq\" (UID: \"505de87b-9cf1-4af8-815b-ed5f65ac6675\") " pod="openshift-multus/multus-additional-cni-plugins-rzmhq" Sep 09 23:08:13.253054 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:13.252876 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a1511acb-caeb-42b1-be06-daa47d1973e3-host\") pod \"node-ca-q2mnk\" (UID: \"a1511acb-caeb-42b1-be06-daa47d1973e3\") " pod="openshift-image-registry/node-ca-q2mnk" Sep 09 23:08:13.253054 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:13.252876 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/cecbf40f-1a0a-4819-b677-6d38f3e0d3af-hosts-file\") pod \"node-resolver-2vcdm\" (UID: \"cecbf40f-1a0a-4819-b677-6d38f3e0d3af\") " pod="openshift-dns/node-resolver-2vcdm" Sep 09 23:08:13.253054 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:13.252921 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/387f7aa8-f4f6-4cee-9b6b-72409b5693c5-host-slash\") pod \"iptables-alerter-lbv8f\" (UID: \"387f7aa8-f4f6-4cee-9b6b-72409b5693c5\") " pod="openshift-network-operator/iptables-alerter-lbv8f" Sep 09 23:08:13.253054 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:13.252935 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/505de87b-9cf1-4af8-815b-ed5f65ac6675-system-cni-dir\") pod \"multus-additional-cni-plugins-rzmhq\" (UID: \"505de87b-9cf1-4af8-815b-ed5f65ac6675\") " pod="openshift-multus/multus-additional-cni-plugins-rzmhq" Sep 09 23:08:13.253054 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:13.252950 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/505de87b-9cf1-4af8-815b-ed5f65ac6675-tuning-conf-dir\") pod \"multus-additional-cni-plugins-rzmhq\" (UID: \"505de87b-9cf1-4af8-815b-ed5f65ac6675\") " pod="openshift-multus/multus-additional-cni-plugins-rzmhq" Sep 09 23:08:13.253054 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:13.252970 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hwrrs\" (UniqueName: \"kubernetes.io/projected/387f7aa8-f4f6-4cee-9b6b-72409b5693c5-kube-api-access-hwrrs\") pod \"iptables-alerter-lbv8f\" (UID: \"387f7aa8-f4f6-4cee-9b6b-72409b5693c5\") " pod="openshift-network-operator/iptables-alerter-lbv8f" Sep 09 23:08:13.253054 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:13.252973 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/505de87b-9cf1-4af8-815b-ed5f65ac6675-system-cni-dir\") pod \"multus-additional-cni-plugins-rzmhq\" (UID: \"505de87b-9cf1-4af8-815b-ed5f65ac6675\") " pod="openshift-multus/multus-additional-cni-plugins-rzmhq" Sep 09 23:08:13.253054 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:13.252987 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/28a75ede-97c5-4801-b30b-96057670ce4c-sys\") pod \"tuned-792r8\" (UID: \"28a75ede-97c5-4801-b30b-96057670ce4c\") " pod="openshift-cluster-node-tuning-operator/tuned-792r8" Sep 09 23:08:13.253054 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:13.253006 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/505de87b-9cf1-4af8-815b-ed5f65ac6675-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-rzmhq\" (UID: \"505de87b-9cf1-4af8-815b-ed5f65ac6675\") " pod="openshift-multus/multus-additional-cni-plugins-rzmhq" Sep 09 23:08:13.253054 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:13.253028 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8r9hd\" (UniqueName: \"kubernetes.io/projected/505de87b-9cf1-4af8-815b-ed5f65ac6675-kube-api-access-8r9hd\") pod \"multus-additional-cni-plugins-rzmhq\" (UID: \"505de87b-9cf1-4af8-815b-ed5f65ac6675\") " pod="openshift-multus/multus-additional-cni-plugins-rzmhq" Sep 09 23:08:13.253054 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:13.252969 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/387f7aa8-f4f6-4cee-9b6b-72409b5693c5-host-slash\") pod \"iptables-alerter-lbv8f\" (UID: \"387f7aa8-f4f6-4cee-9b6b-72409b5693c5\") " pod="openshift-network-operator/iptables-alerter-lbv8f" Sep 09 23:08:13.253842 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:13.253052 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/28a75ede-97c5-4801-b30b-96057670ce4c-etc-sysctl-d\") pod \"tuned-792r8\" (UID: \"28a75ede-97c5-4801-b30b-96057670ce4c\") " pod="openshift-cluster-node-tuning-operator/tuned-792r8" Sep 09 23:08:13.253842 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:13.253075 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/28a75ede-97c5-4801-b30b-96057670ce4c-etc-tuned\") pod \"tuned-792r8\" (UID: \"28a75ede-97c5-4801-b30b-96057670ce4c\") " pod="openshift-cluster-node-tuning-operator/tuned-792r8" Sep 09 23:08:13.253842 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:13.253099 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/28a75ede-97c5-4801-b30b-96057670ce4c-sys\") pod \"tuned-792r8\" (UID: \"28a75ede-97c5-4801-b30b-96057670ce4c\") " pod="openshift-cluster-node-tuning-operator/tuned-792r8" Sep 09 23:08:13.253842 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:13.253121 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k2cc7\" (UniqueName: \"kubernetes.io/projected/28a75ede-97c5-4801-b30b-96057670ce4c-kube-api-access-k2cc7\") pod \"tuned-792r8\" (UID: \"28a75ede-97c5-4801-b30b-96057670ce4c\") " pod="openshift-cluster-node-tuning-operator/tuned-792r8" Sep 09 23:08:13.253842 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:13.253143 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cecbf40f-1a0a-4819-b677-6d38f3e0d3af-tmp-dir\") pod \"node-resolver-2vcdm\" (UID: \"cecbf40f-1a0a-4819-b677-6d38f3e0d3af\") " pod="openshift-dns/node-resolver-2vcdm" Sep 09 23:08:13.253842 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:13.253166 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/28a75ede-97c5-4801-b30b-96057670ce4c-lib-modules\") pod \"tuned-792r8\" (UID: \"28a75ede-97c5-4801-b30b-96057670ce4c\") " pod="openshift-cluster-node-tuning-operator/tuned-792r8" Sep 09 23:08:13.253842 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:13.253218 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/02b55bf2-2972-4487-b51d-9a361a0d2b13-original-pull-secret\") pod \"global-pull-secret-syncer-9dwkv\" (UID: \"02b55bf2-2972-4487-b51d-9a361a0d2b13\") " pod="kube-system/global-pull-secret-syncer-9dwkv" Sep 09 23:08:13.253842 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:13.253248 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/505de87b-9cf1-4af8-815b-ed5f65ac6675-tuning-conf-dir\") pod \"multus-additional-cni-plugins-rzmhq\" (UID: \"505de87b-9cf1-4af8-815b-ed5f65ac6675\") " pod="openshift-multus/multus-additional-cni-plugins-rzmhq" Sep 09 23:08:13.253842 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:13.253254 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/28a75ede-97c5-4801-b30b-96057670ce4c-etc-kubernetes\") pod \"tuned-792r8\" (UID: \"28a75ede-97c5-4801-b30b-96057670ce4c\") " pod="openshift-cluster-node-tuning-operator/tuned-792r8" Sep 09 23:08:13.253842 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:13.253276 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/28a75ede-97c5-4801-b30b-96057670ce4c-lib-modules\") pod \"tuned-792r8\" (UID: \"28a75ede-97c5-4801-b30b-96057670ce4c\") " pod="openshift-cluster-node-tuning-operator/tuned-792r8" Sep 09 23:08:13.253842 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:13.253306 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/28a75ede-97c5-4801-b30b-96057670ce4c-etc-sysctl-conf\") pod \"tuned-792r8\" (UID: \"28a75ede-97c5-4801-b30b-96057670ce4c\") " pod="openshift-cluster-node-tuning-operator/tuned-792r8" Sep 09 23:08:13.253842 ip-10-0-132-204 kubenswrapper[2561]: E0909 23:08:13.253318 2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 09 23:08:13.253842 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:13.253337 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/02b55bf2-2972-4487-b51d-9a361a0d2b13-dbus\") pod \"global-pull-secret-syncer-9dwkv\" (UID: \"02b55bf2-2972-4487-b51d-9a361a0d2b13\") " pod="kube-system/global-pull-secret-syncer-9dwkv" Sep 09 23:08:13.253842 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:13.253384 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/505de87b-9cf1-4af8-815b-ed5f65ac6675-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-rzmhq\" (UID: \"505de87b-9cf1-4af8-815b-ed5f65ac6675\") " pod="openshift-multus/multus-additional-cni-plugins-rzmhq" Sep 09 23:08:13.253842 ip-10-0-132-204 kubenswrapper[2561]: E0909 23:08:13.253398 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/02b55bf2-2972-4487-b51d-9a361a0d2b13-original-pull-secret podName:02b55bf2-2972-4487-b51d-9a361a0d2b13 nodeName:}" failed. No retries permitted until 2026-09-09 23:08:13.753358716 +0000 UTC m=+2.128932772 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/02b55bf2-2972-4487-b51d-9a361a0d2b13-original-pull-secret") pod "global-pull-secret-syncer-9dwkv" (UID: "02b55bf2-2972-4487-b51d-9a361a0d2b13") : object "kube-system"/"original-pull-secret" not registered Sep 09 23:08:13.253842 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:13.253449 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/28a75ede-97c5-4801-b30b-96057670ce4c-etc-modprobe-d\") pod \"tuned-792r8\" (UID: \"28a75ede-97c5-4801-b30b-96057670ce4c\") " pod="openshift-cluster-node-tuning-operator/tuned-792r8" Sep 09 23:08:13.253842 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:13.253479 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/28a75ede-97c5-4801-b30b-96057670ce4c-host\") pod \"tuned-792r8\" (UID: \"28a75ede-97c5-4801-b30b-96057670ce4c\") " pod="openshift-cluster-node-tuning-operator/tuned-792r8" Sep 09 23:08:13.254448 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:13.253506 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/387f7aa8-f4f6-4cee-9b6b-72409b5693c5-iptables-alerter-script\") pod \"iptables-alerter-lbv8f\" (UID: \"387f7aa8-f4f6-4cee-9b6b-72409b5693c5\") " pod="openshift-network-operator/iptables-alerter-lbv8f" Sep 09 23:08:13.254448 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:13.253530 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/28a75ede-97c5-4801-b30b-96057670ce4c-host\") pod \"tuned-792r8\" (UID: \"28a75ede-97c5-4801-b30b-96057670ce4c\") " pod="openshift-cluster-node-tuning-operator/tuned-792r8" Sep 09 23:08:13.254448 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:13.253658 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/28a75ede-97c5-4801-b30b-96057670ce4c-etc-sysctl-d\") pod \"tuned-792r8\" (UID: \"28a75ede-97c5-4801-b30b-96057670ce4c\") " pod="openshift-cluster-node-tuning-operator/tuned-792r8" Sep 09 23:08:13.254448 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:13.253675 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/505de87b-9cf1-4af8-815b-ed5f65ac6675-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-rzmhq\" (UID: \"505de87b-9cf1-4af8-815b-ed5f65ac6675\") " pod="openshift-multus/multus-additional-cni-plugins-rzmhq" Sep 09 23:08:13.254448 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:13.253694 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/505de87b-9cf1-4af8-815b-ed5f65ac6675-cni-binary-copy\") pod \"multus-additional-cni-plugins-rzmhq\" (UID: \"505de87b-9cf1-4af8-815b-ed5f65ac6675\") " pod="openshift-multus/multus-additional-cni-plugins-rzmhq" Sep 09 23:08:13.254448 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:13.253719 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/28a75ede-97c5-4801-b30b-96057670ce4c-etc-kubernetes\") pod \"tuned-792r8\" (UID: \"28a75ede-97c5-4801-b30b-96057670ce4c\") " pod="openshift-cluster-node-tuning-operator/tuned-792r8" Sep 09 23:08:13.254448 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:13.253725 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cecbf40f-1a0a-4819-b677-6d38f3e0d3af-tmp-dir\") pod \"node-resolver-2vcdm\" (UID: \"cecbf40f-1a0a-4819-b677-6d38f3e0d3af\") " pod="openshift-dns/node-resolver-2vcdm" Sep 09 23:08:13.254448 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:13.253761 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/28a75ede-97c5-4801-b30b-96057670ce4c-etc-modprobe-d\") pod \"tuned-792r8\" (UID: \"28a75ede-97c5-4801-b30b-96057670ce4c\") " pod="openshift-cluster-node-tuning-operator/tuned-792r8" Sep 09 23:08:13.254448 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:13.253790 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/28a75ede-97c5-4801-b30b-96057670ce4c-tmp\") pod \"tuned-792r8\" (UID: \"28a75ede-97c5-4801-b30b-96057670ce4c\") " pod="openshift-cluster-node-tuning-operator/tuned-792r8" Sep 09 23:08:13.254448 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:13.253817 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/02b55bf2-2972-4487-b51d-9a361a0d2b13-kubelet-config\") pod \"global-pull-secret-syncer-9dwkv\" (UID: \"02b55bf2-2972-4487-b51d-9a361a0d2b13\") " pod="kube-system/global-pull-secret-syncer-9dwkv" Sep 09 23:08:13.254448 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:13.253836 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/28a75ede-97c5-4801-b30b-96057670ce4c-etc-sysctl-conf\") pod \"tuned-792r8\" (UID: \"28a75ede-97c5-4801-b30b-96057670ce4c\") " pod="openshift-cluster-node-tuning-operator/tuned-792r8" Sep 09 23:08:13.254448 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:13.253841 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rvl5j\" (UniqueName: \"kubernetes.io/projected/cecbf40f-1a0a-4819-b677-6d38f3e0d3af-kube-api-access-rvl5j\") pod \"node-resolver-2vcdm\" (UID: \"cecbf40f-1a0a-4819-b677-6d38f3e0d3af\") " pod="openshift-dns/node-resolver-2vcdm" Sep 09 23:08:13.254448 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:13.253839 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/02b55bf2-2972-4487-b51d-9a361a0d2b13-dbus\") pod \"global-pull-secret-syncer-9dwkv\" (UID: \"02b55bf2-2972-4487-b51d-9a361a0d2b13\") " pod="kube-system/global-pull-secret-syncer-9dwkv" Sep 09 23:08:13.254448 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:13.253871 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/28a75ede-97c5-4801-b30b-96057670ce4c-etc-sysconfig\") pod \"tuned-792r8\" (UID: \"28a75ede-97c5-4801-b30b-96057670ce4c\") " pod="openshift-cluster-node-tuning-operator/tuned-792r8" Sep 09 23:08:13.254448 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:13.253878 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/505de87b-9cf1-4af8-815b-ed5f65ac6675-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-rzmhq\" (UID: \"505de87b-9cf1-4af8-815b-ed5f65ac6675\") " pod="openshift-multus/multus-additional-cni-plugins-rzmhq" Sep 09 23:08:13.254448 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:13.253895 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/28a75ede-97c5-4801-b30b-96057670ce4c-run\") pod \"tuned-792r8\" (UID: \"28a75ede-97c5-4801-b30b-96057670ce4c\") " pod="openshift-cluster-node-tuning-operator/tuned-792r8" Sep 09 23:08:13.254448 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:13.253902 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/02b55bf2-2972-4487-b51d-9a361a0d2b13-kubelet-config\") pod \"global-pull-secret-syncer-9dwkv\" (UID: \"02b55bf2-2972-4487-b51d-9a361a0d2b13\") " pod="kube-system/global-pull-secret-syncer-9dwkv" Sep 09 23:08:13.254904 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:13.253920 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/28a75ede-97c5-4801-b30b-96057670ce4c-var-lib-kubelet\") pod \"tuned-792r8\" (UID: \"28a75ede-97c5-4801-b30b-96057670ce4c\") " pod="openshift-cluster-node-tuning-operator/tuned-792r8" Sep 09 23:08:13.254904 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:13.253941 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/28a75ede-97c5-4801-b30b-96057670ce4c-etc-sysconfig\") pod \"tuned-792r8\" (UID: \"28a75ede-97c5-4801-b30b-96057670ce4c\") " pod="openshift-cluster-node-tuning-operator/tuned-792r8" Sep 09 23:08:13.254904 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:13.253950 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/28a75ede-97c5-4801-b30b-96057670ce4c-run\") pod \"tuned-792r8\" (UID: \"28a75ede-97c5-4801-b30b-96057670ce4c\") " pod="openshift-cluster-node-tuning-operator/tuned-792r8" Sep 09 23:08:13.254904 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:13.253957 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/505de87b-9cf1-4af8-815b-ed5f65ac6675-cnibin\") pod \"multus-additional-cni-plugins-rzmhq\" (UID: \"505de87b-9cf1-4af8-815b-ed5f65ac6675\") " pod="openshift-multus/multus-additional-cni-plugins-rzmhq" Sep 09 23:08:13.254904 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:13.253997 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/28a75ede-97c5-4801-b30b-96057670ce4c-var-lib-kubelet\") pod \"tuned-792r8\" (UID: \"28a75ede-97c5-4801-b30b-96057670ce4c\") " pod="openshift-cluster-node-tuning-operator/tuned-792r8" Sep 09 23:08:13.254904 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:13.254043 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/505de87b-9cf1-4af8-815b-ed5f65ac6675-cnibin\") pod \"multus-additional-cni-plugins-rzmhq\" (UID: \"505de87b-9cf1-4af8-815b-ed5f65ac6675\") " pod="openshift-multus/multus-additional-cni-plugins-rzmhq" Sep 09 23:08:13.254904 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:13.254045 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/a1511acb-caeb-42b1-be06-daa47d1973e3-serviceca\") pod \"node-ca-q2mnk\" (UID: \"a1511acb-caeb-42b1-be06-daa47d1973e3\") " pod="openshift-image-registry/node-ca-q2mnk" Sep 09 23:08:13.255557 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:13.255542 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/28a75ede-97c5-4801-b30b-96057670ce4c-etc-tuned\") pod \"tuned-792r8\" (UID: \"28a75ede-97c5-4801-b30b-96057670ce4c\") " pod="openshift-cluster-node-tuning-operator/tuned-792r8" Sep 09 23:08:13.255755 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:13.255737 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/28a75ede-97c5-4801-b30b-96057670ce4c-tmp\") pod \"tuned-792r8\" (UID: \"28a75ede-97c5-4801-b30b-96057670ce4c\") " pod="openshift-cluster-node-tuning-operator/tuned-792r8" Sep 09 23:08:13.261642 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:13.261612 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8r9hd\" (UniqueName: \"kubernetes.io/projected/505de87b-9cf1-4af8-815b-ed5f65ac6675-kube-api-access-8r9hd\") pod \"multus-additional-cni-plugins-rzmhq\" (UID: \"505de87b-9cf1-4af8-815b-ed5f65ac6675\") " pod="openshift-multus/multus-additional-cni-plugins-rzmhq" Sep 09 23:08:13.261869 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:13.261851 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rvl5j\" (UniqueName: \"kubernetes.io/projected/cecbf40f-1a0a-4819-b677-6d38f3e0d3af-kube-api-access-rvl5j\") pod \"node-resolver-2vcdm\" (UID: \"cecbf40f-1a0a-4819-b677-6d38f3e0d3af\") " pod="openshift-dns/node-resolver-2vcdm" Sep 09 23:08:13.261933 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:13.261857 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k2cc7\" (UniqueName: \"kubernetes.io/projected/28a75ede-97c5-4801-b30b-96057670ce4c-kube-api-access-k2cc7\") pod \"tuned-792r8\" (UID: \"28a75ede-97c5-4801-b30b-96057670ce4c\") " pod="openshift-cluster-node-tuning-operator/tuned-792r8" Sep 09 23:08:13.262014 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:13.262000 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hwrrs\" (UniqueName: \"kubernetes.io/projected/387f7aa8-f4f6-4cee-9b6b-72409b5693c5-kube-api-access-hwrrs\") pod \"iptables-alerter-lbv8f\" (UID: \"387f7aa8-f4f6-4cee-9b6b-72409b5693c5\") " pod="openshift-network-operator/iptables-alerter-lbv8f" Sep 09 23:08:13.262344 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:13.262331 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mztbt\" (UniqueName: \"kubernetes.io/projected/a1511acb-caeb-42b1-be06-daa47d1973e3-kube-api-access-mztbt\") pod \"node-ca-q2mnk\" (UID: \"a1511acb-caeb-42b1-be06-daa47d1973e3\") " pod="openshift-image-registry/node-ca-q2mnk" Sep 09 23:08:13.361546 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:13.361494 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-fnf6n" Sep 09 23:08:13.370856 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:13.370826 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda616cd8b_8bc4_4972_91bf_11f3e7ca7d44.slice/crio-dbc08ff3bd9e48225635707c750f9b9bcfa1f22b2e1d8e710bd6ff2647c29f4e WatchSource:0}: Error finding container dbc08ff3bd9e48225635707c750f9b9bcfa1f22b2e1d8e710bd6ff2647c29f4e: Status 404 returned error can't find the container with id dbc08ff3bd9e48225635707c750f9b9bcfa1f22b2e1d8e710bd6ff2647c29f4e Sep 09 23:08:13.373853 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:13.373835 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-pl5tw" Sep 09 23:08:13.381487 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:13.381467 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6942a2c5_1a59_4ea7_b78d_d131103de85f.slice/crio-7b7da981cc5d5836da1bbdc4e2190206e3bef2ab0b967023a6db1ce0f8d665b4 WatchSource:0}: Error finding container 7b7da981cc5d5836da1bbdc4e2190206e3bef2ab0b967023a6db1ce0f8d665b4: Status 404 returned error can't find the container with id 7b7da981cc5d5836da1bbdc4e2190206e3bef2ab0b967023a6db1ce0f8d665b4 Sep 09 23:08:13.390908 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:13.390893 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-szqb4" Sep 09 23:08:13.399015 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:13.398987 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1c4a374c_66ce_4af1_b989_7dfdd5b29b61.slice/crio-b01552256c0cac80d41618d36060fd8e904401bce46749dd5419d8ae130843cf WatchSource:0}: Error finding container b01552256c0cac80d41618d36060fd8e904401bce46749dd5419d8ae130843cf: Status 404 returned error can't find the container with id b01552256c0cac80d41618d36060fd8e904401bce46749dd5419d8ae130843cf Sep 09 23:08:13.407100 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:13.407085 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5ppxm" Sep 09 23:08:13.414494 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:13.414475 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda15b7bf5_58cb_458e_9d83_9cc1f9409987.slice/crio-6a6170dcf83e11b2464bffb7b14c945c5acb3e76e4b3300bb13256b62d3b71a4 WatchSource:0}: Error finding container 6a6170dcf83e11b2464bffb7b14c945c5acb3e76e4b3300bb13256b62d3b71a4: Status 404 returned error can't find the container with id 6a6170dcf83e11b2464bffb7b14c945c5acb3e76e4b3300bb13256b62d3b71a4 Sep 09 23:08:13.425419 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:13.425400 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-lbv8f" Sep 09 23:08:13.432201 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:13.432182 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-792r8" Sep 09 23:08:13.433003 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:13.432988 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod387f7aa8_f4f6_4cee_9b6b_72409b5693c5.slice/crio-93bfae2466bde475abfabfd79a603e334162ca440c6e2c3539528d04bc767701 WatchSource:0}: Error finding container 93bfae2466bde475abfabfd79a603e334162ca440c6e2c3539528d04bc767701: Status 404 returned error can't find the container with id 93bfae2466bde475abfabfd79a603e334162ca440c6e2c3539528d04bc767701 Sep 09 23:08:13.440297 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:13.440279 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod28a75ede_97c5_4801_b30b_96057670ce4c.slice/crio-165f96092b8dd89bc1da7e594eaf8de67caa281a4b3007b9344d903ef832d9cd WatchSource:0}: Error finding container 165f96092b8dd89bc1da7e594eaf8de67caa281a4b3007b9344d903ef832d9cd: Status 404 returned error can't find the container with id 165f96092b8dd89bc1da7e594eaf8de67caa281a4b3007b9344d903ef832d9cd Sep 09 23:08:13.463897 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:13.463879 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-2vcdm" Sep 09 23:08:13.471764 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:13.471742 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-q2mnk" Sep 09 23:08:13.472204 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:13.472186 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcecbf40f_1a0a_4819_b677_6d38f3e0d3af.slice/crio-74675d5184aef7102fe8b8a0144af2f9615f672217eb74d328cafb49e464ca5b WatchSource:0}: Error finding container 74675d5184aef7102fe8b8a0144af2f9615f672217eb74d328cafb49e464ca5b: Status 404 returned error can't find the container with id 74675d5184aef7102fe8b8a0144af2f9615f672217eb74d328cafb49e464ca5b Sep 09 23:08:13.476505 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:13.476485 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-rzmhq" Sep 09 23:08:13.480389 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:13.480355 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda1511acb_caeb_42b1_be06_daa47d1973e3.slice/crio-0577fc9504a28775ac3464e836af2353e5403a71db6c92a137eadbea499ecb2a WatchSource:0}: Error finding container 0577fc9504a28775ac3464e836af2353e5403a71db6c92a137eadbea499ecb2a: Status 404 returned error can't find the container with id 0577fc9504a28775ac3464e836af2353e5403a71db6c92a137eadbea499ecb2a Sep 09 23:08:13.485924 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:13.485907 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod505de87b_9cf1_4af8_815b_ed5f65ac6675.slice/crio-27daf0853f137a6df4a9dd1a27472d2736e686190d9d6919ed86c807b4d5d719 WatchSource:0}: Error finding container 27daf0853f137a6df4a9dd1a27472d2736e686190d9d6919ed86c807b4d5d719: Status 404 returned error can't find the container with id 27daf0853f137a6df4a9dd1a27472d2736e686190d9d6919ed86c807b4d5d719 Sep 09 23:08:13.657167 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:13.657130 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/77df7cc0-0e7e-468f-89d9-b055af5de0b3-metrics-certs\") pod \"network-metrics-daemon-ktqck\" (UID: \"77df7cc0-0e7e-468f-89d9-b055af5de0b3\") " pod="openshift-multus/network-metrics-daemon-ktqck" Sep 09 23:08:13.657319 ip-10-0-132-204 kubenswrapper[2561]: E0909 23:08:13.657287 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 09 23:08:13.657432 ip-10-0-132-204 kubenswrapper[2561]: E0909 23:08:13.657360 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/77df7cc0-0e7e-468f-89d9-b055af5de0b3-metrics-certs podName:77df7cc0-0e7e-468f-89d9-b055af5de0b3 nodeName:}" failed. No retries permitted until 2026-09-09 23:08:14.657339813 +0000 UTC m=+3.032913868 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/77df7cc0-0e7e-468f-89d9-b055af5de0b3-metrics-certs") pod "network-metrics-daemon-ktqck" (UID: "77df7cc0-0e7e-468f-89d9-b055af5de0b3") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 09 23:08:13.758804 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:13.757842 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/02b55bf2-2972-4487-b51d-9a361a0d2b13-original-pull-secret\") pod \"global-pull-secret-syncer-9dwkv\" (UID: \"02b55bf2-2972-4487-b51d-9a361a0d2b13\") " pod="kube-system/global-pull-secret-syncer-9dwkv" Sep 09 23:08:13.758804 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:13.757931 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xkvm6\" (UniqueName: \"kubernetes.io/projected/61cad06e-7668-4ada-82e5-a34a71bf52fb-kube-api-access-xkvm6\") pod \"network-check-target-6s7s6\" (UID: \"61cad06e-7668-4ada-82e5-a34a71bf52fb\") " pod="openshift-network-diagnostics/network-check-target-6s7s6" Sep 09 23:08:13.758804 ip-10-0-132-204 kubenswrapper[2561]: E0909 23:08:13.758142 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 09 23:08:13.758804 ip-10-0-132-204 kubenswrapper[2561]: E0909 23:08:13.758168 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 09 23:08:13.758804 ip-10-0-132-204 kubenswrapper[2561]: E0909 23:08:13.758183 2561 projected.go:196] Error preparing data for projected volume kube-api-access-xkvm6 for pod openshift-network-diagnostics/network-check-target-6s7s6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 09 23:08:13.758804 ip-10-0-132-204 kubenswrapper[2561]: E0909 23:08:13.758241 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/61cad06e-7668-4ada-82e5-a34a71bf52fb-kube-api-access-xkvm6 podName:61cad06e-7668-4ada-82e5-a34a71bf52fb nodeName:}" failed. No retries permitted until 2026-09-09 23:08:14.758219974 +0000 UTC m=+3.133794019 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-xkvm6" (UniqueName: "kubernetes.io/projected/61cad06e-7668-4ada-82e5-a34a71bf52fb-kube-api-access-xkvm6") pod "network-check-target-6s7s6" (UID: "61cad06e-7668-4ada-82e5-a34a71bf52fb") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 09 23:08:13.758804 ip-10-0-132-204 kubenswrapper[2561]: E0909 23:08:13.758656 2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 09 23:08:13.758804 ip-10-0-132-204 kubenswrapper[2561]: E0909 23:08:13.758732 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/02b55bf2-2972-4487-b51d-9a361a0d2b13-original-pull-secret podName:02b55bf2-2972-4487-b51d-9a361a0d2b13 nodeName:}" failed. No retries permitted until 2026-09-09 23:08:14.758716425 +0000 UTC m=+3.134290474 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/02b55bf2-2972-4487-b51d-9a361a0d2b13-original-pull-secret") pod "global-pull-secret-syncer-9dwkv" (UID: "02b55bf2-2972-4487-b51d-9a361a0d2b13") : object "kube-system"/"original-pull-secret" not registered Sep 09 23:08:14.084728 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:14.084524 2561 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-08 23:03:14 +0000 UTC" deadline="2028-02-23 22:24:40.835974445 +0000 UTC" Sep 09 23:08:14.084728 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:14.084585 2561 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12767h16m26.751393926s" Sep 09 23:08:14.138939 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:14.138581 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-792r8" event={"ID":"28a75ede-97c5-4801-b30b-96057670ce4c","Type":"ContainerStarted","Data":"165f96092b8dd89bc1da7e594eaf8de67caa281a4b3007b9344d903ef832d9cd"} Sep 09 23:08:14.156742 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:14.156702 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pl5tw" event={"ID":"6942a2c5-1a59-4ea7-b78d-d131103de85f","Type":"ContainerStarted","Data":"7b7da981cc5d5836da1bbdc4e2190206e3bef2ab0b967023a6db1ce0f8d665b4"} Sep 09 23:08:14.163006 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:14.162974 2561 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Sep 09 23:08:14.187002 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:14.186965 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-fnf6n" event={"ID":"a616cd8b-8bc4-4972-91bf-11f3e7ca7d44","Type":"ContainerStarted","Data":"dbc08ff3bd9e48225635707c750f9b9bcfa1f22b2e1d8e710bd6ff2647c29f4e"} Sep 09 23:08:14.204809 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:14.204771 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rzmhq" event={"ID":"505de87b-9cf1-4af8-815b-ed5f65ac6675","Type":"ContainerStarted","Data":"27daf0853f137a6df4a9dd1a27472d2736e686190d9d6919ed86c807b4d5d719"} Sep 09 23:08:14.210520 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:14.210478 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-q2mnk" event={"ID":"a1511acb-caeb-42b1-be06-daa47d1973e3","Type":"ContainerStarted","Data":"0577fc9504a28775ac3464e836af2353e5403a71db6c92a137eadbea499ecb2a"} Sep 09 23:08:14.230159 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:14.230130 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-lbv8f" event={"ID":"387f7aa8-f4f6-4cee-9b6b-72409b5693c5","Type":"ContainerStarted","Data":"93bfae2466bde475abfabfd79a603e334162ca440c6e2c3539528d04bc767701"} Sep 09 23:08:14.262674 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:14.262641 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5ppxm" event={"ID":"a15b7bf5-58cb-458e-9d83-9cc1f9409987","Type":"ContainerStarted","Data":"6a6170dcf83e11b2464bffb7b14c945c5acb3e76e4b3300bb13256b62d3b71a4"} Sep 09 23:08:14.274991 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:14.274956 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-szqb4" event={"ID":"1c4a374c-66ce-4af1-b989-7dfdd5b29b61","Type":"ContainerStarted","Data":"b01552256c0cac80d41618d36060fd8e904401bce46749dd5419d8ae130843cf"} Sep 09 23:08:14.284466 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:14.284400 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-204.ec2.internal" event={"ID":"b36829d9c7d7ab19a8579fb50eedaa1b","Type":"ContainerStarted","Data":"be0535432a83c0736f9891854f6a9edbd28da39c456786623481ecc6373cf346"} Sep 09 23:08:14.298288 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:14.298256 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-204.ec2.internal" event={"ID":"0b1737cd5cce52c5c2776007824f9803","Type":"ContainerStarted","Data":"6444548d03f3e68b303f83d8aa71414f47278a150c5f0ab525a31fb314bac72a"} Sep 09 23:08:14.311659 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:14.311631 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-2vcdm" event={"ID":"cecbf40f-1a0a-4819-b677-6d38f3e0d3af","Type":"ContainerStarted","Data":"74675d5184aef7102fe8b8a0144af2f9615f672217eb74d328cafb49e464ca5b"} Sep 09 23:08:14.381019 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:14.380929 2561 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Sep 09 23:08:14.666704 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:14.666591 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/77df7cc0-0e7e-468f-89d9-b055af5de0b3-metrics-certs\") pod \"network-metrics-daemon-ktqck\" (UID: \"77df7cc0-0e7e-468f-89d9-b055af5de0b3\") " pod="openshift-multus/network-metrics-daemon-ktqck" Sep 09 23:08:14.666904 ip-10-0-132-204 kubenswrapper[2561]: E0909 23:08:14.666886 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 09 23:08:14.666995 ip-10-0-132-204 kubenswrapper[2561]: E0909 23:08:14.666960 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/77df7cc0-0e7e-468f-89d9-b055af5de0b3-metrics-certs podName:77df7cc0-0e7e-468f-89d9-b055af5de0b3 nodeName:}" failed. No retries permitted until 2026-09-09 23:08:16.666939411 +0000 UTC m=+5.042513478 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/77df7cc0-0e7e-468f-89d9-b055af5de0b3-metrics-certs") pod "network-metrics-daemon-ktqck" (UID: "77df7cc0-0e7e-468f-89d9-b055af5de0b3") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 09 23:08:14.767699 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:14.767645 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/02b55bf2-2972-4487-b51d-9a361a0d2b13-original-pull-secret\") pod \"global-pull-secret-syncer-9dwkv\" (UID: \"02b55bf2-2972-4487-b51d-9a361a0d2b13\") " pod="kube-system/global-pull-secret-syncer-9dwkv" Sep 09 23:08:14.767885 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:14.767734 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xkvm6\" (UniqueName: \"kubernetes.io/projected/61cad06e-7668-4ada-82e5-a34a71bf52fb-kube-api-access-xkvm6\") pod \"network-check-target-6s7s6\" (UID: \"61cad06e-7668-4ada-82e5-a34a71bf52fb\") " pod="openshift-network-diagnostics/network-check-target-6s7s6" Sep 09 23:08:14.767968 ip-10-0-132-204 kubenswrapper[2561]: E0909 23:08:14.767917 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 09 23:08:14.767968 ip-10-0-132-204 kubenswrapper[2561]: E0909 23:08:14.767937 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 09 23:08:14.767968 ip-10-0-132-204 kubenswrapper[2561]: E0909 23:08:14.767951 2561 projected.go:196] Error preparing data for projected volume kube-api-access-xkvm6 for pod openshift-network-diagnostics/network-check-target-6s7s6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 09 23:08:14.768127 ip-10-0-132-204 kubenswrapper[2561]: E0909 23:08:14.768011 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/61cad06e-7668-4ada-82e5-a34a71bf52fb-kube-api-access-xkvm6 podName:61cad06e-7668-4ada-82e5-a34a71bf52fb nodeName:}" failed. No retries permitted until 2026-09-09 23:08:16.76799181 +0000 UTC m=+5.143565852 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-xkvm6" (UniqueName: "kubernetes.io/projected/61cad06e-7668-4ada-82e5-a34a71bf52fb-kube-api-access-xkvm6") pod "network-check-target-6s7s6" (UID: "61cad06e-7668-4ada-82e5-a34a71bf52fb") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 09 23:08:14.768467 ip-10-0-132-204 kubenswrapper[2561]: E0909 23:08:14.768425 2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 09 23:08:14.768553 ip-10-0-132-204 kubenswrapper[2561]: E0909 23:08:14.768497 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/02b55bf2-2972-4487-b51d-9a361a0d2b13-original-pull-secret podName:02b55bf2-2972-4487-b51d-9a361a0d2b13 nodeName:}" failed. No retries permitted until 2026-09-09 23:08:16.76848098 +0000 UTC m=+5.144055028 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/02b55bf2-2972-4487-b51d-9a361a0d2b13-original-pull-secret") pod "global-pull-secret-syncer-9dwkv" (UID: "02b55bf2-2972-4487-b51d-9a361a0d2b13") : object "kube-system"/"original-pull-secret" not registered Sep 09 23:08:15.085069 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:15.084971 2561 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-08 23:03:14 +0000 UTC" deadline="2028-06-19 03:14:11.37526583 +0000 UTC" Sep 09 23:08:15.085069 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:15.085017 2561 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15556h5m56.290253618s" Sep 09 23:08:15.112090 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:15.111552 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6s7s6" Sep 09 23:08:15.112090 ip-10-0-132-204 kubenswrapper[2561]: E0909 23:08:15.111684 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6s7s6" podUID="61cad06e-7668-4ada-82e5-a34a71bf52fb" Sep 09 23:08:15.112331 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:15.112109 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ktqck" Sep 09 23:08:15.112331 ip-10-0-132-204 kubenswrapper[2561]: E0909 23:08:15.112200 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ktqck" podUID="77df7cc0-0e7e-468f-89d9-b055af5de0b3" Sep 09 23:08:15.112331 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:15.112276 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9dwkv" Sep 09 23:08:15.112530 ip-10-0-132-204 kubenswrapper[2561]: E0909 23:08:15.112350 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9dwkv" podUID="02b55bf2-2972-4487-b51d-9a361a0d2b13" Sep 09 23:08:16.687471 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:16.687425 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/77df7cc0-0e7e-468f-89d9-b055af5de0b3-metrics-certs\") pod \"network-metrics-daemon-ktqck\" (UID: \"77df7cc0-0e7e-468f-89d9-b055af5de0b3\") " pod="openshift-multus/network-metrics-daemon-ktqck" Sep 09 23:08:16.688165 ip-10-0-132-204 kubenswrapper[2561]: E0909 23:08:16.687631 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 09 23:08:16.688165 ip-10-0-132-204 kubenswrapper[2561]: E0909 23:08:16.687692 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/77df7cc0-0e7e-468f-89d9-b055af5de0b3-metrics-certs podName:77df7cc0-0e7e-468f-89d9-b055af5de0b3 nodeName:}" failed. No retries permitted until 2026-09-09 23:08:20.687673506 +0000 UTC m=+9.063247547 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/77df7cc0-0e7e-468f-89d9-b055af5de0b3-metrics-certs") pod "network-metrics-daemon-ktqck" (UID: "77df7cc0-0e7e-468f-89d9-b055af5de0b3") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 09 23:08:16.788697 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:16.788640 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xkvm6\" (UniqueName: \"kubernetes.io/projected/61cad06e-7668-4ada-82e5-a34a71bf52fb-kube-api-access-xkvm6\") pod \"network-check-target-6s7s6\" (UID: \"61cad06e-7668-4ada-82e5-a34a71bf52fb\") " pod="openshift-network-diagnostics/network-check-target-6s7s6" Sep 09 23:08:16.788885 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:16.788729 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/02b55bf2-2972-4487-b51d-9a361a0d2b13-original-pull-secret\") pod \"global-pull-secret-syncer-9dwkv\" (UID: \"02b55bf2-2972-4487-b51d-9a361a0d2b13\") " pod="kube-system/global-pull-secret-syncer-9dwkv" Sep 09 23:08:16.788885 ip-10-0-132-204 kubenswrapper[2561]: E0909 23:08:16.788858 2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 09 23:08:16.788997 ip-10-0-132-204 kubenswrapper[2561]: E0909 23:08:16.788920 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/02b55bf2-2972-4487-b51d-9a361a0d2b13-original-pull-secret podName:02b55bf2-2972-4487-b51d-9a361a0d2b13 nodeName:}" failed. No retries permitted until 2026-09-09 23:08:20.788901592 +0000 UTC m=+9.164475649 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/02b55bf2-2972-4487-b51d-9a361a0d2b13-original-pull-secret") pod "global-pull-secret-syncer-9dwkv" (UID: "02b55bf2-2972-4487-b51d-9a361a0d2b13") : object "kube-system"/"original-pull-secret" not registered Sep 09 23:08:16.789474 ip-10-0-132-204 kubenswrapper[2561]: E0909 23:08:16.789394 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 09 23:08:16.789474 ip-10-0-132-204 kubenswrapper[2561]: E0909 23:08:16.789418 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 09 23:08:16.789474 ip-10-0-132-204 kubenswrapper[2561]: E0909 23:08:16.789432 2561 projected.go:196] Error preparing data for projected volume kube-api-access-xkvm6 for pod openshift-network-diagnostics/network-check-target-6s7s6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 09 23:08:16.789731 ip-10-0-132-204 kubenswrapper[2561]: E0909 23:08:16.789501 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/61cad06e-7668-4ada-82e5-a34a71bf52fb-kube-api-access-xkvm6 podName:61cad06e-7668-4ada-82e5-a34a71bf52fb nodeName:}" failed. No retries permitted until 2026-09-09 23:08:20.789484854 +0000 UTC m=+9.165058910 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-xkvm6" (UniqueName: "kubernetes.io/projected/61cad06e-7668-4ada-82e5-a34a71bf52fb-kube-api-access-xkvm6") pod "network-check-target-6s7s6" (UID: "61cad06e-7668-4ada-82e5-a34a71bf52fb") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 09 23:08:17.111717 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:17.111627 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6s7s6" Sep 09 23:08:17.111717 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:17.111696 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ktqck" Sep 09 23:08:17.111926 ip-10-0-132-204 kubenswrapper[2561]: E0909 23:08:17.111820 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ktqck" podUID="77df7cc0-0e7e-468f-89d9-b055af5de0b3" Sep 09 23:08:17.112222 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:17.112204 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9dwkv" Sep 09 23:08:17.112320 ip-10-0-132-204 kubenswrapper[2561]: E0909 23:08:17.112302 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9dwkv" podUID="02b55bf2-2972-4487-b51d-9a361a0d2b13" Sep 09 23:08:17.112411 ip-10-0-132-204 kubenswrapper[2561]: E0909 23:08:17.112392 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6s7s6" podUID="61cad06e-7668-4ada-82e5-a34a71bf52fb" Sep 09 23:08:19.110852 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:19.110813 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6s7s6" Sep 09 23:08:19.111316 ip-10-0-132-204 kubenswrapper[2561]: E0909 23:08:19.110980 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6s7s6" podUID="61cad06e-7668-4ada-82e5-a34a71bf52fb" Sep 09 23:08:19.111570 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:19.111506 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ktqck" Sep 09 23:08:19.111770 ip-10-0-132-204 kubenswrapper[2561]: E0909 23:08:19.111695 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ktqck" podUID="77df7cc0-0e7e-468f-89d9-b055af5de0b3" Sep 09 23:08:19.111770 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:19.111769 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9dwkv" Sep 09 23:08:19.112036 ip-10-0-132-204 kubenswrapper[2561]: E0909 23:08:19.111898 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9dwkv" podUID="02b55bf2-2972-4487-b51d-9a361a0d2b13" Sep 09 23:08:20.725787 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:20.725193 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/77df7cc0-0e7e-468f-89d9-b055af5de0b3-metrics-certs\") pod \"network-metrics-daemon-ktqck\" (UID: \"77df7cc0-0e7e-468f-89d9-b055af5de0b3\") " pod="openshift-multus/network-metrics-daemon-ktqck" Sep 09 23:08:20.725787 ip-10-0-132-204 kubenswrapper[2561]: E0909 23:08:20.725363 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 09 23:08:20.725787 ip-10-0-132-204 kubenswrapper[2561]: E0909 23:08:20.725448 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/77df7cc0-0e7e-468f-89d9-b055af5de0b3-metrics-certs podName:77df7cc0-0e7e-468f-89d9-b055af5de0b3 nodeName:}" failed. No retries permitted until 2026-09-09 23:08:28.725431973 +0000 UTC m=+17.101006032 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/77df7cc0-0e7e-468f-89d9-b055af5de0b3-metrics-certs") pod "network-metrics-daemon-ktqck" (UID: "77df7cc0-0e7e-468f-89d9-b055af5de0b3") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 09 23:08:20.825653 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:20.825607 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xkvm6\" (UniqueName: \"kubernetes.io/projected/61cad06e-7668-4ada-82e5-a34a71bf52fb-kube-api-access-xkvm6\") pod \"network-check-target-6s7s6\" (UID: \"61cad06e-7668-4ada-82e5-a34a71bf52fb\") " pod="openshift-network-diagnostics/network-check-target-6s7s6" Sep 09 23:08:20.825831 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:20.825702 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/02b55bf2-2972-4487-b51d-9a361a0d2b13-original-pull-secret\") pod \"global-pull-secret-syncer-9dwkv\" (UID: \"02b55bf2-2972-4487-b51d-9a361a0d2b13\") " pod="kube-system/global-pull-secret-syncer-9dwkv" Sep 09 23:08:20.825914 ip-10-0-132-204 kubenswrapper[2561]: E0909 23:08:20.825839 2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 09 23:08:20.825914 ip-10-0-132-204 kubenswrapper[2561]: E0909 23:08:20.825904 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/02b55bf2-2972-4487-b51d-9a361a0d2b13-original-pull-secret podName:02b55bf2-2972-4487-b51d-9a361a0d2b13 nodeName:}" failed. No retries permitted until 2026-09-09 23:08:28.825884616 +0000 UTC m=+17.201458661 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/02b55bf2-2972-4487-b51d-9a361a0d2b13-original-pull-secret") pod "global-pull-secret-syncer-9dwkv" (UID: "02b55bf2-2972-4487-b51d-9a361a0d2b13") : object "kube-system"/"original-pull-secret" not registered Sep 09 23:08:20.826386 ip-10-0-132-204 kubenswrapper[2561]: E0909 23:08:20.826362 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 09 23:08:20.826386 ip-10-0-132-204 kubenswrapper[2561]: E0909 23:08:20.826390 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 09 23:08:20.826588 ip-10-0-132-204 kubenswrapper[2561]: E0909 23:08:20.826404 2561 projected.go:196] Error preparing data for projected volume kube-api-access-xkvm6 for pod openshift-network-diagnostics/network-check-target-6s7s6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 09 23:08:20.826588 ip-10-0-132-204 kubenswrapper[2561]: E0909 23:08:20.826470 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/61cad06e-7668-4ada-82e5-a34a71bf52fb-kube-api-access-xkvm6 podName:61cad06e-7668-4ada-82e5-a34a71bf52fb nodeName:}" failed. No retries permitted until 2026-09-09 23:08:28.826435944 +0000 UTC m=+17.202010006 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-xkvm6" (UniqueName: "kubernetes.io/projected/61cad06e-7668-4ada-82e5-a34a71bf52fb-kube-api-access-xkvm6") pod "network-check-target-6s7s6" (UID: "61cad06e-7668-4ada-82e5-a34a71bf52fb") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 09 23:08:21.111026 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:21.110930 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9dwkv" Sep 09 23:08:21.111203 ip-10-0-132-204 kubenswrapper[2561]: E0909 23:08:21.111075 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9dwkv" podUID="02b55bf2-2972-4487-b51d-9a361a0d2b13" Sep 09 23:08:21.111514 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:21.111489 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6s7s6" Sep 09 23:08:21.111636 ip-10-0-132-204 kubenswrapper[2561]: E0909 23:08:21.111599 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6s7s6" podUID="61cad06e-7668-4ada-82e5-a34a71bf52fb" Sep 09 23:08:21.111707 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:21.111655 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ktqck" Sep 09 23:08:21.111766 ip-10-0-132-204 kubenswrapper[2561]: E0909 23:08:21.111745 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ktqck" podUID="77df7cc0-0e7e-468f-89d9-b055af5de0b3" Sep 09 23:08:23.110703 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:23.110665 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9dwkv" Sep 09 23:08:23.110703 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:23.110693 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6s7s6" Sep 09 23:08:23.111235 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:23.110665 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ktqck" Sep 09 23:08:23.111235 ip-10-0-132-204 kubenswrapper[2561]: E0909 23:08:23.110802 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9dwkv" podUID="02b55bf2-2972-4487-b51d-9a361a0d2b13" Sep 09 23:08:23.111235 ip-10-0-132-204 kubenswrapper[2561]: E0909 23:08:23.110940 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ktqck" podUID="77df7cc0-0e7e-468f-89d9-b055af5de0b3" Sep 09 23:08:23.111235 ip-10-0-132-204 kubenswrapper[2561]: E0909 23:08:23.111034 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6s7s6" podUID="61cad06e-7668-4ada-82e5-a34a71bf52fb" Sep 09 23:08:25.110636 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:25.110605 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9dwkv" Sep 09 23:08:25.110993 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:25.110716 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6s7s6" Sep 09 23:08:25.110993 ip-10-0-132-204 kubenswrapper[2561]: E0909 23:08:25.110719 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9dwkv" podUID="02b55bf2-2972-4487-b51d-9a361a0d2b13" Sep 09 23:08:25.110993 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:25.110732 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ktqck" Sep 09 23:08:25.110993 ip-10-0-132-204 kubenswrapper[2561]: E0909 23:08:25.110809 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6s7s6" podUID="61cad06e-7668-4ada-82e5-a34a71bf52fb" Sep 09 23:08:25.110993 ip-10-0-132-204 kubenswrapper[2561]: E0909 23:08:25.110889 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ktqck" podUID="77df7cc0-0e7e-468f-89d9-b055af5de0b3" Sep 09 23:08:27.110793 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:27.110759 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9dwkv" Sep 09 23:08:27.110793 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:27.110791 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ktqck" Sep 09 23:08:27.111246 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:27.110775 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6s7s6" Sep 09 23:08:27.111246 ip-10-0-132-204 kubenswrapper[2561]: E0909 23:08:27.110891 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9dwkv" podUID="02b55bf2-2972-4487-b51d-9a361a0d2b13" Sep 09 23:08:27.111246 ip-10-0-132-204 kubenswrapper[2561]: E0909 23:08:27.110977 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6s7s6" podUID="61cad06e-7668-4ada-82e5-a34a71bf52fb" Sep 09 23:08:27.111246 ip-10-0-132-204 kubenswrapper[2561]: E0909 23:08:27.111082 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ktqck" podUID="77df7cc0-0e7e-468f-89d9-b055af5de0b3" Sep 09 23:08:28.789626 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:28.789579 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/77df7cc0-0e7e-468f-89d9-b055af5de0b3-metrics-certs\") pod \"network-metrics-daemon-ktqck\" (UID: \"77df7cc0-0e7e-468f-89d9-b055af5de0b3\") " pod="openshift-multus/network-metrics-daemon-ktqck" Sep 09 23:08:28.790054 ip-10-0-132-204 kubenswrapper[2561]: E0909 23:08:28.789756 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 09 23:08:28.790054 ip-10-0-132-204 kubenswrapper[2561]: E0909 23:08:28.789831 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/77df7cc0-0e7e-468f-89d9-b055af5de0b3-metrics-certs podName:77df7cc0-0e7e-468f-89d9-b055af5de0b3 nodeName:}" failed. No retries permitted until 2026-09-09 23:08:44.789813673 +0000 UTC m=+33.165387713 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/77df7cc0-0e7e-468f-89d9-b055af5de0b3-metrics-certs") pod "network-metrics-daemon-ktqck" (UID: "77df7cc0-0e7e-468f-89d9-b055af5de0b3") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 09 23:08:28.891000 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:28.890960 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/02b55bf2-2972-4487-b51d-9a361a0d2b13-original-pull-secret\") pod \"global-pull-secret-syncer-9dwkv\" (UID: \"02b55bf2-2972-4487-b51d-9a361a0d2b13\") " pod="kube-system/global-pull-secret-syncer-9dwkv" Sep 09 23:08:28.891161 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:28.891024 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xkvm6\" (UniqueName: \"kubernetes.io/projected/61cad06e-7668-4ada-82e5-a34a71bf52fb-kube-api-access-xkvm6\") pod \"network-check-target-6s7s6\" (UID: \"61cad06e-7668-4ada-82e5-a34a71bf52fb\") " pod="openshift-network-diagnostics/network-check-target-6s7s6" Sep 09 23:08:28.891161 ip-10-0-132-204 kubenswrapper[2561]: E0909 23:08:28.891110 2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 09 23:08:28.891161 ip-10-0-132-204 kubenswrapper[2561]: E0909 23:08:28.891124 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 09 23:08:28.891161 ip-10-0-132-204 kubenswrapper[2561]: E0909 23:08:28.891139 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 09 23:08:28.891161 ip-10-0-132-204 kubenswrapper[2561]: E0909 23:08:28.891151 2561 projected.go:196] Error preparing data for projected volume kube-api-access-xkvm6 for pod openshift-network-diagnostics/network-check-target-6s7s6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 09 23:08:28.891438 ip-10-0-132-204 kubenswrapper[2561]: E0909 23:08:28.891176 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/02b55bf2-2972-4487-b51d-9a361a0d2b13-original-pull-secret podName:02b55bf2-2972-4487-b51d-9a361a0d2b13 nodeName:}" failed. No retries permitted until 2026-09-09 23:08:44.891159332 +0000 UTC m=+33.266733372 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/02b55bf2-2972-4487-b51d-9a361a0d2b13-original-pull-secret") pod "global-pull-secret-syncer-9dwkv" (UID: "02b55bf2-2972-4487-b51d-9a361a0d2b13") : object "kube-system"/"original-pull-secret" not registered Sep 09 23:08:28.891438 ip-10-0-132-204 kubenswrapper[2561]: E0909 23:08:28.891193 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/61cad06e-7668-4ada-82e5-a34a71bf52fb-kube-api-access-xkvm6 podName:61cad06e-7668-4ada-82e5-a34a71bf52fb nodeName:}" failed. No retries permitted until 2026-09-09 23:08:44.891183416 +0000 UTC m=+33.266757457 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-xkvm6" (UniqueName: "kubernetes.io/projected/61cad06e-7668-4ada-82e5-a34a71bf52fb-kube-api-access-xkvm6") pod "network-check-target-6s7s6" (UID: "61cad06e-7668-4ada-82e5-a34a71bf52fb") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 09 23:08:29.110556 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:29.110473 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9dwkv" Sep 09 23:08:29.110556 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:29.110501 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ktqck" Sep 09 23:08:29.110556 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:29.110492 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6s7s6" Sep 09 23:08:29.110799 ip-10-0-132-204 kubenswrapper[2561]: E0909 23:08:29.110605 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ktqck" podUID="77df7cc0-0e7e-468f-89d9-b055af5de0b3" Sep 09 23:08:29.110799 ip-10-0-132-204 kubenswrapper[2561]: E0909 23:08:29.110680 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6s7s6" podUID="61cad06e-7668-4ada-82e5-a34a71bf52fb" Sep 09 23:08:29.110799 ip-10-0-132-204 kubenswrapper[2561]: E0909 23:08:29.110773 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9dwkv" podUID="02b55bf2-2972-4487-b51d-9a361a0d2b13" Sep 09 23:08:31.110682 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:31.110647 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9dwkv" Sep 09 23:08:31.111153 ip-10-0-132-204 kubenswrapper[2561]: E0909 23:08:31.110770 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9dwkv" podUID="02b55bf2-2972-4487-b51d-9a361a0d2b13" Sep 09 23:08:31.111153 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:31.110783 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6s7s6" Sep 09 23:08:31.111153 ip-10-0-132-204 kubenswrapper[2561]: E0909 23:08:31.110877 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6s7s6" podUID="61cad06e-7668-4ada-82e5-a34a71bf52fb" Sep 09 23:08:31.111153 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:31.110785 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ktqck" Sep 09 23:08:31.111153 ip-10-0-132-204 kubenswrapper[2561]: E0909 23:08:31.110973 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ktqck" podUID="77df7cc0-0e7e-468f-89d9-b055af5de0b3" Sep 09 23:08:33.110838 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:33.110795 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6s7s6" Sep 09 23:08:33.111459 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:33.110795 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ktqck" Sep 09 23:08:33.111459 ip-10-0-132-204 kubenswrapper[2561]: E0909 23:08:33.110936 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6s7s6" podUID="61cad06e-7668-4ada-82e5-a34a71bf52fb" Sep 09 23:08:33.111459 ip-10-0-132-204 kubenswrapper[2561]: E0909 23:08:33.111043 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ktqck" podUID="77df7cc0-0e7e-468f-89d9-b055af5de0b3" Sep 09 23:08:33.111459 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:33.110801 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9dwkv" Sep 09 23:08:33.111459 ip-10-0-132-204 kubenswrapper[2561]: E0909 23:08:33.111124 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9dwkv" podUID="02b55bf2-2972-4487-b51d-9a361a0d2b13" Sep 09 23:08:34.375335 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:34.375061 2561 generic.go:356] "Generic (PLEG): container finished" podID="505de87b-9cf1-4af8-815b-ed5f65ac6675" containerID="cfd3e8d8836bbcb76b9c34f91b30148f2c16fb80a2098042ceb67e5bd3887d7e" exitCode=0 Sep 09 23:08:34.375822 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:34.375108 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rzmhq" event={"ID":"505de87b-9cf1-4af8-815b-ed5f65ac6675","Type":"ContainerDied","Data":"cfd3e8d8836bbcb76b9c34f91b30148f2c16fb80a2098042ceb67e5bd3887d7e"} Sep 09 23:08:34.377018 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:34.376984 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-q2mnk" event={"ID":"a1511acb-caeb-42b1-be06-daa47d1973e3","Type":"ContainerStarted","Data":"2053acc7d554d4ad6f987b22beac7721edff7f4b235beb5f59de9ad2fa7605c1"} Sep 09 23:08:34.378692 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:34.378671 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5ppxm" event={"ID":"a15b7bf5-58cb-458e-9d83-9cc1f9409987","Type":"ContainerStarted","Data":"87c33b96eec00a0112cce18dfefefd47a9d6485c60c044bd93aa99ebe771cf5d"} Sep 09 23:08:34.380134 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:34.380111 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-szqb4" event={"ID":"1c4a374c-66ce-4af1-b989-7dfdd5b29b61","Type":"ContainerStarted","Data":"c9e4ff65a6343ee573c9baa5f91883bb19f3567257a8ab49a999631cae041931"} Sep 09 23:08:34.381648 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:34.381627 2561 generic.go:356] "Generic (PLEG): container finished" podID="b36829d9c7d7ab19a8579fb50eedaa1b" containerID="8e13b02f598d51afb12e032bf01ba8d3daeb0a53a64152da15545db0ac08ffba" exitCode=0 Sep 09 23:08:34.381726 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:34.381700 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-204.ec2.internal" event={"ID":"b36829d9c7d7ab19a8579fb50eedaa1b","Type":"ContainerDied","Data":"8e13b02f598d51afb12e032bf01ba8d3daeb0a53a64152da15545db0ac08ffba"} Sep 09 23:08:34.383249 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:34.383229 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-204.ec2.internal" event={"ID":"0b1737cd5cce52c5c2776007824f9803","Type":"ContainerStarted","Data":"2a6575d997054258acfafb5eab3e24ee12fc55bf344cf5e883fb9a7c6979ef9d"} Sep 09 23:08:34.384695 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:34.384676 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-2vcdm" event={"ID":"cecbf40f-1a0a-4819-b677-6d38f3e0d3af","Type":"ContainerStarted","Data":"899b7bbba2f5ff3d78f53454e05ccc2c7b330eadb7383499e845b44484c95826"} Sep 09 23:08:34.386174 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:34.386154 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-792r8" event={"ID":"28a75ede-97c5-4801-b30b-96057670ce4c","Type":"ContainerStarted","Data":"828d080e8daf520bd7ffb45dec1030215e1900c66ed34874e83c5ad5e9736403"} Sep 09 23:08:34.388555 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:34.388510 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pl5tw_6942a2c5-1a59-4ea7-b78d-d131103de85f/ovn-acl-logging/0.log" Sep 09 23:08:34.388927 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:34.388911 2561 generic.go:356] "Generic (PLEG): container finished" podID="6942a2c5-1a59-4ea7-b78d-d131103de85f" containerID="4e14dde4f4f11f1d2787d02def6bf4eb5a00dd5afdc9bb3acf888fe2d561f4a2" exitCode=1 Sep 09 23:08:34.388999 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:34.388972 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pl5tw" event={"ID":"6942a2c5-1a59-4ea7-b78d-d131103de85f","Type":"ContainerStarted","Data":"0428c9980a7b1a8f74616071f95fcaa09d055f7c0698501839c606f9179b3894"} Sep 09 23:08:34.389038 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:34.389024 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pl5tw" event={"ID":"6942a2c5-1a59-4ea7-b78d-d131103de85f","Type":"ContainerStarted","Data":"da4fc0746ed55b5aa702735da076c90b3413f8d3173c4ad0168ed6e4beebf9cf"} Sep 09 23:08:34.389088 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:34.389065 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pl5tw" event={"ID":"6942a2c5-1a59-4ea7-b78d-d131103de85f","Type":"ContainerStarted","Data":"3edaca821e2719458179e3b6ba193510f2006d804467969cd7b0b71f1b17380a"} Sep 09 23:08:34.389123 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:34.389098 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pl5tw" event={"ID":"6942a2c5-1a59-4ea7-b78d-d131103de85f","Type":"ContainerDied","Data":"4e14dde4f4f11f1d2787d02def6bf4eb5a00dd5afdc9bb3acf888fe2d561f4a2"} Sep 09 23:08:34.389176 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:34.389153 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pl5tw" event={"ID":"6942a2c5-1a59-4ea7-b78d-d131103de85f","Type":"ContainerStarted","Data":"80fd88d4425914e1c00cb985d9b88b4b7dec5ec48666fc592f7c39baee85ddce"} Sep 09 23:08:34.390200 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:34.390184 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-fnf6n" event={"ID":"a616cd8b-8bc4-4972-91bf-11f3e7ca7d44","Type":"ContainerStarted","Data":"b69ee7f5639a673f9f6d9779fd9c821f3f09ff8eaf6d78f3a9de8085b5c67bc9"} Sep 09 23:08:34.409105 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:34.409068 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-204.ec2.internal" podStartSLOduration=20.409056235 podStartE2EDuration="20.409056235s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 23:08:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:08:34.408556579 +0000 UTC m=+22.784130640" watchObservedRunningTime="2026-09-09 23:08:34.409056235 +0000 UTC m=+22.784630296" Sep 09 23:08:34.425656 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:34.425622 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-792r8" podStartSLOduration=1.272419824 podStartE2EDuration="21.425607237s" totalImagesPullingTime="20.153187413s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 23:08:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:08:34.425529377 +0000 UTC m=+22.801103451" watchObservedRunningTime="2026-09-09 23:08:34.425607237 +0000 UTC m=+22.801181302" Sep 09 23:08:34.441993 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:34.441951 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-2vcdm" podStartSLOduration=1.320740207 podStartE2EDuration="21.441937506s" totalImagesPullingTime="20.121197299s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 23:08:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:08:34.441298236 +0000 UTC m=+22.816872298" watchObservedRunningTime="2026-09-09 23:08:34.441937506 +0000 UTC m=+22.817511568" Sep 09 23:08:34.455015 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:34.454964 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-q2mnk" podStartSLOduration=1.280398843 podStartE2EDuration="21.454947089s" totalImagesPullingTime="20.174548246s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 23:08:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:08:34.454794634 +0000 UTC m=+22.830368698" watchObservedRunningTime="2026-09-09 23:08:34.454947089 +0000 UTC m=+22.830521154" Sep 09 23:08:34.499859 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:34.499820 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-fnf6n" podStartSLOduration=0.894625235 podStartE2EDuration="21.499805398s" totalImagesPullingTime="20.605180163s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 23:08:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:08:34.485059588 +0000 UTC m=+22.860633651" watchObservedRunningTime="2026-09-09 23:08:34.499805398 +0000 UTC m=+22.875379460" Sep 09 23:08:34.500050 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:34.500032 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-szqb4" podStartSLOduration=1.275843187 podStartE2EDuration="21.500027125s" totalImagesPullingTime="20.224183938s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:08:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:08:34.499518409 +0000 UTC m=+22.875092470" watchObservedRunningTime="2026-09-09 23:08:34.500027125 +0000 UTC m=+22.875601187" Sep 09 23:08:35.111242 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:35.111220 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9dwkv" Sep 09 23:08:35.111325 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:35.111249 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6s7s6" Sep 09 23:08:35.111325 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:35.111310 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ktqck" Sep 09 23:08:35.111325 ip-10-0-132-204 kubenswrapper[2561]: E0909 23:08:35.111318 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9dwkv" podUID="02b55bf2-2972-4487-b51d-9a361a0d2b13" Sep 09 23:08:35.111441 ip-10-0-132-204 kubenswrapper[2561]: E0909 23:08:35.111390 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6s7s6" podUID="61cad06e-7668-4ada-82e5-a34a71bf52fb" Sep 09 23:08:35.111475 ip-10-0-132-204 kubenswrapper[2561]: E0909 23:08:35.111448 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ktqck" podUID="77df7cc0-0e7e-468f-89d9-b055af5de0b3" Sep 09 23:08:35.396215 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:35.395876 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pl5tw_6942a2c5-1a59-4ea7-b78d-d131103de85f/ovn-acl-logging/0.log" Sep 09 23:08:35.396839 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:35.396806 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pl5tw" event={"ID":"6942a2c5-1a59-4ea7-b78d-d131103de85f","Type":"ContainerStarted","Data":"d1c013f0e80580e342c58953bd8ac4438c009c229607e3e20c73a0bbffcb8de0"} Sep 09 23:08:35.399016 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:35.398990 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-lbv8f" event={"ID":"387f7aa8-f4f6-4cee-9b6b-72409b5693c5","Type":"ContainerStarted","Data":"d37ddbc4852530e07a070b140857f477ea2f16361dec9ab223b0771a33f9c916"} Sep 09 23:08:35.402468 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:35.402441 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-204.ec2.internal" event={"ID":"b36829d9c7d7ab19a8579fb50eedaa1b","Type":"ContainerStarted","Data":"0f828574b83ee6f6a77f3f292133c0b0a41c25182ce3601e8e92187e998957a1"} Sep 09 23:08:35.414148 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:35.414092 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-lbv8f" podStartSLOduration=2.167690143 podStartE2EDuration="22.414073533s" totalImagesPullingTime="20.24638339s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 23:08:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:08:35.41378541 +0000 UTC m=+23.789359480" watchObservedRunningTime="2026-09-09 23:08:35.414073533 +0000 UTC m=+23.789647596" Sep 09 23:08:35.427747 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:35.427709 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-204.ec2.internal" podStartSLOduration=21.427695294 podStartE2EDuration="21.427695294s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 23:08:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:08:35.427326837 +0000 UTC m=+23.802900902" watchObservedRunningTime="2026-09-09 23:08:35.427695294 +0000 UTC m=+23.803269355" Sep 09 23:08:35.474144 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:35.474112 2561 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Sep 09 23:08:36.131290 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:36.131040 2561 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-09T23:08:35.474128259Z","UUID":"0faf9ecc-6205-403a-9466-349a8647c075","Handler":null,"Name":"","Endpoint":""} Sep 09 23:08:36.132924 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:36.132899 2561 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Sep 09 23:08:36.132924 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:36.132937 2561 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Sep 09 23:08:36.407400 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:36.407262 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5ppxm" event={"ID":"a15b7bf5-58cb-458e-9d83-9cc1f9409987","Type":"ContainerStarted","Data":"725de22417fd88fdd43720bc295da76d44d7f2946c865bd825dd5fe1e5d249d8"} Sep 09 23:08:36.477707 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:36.477673 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-szqb4" Sep 09 23:08:36.478225 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:36.478203 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-szqb4" Sep 09 23:08:37.111495 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:37.111473 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ktqck" Sep 09 23:08:37.111495 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:37.111482 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6s7s6" Sep 09 23:08:37.111652 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:37.111482 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9dwkv" Sep 09 23:08:37.111652 ip-10-0-132-204 kubenswrapper[2561]: E0909 23:08:37.111566 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ktqck" podUID="77df7cc0-0e7e-468f-89d9-b055af5de0b3" Sep 09 23:08:37.111747 ip-10-0-132-204 kubenswrapper[2561]: E0909 23:08:37.111652 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6s7s6" podUID="61cad06e-7668-4ada-82e5-a34a71bf52fb" Sep 09 23:08:37.111747 ip-10-0-132-204 kubenswrapper[2561]: E0909 23:08:37.111731 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9dwkv" podUID="02b55bf2-2972-4487-b51d-9a361a0d2b13" Sep 09 23:08:37.411164 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:37.411090 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5ppxm" event={"ID":"a15b7bf5-58cb-458e-9d83-9cc1f9409987","Type":"ContainerStarted","Data":"ff43768de1b01b158707c5bb3c5348ff609f4d3e468e4c261e15c1e6203f0ddc"} Sep 09 23:08:37.414118 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:37.414096 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pl5tw_6942a2c5-1a59-4ea7-b78d-d131103de85f/ovn-acl-logging/0.log" Sep 09 23:08:37.414518 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:37.414497 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pl5tw" event={"ID":"6942a2c5-1a59-4ea7-b78d-d131103de85f","Type":"ContainerStarted","Data":"2fe6239437b60e48ce5eec6bbb776e06f0f2f5370a0d5b70bd98ccd15eedeb18"} Sep 09 23:08:38.405623 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:38.405581 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-szqb4" Sep 09 23:08:38.406327 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:38.406190 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-szqb4" Sep 09 23:08:38.420267 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:38.420225 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5ppxm" podStartSLOduration=2.472933656 podStartE2EDuration="25.420211318s" totalImagesPullingTime="22.947277662s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 23:08:13 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:08:37.427714864 +0000 UTC m=+25.803288925" watchObservedRunningTime="2026-09-09 23:08:38.420211318 +0000 UTC m=+26.795785379" Sep 09 23:08:39.110980 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:39.110761 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9dwkv" Sep 09 23:08:39.110980 ip-10-0-132-204 kubenswrapper[2561]: E0909 23:08:39.110958 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9dwkv" podUID="02b55bf2-2972-4487-b51d-9a361a0d2b13" Sep 09 23:08:39.111428 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:39.111060 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ktqck" Sep 09 23:08:39.111428 ip-10-0-132-204 kubenswrapper[2561]: E0909 23:08:39.111237 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ktqck" podUID="77df7cc0-0e7e-468f-89d9-b055af5de0b3" Sep 09 23:08:39.111428 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:39.111285 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6s7s6" Sep 09 23:08:39.111952 ip-10-0-132-204 kubenswrapper[2561]: E0909 23:08:39.111560 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6s7s6" podUID="61cad06e-7668-4ada-82e5-a34a71bf52fb" Sep 09 23:08:39.422084 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:39.421931 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pl5tw_6942a2c5-1a59-4ea7-b78d-d131103de85f/ovn-acl-logging/0.log" Sep 09 23:08:39.422523 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:39.422500 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pl5tw" event={"ID":"6942a2c5-1a59-4ea7-b78d-d131103de85f","Type":"ContainerStarted","Data":"ab3dfaeaab6640db778f2601295c101c7649ca28bad6251121430d2b4ce2a375"} Sep 09 23:08:39.422777 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:39.422754 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-pl5tw" Sep 09 23:08:39.422904 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:39.422845 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-pl5tw" Sep 09 23:08:39.422963 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:39.422944 2561 scope.go:117] "RemoveContainer" containerID="4e14dde4f4f11f1d2787d02def6bf4eb5a00dd5afdc9bb3acf888fe2d561f4a2" Sep 09 23:08:39.424591 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:39.424563 2561 generic.go:356] "Generic (PLEG): container finished" podID="505de87b-9cf1-4af8-815b-ed5f65ac6675" containerID="27f0de1878aeb3f741c5bbd5fc5d5e49e1f50a0a6ea253786bfbd1a4124ab072" exitCode=0 Sep 09 23:08:39.424676 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:39.424656 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rzmhq" event={"ID":"505de87b-9cf1-4af8-815b-ed5f65ac6675","Type":"ContainerDied","Data":"27f0de1878aeb3f741c5bbd5fc5d5e49e1f50a0a6ea253786bfbd1a4124ab072"} Sep 09 23:08:39.439581 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:39.439563 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-pl5tw" Sep 09 23:08:40.434751 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:40.434674 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pl5tw_6942a2c5-1a59-4ea7-b78d-d131103de85f/ovn-acl-logging/0.log" Sep 09 23:08:40.435282 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:40.435102 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pl5tw" event={"ID":"6942a2c5-1a59-4ea7-b78d-d131103de85f","Type":"ContainerStarted","Data":"c6c68e06133e6cf381cf6e28646900975680d48bbea2914c9e4f4bcb9b82c0c6"} Sep 09 23:08:40.435343 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:40.435308 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-pl5tw" Sep 09 23:08:40.437410 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:40.437384 2561 generic.go:356] "Generic (PLEG): container finished" podID="505de87b-9cf1-4af8-815b-ed5f65ac6675" containerID="65d11975a48ba1bf82f1d467e9bf626df73cdeca492bed4901ab44096aa88920" exitCode=0 Sep 09 23:08:40.437523 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:40.437432 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rzmhq" event={"ID":"505de87b-9cf1-4af8-815b-ed5f65ac6675","Type":"ContainerDied","Data":"65d11975a48ba1bf82f1d467e9bf626df73cdeca492bed4901ab44096aa88920"} Sep 09 23:08:40.451899 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:40.451875 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-pl5tw" Sep 09 23:08:40.462818 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:40.462777 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-pl5tw" podStartSLOduration=7.154249753 podStartE2EDuration="27.462762932s" totalImagesPullingTime="20.308513179s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 23:08:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:08:40.462588266 +0000 UTC m=+28.838162328" watchObservedRunningTime="2026-09-09 23:08:40.462762932 +0000 UTC m=+28.838336993" Sep 09 23:08:40.944939 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:40.944899 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-9dwkv"] Sep 09 23:08:40.945101 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:40.945003 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9dwkv" Sep 09 23:08:40.945101 ip-10-0-132-204 kubenswrapper[2561]: E0909 23:08:40.945079 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9dwkv" podUID="02b55bf2-2972-4487-b51d-9a361a0d2b13" Sep 09 23:08:40.950025 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:40.950003 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-6s7s6"] Sep 09 23:08:40.950160 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:40.950098 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6s7s6" Sep 09 23:08:40.950224 ip-10-0-132-204 kubenswrapper[2561]: E0909 23:08:40.950182 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6s7s6" podUID="61cad06e-7668-4ada-82e5-a34a71bf52fb" Sep 09 23:08:40.950601 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:40.950581 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-ktqck"] Sep 09 23:08:40.950683 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:40.950672 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ktqck" Sep 09 23:08:40.950781 ip-10-0-132-204 kubenswrapper[2561]: E0909 23:08:40.950763 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ktqck" podUID="77df7cc0-0e7e-468f-89d9-b055af5de0b3" Sep 09 23:08:41.442423 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:41.442392 2561 generic.go:356] "Generic (PLEG): container finished" podID="505de87b-9cf1-4af8-815b-ed5f65ac6675" containerID="d9715a790b332b9871a990dba2a550ec8c79992a0831026a6d6a5ec1f078cee7" exitCode=0 Sep 09 23:08:41.443010 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:41.442464 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rzmhq" event={"ID":"505de87b-9cf1-4af8-815b-ed5f65ac6675","Type":"ContainerDied","Data":"d9715a790b332b9871a990dba2a550ec8c79992a0831026a6d6a5ec1f078cee7"} Sep 09 23:08:42.114638 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:42.114608 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6s7s6" Sep 09 23:08:42.114779 ip-10-0-132-204 kubenswrapper[2561]: E0909 23:08:42.114717 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6s7s6" podUID="61cad06e-7668-4ada-82e5-a34a71bf52fb" Sep 09 23:08:43.111354 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:43.111151 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9dwkv" Sep 09 23:08:43.111727 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:43.111212 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ktqck" Sep 09 23:08:43.111727 ip-10-0-132-204 kubenswrapper[2561]: E0909 23:08:43.111477 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9dwkv" podUID="02b55bf2-2972-4487-b51d-9a361a0d2b13" Sep 09 23:08:43.111727 ip-10-0-132-204 kubenswrapper[2561]: E0909 23:08:43.111537 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ktqck" podUID="77df7cc0-0e7e-468f-89d9-b055af5de0b3" Sep 09 23:08:44.110636 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:44.110606 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6s7s6" Sep 09 23:08:44.110833 ip-10-0-132-204 kubenswrapper[2561]: E0909 23:08:44.110716 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6s7s6" podUID="61cad06e-7668-4ada-82e5-a34a71bf52fb" Sep 09 23:08:44.805011 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:44.804980 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/77df7cc0-0e7e-468f-89d9-b055af5de0b3-metrics-certs\") pod \"network-metrics-daemon-ktqck\" (UID: \"77df7cc0-0e7e-468f-89d9-b055af5de0b3\") " pod="openshift-multus/network-metrics-daemon-ktqck" Sep 09 23:08:44.805411 ip-10-0-132-204 kubenswrapper[2561]: E0909 23:08:44.805111 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 09 23:08:44.805411 ip-10-0-132-204 kubenswrapper[2561]: E0909 23:08:44.805182 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/77df7cc0-0e7e-468f-89d9-b055af5de0b3-metrics-certs podName:77df7cc0-0e7e-468f-89d9-b055af5de0b3 nodeName:}" failed. No retries permitted until 2026-09-09 23:09:16.805161084 +0000 UTC m=+65.180735147 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/77df7cc0-0e7e-468f-89d9-b055af5de0b3-metrics-certs") pod "network-metrics-daemon-ktqck" (UID: "77df7cc0-0e7e-468f-89d9-b055af5de0b3") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 09 23:08:44.905539 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:44.905508 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/02b55bf2-2972-4487-b51d-9a361a0d2b13-original-pull-secret\") pod \"global-pull-secret-syncer-9dwkv\" (UID: \"02b55bf2-2972-4487-b51d-9a361a0d2b13\") " pod="kube-system/global-pull-secret-syncer-9dwkv" Sep 09 23:08:44.905689 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:44.905576 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xkvm6\" (UniqueName: \"kubernetes.io/projected/61cad06e-7668-4ada-82e5-a34a71bf52fb-kube-api-access-xkvm6\") pod \"network-check-target-6s7s6\" (UID: \"61cad06e-7668-4ada-82e5-a34a71bf52fb\") " pod="openshift-network-diagnostics/network-check-target-6s7s6" Sep 09 23:08:44.905689 ip-10-0-132-204 kubenswrapper[2561]: E0909 23:08:44.905675 2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 09 23:08:44.905689 ip-10-0-132-204 kubenswrapper[2561]: E0909 23:08:44.905687 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 09 23:08:44.905818 ip-10-0-132-204 kubenswrapper[2561]: E0909 23:08:44.905705 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 09 23:08:44.905818 ip-10-0-132-204 kubenswrapper[2561]: E0909 23:08:44.905719 2561 projected.go:196] Error preparing data for projected volume kube-api-access-xkvm6 for pod openshift-network-diagnostics/network-check-target-6s7s6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 09 23:08:44.905818 ip-10-0-132-204 kubenswrapper[2561]: E0909 23:08:44.905758 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/02b55bf2-2972-4487-b51d-9a361a0d2b13-original-pull-secret podName:02b55bf2-2972-4487-b51d-9a361a0d2b13 nodeName:}" failed. No retries permitted until 2026-09-09 23:09:16.905738049 +0000 UTC m=+65.281312103 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/02b55bf2-2972-4487-b51d-9a361a0d2b13-original-pull-secret") pod "global-pull-secret-syncer-9dwkv" (UID: "02b55bf2-2972-4487-b51d-9a361a0d2b13") : object "kube-system"/"original-pull-secret" not registered Sep 09 23:08:44.905818 ip-10-0-132-204 kubenswrapper[2561]: E0909 23:08:44.905773 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/61cad06e-7668-4ada-82e5-a34a71bf52fb-kube-api-access-xkvm6 podName:61cad06e-7668-4ada-82e5-a34a71bf52fb nodeName:}" failed. No retries permitted until 2026-09-09 23:09:16.90576675 +0000 UTC m=+65.281340790 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-xkvm6" (UniqueName: "kubernetes.io/projected/61cad06e-7668-4ada-82e5-a34a71bf52fb-kube-api-access-xkvm6") pod "network-check-target-6s7s6" (UID: "61cad06e-7668-4ada-82e5-a34a71bf52fb") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 09 23:08:45.111216 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:45.111135 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9dwkv" Sep 09 23:08:45.111392 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:45.111138 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ktqck" Sep 09 23:08:45.111392 ip-10-0-132-204 kubenswrapper[2561]: E0909 23:08:45.111270 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9dwkv" podUID="02b55bf2-2972-4487-b51d-9a361a0d2b13" Sep 09 23:08:45.111392 ip-10-0-132-204 kubenswrapper[2561]: E0909 23:08:45.111325 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ktqck" podUID="77df7cc0-0e7e-468f-89d9-b055af5de0b3" Sep 09 23:08:46.111302 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:46.111268 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6s7s6" Sep 09 23:08:46.111696 ip-10-0-132-204 kubenswrapper[2561]: E0909 23:08:46.111409 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6s7s6" podUID="61cad06e-7668-4ada-82e5-a34a71bf52fb" Sep 09 23:08:46.457192 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:46.457164 2561 generic.go:356] "Generic (PLEG): container finished" podID="505de87b-9cf1-4af8-815b-ed5f65ac6675" containerID="6a7dc39d4b17958e780c4a393fa305af1d560485bb154ff5a3568fbf82290ee3" exitCode=0 Sep 09 23:08:46.457302 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:46.457209 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rzmhq" event={"ID":"505de87b-9cf1-4af8-815b-ed5f65ac6675","Type":"ContainerDied","Data":"6a7dc39d4b17958e780c4a393fa305af1d560485bb154ff5a3568fbf82290ee3"} Sep 09 23:08:46.907923 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:46.907897 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-204.ec2.internal" event="NodeReady" Sep 09 23:08:46.908125 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:46.908037 2561 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Sep 09 23:08:46.962066 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:46.962038 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-cvlgc"] Sep 09 23:08:46.976922 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:46.976895 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-v2twq"] Sep 09 23:08:46.977050 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:46.977022 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-cvlgc" Sep 09 23:08:46.980182 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:46.980152 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Sep 09 23:08:46.980421 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:46.980404 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-249ln\"" Sep 09 23:08:46.980421 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:46.980429 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Sep 09 23:08:46.990813 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:46.990795 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-cvlgc"] Sep 09 23:08:46.990891 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:46.990824 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-v2twq"] Sep 09 23:08:46.990891 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:46.990882 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-v2twq" Sep 09 23:08:46.993650 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:46.993631 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Sep 09 23:08:46.993895 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:46.993875 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Sep 09 23:08:46.994007 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:46.993876 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Sep 09 23:08:46.994007 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:46.993878 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-4h26n\"" Sep 09 23:08:47.111234 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:47.111207 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9dwkv" Sep 09 23:08:47.111346 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:47.111307 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ktqck" Sep 09 23:08:47.113969 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:47.113953 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Sep 09 23:08:47.114055 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:47.113971 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Sep 09 23:08:47.114055 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:47.113971 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-hgrbx\"" Sep 09 23:08:47.123042 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:47.123021 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/0da6e759-847b-4f85-b775-a82a83eb8ae2-config-volume\") pod \"dns-default-cvlgc\" (UID: \"0da6e759-847b-4f85-b775-a82a83eb8ae2\") " pod="openshift-dns/dns-default-cvlgc" Sep 09 23:08:47.123120 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:47.123054 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0da6e759-847b-4f85-b775-a82a83eb8ae2-metrics-tls\") pod \"dns-default-cvlgc\" (UID: \"0da6e759-847b-4f85-b775-a82a83eb8ae2\") " pod="openshift-dns/dns-default-cvlgc" Sep 09 23:08:47.123120 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:47.123071 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6lxxm\" (UniqueName: \"kubernetes.io/projected/0da6e759-847b-4f85-b775-a82a83eb8ae2-kube-api-access-6lxxm\") pod \"dns-default-cvlgc\" (UID: \"0da6e759-847b-4f85-b775-a82a83eb8ae2\") " pod="openshift-dns/dns-default-cvlgc" Sep 09 23:08:47.123205 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:47.123136 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lhf8m\" (UniqueName: \"kubernetes.io/projected/117461f6-118c-4ca7-b116-9d3aff2dfdb6-kube-api-access-lhf8m\") pod \"ingress-canary-v2twq\" (UID: \"117461f6-118c-4ca7-b116-9d3aff2dfdb6\") " pod="openshift-ingress-canary/ingress-canary-v2twq" Sep 09 23:08:47.123205 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:47.123186 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/117461f6-118c-4ca7-b116-9d3aff2dfdb6-cert\") pod \"ingress-canary-v2twq\" (UID: \"117461f6-118c-4ca7-b116-9d3aff2dfdb6\") " pod="openshift-ingress-canary/ingress-canary-v2twq" Sep 09 23:08:47.123269 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:47.123239 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0da6e759-847b-4f85-b775-a82a83eb8ae2-tmp-dir\") pod \"dns-default-cvlgc\" (UID: \"0da6e759-847b-4f85-b775-a82a83eb8ae2\") " pod="openshift-dns/dns-default-cvlgc" Sep 09 23:08:47.223958 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:47.223895 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/117461f6-118c-4ca7-b116-9d3aff2dfdb6-cert\") pod \"ingress-canary-v2twq\" (UID: \"117461f6-118c-4ca7-b116-9d3aff2dfdb6\") " pod="openshift-ingress-canary/ingress-canary-v2twq" Sep 09 23:08:47.223958 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:47.223936 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0da6e759-847b-4f85-b775-a82a83eb8ae2-tmp-dir\") pod \"dns-default-cvlgc\" (UID: \"0da6e759-847b-4f85-b775-a82a83eb8ae2\") " pod="openshift-dns/dns-default-cvlgc" Sep 09 23:08:47.224112 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:47.223976 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/0da6e759-847b-4f85-b775-a82a83eb8ae2-config-volume\") pod \"dns-default-cvlgc\" (UID: \"0da6e759-847b-4f85-b775-a82a83eb8ae2\") " pod="openshift-dns/dns-default-cvlgc" Sep 09 23:08:47.224112 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:47.223996 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0da6e759-847b-4f85-b775-a82a83eb8ae2-metrics-tls\") pod \"dns-default-cvlgc\" (UID: \"0da6e759-847b-4f85-b775-a82a83eb8ae2\") " pod="openshift-dns/dns-default-cvlgc" Sep 09 23:08:47.224112 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:47.224021 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6lxxm\" (UniqueName: \"kubernetes.io/projected/0da6e759-847b-4f85-b775-a82a83eb8ae2-kube-api-access-6lxxm\") pod \"dns-default-cvlgc\" (UID: \"0da6e759-847b-4f85-b775-a82a83eb8ae2\") " pod="openshift-dns/dns-default-cvlgc" Sep 09 23:08:47.224112 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:47.224048 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lhf8m\" (UniqueName: \"kubernetes.io/projected/117461f6-118c-4ca7-b116-9d3aff2dfdb6-kube-api-access-lhf8m\") pod \"ingress-canary-v2twq\" (UID: \"117461f6-118c-4ca7-b116-9d3aff2dfdb6\") " pod="openshift-ingress-canary/ingress-canary-v2twq" Sep 09 23:08:47.224293 ip-10-0-132-204 kubenswrapper[2561]: E0909 23:08:47.224179 2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 09 23:08:47.224293 ip-10-0-132-204 kubenswrapper[2561]: E0909 23:08:47.224242 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0da6e759-847b-4f85-b775-a82a83eb8ae2-metrics-tls podName:0da6e759-847b-4f85-b775-a82a83eb8ae2 nodeName:}" failed. No retries permitted until 2026-09-09 23:08:47.724222544 +0000 UTC m=+36.099796605 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0da6e759-847b-4f85-b775-a82a83eb8ae2-metrics-tls") pod "dns-default-cvlgc" (UID: "0da6e759-847b-4f85-b775-a82a83eb8ae2") : secret "dns-default-metrics-tls" not found Sep 09 23:08:47.224415 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:47.224304 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0da6e759-847b-4f85-b775-a82a83eb8ae2-tmp-dir\") pod \"dns-default-cvlgc\" (UID: \"0da6e759-847b-4f85-b775-a82a83eb8ae2\") " pod="openshift-dns/dns-default-cvlgc" Sep 09 23:08:47.224595 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:47.224578 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/0da6e759-847b-4f85-b775-a82a83eb8ae2-config-volume\") pod \"dns-default-cvlgc\" (UID: \"0da6e759-847b-4f85-b775-a82a83eb8ae2\") " pod="openshift-dns/dns-default-cvlgc" Sep 09 23:08:47.228143 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:47.228120 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/117461f6-118c-4ca7-b116-9d3aff2dfdb6-cert\") pod \"ingress-canary-v2twq\" (UID: \"117461f6-118c-4ca7-b116-9d3aff2dfdb6\") " pod="openshift-ingress-canary/ingress-canary-v2twq" Sep 09 23:08:47.233542 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:47.233523 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lhf8m\" (UniqueName: \"kubernetes.io/projected/117461f6-118c-4ca7-b116-9d3aff2dfdb6-kube-api-access-lhf8m\") pod \"ingress-canary-v2twq\" (UID: \"117461f6-118c-4ca7-b116-9d3aff2dfdb6\") " pod="openshift-ingress-canary/ingress-canary-v2twq" Sep 09 23:08:47.233776 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:47.233760 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6lxxm\" (UniqueName: \"kubernetes.io/projected/0da6e759-847b-4f85-b775-a82a83eb8ae2-kube-api-access-6lxxm\") pod \"dns-default-cvlgc\" (UID: \"0da6e759-847b-4f85-b775-a82a83eb8ae2\") " pod="openshift-dns/dns-default-cvlgc" Sep 09 23:08:47.298957 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:47.298930 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-v2twq" Sep 09 23:08:47.465508 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:47.465282 2561 generic.go:356] "Generic (PLEG): container finished" podID="505de87b-9cf1-4af8-815b-ed5f65ac6675" containerID="b2517137721a592422006cc62f8d685be8f1cf864128729e60ca0c1fe34e8d87" exitCode=0 Sep 09 23:08:47.465673 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:47.465358 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rzmhq" event={"ID":"505de87b-9cf1-4af8-815b-ed5f65ac6675","Type":"ContainerDied","Data":"b2517137721a592422006cc62f8d685be8f1cf864128729e60ca0c1fe34e8d87"} Sep 09 23:08:47.620083 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:47.620059 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-v2twq"] Sep 09 23:08:47.623195 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:08:47.623171 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod117461f6_118c_4ca7_b116_9d3aff2dfdb6.slice/crio-42a03f751cd8425ab7343b6ee25d8ef904a5f227d749a1313352de245485baf2 WatchSource:0}: Error finding container 42a03f751cd8425ab7343b6ee25d8ef904a5f227d749a1313352de245485baf2: Status 404 returned error can't find the container with id 42a03f751cd8425ab7343b6ee25d8ef904a5f227d749a1313352de245485baf2 Sep 09 23:08:47.728470 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:47.728442 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0da6e759-847b-4f85-b775-a82a83eb8ae2-metrics-tls\") pod \"dns-default-cvlgc\" (UID: \"0da6e759-847b-4f85-b775-a82a83eb8ae2\") " pod="openshift-dns/dns-default-cvlgc" Sep 09 23:08:47.728628 ip-10-0-132-204 kubenswrapper[2561]: E0909 23:08:47.728558 2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 09 23:08:47.728628 ip-10-0-132-204 kubenswrapper[2561]: E0909 23:08:47.728618 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0da6e759-847b-4f85-b775-a82a83eb8ae2-metrics-tls podName:0da6e759-847b-4f85-b775-a82a83eb8ae2 nodeName:}" failed. No retries permitted until 2026-09-09 23:08:48.728599957 +0000 UTC m=+37.104174005 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0da6e759-847b-4f85-b775-a82a83eb8ae2-metrics-tls") pod "dns-default-cvlgc" (UID: "0da6e759-847b-4f85-b775-a82a83eb8ae2") : secret "dns-default-metrics-tls" not found Sep 09 23:08:48.110776 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:48.110742 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6s7s6" Sep 09 23:08:48.113832 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:48.113805 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Sep 09 23:08:48.114428 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:48.113818 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-26qq8\"" Sep 09 23:08:48.114428 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:48.113870 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Sep 09 23:08:48.469186 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:48.469107 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-v2twq" event={"ID":"117461f6-118c-4ca7-b116-9d3aff2dfdb6","Type":"ContainerStarted","Data":"42a03f751cd8425ab7343b6ee25d8ef904a5f227d749a1313352de245485baf2"} Sep 09 23:08:48.472870 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:48.472842 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rzmhq" event={"ID":"505de87b-9cf1-4af8-815b-ed5f65ac6675","Type":"ContainerStarted","Data":"d120ff31e752e9dd7e0bbae076cd8d4540cce4d7be40926da695247ac4f24dba"} Sep 09 23:08:48.735225 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:48.735192 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0da6e759-847b-4f85-b775-a82a83eb8ae2-metrics-tls\") pod \"dns-default-cvlgc\" (UID: \"0da6e759-847b-4f85-b775-a82a83eb8ae2\") " pod="openshift-dns/dns-default-cvlgc" Sep 09 23:08:48.735400 ip-10-0-132-204 kubenswrapper[2561]: E0909 23:08:48.735385 2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 09 23:08:48.735476 ip-10-0-132-204 kubenswrapper[2561]: E0909 23:08:48.735464 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0da6e759-847b-4f85-b775-a82a83eb8ae2-metrics-tls podName:0da6e759-847b-4f85-b775-a82a83eb8ae2 nodeName:}" failed. No retries permitted until 2026-09-09 23:08:50.735442596 +0000 UTC m=+39.111016640 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0da6e759-847b-4f85-b775-a82a83eb8ae2-metrics-tls") pod "dns-default-cvlgc" (UID: "0da6e759-847b-4f85-b775-a82a83eb8ae2") : secret "dns-default-metrics-tls" not found Sep 09 23:08:50.480021 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:50.479983 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-v2twq" event={"ID":"117461f6-118c-4ca7-b116-9d3aff2dfdb6","Type":"ContainerStarted","Data":"462e9ce5dde63fab7230b16359b493a131c23e97210b4130af16387ee0e952c9"} Sep 09 23:08:50.496115 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:50.496067 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-rzmhq" podStartSLOduration=6.425652171 podStartE2EDuration="37.496051182s" totalImagesPullingTime="31.070399011s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 23:08:13 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:08:48.503459611 +0000 UTC m=+36.879033699" watchObservedRunningTime="2026-09-09 23:08:50.496051182 +0000 UTC m=+38.871625246" Sep 09 23:08:50.496219 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:50.496174 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-v2twq" podStartSLOduration=2.201812769 podStartE2EDuration="4.49616871s" totalImagesPullingTime="2.294355941s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:08:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:08:50.495583547 +0000 UTC m=+38.871157609" watchObservedRunningTime="2026-09-09 23:08:50.49616871 +0000 UTC m=+38.871742772" Sep 09 23:08:50.749425 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:50.749394 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0da6e759-847b-4f85-b775-a82a83eb8ae2-metrics-tls\") pod \"dns-default-cvlgc\" (UID: \"0da6e759-847b-4f85-b775-a82a83eb8ae2\") " pod="openshift-dns/dns-default-cvlgc" Sep 09 23:08:50.749555 ip-10-0-132-204 kubenswrapper[2561]: E0909 23:08:50.749504 2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 09 23:08:50.749607 ip-10-0-132-204 kubenswrapper[2561]: E0909 23:08:50.749557 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0da6e759-847b-4f85-b775-a82a83eb8ae2-metrics-tls podName:0da6e759-847b-4f85-b775-a82a83eb8ae2 nodeName:}" failed. No retries permitted until 2026-09-09 23:08:54.74954328 +0000 UTC m=+43.125117320 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0da6e759-847b-4f85-b775-a82a83eb8ae2-metrics-tls") pod "dns-default-cvlgc" (UID: "0da6e759-847b-4f85-b775-a82a83eb8ae2") : secret "dns-default-metrics-tls" not found Sep 09 23:08:54.776513 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:08:54.776467 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0da6e759-847b-4f85-b775-a82a83eb8ae2-metrics-tls\") pod \"dns-default-cvlgc\" (UID: \"0da6e759-847b-4f85-b775-a82a83eb8ae2\") " pod="openshift-dns/dns-default-cvlgc" Sep 09 23:08:54.776956 ip-10-0-132-204 kubenswrapper[2561]: E0909 23:08:54.776612 2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 09 23:08:54.776956 ip-10-0-132-204 kubenswrapper[2561]: E0909 23:08:54.776694 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0da6e759-847b-4f85-b775-a82a83eb8ae2-metrics-tls podName:0da6e759-847b-4f85-b775-a82a83eb8ae2 nodeName:}" failed. No retries permitted until 2026-09-09 23:09:02.77667589 +0000 UTC m=+51.152249938 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0da6e759-847b-4f85-b775-a82a83eb8ae2-metrics-tls") pod "dns-default-cvlgc" (UID: "0da6e759-847b-4f85-b775-a82a83eb8ae2") : secret "dns-default-metrics-tls" not found Sep 09 23:09:02.829821 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:09:02.829778 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0da6e759-847b-4f85-b775-a82a83eb8ae2-metrics-tls\") pod \"dns-default-cvlgc\" (UID: \"0da6e759-847b-4f85-b775-a82a83eb8ae2\") " pod="openshift-dns/dns-default-cvlgc" Sep 09 23:09:02.830234 ip-10-0-132-204 kubenswrapper[2561]: E0909 23:09:02.829902 2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 09 23:09:02.830234 ip-10-0-132-204 kubenswrapper[2561]: E0909 23:09:02.829965 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0da6e759-847b-4f85-b775-a82a83eb8ae2-metrics-tls podName:0da6e759-847b-4f85-b775-a82a83eb8ae2 nodeName:}" failed. No retries permitted until 2026-09-09 23:09:18.829951022 +0000 UTC m=+67.205525062 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0da6e759-847b-4f85-b775-a82a83eb8ae2-metrics-tls") pod "dns-default-cvlgc" (UID: "0da6e759-847b-4f85-b775-a82a83eb8ae2") : secret "dns-default-metrics-tls" not found Sep 09 23:09:12.455746 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:09:12.455715 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-pl5tw" Sep 09 23:09:16.830420 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:09:16.830348 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/77df7cc0-0e7e-468f-89d9-b055af5de0b3-metrics-certs\") pod \"network-metrics-daemon-ktqck\" (UID: \"77df7cc0-0e7e-468f-89d9-b055af5de0b3\") " pod="openshift-multus/network-metrics-daemon-ktqck" Sep 09 23:09:16.833215 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:09:16.833198 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Sep 09 23:09:16.841374 ip-10-0-132-204 kubenswrapper[2561]: E0909 23:09:16.841349 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Sep 09 23:09:16.841448 ip-10-0-132-204 kubenswrapper[2561]: E0909 23:09:16.841438 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/77df7cc0-0e7e-468f-89d9-b055af5de0b3-metrics-certs podName:77df7cc0-0e7e-468f-89d9-b055af5de0b3 nodeName:}" failed. No retries permitted until 2026-09-09 23:10:20.841422494 +0000 UTC m=+129.216996534 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/77df7cc0-0e7e-468f-89d9-b055af5de0b3-metrics-certs") pod "network-metrics-daemon-ktqck" (UID: "77df7cc0-0e7e-468f-89d9-b055af5de0b3") : secret "metrics-daemon-secret" not found Sep 09 23:09:16.930771 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:09:16.930743 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/02b55bf2-2972-4487-b51d-9a361a0d2b13-original-pull-secret\") pod \"global-pull-secret-syncer-9dwkv\" (UID: \"02b55bf2-2972-4487-b51d-9a361a0d2b13\") " pod="kube-system/global-pull-secret-syncer-9dwkv" Sep 09 23:09:16.930885 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:09:16.930795 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xkvm6\" (UniqueName: \"kubernetes.io/projected/61cad06e-7668-4ada-82e5-a34a71bf52fb-kube-api-access-xkvm6\") pod \"network-check-target-6s7s6\" (UID: \"61cad06e-7668-4ada-82e5-a34a71bf52fb\") " pod="openshift-network-diagnostics/network-check-target-6s7s6" Sep 09 23:09:16.933607 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:09:16.933589 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Sep 09 23:09:16.933797 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:09:16.933780 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Sep 09 23:09:16.943951 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:09:16.943925 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Sep 09 23:09:16.944798 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:09:16.944769 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/02b55bf2-2972-4487-b51d-9a361a0d2b13-original-pull-secret\") pod \"global-pull-secret-syncer-9dwkv\" (UID: \"02b55bf2-2972-4487-b51d-9a361a0d2b13\") " pod="kube-system/global-pull-secret-syncer-9dwkv" Sep 09 23:09:16.954354 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:09:16.954328 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xkvm6\" (UniqueName: \"kubernetes.io/projected/61cad06e-7668-4ada-82e5-a34a71bf52fb-kube-api-access-xkvm6\") pod \"network-check-target-6s7s6\" (UID: \"61cad06e-7668-4ada-82e5-a34a71bf52fb\") " pod="openshift-network-diagnostics/network-check-target-6s7s6" Sep 09 23:09:17.120013 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:09:17.119939 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9dwkv" Sep 09 23:09:17.224383 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:09:17.224346 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-26qq8\"" Sep 09 23:09:17.232643 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:09:17.232622 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6s7s6" Sep 09 23:09:17.415425 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:09:17.415323 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-9dwkv"] Sep 09 23:09:17.418793 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:09:17.418771 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod02b55bf2_2972_4487_b51d_9a361a0d2b13.slice/crio-7c0d5ba3cdf86e05918152c9c0284ac16df17cf051622a626bd180accb92baa4 WatchSource:0}: Error finding container 7c0d5ba3cdf86e05918152c9c0284ac16df17cf051622a626bd180accb92baa4: Status 404 returned error can't find the container with id 7c0d5ba3cdf86e05918152c9c0284ac16df17cf051622a626bd180accb92baa4 Sep 09 23:09:17.517316 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:09:17.517284 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-6s7s6"] Sep 09 23:09:17.520893 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:09:17.520870 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod61cad06e_7668_4ada_82e5_a34a71bf52fb.slice/crio-2864e0d5b20017e48a9356972b28337d3b935628b162253ff15349d23d2f54d9 WatchSource:0}: Error finding container 2864e0d5b20017e48a9356972b28337d3b935628b162253ff15349d23d2f54d9: Status 404 returned error can't find the container with id 2864e0d5b20017e48a9356972b28337d3b935628b162253ff15349d23d2f54d9 Sep 09 23:09:17.540754 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:09:17.540724 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-6s7s6" event={"ID":"61cad06e-7668-4ada-82e5-a34a71bf52fb","Type":"ContainerStarted","Data":"2864e0d5b20017e48a9356972b28337d3b935628b162253ff15349d23d2f54d9"} Sep 09 23:09:17.541823 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:09:17.541802 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-9dwkv" event={"ID":"02b55bf2-2972-4487-b51d-9a361a0d2b13","Type":"ContainerStarted","Data":"7c0d5ba3cdf86e05918152c9c0284ac16df17cf051622a626bd180accb92baa4"} Sep 09 23:09:18.842104 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:09:18.842056 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0da6e759-847b-4f85-b775-a82a83eb8ae2-metrics-tls\") pod \"dns-default-cvlgc\" (UID: \"0da6e759-847b-4f85-b775-a82a83eb8ae2\") " pod="openshift-dns/dns-default-cvlgc" Sep 09 23:09:18.842507 ip-10-0-132-204 kubenswrapper[2561]: E0909 23:09:18.842241 2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 09 23:09:18.842507 ip-10-0-132-204 kubenswrapper[2561]: E0909 23:09:18.842323 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0da6e759-847b-4f85-b775-a82a83eb8ae2-metrics-tls podName:0da6e759-847b-4f85-b775-a82a83eb8ae2 nodeName:}" failed. No retries permitted until 2026-09-09 23:09:50.842301932 +0000 UTC m=+99.217875978 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0da6e759-847b-4f85-b775-a82a83eb8ae2-metrics-tls") pod "dns-default-cvlgc" (UID: "0da6e759-847b-4f85-b775-a82a83eb8ae2") : secret "dns-default-metrics-tls" not found Sep 09 23:09:22.556708 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:09:22.556674 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-6s7s6" event={"ID":"61cad06e-7668-4ada-82e5-a34a71bf52fb","Type":"ContainerStarted","Data":"f81e0f86a2e0d1ab4e3bd87a9817451dad3c5addb052b9c588fc2b0fcd44a117"} Sep 09 23:09:22.557147 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:09:22.556792 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-6s7s6" Sep 09 23:09:22.558216 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:09:22.558196 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-9dwkv" event={"ID":"02b55bf2-2972-4487-b51d-9a361a0d2b13","Type":"ContainerStarted","Data":"28ed91fc61e299a3ee956ac891702eb3a84617ea55c11eb912745ff4f57a8133"} Sep 09 23:09:22.584641 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:09:22.584595 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-9dwkv" podStartSLOduration=65.044060368 podStartE2EDuration="1m9.584581999s" totalImagesPullingTime="4.540521631s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 23:08:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:09:22.583701616 +0000 UTC m=+70.959275678" watchObservedRunningTime="2026-09-09 23:09:22.584581999 +0000 UTC m=+70.960156060" Sep 09 23:09:22.584764 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:09:22.584742 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-6s7s6" podStartSLOduration=65.150920413 podStartE2EDuration="1m9.584736933s" totalImagesPullingTime="4.43381652s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:08:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:09:22.570890259 +0000 UTC m=+70.946464320" watchObservedRunningTime="2026-09-09 23:09:22.584736933 +0000 UTC m=+70.960310995" Sep 09 23:09:50.859255 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:09:50.859171 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0da6e759-847b-4f85-b775-a82a83eb8ae2-metrics-tls\") pod \"dns-default-cvlgc\" (UID: \"0da6e759-847b-4f85-b775-a82a83eb8ae2\") " pod="openshift-dns/dns-default-cvlgc" Sep 09 23:09:50.859695 ip-10-0-132-204 kubenswrapper[2561]: E0909 23:09:50.859288 2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 09 23:09:50.859695 ip-10-0-132-204 kubenswrapper[2561]: E0909 23:09:50.859345 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0da6e759-847b-4f85-b775-a82a83eb8ae2-metrics-tls podName:0da6e759-847b-4f85-b775-a82a83eb8ae2 nodeName:}" failed. No retries permitted until 2026-09-09 23:10:54.859329786 +0000 UTC m=+163.234903827 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0da6e759-847b-4f85-b775-a82a83eb8ae2-metrics-tls") pod "dns-default-cvlgc" (UID: "0da6e759-847b-4f85-b775-a82a83eb8ae2") : secret "dns-default-metrics-tls" not found Sep 09 23:09:53.562913 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:09:53.562882 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-6s7s6" Sep 09 23:10:20.869573 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:10:20.869532 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/77df7cc0-0e7e-468f-89d9-b055af5de0b3-metrics-certs\") pod \"network-metrics-daemon-ktqck\" (UID: \"77df7cc0-0e7e-468f-89d9-b055af5de0b3\") " pod="openshift-multus/network-metrics-daemon-ktqck" Sep 09 23:10:20.870124 ip-10-0-132-204 kubenswrapper[2561]: E0909 23:10:20.869684 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Sep 09 23:10:20.870124 ip-10-0-132-204 kubenswrapper[2561]: E0909 23:10:20.869764 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/77df7cc0-0e7e-468f-89d9-b055af5de0b3-metrics-certs podName:77df7cc0-0e7e-468f-89d9-b055af5de0b3 nodeName:}" failed. No retries permitted until 2026-09-09 23:12:22.869743037 +0000 UTC m=+251.245317097 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/77df7cc0-0e7e-468f-89d9-b055af5de0b3-metrics-certs") pod "network-metrics-daemon-ktqck" (UID: "77df7cc0-0e7e-468f-89d9-b055af5de0b3") : secret "metrics-daemon-secret" not found Sep 09 23:10:49.987951 ip-10-0-132-204 kubenswrapper[2561]: E0909 23:10:49.987908 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-cvlgc" podUID="0da6e759-847b-4f85-b775-a82a83eb8ae2" Sep 09 23:10:50.124640 ip-10-0-132-204 kubenswrapper[2561]: E0909 23:10:50.124607 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-ktqck" podUID="77df7cc0-0e7e-468f-89d9-b055af5de0b3" Sep 09 23:10:50.772908 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:10:50.772830 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-cvlgc" Sep 09 23:10:54.894231 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:10:54.894188 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0da6e759-847b-4f85-b775-a82a83eb8ae2-metrics-tls\") pod \"dns-default-cvlgc\" (UID: \"0da6e759-847b-4f85-b775-a82a83eb8ae2\") " pod="openshift-dns/dns-default-cvlgc" Sep 09 23:10:54.894663 ip-10-0-132-204 kubenswrapper[2561]: E0909 23:10:54.894309 2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 09 23:10:54.894663 ip-10-0-132-204 kubenswrapper[2561]: E0909 23:10:54.894381 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0da6e759-847b-4f85-b775-a82a83eb8ae2-metrics-tls podName:0da6e759-847b-4f85-b775-a82a83eb8ae2 nodeName:}" failed. No retries permitted until 2026-09-09 23:12:56.894349203 +0000 UTC m=+285.269923244 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0da6e759-847b-4f85-b775-a82a83eb8ae2-metrics-tls") pod "dns-default-cvlgc" (UID: "0da6e759-847b-4f85-b775-a82a83eb8ae2") : secret "dns-default-metrics-tls" not found Sep 09 23:11:04.111586 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:11:04.111498 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ktqck" Sep 09 23:12:13.660293 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:12:13.660253 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-685456655f-9stz9"] Sep 09 23:12:13.663585 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:12:13.663568 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-mbkzn"] Sep 09 23:12:13.663714 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:12:13.663685 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-685456655f-9stz9" Sep 09 23:12:13.666430 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:12:13.666175 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-8nppb\"" Sep 09 23:12:13.666430 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:12:13.666250 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-sl8rx"] Sep 09 23:12:13.666549 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:12:13.666485 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-mbkzn" Sep 09 23:12:13.668713 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:12:13.668696 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Sep 09 23:12:13.669033 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:12:13.669012 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-685456655f-9stz9"] Sep 09 23:12:13.669125 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:12:13.669081 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Sep 09 23:12:13.669125 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:12:13.669089 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Sep 09 23:12:13.669125 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:12:13.669107 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-sl8rx" Sep 09 23:12:13.669258 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:12:13.669079 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-b59vx\"" Sep 09 23:12:13.671867 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:12:13.671797 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Sep 09 23:12:13.671867 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:12:13.671829 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Sep 09 23:12:13.671867 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:12:13.671861 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-kn9q4\"" Sep 09 23:12:13.677090 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:12:13.677039 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-sl8rx"] Sep 09 23:12:13.679836 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:12:13.679806 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-mbkzn"] Sep 09 23:12:13.721728 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:12:13.721697 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qvvt7\" (UniqueName: \"kubernetes.io/projected/fc77a21b-a0b3-41c8-8a98-205b1bf951b8-kube-api-access-qvvt7\") pod \"cluster-samples-operator-7cdcfcf76c-mbkzn\" (UID: \"fc77a21b-a0b3-41c8-8a98-205b1bf951b8\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-mbkzn" Sep 09 23:12:13.721890 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:12:13.721753 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-25gkw\" (UniqueName: \"kubernetes.io/projected/af0af713-eccd-4d71-8400-8318e56d8214-kube-api-access-25gkw\") pod \"volume-data-source-validator-695c895bd6-sl8rx\" (UID: \"af0af713-eccd-4d71-8400-8318e56d8214\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-sl8rx" Sep 09 23:12:13.721890 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:12:13.721789 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-45897\" (UniqueName: \"kubernetes.io/projected/07b145f0-cdc5-40cb-b9d1-74a3af81a78a-kube-api-access-45897\") pod \"network-check-source-685456655f-9stz9\" (UID: \"07b145f0-cdc5-40cb-b9d1-74a3af81a78a\") " pod="openshift-network-diagnostics/network-check-source-685456655f-9stz9" Sep 09 23:12:13.721890 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:12:13.721817 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/fc77a21b-a0b3-41c8-8a98-205b1bf951b8-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-mbkzn\" (UID: \"fc77a21b-a0b3-41c8-8a98-205b1bf951b8\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-mbkzn" Sep 09 23:12:13.749578 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:12:13.749546 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-859f94c4b-hhbq5"] Sep 09 23:12:13.752465 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:12:13.752446 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-hhbq5" Sep 09 23:12:13.755318 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:12:13.755283 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Sep 09 23:12:13.755442 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:12:13.755287 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Sep 09 23:12:13.755442 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:12:13.755342 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Sep 09 23:12:13.755936 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:12:13.755755 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Sep 09 23:12:13.756049 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:12:13.755951 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-76bcd6ccf5-pqpnz"] Sep 09 23:12:13.756234 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:12:13.756216 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-hmdxn\"" Sep 09 23:12:13.758779 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:12:13.758761 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-894458656-blvvg"] Sep 09 23:12:13.758884 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:12:13.758867 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-76bcd6ccf5-pqpnz" Sep 09 23:12:13.761162 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:12:13.761147 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Sep 09 23:12:13.761687 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:12:13.761669 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-894458656-blvvg" Sep 09 23:12:13.761905 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:12:13.761873 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Sep 09 23:12:13.762290 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:12:13.762195 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Sep 09 23:12:13.762431 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:12:13.762411 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-4h9q7\"" Sep 09 23:12:13.762746 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:12:13.762576 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Sep 09 23:12:13.763444 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:12:13.763425 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-859f94c4b-hhbq5"] Sep 09 23:12:13.764699 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:12:13.764679 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Sep 09 23:12:13.764783 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:12:13.764718 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Sep 09 23:12:13.764837 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:12:13.764784 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Sep 09 23:12:13.764917 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:12:13.764902 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Sep 09 23:12:13.765192 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:12:13.765177 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-sltps\"" Sep 09 23:12:13.765674 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:12:13.765391 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Sep 09 23:12:13.765674 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:12:13.765396 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Sep 09 23:12:13.769671 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:12:13.769655 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Sep 09 23:12:13.769771 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:12:13.769727 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-76bcd6ccf5-pqpnz"] Sep 09 23:12:13.780038 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:12:13.780017 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-894458656-blvvg"] Sep 09 23:12:13.822548 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:12:13.822514 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-25gkw\" (UniqueName: \"kubernetes.io/projected/af0af713-eccd-4d71-8400-8318e56d8214-kube-api-access-25gkw\") pod \"volume-data-source-validator-695c895bd6-sl8rx\" (UID: \"af0af713-eccd-4d71-8400-8318e56d8214\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-sl8rx" Sep 09 23:12:13.822548 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:12:13.822553 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/90ae4174-3e12-48c2-af21-cee4d17b6a79-service-ca-bundle\") pod \"insights-operator-76bcd6ccf5-pqpnz\" (UID: \"90ae4174-3e12-48c2-af21-cee4d17b6a79\") " pod="openshift-insights/insights-operator-76bcd6ccf5-pqpnz" Sep 09 23:12:13.822742 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:12:13.822580 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-45897\" (UniqueName: \"kubernetes.io/projected/07b145f0-cdc5-40cb-b9d1-74a3af81a78a-kube-api-access-45897\") pod \"network-check-source-685456655f-9stz9\" (UID: \"07b145f0-cdc5-40cb-b9d1-74a3af81a78a\") " pod="openshift-network-diagnostics/network-check-source-685456655f-9stz9" Sep 09 23:12:13.822742 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:12:13.822600 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/90ae4174-3e12-48c2-af21-cee4d17b6a79-trusted-ca-bundle\") pod \"insights-operator-76bcd6ccf5-pqpnz\" (UID: \"90ae4174-3e12-48c2-af21-cee4d17b6a79\") " pod="openshift-insights/insights-operator-76bcd6ccf5-pqpnz" Sep 09 23:12:13.822742 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:12:13.822621 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/9238fa77-06ef-4b6b-9544-ab94b7466815-default-certificate\") pod \"router-default-894458656-blvvg\" (UID: \"9238fa77-06ef-4b6b-9544-ab94b7466815\") " pod="openshift-ingress/router-default-894458656-blvvg" Sep 09 23:12:13.822742 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:12:13.822638 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9238fa77-06ef-4b6b-9544-ab94b7466815-service-ca-bundle\") pod \"router-default-894458656-blvvg\" (UID: \"9238fa77-06ef-4b6b-9544-ab94b7466815\") " pod="openshift-ingress/router-default-894458656-blvvg" Sep 09 23:12:13.822742 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:12:13.822668 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/fc77a21b-a0b3-41c8-8a98-205b1bf951b8-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-mbkzn\" (UID: \"fc77a21b-a0b3-41c8-8a98-205b1bf951b8\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-mbkzn" Sep 09 23:12:13.822742 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:12:13.822689 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/90ae4174-3e12-48c2-af21-cee4d17b6a79-tmp\") pod \"insights-operator-76bcd6ccf5-pqpnz\" (UID: \"90ae4174-3e12-48c2-af21-cee4d17b6a79\") " pod="openshift-insights/insights-operator-76bcd6ccf5-pqpnz" Sep 09 23:12:13.822742 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:12:13.822722 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6knzw\" (UniqueName: \"kubernetes.io/projected/9238fa77-06ef-4b6b-9544-ab94b7466815-kube-api-access-6knzw\") pod \"router-default-894458656-blvvg\" (UID: \"9238fa77-06ef-4b6b-9544-ab94b7466815\") " pod="openshift-ingress/router-default-894458656-blvvg" Sep 09 23:12:13.822742 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:12:13.822738 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/9238fa77-06ef-4b6b-9544-ab94b7466815-stats-auth\") pod \"router-default-894458656-blvvg\" (UID: \"9238fa77-06ef-4b6b-9544-ab94b7466815\") " pod="openshift-ingress/router-default-894458656-blvvg" Sep 09 23:12:13.823202 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:12:13.822752 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9238fa77-06ef-4b6b-9544-ab94b7466815-metrics-certs\") pod \"router-default-894458656-blvvg\" (UID: \"9238fa77-06ef-4b6b-9544-ab94b7466815\") " pod="openshift-ingress/router-default-894458656-blvvg" Sep 09 23:12:13.823202 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:12:13.822781 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/90ae4174-3e12-48c2-af21-cee4d17b6a79-snapshots\") pod \"insights-operator-76bcd6ccf5-pqpnz\" (UID: \"90ae4174-3e12-48c2-af21-cee4d17b6a79\") " pod="openshift-insights/insights-operator-76bcd6ccf5-pqpnz" Sep 09 23:12:13.823202 ip-10-0-132-204 kubenswrapper[2561]: E0909 23:12:13.822789 2561 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Sep 09 23:12:13.823202 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:12:13.822796 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/90ae4174-3e12-48c2-af21-cee4d17b6a79-serving-cert\") pod \"insights-operator-76bcd6ccf5-pqpnz\" (UID: \"90ae4174-3e12-48c2-af21-cee4d17b6a79\") " pod="openshift-insights/insights-operator-76bcd6ccf5-pqpnz" Sep 09 23:12:13.823202 ip-10-0-132-204 kubenswrapper[2561]: E0909 23:12:13.822849 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fc77a21b-a0b3-41c8-8a98-205b1bf951b8-samples-operator-tls podName:fc77a21b-a0b3-41c8-8a98-205b1bf951b8 nodeName:}" failed. No retries permitted until 2026-09-09 23:12:14.322834773 +0000 UTC m=+242.698408812 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/fc77a21b-a0b3-41c8-8a98-205b1bf951b8-samples-operator-tls") pod "cluster-samples-operator-7cdcfcf76c-mbkzn" (UID: "fc77a21b-a0b3-41c8-8a98-205b1bf951b8") : secret "samples-operator-tls" not found Sep 09 23:12:13.823202 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:12:13.822884 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/905ebf0d-8b71-444f-ac69-999fccfb8c1a-serving-cert\") pod \"service-ca-operator-859f94c4b-hhbq5\" (UID: \"905ebf0d-8b71-444f-ac69-999fccfb8c1a\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-hhbq5" Sep 09 23:12:13.823202 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:12:13.822911 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-svjlq\" (UniqueName: \"kubernetes.io/projected/90ae4174-3e12-48c2-af21-cee4d17b6a79-kube-api-access-svjlq\") pod \"insights-operator-76bcd6ccf5-pqpnz\" (UID: \"90ae4174-3e12-48c2-af21-cee4d17b6a79\") " pod="openshift-insights/insights-operator-76bcd6ccf5-pqpnz" Sep 09 23:12:13.823202 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:12:13.822941 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tklf4\" (UniqueName: \"kubernetes.io/projected/905ebf0d-8b71-444f-ac69-999fccfb8c1a-kube-api-access-tklf4\") pod \"service-ca-operator-859f94c4b-hhbq5\" (UID: \"905ebf0d-8b71-444f-ac69-999fccfb8c1a\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-hhbq5" Sep 09 23:12:13.823202 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:12:13.822993 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qvvt7\" (UniqueName: \"kubernetes.io/projected/fc77a21b-a0b3-41c8-8a98-205b1bf951b8-kube-api-access-qvvt7\") pod \"cluster-samples-operator-7cdcfcf76c-mbkzn\" (UID: \"fc77a21b-a0b3-41c8-8a98-205b1bf951b8\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-mbkzn" Sep 09 23:12:13.823202 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:12:13.823045 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/905ebf0d-8b71-444f-ac69-999fccfb8c1a-config\") pod \"service-ca-operator-859f94c4b-hhbq5\" (UID: \"905ebf0d-8b71-444f-ac69-999fccfb8c1a\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-hhbq5" Sep 09 23:12:13.833582 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:12:13.833547 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-45897\" (UniqueName: \"kubernetes.io/projected/07b145f0-cdc5-40cb-b9d1-74a3af81a78a-kube-api-access-45897\") pod \"network-check-source-685456655f-9stz9\" (UID: \"07b145f0-cdc5-40cb-b9d1-74a3af81a78a\") " pod="openshift-network-diagnostics/network-check-source-685456655f-9stz9" Sep 09 23:12:13.833690 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:12:13.833552 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qvvt7\" (UniqueName: \"kubernetes.io/projected/fc77a21b-a0b3-41c8-8a98-205b1bf951b8-kube-api-access-qvvt7\") pod \"cluster-samples-operator-7cdcfcf76c-mbkzn\" (UID: \"fc77a21b-a0b3-41c8-8a98-205b1bf951b8\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-mbkzn" Sep 09 23:12:13.833690 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:12:13.833629 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-25gkw\" (UniqueName: \"kubernetes.io/projected/af0af713-eccd-4d71-8400-8318e56d8214-kube-api-access-25gkw\") pod \"volume-data-source-validator-695c895bd6-sl8rx\" (UID: \"af0af713-eccd-4d71-8400-8318e56d8214\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-sl8rx" Sep 09 23:12:13.924391 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:12:13.924299 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/90ae4174-3e12-48c2-af21-cee4d17b6a79-trusted-ca-bundle\") pod \"insights-operator-76bcd6ccf5-pqpnz\" (UID: \"90ae4174-3e12-48c2-af21-cee4d17b6a79\") " pod="openshift-insights/insights-operator-76bcd6ccf5-pqpnz" Sep 09 23:12:13.924391 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:12:13.924332 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/9238fa77-06ef-4b6b-9544-ab94b7466815-default-certificate\") pod \"router-default-894458656-blvvg\" (UID: \"9238fa77-06ef-4b6b-9544-ab94b7466815\") " pod="openshift-ingress/router-default-894458656-blvvg" Sep 09 23:12:13.924391 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:12:13.924347 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9238fa77-06ef-4b6b-9544-ab94b7466815-service-ca-bundle\") pod \"router-default-894458656-blvvg\" (UID: \"9238fa77-06ef-4b6b-9544-ab94b7466815\") " pod="openshift-ingress/router-default-894458656-blvvg" Sep 09 23:12:13.924657 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:12:13.924405 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/90ae4174-3e12-48c2-af21-cee4d17b6a79-tmp\") pod \"insights-operator-76bcd6ccf5-pqpnz\" (UID: \"90ae4174-3e12-48c2-af21-cee4d17b6a79\") " pod="openshift-insights/insights-operator-76bcd6ccf5-pqpnz" Sep 09 23:12:13.924657 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:12:13.924429 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6knzw\" (UniqueName: \"kubernetes.io/projected/9238fa77-06ef-4b6b-9544-ab94b7466815-kube-api-access-6knzw\") pod \"router-default-894458656-blvvg\" (UID: \"9238fa77-06ef-4b6b-9544-ab94b7466815\") " pod="openshift-ingress/router-default-894458656-blvvg" Sep 09 23:12:13.924657 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:12:13.924457 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/9238fa77-06ef-4b6b-9544-ab94b7466815-stats-auth\") pod \"router-default-894458656-blvvg\" (UID: \"9238fa77-06ef-4b6b-9544-ab94b7466815\") " pod="openshift-ingress/router-default-894458656-blvvg" Sep 09 23:12:13.924657 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:12:13.924478 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9238fa77-06ef-4b6b-9544-ab94b7466815-metrics-certs\") pod \"router-default-894458656-blvvg\" (UID: \"9238fa77-06ef-4b6b-9544-ab94b7466815\") " pod="openshift-ingress/router-default-894458656-blvvg" Sep 09 23:12:13.924657 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:12:13.924511 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/90ae4174-3e12-48c2-af21-cee4d17b6a79-snapshots\") pod \"insights-operator-76bcd6ccf5-pqpnz\" (UID: \"90ae4174-3e12-48c2-af21-cee4d17b6a79\") " pod="openshift-insights/insights-operator-76bcd6ccf5-pqpnz" Sep 09 23:12:13.924657 ip-10-0-132-204 kubenswrapper[2561]: E0909 23:12:13.924618 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9238fa77-06ef-4b6b-9544-ab94b7466815-service-ca-bundle podName:9238fa77-06ef-4b6b-9544-ab94b7466815 nodeName:}" failed. No retries permitted until 2026-09-09 23:12:14.42459876 +0000 UTC m=+242.800172819 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/9238fa77-06ef-4b6b-9544-ab94b7466815-service-ca-bundle") pod "router-default-894458656-blvvg" (UID: "9238fa77-06ef-4b6b-9544-ab94b7466815") : configmap references non-existent config key: service-ca.crt Sep 09 23:12:13.924657 ip-10-0-132-204 kubenswrapper[2561]: E0909 23:12:13.924617 2561 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Sep 09 23:12:13.924992 ip-10-0-132-204 kubenswrapper[2561]: E0909 23:12:13.924668 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9238fa77-06ef-4b6b-9544-ab94b7466815-metrics-certs podName:9238fa77-06ef-4b6b-9544-ab94b7466815 nodeName:}" failed. No retries permitted until 2026-09-09 23:12:14.424658058 +0000 UTC m=+242.800232097 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9238fa77-06ef-4b6b-9544-ab94b7466815-metrics-certs") pod "router-default-894458656-blvvg" (UID: "9238fa77-06ef-4b6b-9544-ab94b7466815") : secret "router-metrics-certs-default" not found Sep 09 23:12:13.924992 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:12:13.924723 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/90ae4174-3e12-48c2-af21-cee4d17b6a79-serving-cert\") pod \"insights-operator-76bcd6ccf5-pqpnz\" (UID: \"90ae4174-3e12-48c2-af21-cee4d17b6a79\") " pod="openshift-insights/insights-operator-76bcd6ccf5-pqpnz" Sep 09 23:12:13.924992 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:12:13.924775 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/905ebf0d-8b71-444f-ac69-999fccfb8c1a-serving-cert\") pod \"service-ca-operator-859f94c4b-hhbq5\" (UID: \"905ebf0d-8b71-444f-ac69-999fccfb8c1a\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-hhbq5" Sep 09 23:12:13.924992 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:12:13.924815 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-svjlq\" (UniqueName: \"kubernetes.io/projected/90ae4174-3e12-48c2-af21-cee4d17b6a79-kube-api-access-svjlq\") pod \"insights-operator-76bcd6ccf5-pqpnz\" (UID: \"90ae4174-3e12-48c2-af21-cee4d17b6a79\") " pod="openshift-insights/insights-operator-76bcd6ccf5-pqpnz" Sep 09 23:12:13.924992 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:12:13.924847 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/90ae4174-3e12-48c2-af21-cee4d17b6a79-tmp\") pod \"insights-operator-76bcd6ccf5-pqpnz\" (UID: \"90ae4174-3e12-48c2-af21-cee4d17b6a79\") " pod="openshift-insights/insights-operator-76bcd6ccf5-pqpnz" Sep 09 23:12:13.924992 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:12:13.924852 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tklf4\" (UniqueName: \"kubernetes.io/projected/905ebf0d-8b71-444f-ac69-999fccfb8c1a-kube-api-access-tklf4\") pod \"service-ca-operator-859f94c4b-hhbq5\" (UID: \"905ebf0d-8b71-444f-ac69-999fccfb8c1a\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-hhbq5" Sep 09 23:12:13.924992 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:12:13.924916 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/905ebf0d-8b71-444f-ac69-999fccfb8c1a-config\") pod \"service-ca-operator-859f94c4b-hhbq5\" (UID: \"905ebf0d-8b71-444f-ac69-999fccfb8c1a\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-hhbq5" Sep 09 23:12:13.924992 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:12:13.924983 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/90ae4174-3e12-48c2-af21-cee4d17b6a79-service-ca-bundle\") pod \"insights-operator-76bcd6ccf5-pqpnz\" (UID: \"90ae4174-3e12-48c2-af21-cee4d17b6a79\") " pod="openshift-insights/insights-operator-76bcd6ccf5-pqpnz" Sep 09 23:12:13.925469 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:12:13.925323 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/90ae4174-3e12-48c2-af21-cee4d17b6a79-snapshots\") pod \"insights-operator-76bcd6ccf5-pqpnz\" (UID: \"90ae4174-3e12-48c2-af21-cee4d17b6a79\") " pod="openshift-insights/insights-operator-76bcd6ccf5-pqpnz" Sep 09 23:12:13.925584 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:12:13.925565 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/90ae4174-3e12-48c2-af21-cee4d17b6a79-service-ca-bundle\") pod \"insights-operator-76bcd6ccf5-pqpnz\" (UID: \"90ae4174-3e12-48c2-af21-cee4d17b6a79\") " pod="openshift-insights/insights-operator-76bcd6ccf5-pqpnz" Sep 09 23:12:13.925843 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:12:13.925821 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/905ebf0d-8b71-444f-ac69-999fccfb8c1a-config\") pod \"service-ca-operator-859f94c4b-hhbq5\" (UID: \"905ebf0d-8b71-444f-ac69-999fccfb8c1a\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-hhbq5" Sep 09 23:12:13.925926 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:12:13.925906 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/90ae4174-3e12-48c2-af21-cee4d17b6a79-trusted-ca-bundle\") pod \"insights-operator-76bcd6ccf5-pqpnz\" (UID: \"90ae4174-3e12-48c2-af21-cee4d17b6a79\") " pod="openshift-insights/insights-operator-76bcd6ccf5-pqpnz" Sep 09 23:12:13.927017 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:12:13.926995 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/9238fa77-06ef-4b6b-9544-ab94b7466815-stats-auth\") pod \"router-default-894458656-blvvg\" (UID: \"9238fa77-06ef-4b6b-9544-ab94b7466815\") " pod="openshift-ingress/router-default-894458656-blvvg" Sep 09 23:12:13.927433 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:12:13.927414 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/905ebf0d-8b71-444f-ac69-999fccfb8c1a-serving-cert\") pod \"service-ca-operator-859f94c4b-hhbq5\" (UID: \"905ebf0d-8b71-444f-ac69-999fccfb8c1a\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-hhbq5" Sep 09 23:12:13.927513 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:12:13.927499 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/9238fa77-06ef-4b6b-9544-ab94b7466815-default-certificate\") pod \"router-default-894458656-blvvg\" (UID: \"9238fa77-06ef-4b6b-9544-ab94b7466815\") " pod="openshift-ingress/router-default-894458656-blvvg" Sep 09 23:12:13.928124 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:12:13.928106 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/90ae4174-3e12-48c2-af21-cee4d17b6a79-serving-cert\") pod \"insights-operator-76bcd6ccf5-pqpnz\" (UID: \"90ae4174-3e12-48c2-af21-cee4d17b6a79\") " pod="openshift-insights/insights-operator-76bcd6ccf5-pqpnz" Sep 09 23:12:13.933488 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:12:13.933468 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6knzw\" (UniqueName: \"kubernetes.io/projected/9238fa77-06ef-4b6b-9544-ab94b7466815-kube-api-access-6knzw\") pod \"router-default-894458656-blvvg\" (UID: \"9238fa77-06ef-4b6b-9544-ab94b7466815\") " pod="openshift-ingress/router-default-894458656-blvvg" Sep 09 23:12:13.933865 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:12:13.933848 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-svjlq\" (UniqueName: \"kubernetes.io/projected/90ae4174-3e12-48c2-af21-cee4d17b6a79-kube-api-access-svjlq\") pod \"insights-operator-76bcd6ccf5-pqpnz\" (UID: \"90ae4174-3e12-48c2-af21-cee4d17b6a79\") " pod="openshift-insights/insights-operator-76bcd6ccf5-pqpnz" Sep 09 23:12:13.934004 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:12:13.933989 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tklf4\" (UniqueName: \"kubernetes.io/projected/905ebf0d-8b71-444f-ac69-999fccfb8c1a-kube-api-access-tklf4\") pod \"service-ca-operator-859f94c4b-hhbq5\" (UID: \"905ebf0d-8b71-444f-ac69-999fccfb8c1a\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-hhbq5" Sep 09 23:12:13.973622 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:12:13.973601 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-685456655f-9stz9" Sep 09 23:12:13.986662 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:12:13.986642 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-sl8rx" Sep 09 23:12:14.061719 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:12:14.061688 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-hhbq5" Sep 09 23:12:14.071916 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:12:14.071895 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-76bcd6ccf5-pqpnz" Sep 09 23:12:14.244943 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:12:14.244905 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-685456655f-9stz9"] Sep 09 23:12:14.248614 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:12:14.248587 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod07b145f0_cdc5_40cb_b9d1_74a3af81a78a.slice/crio-77448a97eeff65d7a28c3f7ab7baac138addc147108280ecc7e4dbc513777258 WatchSource:0}: Error finding container 77448a97eeff65d7a28c3f7ab7baac138addc147108280ecc7e4dbc513777258: Status 404 returned error can't find the container with id 77448a97eeff65d7a28c3f7ab7baac138addc147108280ecc7e4dbc513777258 Sep 09 23:12:14.264348 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:12:14.264320 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-sl8rx"] Sep 09 23:12:14.277132 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:12:14.277107 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaf0af713_eccd_4d71_8400_8318e56d8214.slice/crio-b672c8cfa46311cb2234ff86d99680554853e86f7d437cb39a7ef58c326c1215 WatchSource:0}: Error finding container b672c8cfa46311cb2234ff86d99680554853e86f7d437cb39a7ef58c326c1215: Status 404 returned error can't find the container with id b672c8cfa46311cb2234ff86d99680554853e86f7d437cb39a7ef58c326c1215 Sep 09 23:12:14.329772 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:12:14.329741 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/fc77a21b-a0b3-41c8-8a98-205b1bf951b8-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-mbkzn\" (UID: \"fc77a21b-a0b3-41c8-8a98-205b1bf951b8\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-mbkzn" Sep 09 23:12:14.330001 ip-10-0-132-204 kubenswrapper[2561]: E0909 23:12:14.329866 2561 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Sep 09 23:12:14.330001 ip-10-0-132-204 kubenswrapper[2561]: E0909 23:12:14.329933 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fc77a21b-a0b3-41c8-8a98-205b1bf951b8-samples-operator-tls podName:fc77a21b-a0b3-41c8-8a98-205b1bf951b8 nodeName:}" failed. No retries permitted until 2026-09-09 23:12:15.329914072 +0000 UTC m=+243.705488125 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/fc77a21b-a0b3-41c8-8a98-205b1bf951b8-samples-operator-tls") pod "cluster-samples-operator-7cdcfcf76c-mbkzn" (UID: "fc77a21b-a0b3-41c8-8a98-205b1bf951b8") : secret "samples-operator-tls" not found Sep 09 23:12:14.331197 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:12:14.331172 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-859f94c4b-hhbq5"] Sep 09 23:12:14.334973 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:12:14.334947 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod905ebf0d_8b71_444f_ac69_999fccfb8c1a.slice/crio-1b11f2a96df3a64df23d216f5feeb3f3ddfe87b0146157ca14e798b5212165d3 WatchSource:0}: Error finding container 1b11f2a96df3a64df23d216f5feeb3f3ddfe87b0146157ca14e798b5212165d3: Status 404 returned error can't find the container with id 1b11f2a96df3a64df23d216f5feeb3f3ddfe87b0146157ca14e798b5212165d3 Sep 09 23:12:14.349293 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:12:14.349233 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-76bcd6ccf5-pqpnz"] Sep 09 23:12:14.353224 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:12:14.353201 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod90ae4174_3e12_48c2_af21_cee4d17b6a79.slice/crio-5e7e78269b4052895b78088e19ce76e2fad90b2771a7cafc6ba24bf77a2a0b42 WatchSource:0}: Error finding container 5e7e78269b4052895b78088e19ce76e2fad90b2771a7cafc6ba24bf77a2a0b42: Status 404 returned error can't find the container with id 5e7e78269b4052895b78088e19ce76e2fad90b2771a7cafc6ba24bf77a2a0b42 Sep 09 23:12:14.430388 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:12:14.430326 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9238fa77-06ef-4b6b-9544-ab94b7466815-service-ca-bundle\") pod \"router-default-894458656-blvvg\" (UID: \"9238fa77-06ef-4b6b-9544-ab94b7466815\") " pod="openshift-ingress/router-default-894458656-blvvg" Sep 09 23:12:14.430564 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:12:14.430425 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9238fa77-06ef-4b6b-9544-ab94b7466815-metrics-certs\") pod \"router-default-894458656-blvvg\" (UID: \"9238fa77-06ef-4b6b-9544-ab94b7466815\") " pod="openshift-ingress/router-default-894458656-blvvg" Sep 09 23:12:14.430564 ip-10-0-132-204 kubenswrapper[2561]: E0909 23:12:14.430497 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9238fa77-06ef-4b6b-9544-ab94b7466815-service-ca-bundle podName:9238fa77-06ef-4b6b-9544-ab94b7466815 nodeName:}" failed. No retries permitted until 2026-09-09 23:12:15.430478901 +0000 UTC m=+243.806052955 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/9238fa77-06ef-4b6b-9544-ab94b7466815-service-ca-bundle") pod "router-default-894458656-blvvg" (UID: "9238fa77-06ef-4b6b-9544-ab94b7466815") : configmap references non-existent config key: service-ca.crt Sep 09 23:12:14.430564 ip-10-0-132-204 kubenswrapper[2561]: E0909 23:12:14.430512 2561 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Sep 09 23:12:14.430564 ip-10-0-132-204 kubenswrapper[2561]: E0909 23:12:14.430552 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9238fa77-06ef-4b6b-9544-ab94b7466815-metrics-certs podName:9238fa77-06ef-4b6b-9544-ab94b7466815 nodeName:}" failed. No retries permitted until 2026-09-09 23:12:15.430541185 +0000 UTC m=+243.806115225 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9238fa77-06ef-4b6b-9544-ab94b7466815-metrics-certs") pod "router-default-894458656-blvvg" (UID: "9238fa77-06ef-4b6b-9544-ab94b7466815") : secret "router-metrics-certs-default" not found Sep 09 23:12:14.966664 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:12:14.966623 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-hhbq5" event={"ID":"905ebf0d-8b71-444f-ac69-999fccfb8c1a","Type":"ContainerStarted","Data":"1b11f2a96df3a64df23d216f5feeb3f3ddfe87b0146157ca14e798b5212165d3"} Sep 09 23:12:14.968585 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:12:14.968523 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-sl8rx" event={"ID":"af0af713-eccd-4d71-8400-8318e56d8214","Type":"ContainerStarted","Data":"b672c8cfa46311cb2234ff86d99680554853e86f7d437cb39a7ef58c326c1215"} Sep 09 23:12:14.971586 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:12:14.970835 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-685456655f-9stz9" event={"ID":"07b145f0-cdc5-40cb-b9d1-74a3af81a78a","Type":"ContainerStarted","Data":"28bd9f1cbc2efc62da1e1d2017c454a049e17b3df0170943ea1189829eb9485f"} Sep 09 23:12:14.971586 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:12:14.970884 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-685456655f-9stz9" event={"ID":"07b145f0-cdc5-40cb-b9d1-74a3af81a78a","Type":"ContainerStarted","Data":"77448a97eeff65d7a28c3f7ab7baac138addc147108280ecc7e4dbc513777258"} Sep 09 23:12:14.973082 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:12:14.972983 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-76bcd6ccf5-pqpnz" event={"ID":"90ae4174-3e12-48c2-af21-cee4d17b6a79","Type":"ContainerStarted","Data":"5e7e78269b4052895b78088e19ce76e2fad90b2771a7cafc6ba24bf77a2a0b42"} Sep 09 23:12:14.988750 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:12:14.988701 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-685456655f-9stz9" podStartSLOduration=1.9886833259999999 podStartE2EDuration="1.988683326s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:12:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:12:14.987266376 +0000 UTC m=+243.362840439" watchObservedRunningTime="2026-09-09 23:12:14.988683326 +0000 UTC m=+243.364257389" Sep 09 23:12:15.337348 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:12:15.337309 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/fc77a21b-a0b3-41c8-8a98-205b1bf951b8-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-mbkzn\" (UID: \"fc77a21b-a0b3-41c8-8a98-205b1bf951b8\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-mbkzn" Sep 09 23:12:15.337599 ip-10-0-132-204 kubenswrapper[2561]: E0909 23:12:15.337581 2561 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Sep 09 23:12:15.337678 ip-10-0-132-204 kubenswrapper[2561]: E0909 23:12:15.337651 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fc77a21b-a0b3-41c8-8a98-205b1bf951b8-samples-operator-tls podName:fc77a21b-a0b3-41c8-8a98-205b1bf951b8 nodeName:}" failed. No retries permitted until 2026-09-09 23:12:17.337632887 +0000 UTC m=+245.713206930 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/fc77a21b-a0b3-41c8-8a98-205b1bf951b8-samples-operator-tls") pod "cluster-samples-operator-7cdcfcf76c-mbkzn" (UID: "fc77a21b-a0b3-41c8-8a98-205b1bf951b8") : secret "samples-operator-tls" not found Sep 09 23:12:15.438199 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:12:15.437893 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9238fa77-06ef-4b6b-9544-ab94b7466815-service-ca-bundle\") pod \"router-default-894458656-blvvg\" (UID: \"9238fa77-06ef-4b6b-9544-ab94b7466815\") " pod="openshift-ingress/router-default-894458656-blvvg" Sep 09 23:12:15.438199 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:12:15.437992 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9238fa77-06ef-4b6b-9544-ab94b7466815-metrics-certs\") pod \"router-default-894458656-blvvg\" (UID: \"9238fa77-06ef-4b6b-9544-ab94b7466815\") " pod="openshift-ingress/router-default-894458656-blvvg" Sep 09 23:12:15.438199 ip-10-0-132-204 kubenswrapper[2561]: E0909 23:12:15.438071 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9238fa77-06ef-4b6b-9544-ab94b7466815-service-ca-bundle podName:9238fa77-06ef-4b6b-9544-ab94b7466815 nodeName:}" failed. No retries permitted until 2026-09-09 23:12:17.438052085 +0000 UTC m=+245.813626160 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/9238fa77-06ef-4b6b-9544-ab94b7466815-service-ca-bundle") pod "router-default-894458656-blvvg" (UID: "9238fa77-06ef-4b6b-9544-ab94b7466815") : configmap references non-existent config key: service-ca.crt Sep 09 23:12:15.438199 ip-10-0-132-204 kubenswrapper[2561]: E0909 23:12:15.438137 2561 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Sep 09 23:12:15.438199 ip-10-0-132-204 kubenswrapper[2561]: E0909 23:12:15.438175 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9238fa77-06ef-4b6b-9544-ab94b7466815-metrics-certs podName:9238fa77-06ef-4b6b-9544-ab94b7466815 nodeName:}" failed. No retries permitted until 2026-09-09 23:12:17.438163227 +0000 UTC m=+245.813737281 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9238fa77-06ef-4b6b-9544-ab94b7466815-metrics-certs") pod "router-default-894458656-blvvg" (UID: "9238fa77-06ef-4b6b-9544-ab94b7466815") : secret "router-metrics-certs-default" not found Sep 09 23:12:15.978436 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:12:15.978392 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-sl8rx" event={"ID":"af0af713-eccd-4d71-8400-8318e56d8214","Type":"ContainerStarted","Data":"0a131f9f97aa395c84284add130c4a532d6cc2a3b0dafe05a9e6f342e0472661"} Sep 09 23:12:15.996192 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:12:15.996138 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-sl8rx" podStartSLOduration=1.806514444 podStartE2EDuration="2.996118021s" totalImagesPullingTime="1.189603577s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:12:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:12:15.995097736 +0000 UTC m=+244.370671800" watchObservedRunningTime="2026-09-09 23:12:15.996118021 +0000 UTC m=+244.371692130" Sep 09 23:12:17.353917 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:12:17.353817 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/fc77a21b-a0b3-41c8-8a98-205b1bf951b8-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-mbkzn\" (UID: \"fc77a21b-a0b3-41c8-8a98-205b1bf951b8\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-mbkzn" Sep 09 23:12:17.354332 ip-10-0-132-204 kubenswrapper[2561]: E0909 23:12:17.354089 2561 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Sep 09 23:12:17.354332 ip-10-0-132-204 kubenswrapper[2561]: E0909 23:12:17.354159 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fc77a21b-a0b3-41c8-8a98-205b1bf951b8-samples-operator-tls podName:fc77a21b-a0b3-41c8-8a98-205b1bf951b8 nodeName:}" failed. No retries permitted until 2026-09-09 23:12:21.354133682 +0000 UTC m=+249.729707743 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/fc77a21b-a0b3-41c8-8a98-205b1bf951b8-samples-operator-tls") pod "cluster-samples-operator-7cdcfcf76c-mbkzn" (UID: "fc77a21b-a0b3-41c8-8a98-205b1bf951b8") : secret "samples-operator-tls" not found Sep 09 23:12:17.455151 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:12:17.455117 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9238fa77-06ef-4b6b-9544-ab94b7466815-metrics-certs\") pod \"router-default-894458656-blvvg\" (UID: \"9238fa77-06ef-4b6b-9544-ab94b7466815\") " pod="openshift-ingress/router-default-894458656-blvvg" Sep 09 23:12:17.455299 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:12:17.455202 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9238fa77-06ef-4b6b-9544-ab94b7466815-service-ca-bundle\") pod \"router-default-894458656-blvvg\" (UID: \"9238fa77-06ef-4b6b-9544-ab94b7466815\") " pod="openshift-ingress/router-default-894458656-blvvg" Sep 09 23:12:17.455356 ip-10-0-132-204 kubenswrapper[2561]: E0909 23:12:17.455291 2561 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Sep 09 23:12:17.455356 ip-10-0-132-204 kubenswrapper[2561]: E0909 23:12:17.455339 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9238fa77-06ef-4b6b-9544-ab94b7466815-service-ca-bundle podName:9238fa77-06ef-4b6b-9544-ab94b7466815 nodeName:}" failed. No retries permitted until 2026-09-09 23:12:21.455321701 +0000 UTC m=+249.830895761 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/9238fa77-06ef-4b6b-9544-ab94b7466815-service-ca-bundle") pod "router-default-894458656-blvvg" (UID: "9238fa77-06ef-4b6b-9544-ab94b7466815") : configmap references non-existent config key: service-ca.crt Sep 09 23:12:17.455457 ip-10-0-132-204 kubenswrapper[2561]: E0909 23:12:17.455357 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9238fa77-06ef-4b6b-9544-ab94b7466815-metrics-certs podName:9238fa77-06ef-4b6b-9544-ab94b7466815 nodeName:}" failed. No retries permitted until 2026-09-09 23:12:21.455348858 +0000 UTC m=+249.830922897 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9238fa77-06ef-4b6b-9544-ab94b7466815-metrics-certs") pod "router-default-894458656-blvvg" (UID: "9238fa77-06ef-4b6b-9544-ab94b7466815") : secret "router-metrics-certs-default" not found Sep 09 23:12:17.986731 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:12:17.986694 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-hhbq5" event={"ID":"905ebf0d-8b71-444f-ac69-999fccfb8c1a","Type":"ContainerStarted","Data":"1dc1abef3edbb2057e04923677db89c4571f91d06e06d446725f3ae77cb461df"} Sep 09 23:12:17.988220 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:12:17.988193 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-76bcd6ccf5-pqpnz" event={"ID":"90ae4174-3e12-48c2-af21-cee4d17b6a79","Type":"ContainerStarted","Data":"5fa2ae34bc61d225ac2e2dc091f075c47976ffb4e5c98b76dbc9c0c91c5fe391"} Sep 09 23:12:18.004398 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:12:18.004336 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-hhbq5" podStartSLOduration=2.262888278 podStartE2EDuration="5.004323159s" totalImagesPullingTime="2.741434881s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:12:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:12:18.00350299 +0000 UTC m=+246.379077054" watchObservedRunningTime="2026-09-09 23:12:18.004323159 +0000 UTC m=+246.379897220" Sep 09 23:12:18.021095 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:12:18.021052 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-76bcd6ccf5-pqpnz" podStartSLOduration=2.300585728 podStartE2EDuration="5.021037572s" totalImagesPullingTime="2.720451844s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:12:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:12:18.020070708 +0000 UTC m=+246.395644771" watchObservedRunningTime="2026-09-09 23:12:18.021037572 +0000 UTC m=+246.396611635" Sep 09 23:12:18.486998 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:12:18.486968 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-x6vdz"] Sep 09 23:12:18.490308 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:12:18.490288 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-x6vdz" Sep 09 23:12:18.492820 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:12:18.492793 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Sep 09 23:12:18.492927 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:12:18.492907 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-xkjxb\"" Sep 09 23:12:18.493200 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:12:18.493182 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Sep 09 23:12:18.500968 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:12:18.500949 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-x6vdz"] Sep 09 23:12:18.563420 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:12:18.563381 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7xc55\" (UniqueName: \"kubernetes.io/projected/1198f3f5-48cb-44d8-a496-34e7de2d2d45-kube-api-access-7xc55\") pod \"insights-runtime-extractor-x6vdz\" (UID: \"1198f3f5-48cb-44d8-a496-34e7de2d2d45\") " pod="openshift-insights/insights-runtime-extractor-x6vdz" Sep 09 23:12:18.563420 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:12:18.563417 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1198f3f5-48cb-44d8-a496-34e7de2d2d45-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-x6vdz\" (UID: \"1198f3f5-48cb-44d8-a496-34e7de2d2d45\") " pod="openshift-insights/insights-runtime-extractor-x6vdz" Sep 09 23:12:18.563594 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:12:18.563445 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/1198f3f5-48cb-44d8-a496-34e7de2d2d45-crio-socket\") pod \"insights-runtime-extractor-x6vdz\" (UID: \"1198f3f5-48cb-44d8-a496-34e7de2d2d45\") " pod="openshift-insights/insights-runtime-extractor-x6vdz" Sep 09 23:12:18.563594 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:12:18.563484 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1198f3f5-48cb-44d8-a496-34e7de2d2d45-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-x6vdz\" (UID: \"1198f3f5-48cb-44d8-a496-34e7de2d2d45\") " pod="openshift-insights/insights-runtime-extractor-x6vdz" Sep 09 23:12:18.563594 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:12:18.563532 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/1198f3f5-48cb-44d8-a496-34e7de2d2d45-data-volume\") pod \"insights-runtime-extractor-x6vdz\" (UID: \"1198f3f5-48cb-44d8-a496-34e7de2d2d45\") " pod="openshift-insights/insights-runtime-extractor-x6vdz" Sep 09 23:12:18.664349 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:12:18.664321 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/1198f3f5-48cb-44d8-a496-34e7de2d2d45-data-volume\") pod \"insights-runtime-extractor-x6vdz\" (UID: \"1198f3f5-48cb-44d8-a496-34e7de2d2d45\") " pod="openshift-insights/insights-runtime-extractor-x6vdz" Sep 09 23:12:18.664508 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:12:18.664385 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7xc55\" (UniqueName: \"kubernetes.io/projected/1198f3f5-48cb-44d8-a496-34e7de2d2d45-kube-api-access-7xc55\") pod \"insights-runtime-extractor-x6vdz\" (UID: \"1198f3f5-48cb-44d8-a496-34e7de2d2d45\") " pod="openshift-insights/insights-runtime-extractor-x6vdz" Sep 09 23:12:18.664508 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:12:18.664406 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1198f3f5-48cb-44d8-a496-34e7de2d2d45-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-x6vdz\" (UID: \"1198f3f5-48cb-44d8-a496-34e7de2d2d45\") " pod="openshift-insights/insights-runtime-extractor-x6vdz" Sep 09 23:12:18.664508 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:12:18.664433 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/1198f3f5-48cb-44d8-a496-34e7de2d2d45-crio-socket\") pod \"insights-runtime-extractor-x6vdz\" (UID: \"1198f3f5-48cb-44d8-a496-34e7de2d2d45\") " pod="openshift-insights/insights-runtime-extractor-x6vdz" Sep 09 23:12:18.664508 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:12:18.664452 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1198f3f5-48cb-44d8-a496-34e7de2d2d45-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-x6vdz\" (UID: \"1198f3f5-48cb-44d8-a496-34e7de2d2d45\") " pod="openshift-insights/insights-runtime-extractor-x6vdz" Sep 09 23:12:18.664699 ip-10-0-132-204 kubenswrapper[2561]: E0909 23:12:18.664536 2561 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 09 23:12:18.664699 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:12:18.664544 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/1198f3f5-48cb-44d8-a496-34e7de2d2d45-crio-socket\") pod \"insights-runtime-extractor-x6vdz\" (UID: \"1198f3f5-48cb-44d8-a496-34e7de2d2d45\") " pod="openshift-insights/insights-runtime-extractor-x6vdz" Sep 09 23:12:18.664699 ip-10-0-132-204 kubenswrapper[2561]: E0909 23:12:18.664559 2561 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 09 23:12:18.664699 ip-10-0-132-204 kubenswrapper[2561]: E0909 23:12:18.664618 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1198f3f5-48cb-44d8-a496-34e7de2d2d45-kube-rbac-proxy-cm podName:1198f3f5-48cb-44d8-a496-34e7de2d2d45 nodeName:}" failed. No retries permitted until 2026-09-09 23:12:19.164598037 +0000 UTC m=+247.540172098 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/1198f3f5-48cb-44d8-a496-34e7de2d2d45-kube-rbac-proxy-cm") pod "insights-runtime-extractor-x6vdz" (UID: "1198f3f5-48cb-44d8-a496-34e7de2d2d45") : configmap "kube-rbac-proxy" not found Sep 09 23:12:18.664699 ip-10-0-132-204 kubenswrapper[2561]: E0909 23:12:18.664659 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1198f3f5-48cb-44d8-a496-34e7de2d2d45-insights-runtime-extractor-tls podName:1198f3f5-48cb-44d8-a496-34e7de2d2d45 nodeName:}" failed. No retries permitted until 2026-09-09 23:12:19.1646482 +0000 UTC m=+247.540222239 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/1198f3f5-48cb-44d8-a496-34e7de2d2d45-insights-runtime-extractor-tls") pod "insights-runtime-extractor-x6vdz" (UID: "1198f3f5-48cb-44d8-a496-34e7de2d2d45") : secret "insights-runtime-extractor-tls" not found Sep 09 23:12:18.664882 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:12:18.664727 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/1198f3f5-48cb-44d8-a496-34e7de2d2d45-data-volume\") pod \"insights-runtime-extractor-x6vdz\" (UID: \"1198f3f5-48cb-44d8-a496-34e7de2d2d45\") " pod="openshift-insights/insights-runtime-extractor-x6vdz" Sep 09 23:12:18.674675 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:12:18.674647 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7xc55\" (UniqueName: \"kubernetes.io/projected/1198f3f5-48cb-44d8-a496-34e7de2d2d45-kube-api-access-7xc55\") pod \"insights-runtime-extractor-x6vdz\" (UID: \"1198f3f5-48cb-44d8-a496-34e7de2d2d45\") " pod="openshift-insights/insights-runtime-extractor-x6vdz" Sep 09 23:12:19.169781 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:12:19.169746 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1198f3f5-48cb-44d8-a496-34e7de2d2d45-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-x6vdz\" (UID: \"1198f3f5-48cb-44d8-a496-34e7de2d2d45\") " pod="openshift-insights/insights-runtime-extractor-x6vdz" Sep 09 23:12:19.169921 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:12:19.169904 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1198f3f5-48cb-44d8-a496-34e7de2d2d45-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-x6vdz\" (UID: \"1198f3f5-48cb-44d8-a496-34e7de2d2d45\") " pod="openshift-insights/insights-runtime-extractor-x6vdz" Sep 09 23:12:19.169987 ip-10-0-132-204 kubenswrapper[2561]: E0909 23:12:19.169971 2561 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 09 23:12:19.170018 ip-10-0-132-204 kubenswrapper[2561]: E0909 23:12:19.169994 2561 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 09 23:12:19.170066 ip-10-0-132-204 kubenswrapper[2561]: E0909 23:12:19.170029 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1198f3f5-48cb-44d8-a496-34e7de2d2d45-kube-rbac-proxy-cm podName:1198f3f5-48cb-44d8-a496-34e7de2d2d45 nodeName:}" failed. No retries permitted until 2026-09-09 23:12:20.170014715 +0000 UTC m=+248.545588772 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/1198f3f5-48cb-44d8-a496-34e7de2d2d45-kube-rbac-proxy-cm") pod "insights-runtime-extractor-x6vdz" (UID: "1198f3f5-48cb-44d8-a496-34e7de2d2d45") : configmap "kube-rbac-proxy" not found Sep 09 23:12:19.170066 ip-10-0-132-204 kubenswrapper[2561]: E0909 23:12:19.170052 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1198f3f5-48cb-44d8-a496-34e7de2d2d45-insights-runtime-extractor-tls podName:1198f3f5-48cb-44d8-a496-34e7de2d2d45 nodeName:}" failed. No retries permitted until 2026-09-09 23:12:20.170034941 +0000 UTC m=+248.545609004 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/1198f3f5-48cb-44d8-a496-34e7de2d2d45-insights-runtime-extractor-tls") pod "insights-runtime-extractor-x6vdz" (UID: "1198f3f5-48cb-44d8-a496-34e7de2d2d45") : secret "insights-runtime-extractor-tls" not found Sep 09 23:12:20.177606 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:12:20.177556 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1198f3f5-48cb-44d8-a496-34e7de2d2d45-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-x6vdz\" (UID: \"1198f3f5-48cb-44d8-a496-34e7de2d2d45\") " pod="openshift-insights/insights-runtime-extractor-x6vdz" Sep 09 23:12:20.177984 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:12:20.177644 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1198f3f5-48cb-44d8-a496-34e7de2d2d45-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-x6vdz\" (UID: \"1198f3f5-48cb-44d8-a496-34e7de2d2d45\") " pod="openshift-insights/insights-runtime-extractor-x6vdz" Sep 09 23:12:20.177984 ip-10-0-132-204 kubenswrapper[2561]: E0909 23:12:20.177680 2561 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 09 23:12:20.177984 ip-10-0-132-204 kubenswrapper[2561]: E0909 23:12:20.177744 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1198f3f5-48cb-44d8-a496-34e7de2d2d45-kube-rbac-proxy-cm podName:1198f3f5-48cb-44d8-a496-34e7de2d2d45 nodeName:}" failed. No retries permitted until 2026-09-09 23:12:22.177726317 +0000 UTC m=+250.553300374 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/1198f3f5-48cb-44d8-a496-34e7de2d2d45-kube-rbac-proxy-cm") pod "insights-runtime-extractor-x6vdz" (UID: "1198f3f5-48cb-44d8-a496-34e7de2d2d45") : configmap "kube-rbac-proxy" not found Sep 09 23:12:20.177984 ip-10-0-132-204 kubenswrapper[2561]: E0909 23:12:20.177778 2561 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 09 23:12:20.177984 ip-10-0-132-204 kubenswrapper[2561]: E0909 23:12:20.177837 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1198f3f5-48cb-44d8-a496-34e7de2d2d45-insights-runtime-extractor-tls podName:1198f3f5-48cb-44d8-a496-34e7de2d2d45 nodeName:}" failed. No retries permitted until 2026-09-09 23:12:22.177822096 +0000 UTC m=+250.553396137 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/1198f3f5-48cb-44d8-a496-34e7de2d2d45-insights-runtime-extractor-tls") pod "insights-runtime-extractor-x6vdz" (UID: "1198f3f5-48cb-44d8-a496-34e7de2d2d45") : secret "insights-runtime-extractor-tls" not found Sep 09 23:12:20.215250 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:12:20.215224 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-2vcdm_cecbf40f-1a0a-4819-b677-6d38f3e0d3af/dns-node-resolver/0.log" Sep 09 23:12:21.216128 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:12:21.216102 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-q2mnk_a1511acb-caeb-42b1-be06-daa47d1973e3/node-ca/0.log" Sep 09 23:12:21.385981 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:12:21.385948 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/fc77a21b-a0b3-41c8-8a98-205b1bf951b8-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-mbkzn\" (UID: \"fc77a21b-a0b3-41c8-8a98-205b1bf951b8\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-mbkzn" Sep 09 23:12:21.386147 ip-10-0-132-204 kubenswrapper[2561]: E0909 23:12:21.386097 2561 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Sep 09 23:12:21.386193 ip-10-0-132-204 kubenswrapper[2561]: E0909 23:12:21.386159 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fc77a21b-a0b3-41c8-8a98-205b1bf951b8-samples-operator-tls podName:fc77a21b-a0b3-41c8-8a98-205b1bf951b8 nodeName:}" failed. No retries permitted until 2026-09-09 23:12:29.386142834 +0000 UTC m=+257.761716877 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/fc77a21b-a0b3-41c8-8a98-205b1bf951b8-samples-operator-tls") pod "cluster-samples-operator-7cdcfcf76c-mbkzn" (UID: "fc77a21b-a0b3-41c8-8a98-205b1bf951b8") : secret "samples-operator-tls" not found Sep 09 23:12:21.487370 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:12:21.487343 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9238fa77-06ef-4b6b-9544-ab94b7466815-metrics-certs\") pod \"router-default-894458656-blvvg\" (UID: \"9238fa77-06ef-4b6b-9544-ab94b7466815\") " pod="openshift-ingress/router-default-894458656-blvvg" Sep 09 23:12:21.487510 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:12:21.487446 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9238fa77-06ef-4b6b-9544-ab94b7466815-service-ca-bundle\") pod \"router-default-894458656-blvvg\" (UID: \"9238fa77-06ef-4b6b-9544-ab94b7466815\") " pod="openshift-ingress/router-default-894458656-blvvg" Sep 09 23:12:21.487544 ip-10-0-132-204 kubenswrapper[2561]: E0909 23:12:21.487498 2561 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Sep 09 23:12:21.487578 ip-10-0-132-204 kubenswrapper[2561]: E0909 23:12:21.487567 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9238fa77-06ef-4b6b-9544-ab94b7466815-metrics-certs podName:9238fa77-06ef-4b6b-9544-ab94b7466815 nodeName:}" failed. No retries permitted until 2026-09-09 23:12:29.48755135 +0000 UTC m=+257.863125394 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9238fa77-06ef-4b6b-9544-ab94b7466815-metrics-certs") pod "router-default-894458656-blvvg" (UID: "9238fa77-06ef-4b6b-9544-ab94b7466815") : secret "router-metrics-certs-default" not found Sep 09 23:12:21.487616 ip-10-0-132-204 kubenswrapper[2561]: E0909 23:12:21.487581 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9238fa77-06ef-4b6b-9544-ab94b7466815-service-ca-bundle podName:9238fa77-06ef-4b6b-9544-ab94b7466815 nodeName:}" failed. No retries permitted until 2026-09-09 23:12:29.487574805 +0000 UTC m=+257.863148845 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/9238fa77-06ef-4b6b-9544-ab94b7466815-service-ca-bundle") pod "router-default-894458656-blvvg" (UID: "9238fa77-06ef-4b6b-9544-ab94b7466815") : configmap references non-existent config key: service-ca.crt Sep 09 23:12:22.193802 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:12:22.193764 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1198f3f5-48cb-44d8-a496-34e7de2d2d45-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-x6vdz\" (UID: \"1198f3f5-48cb-44d8-a496-34e7de2d2d45\") " pod="openshift-insights/insights-runtime-extractor-x6vdz" Sep 09 23:12:22.193999 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:12:22.193816 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1198f3f5-48cb-44d8-a496-34e7de2d2d45-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-x6vdz\" (UID: \"1198f3f5-48cb-44d8-a496-34e7de2d2d45\") " pod="openshift-insights/insights-runtime-extractor-x6vdz" Sep 09 23:12:22.193999 ip-10-0-132-204 kubenswrapper[2561]: E0909 23:12:22.193894 2561 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 09 23:12:22.193999 ip-10-0-132-204 kubenswrapper[2561]: E0909 23:12:22.193920 2561 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 09 23:12:22.193999 ip-10-0-132-204 kubenswrapper[2561]: E0909 23:12:22.193964 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1198f3f5-48cb-44d8-a496-34e7de2d2d45-kube-rbac-proxy-cm podName:1198f3f5-48cb-44d8-a496-34e7de2d2d45 nodeName:}" failed. No retries permitted until 2026-09-09 23:12:26.193946188 +0000 UTC m=+254.569520241 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/1198f3f5-48cb-44d8-a496-34e7de2d2d45-kube-rbac-proxy-cm") pod "insights-runtime-extractor-x6vdz" (UID: "1198f3f5-48cb-44d8-a496-34e7de2d2d45") : configmap "kube-rbac-proxy" not found Sep 09 23:12:22.193999 ip-10-0-132-204 kubenswrapper[2561]: E0909 23:12:22.193982 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1198f3f5-48cb-44d8-a496-34e7de2d2d45-insights-runtime-extractor-tls podName:1198f3f5-48cb-44d8-a496-34e7de2d2d45 nodeName:}" failed. No retries permitted until 2026-09-09 23:12:26.193973542 +0000 UTC m=+254.569547590 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/1198f3f5-48cb-44d8-a496-34e7de2d2d45-insights-runtime-extractor-tls") pod "insights-runtime-extractor-x6vdz" (UID: "1198f3f5-48cb-44d8-a496-34e7de2d2d45") : secret "insights-runtime-extractor-tls" not found Sep 09 23:12:22.223768 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:12:22.223741 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-v2twq_117461f6-118c-4ca7-b116-9d3aff2dfdb6/serve-healthcheck-canary/0.log" Sep 09 23:12:22.900046 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:12:22.900010 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/77df7cc0-0e7e-468f-89d9-b055af5de0b3-metrics-certs\") pod \"network-metrics-daemon-ktqck\" (UID: \"77df7cc0-0e7e-468f-89d9-b055af5de0b3\") " pod="openshift-multus/network-metrics-daemon-ktqck" Sep 09 23:12:22.900245 ip-10-0-132-204 kubenswrapper[2561]: E0909 23:12:22.900178 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Sep 09 23:12:22.900316 ip-10-0-132-204 kubenswrapper[2561]: E0909 23:12:22.900254 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/77df7cc0-0e7e-468f-89d9-b055af5de0b3-metrics-certs podName:77df7cc0-0e7e-468f-89d9-b055af5de0b3 nodeName:}" failed. No retries permitted until 2026-09-09 23:14:24.900234246 +0000 UTC m=+373.275808286 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/77df7cc0-0e7e-468f-89d9-b055af5de0b3-metrics-certs") pod "network-metrics-daemon-ktqck" (UID: "77df7cc0-0e7e-468f-89d9-b055af5de0b3") : secret "metrics-daemon-secret" not found Sep 09 23:12:26.226123 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:12:26.226084 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1198f3f5-48cb-44d8-a496-34e7de2d2d45-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-x6vdz\" (UID: \"1198f3f5-48cb-44d8-a496-34e7de2d2d45\") " pod="openshift-insights/insights-runtime-extractor-x6vdz" Sep 09 23:12:26.226508 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:12:26.226134 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1198f3f5-48cb-44d8-a496-34e7de2d2d45-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-x6vdz\" (UID: \"1198f3f5-48cb-44d8-a496-34e7de2d2d45\") " pod="openshift-insights/insights-runtime-extractor-x6vdz" Sep 09 23:12:26.226508 ip-10-0-132-204 kubenswrapper[2561]: E0909 23:12:26.226210 2561 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 09 23:12:26.226508 ip-10-0-132-204 kubenswrapper[2561]: E0909 23:12:26.226233 2561 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 09 23:12:26.226508 ip-10-0-132-204 kubenswrapper[2561]: E0909 23:12:26.226276 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1198f3f5-48cb-44d8-a496-34e7de2d2d45-kube-rbac-proxy-cm podName:1198f3f5-48cb-44d8-a496-34e7de2d2d45 nodeName:}" failed. No retries permitted until 2026-09-09 23:12:34.226262539 +0000 UTC m=+262.601836580 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/1198f3f5-48cb-44d8-a496-34e7de2d2d45-kube-rbac-proxy-cm") pod "insights-runtime-extractor-x6vdz" (UID: "1198f3f5-48cb-44d8-a496-34e7de2d2d45") : configmap "kube-rbac-proxy" not found Sep 09 23:12:26.226508 ip-10-0-132-204 kubenswrapper[2561]: E0909 23:12:26.226290 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1198f3f5-48cb-44d8-a496-34e7de2d2d45-insights-runtime-extractor-tls podName:1198f3f5-48cb-44d8-a496-34e7de2d2d45 nodeName:}" failed. No retries permitted until 2026-09-09 23:12:34.226284338 +0000 UTC m=+262.601858378 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/1198f3f5-48cb-44d8-a496-34e7de2d2d45-insights-runtime-extractor-tls") pod "insights-runtime-extractor-x6vdz" (UID: "1198f3f5-48cb-44d8-a496-34e7de2d2d45") : secret "insights-runtime-extractor-tls" not found Sep 09 23:12:29.450138 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:12:29.450109 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/fc77a21b-a0b3-41c8-8a98-205b1bf951b8-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-mbkzn\" (UID: \"fc77a21b-a0b3-41c8-8a98-205b1bf951b8\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-mbkzn" Sep 09 23:12:29.452401 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:12:29.452358 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/fc77a21b-a0b3-41c8-8a98-205b1bf951b8-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-mbkzn\" (UID: \"fc77a21b-a0b3-41c8-8a98-205b1bf951b8\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-mbkzn" Sep 09 23:12:29.550792 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:12:29.550765 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9238fa77-06ef-4b6b-9544-ab94b7466815-service-ca-bundle\") pod \"router-default-894458656-blvvg\" (UID: \"9238fa77-06ef-4b6b-9544-ab94b7466815\") " pod="openshift-ingress/router-default-894458656-blvvg" Sep 09 23:12:29.550899 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:12:29.550817 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9238fa77-06ef-4b6b-9544-ab94b7466815-metrics-certs\") pod \"router-default-894458656-blvvg\" (UID: \"9238fa77-06ef-4b6b-9544-ab94b7466815\") " pod="openshift-ingress/router-default-894458656-blvvg" Sep 09 23:12:29.550942 ip-10-0-132-204 kubenswrapper[2561]: E0909 23:12:29.550927 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9238fa77-06ef-4b6b-9544-ab94b7466815-service-ca-bundle podName:9238fa77-06ef-4b6b-9544-ab94b7466815 nodeName:}" failed. No retries permitted until 2026-09-09 23:12:45.550909574 +0000 UTC m=+273.926483623 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/9238fa77-06ef-4b6b-9544-ab94b7466815-service-ca-bundle") pod "router-default-894458656-blvvg" (UID: "9238fa77-06ef-4b6b-9544-ab94b7466815") : configmap references non-existent config key: service-ca.crt Sep 09 23:12:29.556023 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:12:29.556000 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9238fa77-06ef-4b6b-9544-ab94b7466815-metrics-certs\") pod \"router-default-894458656-blvvg\" (UID: \"9238fa77-06ef-4b6b-9544-ab94b7466815\") " pod="openshift-ingress/router-default-894458656-blvvg" Sep 09 23:12:29.580795 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:12:29.580775 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-mbkzn" Sep 09 23:12:29.849730 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:12:29.849703 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-mbkzn"] Sep 09 23:12:30.023507 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:12:30.023474 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-mbkzn" event={"ID":"fc77a21b-a0b3-41c8-8a98-205b1bf951b8","Type":"ContainerStarted","Data":"799787e3dcf2559ddced1df0412c66fda4109094573844131f7ba72b0635ff64"} Sep 09 23:12:32.032650 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:12:32.032614 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-mbkzn" event={"ID":"fc77a21b-a0b3-41c8-8a98-205b1bf951b8","Type":"ContainerStarted","Data":"062563c2a37890ec4863d6d2e042c121f1f017ccc034ea80fef9c6b92a2fd528"} Sep 09 23:12:32.033007 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:12:32.032674 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-mbkzn" event={"ID":"fc77a21b-a0b3-41c8-8a98-205b1bf951b8","Type":"ContainerStarted","Data":"cf35e0f4e02581889f5025baa149cafee91b113a9159bf3e9dc812712cd8d5f4"} Sep 09 23:12:32.050663 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:12:32.050618 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-mbkzn" podStartSLOduration=17.13425753 podStartE2EDuration="19.050601146s" totalImagesPullingTime="1.916343616s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:12:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:12:32.050049962 +0000 UTC m=+260.425624060" watchObservedRunningTime="2026-09-09 23:12:32.050601146 +0000 UTC m=+260.426175209" Sep 09 23:12:34.290976 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:12:34.290903 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1198f3f5-48cb-44d8-a496-34e7de2d2d45-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-x6vdz\" (UID: \"1198f3f5-48cb-44d8-a496-34e7de2d2d45\") " pod="openshift-insights/insights-runtime-extractor-x6vdz" Sep 09 23:12:34.290976 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:12:34.290947 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1198f3f5-48cb-44d8-a496-34e7de2d2d45-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-x6vdz\" (UID: \"1198f3f5-48cb-44d8-a496-34e7de2d2d45\") " pod="openshift-insights/insights-runtime-extractor-x6vdz" Sep 09 23:12:34.291343 ip-10-0-132-204 kubenswrapper[2561]: E0909 23:12:34.291058 2561 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 09 23:12:34.291343 ip-10-0-132-204 kubenswrapper[2561]: E0909 23:12:34.291108 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1198f3f5-48cb-44d8-a496-34e7de2d2d45-insights-runtime-extractor-tls podName:1198f3f5-48cb-44d8-a496-34e7de2d2d45 nodeName:}" failed. No retries permitted until 2026-09-09 23:12:50.291095179 +0000 UTC m=+278.666669218 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/1198f3f5-48cb-44d8-a496-34e7de2d2d45-insights-runtime-extractor-tls") pod "insights-runtime-extractor-x6vdz" (UID: "1198f3f5-48cb-44d8-a496-34e7de2d2d45") : secret "insights-runtime-extractor-tls" not found Sep 09 23:12:34.291462 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:12:34.291444 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1198f3f5-48cb-44d8-a496-34e7de2d2d45-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-x6vdz\" (UID: \"1198f3f5-48cb-44d8-a496-34e7de2d2d45\") " pod="openshift-insights/insights-runtime-extractor-x6vdz" Sep 09 23:12:41.822258 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:12:41.822217 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-6c744854f9-4vtjs"] Sep 09 23:12:41.826714 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:12:41.826696 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6c744854f9-4vtjs" Sep 09 23:12:41.829762 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:12:41.829732 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Sep 09 23:12:41.829848 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:12:41.829783 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-48t55\"" Sep 09 23:12:41.829848 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:12:41.829812 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Sep 09 23:12:41.829848 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:12:41.829812 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Sep 09 23:12:41.834817 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:12:41.834795 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Sep 09 23:12:41.838420 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:12:41.838402 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6c744854f9-4vtjs"] Sep 09 23:12:41.942797 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:12:41.942766 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/20c1b743-eb6e-4d7c-84f2-f4450c1a7dd9-image-registry-private-configuration\") pod \"image-registry-6c744854f9-4vtjs\" (UID: \"20c1b743-eb6e-4d7c-84f2-f4450c1a7dd9\") " pod="openshift-image-registry/image-registry-6c744854f9-4vtjs" Sep 09 23:12:41.942797 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:12:41.942798 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/20c1b743-eb6e-4d7c-84f2-f4450c1a7dd9-registry-tls\") pod \"image-registry-6c744854f9-4vtjs\" (UID: \"20c1b743-eb6e-4d7c-84f2-f4450c1a7dd9\") " pod="openshift-image-registry/image-registry-6c744854f9-4vtjs" Sep 09 23:12:41.942984 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:12:41.942818 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rcssj\" (UniqueName: \"kubernetes.io/projected/20c1b743-eb6e-4d7c-84f2-f4450c1a7dd9-kube-api-access-rcssj\") pod \"image-registry-6c744854f9-4vtjs\" (UID: \"20c1b743-eb6e-4d7c-84f2-f4450c1a7dd9\") " pod="openshift-image-registry/image-registry-6c744854f9-4vtjs" Sep 09 23:12:41.942984 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:12:41.942928 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/20c1b743-eb6e-4d7c-84f2-f4450c1a7dd9-ca-trust-extracted\") pod \"image-registry-6c744854f9-4vtjs\" (UID: \"20c1b743-eb6e-4d7c-84f2-f4450c1a7dd9\") " pod="openshift-image-registry/image-registry-6c744854f9-4vtjs" Sep 09 23:12:41.942984 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:12:41.942967 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/20c1b743-eb6e-4d7c-84f2-f4450c1a7dd9-trusted-ca\") pod \"image-registry-6c744854f9-4vtjs\" (UID: \"20c1b743-eb6e-4d7c-84f2-f4450c1a7dd9\") " pod="openshift-image-registry/image-registry-6c744854f9-4vtjs" Sep 09 23:12:41.943148 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:12:41.942994 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/20c1b743-eb6e-4d7c-84f2-f4450c1a7dd9-installation-pull-secrets\") pod \"image-registry-6c744854f9-4vtjs\" (UID: \"20c1b743-eb6e-4d7c-84f2-f4450c1a7dd9\") " pod="openshift-image-registry/image-registry-6c744854f9-4vtjs" Sep 09 23:12:41.943148 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:12:41.943053 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/20c1b743-eb6e-4d7c-84f2-f4450c1a7dd9-registry-certificates\") pod \"image-registry-6c744854f9-4vtjs\" (UID: \"20c1b743-eb6e-4d7c-84f2-f4450c1a7dd9\") " pod="openshift-image-registry/image-registry-6c744854f9-4vtjs" Sep 09 23:12:41.943148 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:12:41.943085 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/20c1b743-eb6e-4d7c-84f2-f4450c1a7dd9-bound-sa-token\") pod \"image-registry-6c744854f9-4vtjs\" (UID: \"20c1b743-eb6e-4d7c-84f2-f4450c1a7dd9\") " pod="openshift-image-registry/image-registry-6c744854f9-4vtjs" Sep 09 23:12:42.043563 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:12:42.043527 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/20c1b743-eb6e-4d7c-84f2-f4450c1a7dd9-ca-trust-extracted\") pod \"image-registry-6c744854f9-4vtjs\" (UID: \"20c1b743-eb6e-4d7c-84f2-f4450c1a7dd9\") " pod="openshift-image-registry/image-registry-6c744854f9-4vtjs" Sep 09 23:12:42.043729 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:12:42.043580 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/20c1b743-eb6e-4d7c-84f2-f4450c1a7dd9-trusted-ca\") pod \"image-registry-6c744854f9-4vtjs\" (UID: \"20c1b743-eb6e-4d7c-84f2-f4450c1a7dd9\") " pod="openshift-image-registry/image-registry-6c744854f9-4vtjs" Sep 09 23:12:42.043729 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:12:42.043599 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/20c1b743-eb6e-4d7c-84f2-f4450c1a7dd9-installation-pull-secrets\") pod \"image-registry-6c744854f9-4vtjs\" (UID: \"20c1b743-eb6e-4d7c-84f2-f4450c1a7dd9\") " pod="openshift-image-registry/image-registry-6c744854f9-4vtjs" Sep 09 23:12:42.043729 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:12:42.043620 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/20c1b743-eb6e-4d7c-84f2-f4450c1a7dd9-registry-certificates\") pod \"image-registry-6c744854f9-4vtjs\" (UID: \"20c1b743-eb6e-4d7c-84f2-f4450c1a7dd9\") " pod="openshift-image-registry/image-registry-6c744854f9-4vtjs" Sep 09 23:12:42.043729 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:12:42.043635 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/20c1b743-eb6e-4d7c-84f2-f4450c1a7dd9-bound-sa-token\") pod \"image-registry-6c744854f9-4vtjs\" (UID: \"20c1b743-eb6e-4d7c-84f2-f4450c1a7dd9\") " pod="openshift-image-registry/image-registry-6c744854f9-4vtjs" Sep 09 23:12:42.043729 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:12:42.043674 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/20c1b743-eb6e-4d7c-84f2-f4450c1a7dd9-image-registry-private-configuration\") pod \"image-registry-6c744854f9-4vtjs\" (UID: \"20c1b743-eb6e-4d7c-84f2-f4450c1a7dd9\") " pod="openshift-image-registry/image-registry-6c744854f9-4vtjs" Sep 09 23:12:42.043729 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:12:42.043691 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/20c1b743-eb6e-4d7c-84f2-f4450c1a7dd9-registry-tls\") pod \"image-registry-6c744854f9-4vtjs\" (UID: \"20c1b743-eb6e-4d7c-84f2-f4450c1a7dd9\") " pod="openshift-image-registry/image-registry-6c744854f9-4vtjs" Sep 09 23:12:42.043729 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:12:42.043712 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rcssj\" (UniqueName: \"kubernetes.io/projected/20c1b743-eb6e-4d7c-84f2-f4450c1a7dd9-kube-api-access-rcssj\") pod \"image-registry-6c744854f9-4vtjs\" (UID: \"20c1b743-eb6e-4d7c-84f2-f4450c1a7dd9\") " pod="openshift-image-registry/image-registry-6c744854f9-4vtjs" Sep 09 23:12:42.044047 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:12:42.044030 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/20c1b743-eb6e-4d7c-84f2-f4450c1a7dd9-ca-trust-extracted\") pod \"image-registry-6c744854f9-4vtjs\" (UID: \"20c1b743-eb6e-4d7c-84f2-f4450c1a7dd9\") " pod="openshift-image-registry/image-registry-6c744854f9-4vtjs" Sep 09 23:12:42.044494 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:12:42.044468 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/20c1b743-eb6e-4d7c-84f2-f4450c1a7dd9-registry-certificates\") pod \"image-registry-6c744854f9-4vtjs\" (UID: \"20c1b743-eb6e-4d7c-84f2-f4450c1a7dd9\") " pod="openshift-image-registry/image-registry-6c744854f9-4vtjs" Sep 09 23:12:42.044867 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:12:42.044839 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/20c1b743-eb6e-4d7c-84f2-f4450c1a7dd9-trusted-ca\") pod \"image-registry-6c744854f9-4vtjs\" (UID: \"20c1b743-eb6e-4d7c-84f2-f4450c1a7dd9\") " pod="openshift-image-registry/image-registry-6c744854f9-4vtjs" Sep 09 23:12:42.046193 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:12:42.046174 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/20c1b743-eb6e-4d7c-84f2-f4450c1a7dd9-installation-pull-secrets\") pod \"image-registry-6c744854f9-4vtjs\" (UID: \"20c1b743-eb6e-4d7c-84f2-f4450c1a7dd9\") " pod="openshift-image-registry/image-registry-6c744854f9-4vtjs" Sep 09 23:12:42.046429 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:12:42.046409 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/20c1b743-eb6e-4d7c-84f2-f4450c1a7dd9-registry-tls\") pod \"image-registry-6c744854f9-4vtjs\" (UID: \"20c1b743-eb6e-4d7c-84f2-f4450c1a7dd9\") " pod="openshift-image-registry/image-registry-6c744854f9-4vtjs" Sep 09 23:12:42.046480 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:12:42.046449 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/20c1b743-eb6e-4d7c-84f2-f4450c1a7dd9-image-registry-private-configuration\") pod \"image-registry-6c744854f9-4vtjs\" (UID: \"20c1b743-eb6e-4d7c-84f2-f4450c1a7dd9\") " pod="openshift-image-registry/image-registry-6c744854f9-4vtjs" Sep 09 23:12:42.052295 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:12:42.052271 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rcssj\" (UniqueName: \"kubernetes.io/projected/20c1b743-eb6e-4d7c-84f2-f4450c1a7dd9-kube-api-access-rcssj\") pod \"image-registry-6c744854f9-4vtjs\" (UID: \"20c1b743-eb6e-4d7c-84f2-f4450c1a7dd9\") " pod="openshift-image-registry/image-registry-6c744854f9-4vtjs" Sep 09 23:12:42.052417 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:12:42.052402 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/20c1b743-eb6e-4d7c-84f2-f4450c1a7dd9-bound-sa-token\") pod \"image-registry-6c744854f9-4vtjs\" (UID: \"20c1b743-eb6e-4d7c-84f2-f4450c1a7dd9\") " pod="openshift-image-registry/image-registry-6c744854f9-4vtjs" Sep 09 23:12:42.136626 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:12:42.136552 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6c744854f9-4vtjs" Sep 09 23:12:42.417995 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:12:42.417973 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6c744854f9-4vtjs"] Sep 09 23:12:42.420043 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:12:42.420017 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod20c1b743_eb6e_4d7c_84f2_f4450c1a7dd9.slice/crio-0c42b3bbd753b826cb4a20f58e4e36c9af988c71db084bab85265b23f6cc7374 WatchSource:0}: Error finding container 0c42b3bbd753b826cb4a20f58e4e36c9af988c71db084bab85265b23f6cc7374: Status 404 returned error can't find the container with id 0c42b3bbd753b826cb4a20f58e4e36c9af988c71db084bab85265b23f6cc7374 Sep 09 23:12:43.067780 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:12:43.067745 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6c744854f9-4vtjs" event={"ID":"20c1b743-eb6e-4d7c-84f2-f4450c1a7dd9","Type":"ContainerStarted","Data":"cac6e0eeaa1d19a100670592d812a688b609ca16c68fb5abbbf09c240ea10e5b"} Sep 09 23:12:43.068121 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:12:43.067791 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6c744854f9-4vtjs" event={"ID":"20c1b743-eb6e-4d7c-84f2-f4450c1a7dd9","Type":"ContainerStarted","Data":"0c42b3bbd753b826cb4a20f58e4e36c9af988c71db084bab85265b23f6cc7374"} Sep 09 23:12:43.068121 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:12:43.067884 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-6c744854f9-4vtjs" Sep 09 23:12:43.088537 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:12:43.088495 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-6c744854f9-4vtjs" podStartSLOduration=2.08848182 podStartE2EDuration="2.08848182s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:12:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:12:43.086835792 +0000 UTC m=+271.462409856" watchObservedRunningTime="2026-09-09 23:12:43.08848182 +0000 UTC m=+271.464055893" Sep 09 23:12:45.570469 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:12:45.570433 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9238fa77-06ef-4b6b-9544-ab94b7466815-service-ca-bundle\") pod \"router-default-894458656-blvvg\" (UID: \"9238fa77-06ef-4b6b-9544-ab94b7466815\") " pod="openshift-ingress/router-default-894458656-blvvg" Sep 09 23:12:45.571004 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:12:45.570986 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9238fa77-06ef-4b6b-9544-ab94b7466815-service-ca-bundle\") pod \"router-default-894458656-blvvg\" (UID: \"9238fa77-06ef-4b6b-9544-ab94b7466815\") " pod="openshift-ingress/router-default-894458656-blvvg" Sep 09 23:12:45.576346 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:12:45.576328 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-894458656-blvvg" Sep 09 23:12:45.893286 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:12:45.893258 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9238fa77_06ef_4b6b_9544_ab94b7466815.slice/crio-9cc522f5a83f6ad3505f7f2cfb4ed50128b277c3d5dd4b296e7c5ab411b6f499 WatchSource:0}: Error finding container 9cc522f5a83f6ad3505f7f2cfb4ed50128b277c3d5dd4b296e7c5ab411b6f499: Status 404 returned error can't find the container with id 9cc522f5a83f6ad3505f7f2cfb4ed50128b277c3d5dd4b296e7c5ab411b6f499 Sep 09 23:12:45.894321 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:12:45.894299 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-894458656-blvvg"] Sep 09 23:12:46.077933 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:12:46.077894 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-894458656-blvvg" event={"ID":"9238fa77-06ef-4b6b-9544-ab94b7466815","Type":"ContainerStarted","Data":"de1a21a0ad3d68ca09e577c9f77cdfb223c184d3e044e605512630e3c3169ca5"} Sep 09 23:12:46.078078 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:12:46.077950 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-894458656-blvvg" event={"ID":"9238fa77-06ef-4b6b-9544-ab94b7466815","Type":"ContainerStarted","Data":"9cc522f5a83f6ad3505f7f2cfb4ed50128b277c3d5dd4b296e7c5ab411b6f499"} Sep 09 23:12:46.096632 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:12:46.096586 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-894458656-blvvg" podStartSLOduration=33.096570561 podStartE2EDuration="33.096570561s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:12:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:12:46.09519712 +0000 UTC m=+274.470771182" watchObservedRunningTime="2026-09-09 23:12:46.096570561 +0000 UTC m=+274.472144623" Sep 09 23:12:46.576908 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:12:46.576871 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-894458656-blvvg" Sep 09 23:12:46.579380 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:12:46.579344 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-894458656-blvvg" Sep 09 23:12:47.081237 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:12:47.081209 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-894458656-blvvg" Sep 09 23:12:47.082344 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:12:47.082323 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-894458656-blvvg" Sep 09 23:12:50.305344 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:12:50.305307 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1198f3f5-48cb-44d8-a496-34e7de2d2d45-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-x6vdz\" (UID: \"1198f3f5-48cb-44d8-a496-34e7de2d2d45\") " pod="openshift-insights/insights-runtime-extractor-x6vdz" Sep 09 23:12:50.307776 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:12:50.307753 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1198f3f5-48cb-44d8-a496-34e7de2d2d45-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-x6vdz\" (UID: \"1198f3f5-48cb-44d8-a496-34e7de2d2d45\") " pod="openshift-insights/insights-runtime-extractor-x6vdz" Sep 09 23:12:50.599592 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:12:50.599492 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-x6vdz" Sep 09 23:12:50.872547 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:12:50.872480 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-x6vdz"] Sep 09 23:12:50.875279 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:12:50.875248 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1198f3f5_48cb_44d8_a496_34e7de2d2d45.slice/crio-e89580f6e96fe68bb66f8a594de7f7ca59594642c6fcbbcb19ebaa1b0b521b6e WatchSource:0}: Error finding container e89580f6e96fe68bb66f8a594de7f7ca59594642c6fcbbcb19ebaa1b0b521b6e: Status 404 returned error can't find the container with id e89580f6e96fe68bb66f8a594de7f7ca59594642c6fcbbcb19ebaa1b0b521b6e Sep 09 23:12:51.095662 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:12:51.095632 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-x6vdz" event={"ID":"1198f3f5-48cb-44d8-a496-34e7de2d2d45","Type":"ContainerStarted","Data":"74c9f8d19ed8a330c23abd640d587a6e5d88c693ec945e3f0e1f47f8a9859b32"} Sep 09 23:12:51.095832 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:12:51.095685 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-x6vdz" event={"ID":"1198f3f5-48cb-44d8-a496-34e7de2d2d45","Type":"ContainerStarted","Data":"e89580f6e96fe68bb66f8a594de7f7ca59594642c6fcbbcb19ebaa1b0b521b6e"} Sep 09 23:12:52.100888 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:12:52.100854 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-x6vdz" event={"ID":"1198f3f5-48cb-44d8-a496-34e7de2d2d45","Type":"ContainerStarted","Data":"9b1eb8559f08f4b2a0379d69c1106c55ee3740aeb88c524ee903a2559a8a4ae0"} Sep 09 23:12:53.773284 ip-10-0-132-204 kubenswrapper[2561]: E0909 23:12:53.773233 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-cvlgc" podUID="0da6e759-847b-4f85-b775-a82a83eb8ae2" Sep 09 23:12:54.108382 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:12:54.108283 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-x6vdz" event={"ID":"1198f3f5-48cb-44d8-a496-34e7de2d2d45","Type":"ContainerStarted","Data":"5a8607bc1181ca6576a3862a71f735e7203d7caefa7878670f7220de65e0b252"} Sep 09 23:12:54.108382 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:12:54.108308 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-cvlgc" Sep 09 23:12:54.127180 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:12:54.127137 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-x6vdz" podStartSLOduration=33.997033443 podStartE2EDuration="36.127122561s" totalImagesPullingTime="2.130089118s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 23:12:18 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:12:54.12543953 +0000 UTC m=+282.501013594" watchObservedRunningTime="2026-09-09 23:12:54.127122561 +0000 UTC m=+282.502696622" Sep 09 23:12:56.918083 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:12:56.918045 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-zltt8"] Sep 09 23:12:56.921548 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:12:56.921528 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-zltt8" Sep 09 23:12:56.923891 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:12:56.923872 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Sep 09 23:12:56.924122 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:12:56.924102 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Sep 09 23:12:56.924200 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:12:56.924122 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Sep 09 23:12:56.924429 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:12:56.924414 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Sep 09 23:12:56.925495 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:12:56.925473 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-hzzbt\"" Sep 09 23:12:56.925619 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:12:56.925509 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Sep 09 23:12:56.925619 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:12:56.925538 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Sep 09 23:12:56.957665 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:12:56.957635 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0da6e759-847b-4f85-b775-a82a83eb8ae2-metrics-tls\") pod \"dns-default-cvlgc\" (UID: \"0da6e759-847b-4f85-b775-a82a83eb8ae2\") " pod="openshift-dns/dns-default-cvlgc" Sep 09 23:12:56.959991 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:12:56.959974 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0da6e759-847b-4f85-b775-a82a83eb8ae2-metrics-tls\") pod \"dns-default-cvlgc\" (UID: \"0da6e759-847b-4f85-b775-a82a83eb8ae2\") " pod="openshift-dns/dns-default-cvlgc" Sep 09 23:12:57.058577 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:12:57.058544 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d6ts4\" (UniqueName: \"kubernetes.io/projected/8c702585-be92-4326-80b9-532cb4dfbb69-kube-api-access-d6ts4\") pod \"node-exporter-zltt8\" (UID: \"8c702585-be92-4326-80b9-532cb4dfbb69\") " pod="openshift-monitoring/node-exporter-zltt8" Sep 09 23:12:57.058577 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:12:57.058580 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/8c702585-be92-4326-80b9-532cb4dfbb69-node-exporter-textfile\") pod \"node-exporter-zltt8\" (UID: \"8c702585-be92-4326-80b9-532cb4dfbb69\") " pod="openshift-monitoring/node-exporter-zltt8" Sep 09 23:12:57.058799 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:12:57.058599 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/8c702585-be92-4326-80b9-532cb4dfbb69-node-exporter-wtmp\") pod \"node-exporter-zltt8\" (UID: \"8c702585-be92-4326-80b9-532cb4dfbb69\") " pod="openshift-monitoring/node-exporter-zltt8" Sep 09 23:12:57.058799 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:12:57.058636 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/8c702585-be92-4326-80b9-532cb4dfbb69-node-exporter-accelerators-collector-config\") pod \"node-exporter-zltt8\" (UID: \"8c702585-be92-4326-80b9-532cb4dfbb69\") " pod="openshift-monitoring/node-exporter-zltt8" Sep 09 23:12:57.058799 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:12:57.058700 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8c702585-be92-4326-80b9-532cb4dfbb69-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-zltt8\" (UID: \"8c702585-be92-4326-80b9-532cb4dfbb69\") " pod="openshift-monitoring/node-exporter-zltt8" Sep 09 23:12:57.058799 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:12:57.058730 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8c702585-be92-4326-80b9-532cb4dfbb69-sys\") pod \"node-exporter-zltt8\" (UID: \"8c702585-be92-4326-80b9-532cb4dfbb69\") " pod="openshift-monitoring/node-exporter-zltt8" Sep 09 23:12:57.058799 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:12:57.058750 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/8c702585-be92-4326-80b9-532cb4dfbb69-node-exporter-tls\") pod \"node-exporter-zltt8\" (UID: \"8c702585-be92-4326-80b9-532cb4dfbb69\") " pod="openshift-monitoring/node-exporter-zltt8" Sep 09 23:12:57.058799 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:12:57.058787 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8c702585-be92-4326-80b9-532cb4dfbb69-metrics-client-ca\") pod \"node-exporter-zltt8\" (UID: \"8c702585-be92-4326-80b9-532cb4dfbb69\") " pod="openshift-monitoring/node-exporter-zltt8" Sep 09 23:12:57.058967 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:12:57.058806 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/8c702585-be92-4326-80b9-532cb4dfbb69-root\") pod \"node-exporter-zltt8\" (UID: \"8c702585-be92-4326-80b9-532cb4dfbb69\") " pod="openshift-monitoring/node-exporter-zltt8" Sep 09 23:12:57.111522 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:12:57.111492 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-249ln\"" Sep 09 23:12:57.119492 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:12:57.119469 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-cvlgc" Sep 09 23:12:57.160002 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:12:57.159970 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/8c702585-be92-4326-80b9-532cb4dfbb69-node-exporter-tls\") pod \"node-exporter-zltt8\" (UID: \"8c702585-be92-4326-80b9-532cb4dfbb69\") " pod="openshift-monitoring/node-exporter-zltt8" Sep 09 23:12:57.160002 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:12:57.160009 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8c702585-be92-4326-80b9-532cb4dfbb69-metrics-client-ca\") pod \"node-exporter-zltt8\" (UID: \"8c702585-be92-4326-80b9-532cb4dfbb69\") " pod="openshift-monitoring/node-exporter-zltt8" Sep 09 23:12:57.160185 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:12:57.160029 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/8c702585-be92-4326-80b9-532cb4dfbb69-root\") pod \"node-exporter-zltt8\" (UID: \"8c702585-be92-4326-80b9-532cb4dfbb69\") " pod="openshift-monitoring/node-exporter-zltt8" Sep 09 23:12:57.160185 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:12:57.160053 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d6ts4\" (UniqueName: \"kubernetes.io/projected/8c702585-be92-4326-80b9-532cb4dfbb69-kube-api-access-d6ts4\") pod \"node-exporter-zltt8\" (UID: \"8c702585-be92-4326-80b9-532cb4dfbb69\") " pod="openshift-monitoring/node-exporter-zltt8" Sep 09 23:12:57.160185 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:12:57.160106 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/8c702585-be92-4326-80b9-532cb4dfbb69-node-exporter-textfile\") pod \"node-exporter-zltt8\" (UID: \"8c702585-be92-4326-80b9-532cb4dfbb69\") " pod="openshift-monitoring/node-exporter-zltt8" Sep 09 23:12:57.160185 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:12:57.160122 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/8c702585-be92-4326-80b9-532cb4dfbb69-root\") pod \"node-exporter-zltt8\" (UID: \"8c702585-be92-4326-80b9-532cb4dfbb69\") " pod="openshift-monitoring/node-exporter-zltt8" Sep 09 23:12:57.160185 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:12:57.160135 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/8c702585-be92-4326-80b9-532cb4dfbb69-node-exporter-wtmp\") pod \"node-exporter-zltt8\" (UID: \"8c702585-be92-4326-80b9-532cb4dfbb69\") " pod="openshift-monitoring/node-exporter-zltt8" Sep 09 23:12:57.160185 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:12:57.160180 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/8c702585-be92-4326-80b9-532cb4dfbb69-node-exporter-accelerators-collector-config\") pod \"node-exporter-zltt8\" (UID: \"8c702585-be92-4326-80b9-532cb4dfbb69\") " pod="openshift-monitoring/node-exporter-zltt8" Sep 09 23:12:57.160359 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:12:57.160221 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8c702585-be92-4326-80b9-532cb4dfbb69-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-zltt8\" (UID: \"8c702585-be92-4326-80b9-532cb4dfbb69\") " pod="openshift-monitoring/node-exporter-zltt8" Sep 09 23:12:57.160359 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:12:57.160250 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8c702585-be92-4326-80b9-532cb4dfbb69-sys\") pod \"node-exporter-zltt8\" (UID: \"8c702585-be92-4326-80b9-532cb4dfbb69\") " pod="openshift-monitoring/node-exporter-zltt8" Sep 09 23:12:57.160359 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:12:57.160308 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8c702585-be92-4326-80b9-532cb4dfbb69-sys\") pod \"node-exporter-zltt8\" (UID: \"8c702585-be92-4326-80b9-532cb4dfbb69\") " pod="openshift-monitoring/node-exporter-zltt8" Sep 09 23:12:57.160469 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:12:57.160389 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/8c702585-be92-4326-80b9-532cb4dfbb69-node-exporter-wtmp\") pod \"node-exporter-zltt8\" (UID: \"8c702585-be92-4326-80b9-532cb4dfbb69\") " pod="openshift-monitoring/node-exporter-zltt8" Sep 09 23:12:57.160533 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:12:57.160513 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/8c702585-be92-4326-80b9-532cb4dfbb69-node-exporter-textfile\") pod \"node-exporter-zltt8\" (UID: \"8c702585-be92-4326-80b9-532cb4dfbb69\") " pod="openshift-monitoring/node-exporter-zltt8" Sep 09 23:12:57.160809 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:12:57.160791 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/8c702585-be92-4326-80b9-532cb4dfbb69-node-exporter-accelerators-collector-config\") pod \"node-exporter-zltt8\" (UID: \"8c702585-be92-4326-80b9-532cb4dfbb69\") " pod="openshift-monitoring/node-exporter-zltt8" Sep 09 23:12:57.160844 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:12:57.160797 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8c702585-be92-4326-80b9-532cb4dfbb69-metrics-client-ca\") pod \"node-exporter-zltt8\" (UID: \"8c702585-be92-4326-80b9-532cb4dfbb69\") " pod="openshift-monitoring/node-exporter-zltt8" Sep 09 23:12:57.160905 ip-10-0-132-204 kubenswrapper[2561]: E0909 23:12:57.160887 2561 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Sep 09 23:12:57.160970 ip-10-0-132-204 kubenswrapper[2561]: E0909 23:12:57.160960 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8c702585-be92-4326-80b9-532cb4dfbb69-node-exporter-tls podName:8c702585-be92-4326-80b9-532cb4dfbb69 nodeName:}" failed. No retries permitted until 2026-09-09 23:12:57.660941711 +0000 UTC m=+286.036515760 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/8c702585-be92-4326-80b9-532cb4dfbb69-node-exporter-tls") pod "node-exporter-zltt8" (UID: "8c702585-be92-4326-80b9-532cb4dfbb69") : secret "node-exporter-tls" not found Sep 09 23:12:57.162785 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:12:57.162765 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8c702585-be92-4326-80b9-532cb4dfbb69-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-zltt8\" (UID: \"8c702585-be92-4326-80b9-532cb4dfbb69\") " pod="openshift-monitoring/node-exporter-zltt8" Sep 09 23:12:57.169688 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:12:57.169636 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d6ts4\" (UniqueName: \"kubernetes.io/projected/8c702585-be92-4326-80b9-532cb4dfbb69-kube-api-access-d6ts4\") pod \"node-exporter-zltt8\" (UID: \"8c702585-be92-4326-80b9-532cb4dfbb69\") " pod="openshift-monitoring/node-exporter-zltt8" Sep 09 23:12:57.392871 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:12:57.392841 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-cvlgc"] Sep 09 23:12:57.395464 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:12:57.395438 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0da6e759_847b_4f85_b775_a82a83eb8ae2.slice/crio-91a6e10ec5ded8530cf87f7aba6e06e6d0263f9de7dfa3487c60dbdb3f3bbd43 WatchSource:0}: Error finding container 91a6e10ec5ded8530cf87f7aba6e06e6d0263f9de7dfa3487c60dbdb3f3bbd43: Status 404 returned error can't find the container with id 91a6e10ec5ded8530cf87f7aba6e06e6d0263f9de7dfa3487c60dbdb3f3bbd43 Sep 09 23:12:57.664869 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:12:57.664835 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/8c702585-be92-4326-80b9-532cb4dfbb69-node-exporter-tls\") pod \"node-exporter-zltt8\" (UID: \"8c702585-be92-4326-80b9-532cb4dfbb69\") " pod="openshift-monitoring/node-exporter-zltt8" Sep 09 23:12:57.667226 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:12:57.667199 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/8c702585-be92-4326-80b9-532cb4dfbb69-node-exporter-tls\") pod \"node-exporter-zltt8\" (UID: \"8c702585-be92-4326-80b9-532cb4dfbb69\") " pod="openshift-monitoring/node-exporter-zltt8" Sep 09 23:12:57.830471 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:12:57.830393 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-zltt8" Sep 09 23:12:57.842673 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:12:57.842645 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8c702585_be92_4326_80b9_532cb4dfbb69.slice/crio-5f2d9a838cbc380674076562ad85db0723f364b17fa25a28a1cd362cec5a9b18 WatchSource:0}: Error finding container 5f2d9a838cbc380674076562ad85db0723f364b17fa25a28a1cd362cec5a9b18: Status 404 returned error can't find the container with id 5f2d9a838cbc380674076562ad85db0723f364b17fa25a28a1cd362cec5a9b18 Sep 09 23:12:57.962133 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:12:57.962061 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 09 23:12:57.966960 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:12:57.966918 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:12:57.970208 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:12:57.970165 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Sep 09 23:12:57.970347 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:12:57.970312 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Sep 09 23:12:57.970444 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:12:57.970312 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Sep 09 23:12:57.970668 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:12:57.970598 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Sep 09 23:12:57.970918 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:12:57.970715 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Sep 09 23:12:57.970918 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:12:57.970782 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Sep 09 23:12:57.970918 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:12:57.970782 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-xwk2g\"" Sep 09 23:12:57.970918 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:12:57.970817 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Sep 09 23:12:57.970918 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:12:57.970901 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Sep 09 23:12:57.971195 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:12:57.971008 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Sep 09 23:12:58.011554 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:12:58.011525 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 09 23:12:58.068282 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:12:58.068245 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/8eb6951b-4a31-41cb-ad67-acca8d2633f8-config-volume\") pod \"alertmanager-main-0\" (UID: \"8eb6951b-4a31-41cb-ad67-acca8d2633f8\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:12:58.068282 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:12:58.068286 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8eb6951b-4a31-41cb-ad67-acca8d2633f8-config-out\") pod \"alertmanager-main-0\" (UID: \"8eb6951b-4a31-41cb-ad67-acca8d2633f8\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:12:58.068502 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:12:58.068330 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w6kt2\" (UniqueName: \"kubernetes.io/projected/8eb6951b-4a31-41cb-ad67-acca8d2633f8-kube-api-access-w6kt2\") pod \"alertmanager-main-0\" (UID: \"8eb6951b-4a31-41cb-ad67-acca8d2633f8\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:12:58.068502 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:12:58.068440 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8eb6951b-4a31-41cb-ad67-acca8d2633f8-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"8eb6951b-4a31-41cb-ad67-acca8d2633f8\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:12:58.068502 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:12:58.068483 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/8eb6951b-4a31-41cb-ad67-acca8d2633f8-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"8eb6951b-4a31-41cb-ad67-acca8d2633f8\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:12:58.068687 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:12:58.068503 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8eb6951b-4a31-41cb-ad67-acca8d2633f8-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"8eb6951b-4a31-41cb-ad67-acca8d2633f8\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:12:58.068687 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:12:58.068575 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8eb6951b-4a31-41cb-ad67-acca8d2633f8-tls-assets\") pod \"alertmanager-main-0\" (UID: \"8eb6951b-4a31-41cb-ad67-acca8d2633f8\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:12:58.068687 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:12:58.068613 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/8eb6951b-4a31-41cb-ad67-acca8d2633f8-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"8eb6951b-4a31-41cb-ad67-acca8d2633f8\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:12:58.068687 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:12:58.068642 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8eb6951b-4a31-41cb-ad67-acca8d2633f8-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"8eb6951b-4a31-41cb-ad67-acca8d2633f8\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:12:58.068687 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:12:58.068658 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8eb6951b-4a31-41cb-ad67-acca8d2633f8-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"8eb6951b-4a31-41cb-ad67-acca8d2633f8\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:12:58.068687 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:12:58.068682 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/8eb6951b-4a31-41cb-ad67-acca8d2633f8-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"8eb6951b-4a31-41cb-ad67-acca8d2633f8\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:12:58.068920 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:12:58.068706 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8eb6951b-4a31-41cb-ad67-acca8d2633f8-web-config\") pod \"alertmanager-main-0\" (UID: \"8eb6951b-4a31-41cb-ad67-acca8d2633f8\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:12:58.068920 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:12:58.068752 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/8eb6951b-4a31-41cb-ad67-acca8d2633f8-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"8eb6951b-4a31-41cb-ad67-acca8d2633f8\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:12:58.122564 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:12:58.122525 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-zltt8" event={"ID":"8c702585-be92-4326-80b9-532cb4dfbb69","Type":"ContainerStarted","Data":"5f2d9a838cbc380674076562ad85db0723f364b17fa25a28a1cd362cec5a9b18"} Sep 09 23:12:58.123836 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:12:58.123808 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-cvlgc" event={"ID":"0da6e759-847b-4f85-b775-a82a83eb8ae2","Type":"ContainerStarted","Data":"91a6e10ec5ded8530cf87f7aba6e06e6d0263f9de7dfa3487c60dbdb3f3bbd43"} Sep 09 23:12:58.169259 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:12:58.169217 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/8eb6951b-4a31-41cb-ad67-acca8d2633f8-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"8eb6951b-4a31-41cb-ad67-acca8d2633f8\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:12:58.169448 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:12:58.169268 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8eb6951b-4a31-41cb-ad67-acca8d2633f8-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"8eb6951b-4a31-41cb-ad67-acca8d2633f8\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:12:58.169448 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:12:58.169314 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8eb6951b-4a31-41cb-ad67-acca8d2633f8-tls-assets\") pod \"alertmanager-main-0\" (UID: \"8eb6951b-4a31-41cb-ad67-acca8d2633f8\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:12:58.169448 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:12:58.169355 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/8eb6951b-4a31-41cb-ad67-acca8d2633f8-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"8eb6951b-4a31-41cb-ad67-acca8d2633f8\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:12:58.169448 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:12:58.169402 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8eb6951b-4a31-41cb-ad67-acca8d2633f8-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"8eb6951b-4a31-41cb-ad67-acca8d2633f8\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:12:58.169448 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:12:58.169424 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8eb6951b-4a31-41cb-ad67-acca8d2633f8-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"8eb6951b-4a31-41cb-ad67-acca8d2633f8\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:12:58.169448 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:12:58.169449 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/8eb6951b-4a31-41cb-ad67-acca8d2633f8-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"8eb6951b-4a31-41cb-ad67-acca8d2633f8\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:12:58.169739 ip-10-0-132-204 kubenswrapper[2561]: E0909 23:12:58.169489 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8eb6951b-4a31-41cb-ad67-acca8d2633f8-alertmanager-trusted-ca-bundle podName:8eb6951b-4a31-41cb-ad67-acca8d2633f8 nodeName:}" failed. No retries permitted until 2026-09-09 23:12:58.669462489 +0000 UTC m=+287.045036544 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "alertmanager-trusted-ca-bundle" (UniqueName: "kubernetes.io/configmap/8eb6951b-4a31-41cb-ad67-acca8d2633f8-alertmanager-trusted-ca-bundle") pod "alertmanager-main-0" (UID: "8eb6951b-4a31-41cb-ad67-acca8d2633f8") : configmap references non-existent config key: ca-bundle.crt Sep 09 23:12:58.169739 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:12:58.169521 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8eb6951b-4a31-41cb-ad67-acca8d2633f8-web-config\") pod \"alertmanager-main-0\" (UID: \"8eb6951b-4a31-41cb-ad67-acca8d2633f8\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:12:58.169739 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:12:58.169557 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/8eb6951b-4a31-41cb-ad67-acca8d2633f8-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"8eb6951b-4a31-41cb-ad67-acca8d2633f8\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:12:58.169739 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:12:58.169596 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/8eb6951b-4a31-41cb-ad67-acca8d2633f8-config-volume\") pod \"alertmanager-main-0\" (UID: \"8eb6951b-4a31-41cb-ad67-acca8d2633f8\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:12:58.169739 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:12:58.169618 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8eb6951b-4a31-41cb-ad67-acca8d2633f8-config-out\") pod \"alertmanager-main-0\" (UID: \"8eb6951b-4a31-41cb-ad67-acca8d2633f8\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:12:58.169739 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:12:58.169639 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w6kt2\" (UniqueName: \"kubernetes.io/projected/8eb6951b-4a31-41cb-ad67-acca8d2633f8-kube-api-access-w6kt2\") pod \"alertmanager-main-0\" (UID: \"8eb6951b-4a31-41cb-ad67-acca8d2633f8\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:12:58.170045 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:12:58.169764 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8eb6951b-4a31-41cb-ad67-acca8d2633f8-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"8eb6951b-4a31-41cb-ad67-acca8d2633f8\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:12:58.170764 ip-10-0-132-204 kubenswrapper[2561]: E0909 23:12:58.169526 2561 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found Sep 09 23:12:58.170764 ip-10-0-132-204 kubenswrapper[2561]: E0909 23:12:58.170331 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8eb6951b-4a31-41cb-ad67-acca8d2633f8-secret-alertmanager-main-tls podName:8eb6951b-4a31-41cb-ad67-acca8d2633f8 nodeName:}" failed. No retries permitted until 2026-09-09 23:12:58.670309906 +0000 UTC m=+287.045883962 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/8eb6951b-4a31-41cb-ad67-acca8d2633f8-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "8eb6951b-4a31-41cb-ad67-acca8d2633f8") : secret "alertmanager-main-tls" not found Sep 09 23:12:58.170764 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:12:58.170612 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8eb6951b-4a31-41cb-ad67-acca8d2633f8-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"8eb6951b-4a31-41cb-ad67-acca8d2633f8\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:12:58.170764 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:12:58.170651 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/8eb6951b-4a31-41cb-ad67-acca8d2633f8-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"8eb6951b-4a31-41cb-ad67-acca8d2633f8\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:12:58.173119 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:12:58.173071 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8eb6951b-4a31-41cb-ad67-acca8d2633f8-tls-assets\") pod \"alertmanager-main-0\" (UID: \"8eb6951b-4a31-41cb-ad67-acca8d2633f8\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:12:58.173640 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:12:58.173616 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8eb6951b-4a31-41cb-ad67-acca8d2633f8-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"8eb6951b-4a31-41cb-ad67-acca8d2633f8\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:12:58.174482 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:12:58.174458 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8eb6951b-4a31-41cb-ad67-acca8d2633f8-web-config\") pod \"alertmanager-main-0\" (UID: \"8eb6951b-4a31-41cb-ad67-acca8d2633f8\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:12:58.175067 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:12:58.175044 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/8eb6951b-4a31-41cb-ad67-acca8d2633f8-config-volume\") pod \"alertmanager-main-0\" (UID: \"8eb6951b-4a31-41cb-ad67-acca8d2633f8\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:12:58.175168 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:12:58.175087 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/8eb6951b-4a31-41cb-ad67-acca8d2633f8-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"8eb6951b-4a31-41cb-ad67-acca8d2633f8\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:12:58.175227 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:12:58.175209 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8eb6951b-4a31-41cb-ad67-acca8d2633f8-config-out\") pod \"alertmanager-main-0\" (UID: \"8eb6951b-4a31-41cb-ad67-acca8d2633f8\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:12:58.175276 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:12:58.175232 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/8eb6951b-4a31-41cb-ad67-acca8d2633f8-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"8eb6951b-4a31-41cb-ad67-acca8d2633f8\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:12:58.175452 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:12:58.175427 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8eb6951b-4a31-41cb-ad67-acca8d2633f8-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"8eb6951b-4a31-41cb-ad67-acca8d2633f8\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:12:58.179211 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:12:58.179191 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w6kt2\" (UniqueName: \"kubernetes.io/projected/8eb6951b-4a31-41cb-ad67-acca8d2633f8-kube-api-access-w6kt2\") pod \"alertmanager-main-0\" (UID: \"8eb6951b-4a31-41cb-ad67-acca8d2633f8\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:12:58.674132 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:12:58.674094 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/8eb6951b-4a31-41cb-ad67-acca8d2633f8-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"8eb6951b-4a31-41cb-ad67-acca8d2633f8\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:12:58.674331 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:12:58.674198 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8eb6951b-4a31-41cb-ad67-acca8d2633f8-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"8eb6951b-4a31-41cb-ad67-acca8d2633f8\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:12:58.674331 ip-10-0-132-204 kubenswrapper[2561]: E0909 23:12:58.674293 2561 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found Sep 09 23:12:58.674485 ip-10-0-132-204 kubenswrapper[2561]: E0909 23:12:58.674388 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8eb6951b-4a31-41cb-ad67-acca8d2633f8-secret-alertmanager-main-tls podName:8eb6951b-4a31-41cb-ad67-acca8d2633f8 nodeName:}" failed. No retries permitted until 2026-09-09 23:12:59.674352432 +0000 UTC m=+288.049926473 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/8eb6951b-4a31-41cb-ad67-acca8d2633f8-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "8eb6951b-4a31-41cb-ad67-acca8d2633f8") : secret "alertmanager-main-tls" not found Sep 09 23:12:58.675192 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:12:58.675167 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8eb6951b-4a31-41cb-ad67-acca8d2633f8-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"8eb6951b-4a31-41cb-ad67-acca8d2633f8\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:12:58.881173 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:12:58.881097 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-6dbc848f7f-ll2ll"] Sep 09 23:12:58.885325 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:12:58.885302 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-6dbc848f7f-ll2ll" Sep 09 23:12:58.887812 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:12:58.887782 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-xktfk\"" Sep 09 23:12:58.887945 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:12:58.887929 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Sep 09 23:12:58.887990 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:12:58.887966 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Sep 09 23:12:58.888031 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:12:58.887993 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Sep 09 23:12:58.888386 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:12:58.888332 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-5fq08d77bsmf4\"" Sep 09 23:12:58.888501 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:12:58.888339 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Sep 09 23:12:58.888501 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:12:58.888419 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Sep 09 23:12:58.894822 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:12:58.894802 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-6dbc848f7f-ll2ll"] Sep 09 23:12:59.078215 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:12:59.078179 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c5d3fec8-dee1-4746-8bc9-6c0d873f9698-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-6dbc848f7f-ll2ll\" (UID: \"c5d3fec8-dee1-4746-8bc9-6c0d873f9698\") " pod="openshift-monitoring/thanos-querier-6dbc848f7f-ll2ll" Sep 09 23:12:59.078705 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:12:59.078248 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/c5d3fec8-dee1-4746-8bc9-6c0d873f9698-secret-grpc-tls\") pod \"thanos-querier-6dbc848f7f-ll2ll\" (UID: \"c5d3fec8-dee1-4746-8bc9-6c0d873f9698\") " pod="openshift-monitoring/thanos-querier-6dbc848f7f-ll2ll" Sep 09 23:12:59.078705 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:12:59.078278 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-66t8z\" (UniqueName: \"kubernetes.io/projected/c5d3fec8-dee1-4746-8bc9-6c0d873f9698-kube-api-access-66t8z\") pod \"thanos-querier-6dbc848f7f-ll2ll\" (UID: \"c5d3fec8-dee1-4746-8bc9-6c0d873f9698\") " pod="openshift-monitoring/thanos-querier-6dbc848f7f-ll2ll" Sep 09 23:12:59.078705 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:12:59.078397 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/c5d3fec8-dee1-4746-8bc9-6c0d873f9698-secret-thanos-querier-tls\") pod \"thanos-querier-6dbc848f7f-ll2ll\" (UID: \"c5d3fec8-dee1-4746-8bc9-6c0d873f9698\") " pod="openshift-monitoring/thanos-querier-6dbc848f7f-ll2ll" Sep 09 23:12:59.078705 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:12:59.078435 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c5d3fec8-dee1-4746-8bc9-6c0d873f9698-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-6dbc848f7f-ll2ll\" (UID: \"c5d3fec8-dee1-4746-8bc9-6c0d873f9698\") " pod="openshift-monitoring/thanos-querier-6dbc848f7f-ll2ll" Sep 09 23:12:59.078705 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:12:59.078495 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c5d3fec8-dee1-4746-8bc9-6c0d873f9698-metrics-client-ca\") pod \"thanos-querier-6dbc848f7f-ll2ll\" (UID: \"c5d3fec8-dee1-4746-8bc9-6c0d873f9698\") " pod="openshift-monitoring/thanos-querier-6dbc848f7f-ll2ll" Sep 09 23:12:59.078705 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:12:59.078560 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/c5d3fec8-dee1-4746-8bc9-6c0d873f9698-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-6dbc848f7f-ll2ll\" (UID: \"c5d3fec8-dee1-4746-8bc9-6c0d873f9698\") " pod="openshift-monitoring/thanos-querier-6dbc848f7f-ll2ll" Sep 09 23:12:59.078705 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:12:59.078596 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/c5d3fec8-dee1-4746-8bc9-6c0d873f9698-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-6dbc848f7f-ll2ll\" (UID: \"c5d3fec8-dee1-4746-8bc9-6c0d873f9698\") " pod="openshift-monitoring/thanos-querier-6dbc848f7f-ll2ll" Sep 09 23:12:59.179226 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:12:59.179196 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/c5d3fec8-dee1-4746-8bc9-6c0d873f9698-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-6dbc848f7f-ll2ll\" (UID: \"c5d3fec8-dee1-4746-8bc9-6c0d873f9698\") " pod="openshift-monitoring/thanos-querier-6dbc848f7f-ll2ll" Sep 09 23:12:59.179415 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:12:59.179256 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c5d3fec8-dee1-4746-8bc9-6c0d873f9698-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-6dbc848f7f-ll2ll\" (UID: \"c5d3fec8-dee1-4746-8bc9-6c0d873f9698\") " pod="openshift-monitoring/thanos-querier-6dbc848f7f-ll2ll" Sep 09 23:12:59.179415 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:12:59.179284 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/c5d3fec8-dee1-4746-8bc9-6c0d873f9698-secret-grpc-tls\") pod \"thanos-querier-6dbc848f7f-ll2ll\" (UID: \"c5d3fec8-dee1-4746-8bc9-6c0d873f9698\") " pod="openshift-monitoring/thanos-querier-6dbc848f7f-ll2ll" Sep 09 23:12:59.179415 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:12:59.179301 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-66t8z\" (UniqueName: \"kubernetes.io/projected/c5d3fec8-dee1-4746-8bc9-6c0d873f9698-kube-api-access-66t8z\") pod \"thanos-querier-6dbc848f7f-ll2ll\" (UID: \"c5d3fec8-dee1-4746-8bc9-6c0d873f9698\") " pod="openshift-monitoring/thanos-querier-6dbc848f7f-ll2ll" Sep 09 23:12:59.179415 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:12:59.179341 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/c5d3fec8-dee1-4746-8bc9-6c0d873f9698-secret-thanos-querier-tls\") pod \"thanos-querier-6dbc848f7f-ll2ll\" (UID: \"c5d3fec8-dee1-4746-8bc9-6c0d873f9698\") " pod="openshift-monitoring/thanos-querier-6dbc848f7f-ll2ll" Sep 09 23:12:59.179415 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:12:59.179392 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c5d3fec8-dee1-4746-8bc9-6c0d873f9698-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-6dbc848f7f-ll2ll\" (UID: \"c5d3fec8-dee1-4746-8bc9-6c0d873f9698\") " pod="openshift-monitoring/thanos-querier-6dbc848f7f-ll2ll" Sep 09 23:12:59.179415 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:12:59.179416 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c5d3fec8-dee1-4746-8bc9-6c0d873f9698-metrics-client-ca\") pod \"thanos-querier-6dbc848f7f-ll2ll\" (UID: \"c5d3fec8-dee1-4746-8bc9-6c0d873f9698\") " pod="openshift-monitoring/thanos-querier-6dbc848f7f-ll2ll" Sep 09 23:12:59.179709 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:12:59.179436 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/c5d3fec8-dee1-4746-8bc9-6c0d873f9698-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-6dbc848f7f-ll2ll\" (UID: \"c5d3fec8-dee1-4746-8bc9-6c0d873f9698\") " pod="openshift-monitoring/thanos-querier-6dbc848f7f-ll2ll" Sep 09 23:12:59.180404 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:12:59.180325 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c5d3fec8-dee1-4746-8bc9-6c0d873f9698-metrics-client-ca\") pod \"thanos-querier-6dbc848f7f-ll2ll\" (UID: \"c5d3fec8-dee1-4746-8bc9-6c0d873f9698\") " pod="openshift-monitoring/thanos-querier-6dbc848f7f-ll2ll" Sep 09 23:12:59.182142 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:12:59.182107 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/c5d3fec8-dee1-4746-8bc9-6c0d873f9698-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-6dbc848f7f-ll2ll\" (UID: \"c5d3fec8-dee1-4746-8bc9-6c0d873f9698\") " pod="openshift-monitoring/thanos-querier-6dbc848f7f-ll2ll" Sep 09 23:12:59.182248 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:12:59.182143 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/c5d3fec8-dee1-4746-8bc9-6c0d873f9698-secret-thanos-querier-tls\") pod \"thanos-querier-6dbc848f7f-ll2ll\" (UID: \"c5d3fec8-dee1-4746-8bc9-6c0d873f9698\") " pod="openshift-monitoring/thanos-querier-6dbc848f7f-ll2ll" Sep 09 23:12:59.182402 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:12:59.182381 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c5d3fec8-dee1-4746-8bc9-6c0d873f9698-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-6dbc848f7f-ll2ll\" (UID: \"c5d3fec8-dee1-4746-8bc9-6c0d873f9698\") " pod="openshift-monitoring/thanos-querier-6dbc848f7f-ll2ll" Sep 09 23:12:59.182506 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:12:59.182490 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/c5d3fec8-dee1-4746-8bc9-6c0d873f9698-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-6dbc848f7f-ll2ll\" (UID: \"c5d3fec8-dee1-4746-8bc9-6c0d873f9698\") " pod="openshift-monitoring/thanos-querier-6dbc848f7f-ll2ll" Sep 09 23:12:59.182591 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:12:59.182568 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c5d3fec8-dee1-4746-8bc9-6c0d873f9698-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-6dbc848f7f-ll2ll\" (UID: \"c5d3fec8-dee1-4746-8bc9-6c0d873f9698\") " pod="openshift-monitoring/thanos-querier-6dbc848f7f-ll2ll" Sep 09 23:12:59.182641 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:12:59.182624 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/c5d3fec8-dee1-4746-8bc9-6c0d873f9698-secret-grpc-tls\") pod \"thanos-querier-6dbc848f7f-ll2ll\" (UID: \"c5d3fec8-dee1-4746-8bc9-6c0d873f9698\") " pod="openshift-monitoring/thanos-querier-6dbc848f7f-ll2ll" Sep 09 23:12:59.187155 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:12:59.187134 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-66t8z\" (UniqueName: \"kubernetes.io/projected/c5d3fec8-dee1-4746-8bc9-6c0d873f9698-kube-api-access-66t8z\") pod \"thanos-querier-6dbc848f7f-ll2ll\" (UID: \"c5d3fec8-dee1-4746-8bc9-6c0d873f9698\") " pod="openshift-monitoring/thanos-querier-6dbc848f7f-ll2ll" Sep 09 23:12:59.196981 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:12:59.196962 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-6dbc848f7f-ll2ll" Sep 09 23:12:59.481640 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:12:59.481585 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-6dbc848f7f-ll2ll"] Sep 09 23:12:59.485208 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:12:59.485177 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc5d3fec8_dee1_4746_8bc9_6c0d873f9698.slice/crio-5d432b67a6a1116d2995b19925a740514c0bd2f8c152e4810aaea6f70da7e856 WatchSource:0}: Error finding container 5d432b67a6a1116d2995b19925a740514c0bd2f8c152e4810aaea6f70da7e856: Status 404 returned error can't find the container with id 5d432b67a6a1116d2995b19925a740514c0bd2f8c152e4810aaea6f70da7e856 Sep 09 23:12:59.683382 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:12:59.683273 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/8eb6951b-4a31-41cb-ad67-acca8d2633f8-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"8eb6951b-4a31-41cb-ad67-acca8d2633f8\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:12:59.685848 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:12:59.685811 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/8eb6951b-4a31-41cb-ad67-acca8d2633f8-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"8eb6951b-4a31-41cb-ad67-acca8d2633f8\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:12:59.781012 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:12:59.780978 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:13:00.062953 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:13:00.062928 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 09 23:13:00.063588 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:13:00.063564 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8eb6951b_4a31_41cb_ad67_acca8d2633f8.slice/crio-b335c38308564e396c6c78292a35db1f7fa8134d49bd7584660f6d9aa24a9f16 WatchSource:0}: Error finding container b335c38308564e396c6c78292a35db1f7fa8134d49bd7584660f6d9aa24a9f16: Status 404 returned error can't find the container with id b335c38308564e396c6c78292a35db1f7fa8134d49bd7584660f6d9aa24a9f16 Sep 09 23:13:00.131910 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:13:00.131878 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8eb6951b-4a31-41cb-ad67-acca8d2633f8","Type":"ContainerStarted","Data":"b335c38308564e396c6c78292a35db1f7fa8134d49bd7584660f6d9aa24a9f16"} Sep 09 23:13:00.133083 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:13:00.133056 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6dbc848f7f-ll2ll" event={"ID":"c5d3fec8-dee1-4746-8bc9-6c0d873f9698","Type":"ContainerStarted","Data":"5d432b67a6a1116d2995b19925a740514c0bd2f8c152e4810aaea6f70da7e856"} Sep 09 23:13:00.134574 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:13:00.134553 2561 generic.go:356] "Generic (PLEG): container finished" podID="8c702585-be92-4326-80b9-532cb4dfbb69" containerID="bb8c5a85d2c43a338bbd9790fce3bbc8cbacfabafbae35bda7f679c5f4b608b9" exitCode=0 Sep 09 23:13:00.134657 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:13:00.134620 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-zltt8" event={"ID":"8c702585-be92-4326-80b9-532cb4dfbb69","Type":"ContainerDied","Data":"bb8c5a85d2c43a338bbd9790fce3bbc8cbacfabafbae35bda7f679c5f4b608b9"} Sep 09 23:13:00.136402 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:13:00.136360 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-cvlgc" event={"ID":"0da6e759-847b-4f85-b775-a82a83eb8ae2","Type":"ContainerStarted","Data":"9d40a053ba79a3ba4562bd1e0f5edbb051f8a61c0a659c9d7514b1a09ed8dc11"} Sep 09 23:13:00.136493 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:13:00.136418 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-cvlgc" event={"ID":"0da6e759-847b-4f85-b775-a82a83eb8ae2","Type":"ContainerStarted","Data":"45978aea4e0b6fbc8500a858f8d824b0e5eaa7fe296ac84fbc372b235ebdae0e"} Sep 09 23:13:00.136571 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:13:00.136506 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-cvlgc" Sep 09 23:13:00.167634 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:13:00.167588 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-cvlgc" podStartSLOduration=252.365785133 podStartE2EDuration="4m14.167567374s" totalImagesPullingTime="1.801782241s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:08:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:13:00.166922442 +0000 UTC m=+288.542496531" watchObservedRunningTime="2026-09-09 23:13:00.167567374 +0000 UTC m=+288.543141440" Sep 09 23:13:01.146773 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:13:01.146731 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-zltt8" event={"ID":"8c702585-be92-4326-80b9-532cb4dfbb69","Type":"ContainerStarted","Data":"d1464c09e836b1c4b8c5525c5bfa51948256ee27349482349ec9e77170afac57"} Sep 09 23:13:01.147218 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:13:01.146833 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-zltt8" event={"ID":"8c702585-be92-4326-80b9-532cb4dfbb69","Type":"ContainerStarted","Data":"85744c61b3369f968a9c07e523cec826abe9e84eab1e64959c4f8ab81cf9cb7b"} Sep 09 23:13:01.168541 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:13:01.168479 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-zltt8" podStartSLOduration=3.735773183 podStartE2EDuration="5.168462039s" totalImagesPullingTime="1.353310512s" totalInitContainerRuntime="79.378344ms" isStatefulPod=true podCreationTimestamp="2026-09-09 23:12:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:13:01.166027832 +0000 UTC m=+289.541602159" watchObservedRunningTime="2026-09-09 23:13:01.168462039 +0000 UTC m=+289.544036100" Sep 09 23:13:01.296773 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:13:01.296736 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-78c7c65684-56vmn"] Sep 09 23:13:01.300107 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:13:01.300086 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-78c7c65684-56vmn" Sep 09 23:13:01.303884 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:13:01.303857 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Sep 09 23:13:01.304031 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:13:01.303862 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-jcl9t\"" Sep 09 23:13:01.304031 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:13:01.303903 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dna1n7h4pf8ti\"" Sep 09 23:13:01.304031 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:13:01.303958 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Sep 09 23:13:01.304512 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:13:01.304488 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Sep 09 23:13:01.304831 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:13:01.304726 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Sep 09 23:13:01.313058 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:13:01.313040 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-78c7c65684-56vmn"] Sep 09 23:13:01.498448 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:13:01.498361 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7b984e06-8e7a-44b1-b4f1-3404f0be716c-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-78c7c65684-56vmn\" (UID: \"7b984e06-8e7a-44b1-b4f1-3404f0be716c\") " pod="openshift-monitoring/metrics-server-78c7c65684-56vmn" Sep 09 23:13:01.498596 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:13:01.498462 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7b984e06-8e7a-44b1-b4f1-3404f0be716c-client-ca-bundle\") pod \"metrics-server-78c7c65684-56vmn\" (UID: \"7b984e06-8e7a-44b1-b4f1-3404f0be716c\") " pod="openshift-monitoring/metrics-server-78c7c65684-56vmn" Sep 09 23:13:01.498596 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:13:01.498487 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/7b984e06-8e7a-44b1-b4f1-3404f0be716c-audit-log\") pod \"metrics-server-78c7c65684-56vmn\" (UID: \"7b984e06-8e7a-44b1-b4f1-3404f0be716c\") " pod="openshift-monitoring/metrics-server-78c7c65684-56vmn" Sep 09 23:13:01.498596 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:13:01.498506 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r46v7\" (UniqueName: \"kubernetes.io/projected/7b984e06-8e7a-44b1-b4f1-3404f0be716c-kube-api-access-r46v7\") pod \"metrics-server-78c7c65684-56vmn\" (UID: \"7b984e06-8e7a-44b1-b4f1-3404f0be716c\") " pod="openshift-monitoring/metrics-server-78c7c65684-56vmn" Sep 09 23:13:01.498701 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:13:01.498606 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/7b984e06-8e7a-44b1-b4f1-3404f0be716c-secret-metrics-server-tls\") pod \"metrics-server-78c7c65684-56vmn\" (UID: \"7b984e06-8e7a-44b1-b4f1-3404f0be716c\") " pod="openshift-monitoring/metrics-server-78c7c65684-56vmn" Sep 09 23:13:01.498701 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:13:01.498685 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/7b984e06-8e7a-44b1-b4f1-3404f0be716c-metrics-server-audit-profiles\") pod \"metrics-server-78c7c65684-56vmn\" (UID: \"7b984e06-8e7a-44b1-b4f1-3404f0be716c\") " pod="openshift-monitoring/metrics-server-78c7c65684-56vmn" Sep 09 23:13:01.498761 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:13:01.498728 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/7b984e06-8e7a-44b1-b4f1-3404f0be716c-secret-metrics-server-client-certs\") pod \"metrics-server-78c7c65684-56vmn\" (UID: \"7b984e06-8e7a-44b1-b4f1-3404f0be716c\") " pod="openshift-monitoring/metrics-server-78c7c65684-56vmn" Sep 09 23:13:01.599627 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:13:01.599587 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/7b984e06-8e7a-44b1-b4f1-3404f0be716c-metrics-server-audit-profiles\") pod \"metrics-server-78c7c65684-56vmn\" (UID: \"7b984e06-8e7a-44b1-b4f1-3404f0be716c\") " pod="openshift-monitoring/metrics-server-78c7c65684-56vmn" Sep 09 23:13:01.599627 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:13:01.599632 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/7b984e06-8e7a-44b1-b4f1-3404f0be716c-secret-metrics-server-client-certs\") pod \"metrics-server-78c7c65684-56vmn\" (UID: \"7b984e06-8e7a-44b1-b4f1-3404f0be716c\") " pod="openshift-monitoring/metrics-server-78c7c65684-56vmn" Sep 09 23:13:01.599867 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:13:01.599686 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7b984e06-8e7a-44b1-b4f1-3404f0be716c-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-78c7c65684-56vmn\" (UID: \"7b984e06-8e7a-44b1-b4f1-3404f0be716c\") " pod="openshift-monitoring/metrics-server-78c7c65684-56vmn" Sep 09 23:13:01.599867 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:13:01.599713 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7b984e06-8e7a-44b1-b4f1-3404f0be716c-client-ca-bundle\") pod \"metrics-server-78c7c65684-56vmn\" (UID: \"7b984e06-8e7a-44b1-b4f1-3404f0be716c\") " pod="openshift-monitoring/metrics-server-78c7c65684-56vmn" Sep 09 23:13:01.599867 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:13:01.599743 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/7b984e06-8e7a-44b1-b4f1-3404f0be716c-audit-log\") pod \"metrics-server-78c7c65684-56vmn\" (UID: \"7b984e06-8e7a-44b1-b4f1-3404f0be716c\") " pod="openshift-monitoring/metrics-server-78c7c65684-56vmn" Sep 09 23:13:01.599867 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:13:01.599767 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r46v7\" (UniqueName: \"kubernetes.io/projected/7b984e06-8e7a-44b1-b4f1-3404f0be716c-kube-api-access-r46v7\") pod \"metrics-server-78c7c65684-56vmn\" (UID: \"7b984e06-8e7a-44b1-b4f1-3404f0be716c\") " pod="openshift-monitoring/metrics-server-78c7c65684-56vmn" Sep 09 23:13:01.599867 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:13:01.599846 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/7b984e06-8e7a-44b1-b4f1-3404f0be716c-secret-metrics-server-tls\") pod \"metrics-server-78c7c65684-56vmn\" (UID: \"7b984e06-8e7a-44b1-b4f1-3404f0be716c\") " pod="openshift-monitoring/metrics-server-78c7c65684-56vmn" Sep 09 23:13:01.600164 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:13:01.600133 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/7b984e06-8e7a-44b1-b4f1-3404f0be716c-audit-log\") pod \"metrics-server-78c7c65684-56vmn\" (UID: \"7b984e06-8e7a-44b1-b4f1-3404f0be716c\") " pod="openshift-monitoring/metrics-server-78c7c65684-56vmn" Sep 09 23:13:01.600845 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:13:01.600788 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/7b984e06-8e7a-44b1-b4f1-3404f0be716c-metrics-server-audit-profiles\") pod \"metrics-server-78c7c65684-56vmn\" (UID: \"7b984e06-8e7a-44b1-b4f1-3404f0be716c\") " pod="openshift-monitoring/metrics-server-78c7c65684-56vmn" Sep 09 23:13:01.600957 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:13:01.600848 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7b984e06-8e7a-44b1-b4f1-3404f0be716c-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-78c7c65684-56vmn\" (UID: \"7b984e06-8e7a-44b1-b4f1-3404f0be716c\") " pod="openshift-monitoring/metrics-server-78c7c65684-56vmn" Sep 09 23:13:01.602750 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:13:01.602718 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/7b984e06-8e7a-44b1-b4f1-3404f0be716c-secret-metrics-server-client-certs\") pod \"metrics-server-78c7c65684-56vmn\" (UID: \"7b984e06-8e7a-44b1-b4f1-3404f0be716c\") " pod="openshift-monitoring/metrics-server-78c7c65684-56vmn" Sep 09 23:13:01.603262 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:13:01.603242 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7b984e06-8e7a-44b1-b4f1-3404f0be716c-client-ca-bundle\") pod \"metrics-server-78c7c65684-56vmn\" (UID: \"7b984e06-8e7a-44b1-b4f1-3404f0be716c\") " pod="openshift-monitoring/metrics-server-78c7c65684-56vmn" Sep 09 23:13:01.603341 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:13:01.603277 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/7b984e06-8e7a-44b1-b4f1-3404f0be716c-secret-metrics-server-tls\") pod \"metrics-server-78c7c65684-56vmn\" (UID: \"7b984e06-8e7a-44b1-b4f1-3404f0be716c\") " pod="openshift-monitoring/metrics-server-78c7c65684-56vmn" Sep 09 23:13:01.607799 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:13:01.607780 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r46v7\" (UniqueName: \"kubernetes.io/projected/7b984e06-8e7a-44b1-b4f1-3404f0be716c-kube-api-access-r46v7\") pod \"metrics-server-78c7c65684-56vmn\" (UID: \"7b984e06-8e7a-44b1-b4f1-3404f0be716c\") " pod="openshift-monitoring/metrics-server-78c7c65684-56vmn" Sep 09 23:13:01.611608 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:13:01.611578 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-78c7c65684-56vmn" Sep 09 23:13:01.673157 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:13:01.673065 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-85bbbbbf4-rdcr7"] Sep 09 23:13:01.676539 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:13:01.676520 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-rdcr7" Sep 09 23:13:01.679275 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:13:01.679252 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Sep 09 23:13:01.679275 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:13:01.679274 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-4sbvs\"" Sep 09 23:13:01.686634 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:13:01.686581 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-85bbbbbf4-rdcr7"] Sep 09 23:13:01.802050 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:13:01.802028 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-29xlq\" (UniqueName: \"kubernetes.io/projected/4a45b8ea-3eff-465e-859b-df7b0909fbc3-kube-api-access-29xlq\") pod \"monitoring-plugin-85bbbbbf4-rdcr7\" (UID: \"4a45b8ea-3eff-465e-859b-df7b0909fbc3\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-rdcr7" Sep 09 23:13:01.802144 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:13:01.802068 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/4a45b8ea-3eff-465e-859b-df7b0909fbc3-monitoring-plugin-cert\") pod \"monitoring-plugin-85bbbbbf4-rdcr7\" (UID: \"4a45b8ea-3eff-465e-859b-df7b0909fbc3\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-rdcr7" Sep 09 23:13:01.902439 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:13:01.902412 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-29xlq\" (UniqueName: \"kubernetes.io/projected/4a45b8ea-3eff-465e-859b-df7b0909fbc3-kube-api-access-29xlq\") pod \"monitoring-plugin-85bbbbbf4-rdcr7\" (UID: \"4a45b8ea-3eff-465e-859b-df7b0909fbc3\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-rdcr7" Sep 09 23:13:01.902538 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:13:01.902458 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/4a45b8ea-3eff-465e-859b-df7b0909fbc3-monitoring-plugin-cert\") pod \"monitoring-plugin-85bbbbbf4-rdcr7\" (UID: \"4a45b8ea-3eff-465e-859b-df7b0909fbc3\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-rdcr7" Sep 09 23:13:01.904734 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:13:01.904714 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/4a45b8ea-3eff-465e-859b-df7b0909fbc3-monitoring-plugin-cert\") pod \"monitoring-plugin-85bbbbbf4-rdcr7\" (UID: \"4a45b8ea-3eff-465e-859b-df7b0909fbc3\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-rdcr7" Sep 09 23:13:01.910510 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:13:01.910491 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-29xlq\" (UniqueName: \"kubernetes.io/projected/4a45b8ea-3eff-465e-859b-df7b0909fbc3-kube-api-access-29xlq\") pod \"monitoring-plugin-85bbbbbf4-rdcr7\" (UID: \"4a45b8ea-3eff-465e-859b-df7b0909fbc3\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-rdcr7" Sep 09 23:13:01.987853 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:13:01.987825 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-rdcr7" Sep 09 23:13:02.064502 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:13:02.064473 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-78c7c65684-56vmn"] Sep 09 23:13:02.067587 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:13:02.067563 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7b984e06_8e7a_44b1_b4f1_3404f0be716c.slice/crio-354297984fd875a32266c7ab6f0cac1e8ce6c5c0e697abb4d77d07f13ebe1d20 WatchSource:0}: Error finding container 354297984fd875a32266c7ab6f0cac1e8ce6c5c0e697abb4d77d07f13ebe1d20: Status 404 returned error can't find the container with id 354297984fd875a32266c7ab6f0cac1e8ce6c5c0e697abb4d77d07f13ebe1d20 Sep 09 23:13:02.141005 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:13:02.140968 2561 patch_prober.go:28] interesting pod/image-registry-6c744854f9-4vtjs container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Sep 09 23:13:02.141154 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:13:02.141019 2561 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-6c744854f9-4vtjs" podUID="20c1b743-eb6e-4d7c-84f2-f4450c1a7dd9" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Sep 09 23:13:02.150945 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:13:02.150918 2561 generic.go:356] "Generic (PLEG): container finished" podID="8eb6951b-4a31-41cb-ad67-acca8d2633f8" containerID="5401c9b52ccf8ff9500aaea476661dda53ede7888a8883877064717e0708350f" exitCode=0 Sep 09 23:13:02.151274 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:13:02.150955 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8eb6951b-4a31-41cb-ad67-acca8d2633f8","Type":"ContainerDied","Data":"5401c9b52ccf8ff9500aaea476661dda53ede7888a8883877064717e0708350f"} Sep 09 23:13:02.153265 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:13:02.153243 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6dbc848f7f-ll2ll" event={"ID":"c5d3fec8-dee1-4746-8bc9-6c0d873f9698","Type":"ContainerStarted","Data":"4f13bf553fdb8bc0dc7697d6c439f061a4e866b429e04a655aa16c3b9d8f2b28"} Sep 09 23:13:02.153333 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:13:02.153315 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6dbc848f7f-ll2ll" event={"ID":"c5d3fec8-dee1-4746-8bc9-6c0d873f9698","Type":"ContainerStarted","Data":"404b33f16703d120739ccb512f14a3c0ea30207188d42b5972eeec7e3da89be2"} Sep 09 23:13:02.153405 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:13:02.153356 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6dbc848f7f-ll2ll" event={"ID":"c5d3fec8-dee1-4746-8bc9-6c0d873f9698","Type":"ContainerStarted","Data":"27aaa8fb3faf7e0a985a5ffc3b39803cabbe94765616967fba03d412f1ba5652"} Sep 09 23:13:02.154611 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:13:02.154592 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-78c7c65684-56vmn" event={"ID":"7b984e06-8e7a-44b1-b4f1-3404f0be716c","Type":"ContainerStarted","Data":"354297984fd875a32266c7ab6f0cac1e8ce6c5c0e697abb4d77d07f13ebe1d20"} Sep 09 23:13:02.261699 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:13:02.261669 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-85bbbbbf4-rdcr7"] Sep 09 23:13:02.264442 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:13:02.264415 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4a45b8ea_3eff_465e_859b_df7b0909fbc3.slice/crio-9074f8a5bfdbecf845156a92220e66364fe90f7bdddd9c88ed290d52f8cdbc02 WatchSource:0}: Error finding container 9074f8a5bfdbecf845156a92220e66364fe90f7bdddd9c88ed290d52f8cdbc02: Status 404 returned error can't find the container with id 9074f8a5bfdbecf845156a92220e66364fe90f7bdddd9c88ed290d52f8cdbc02 Sep 09 23:13:03.161773 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:13:03.161728 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-rdcr7" event={"ID":"4a45b8ea-3eff-465e-859b-df7b0909fbc3","Type":"ContainerStarted","Data":"9074f8a5bfdbecf845156a92220e66364fe90f7bdddd9c88ed290d52f8cdbc02"} Sep 09 23:13:04.076610 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:13:04.076515 2561 patch_prober.go:28] interesting pod/image-registry-6c744854f9-4vtjs container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Sep 09 23:13:04.076610 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:13:04.076575 2561 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-6c744854f9-4vtjs" podUID="20c1b743-eb6e-4d7c-84f2-f4450c1a7dd9" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Sep 09 23:13:04.168842 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:13:04.168796 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6dbc848f7f-ll2ll" event={"ID":"c5d3fec8-dee1-4746-8bc9-6c0d873f9698","Type":"ContainerStarted","Data":"ffe19061a0bfadc571f59137a8f99ed7747d0b6a7c4477267b005cdf5eb4d2e3"} Sep 09 23:13:04.169226 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:13:04.168880 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6dbc848f7f-ll2ll" event={"ID":"c5d3fec8-dee1-4746-8bc9-6c0d873f9698","Type":"ContainerStarted","Data":"9334aae50ef1806979e9529adb3ce10f459d66b7fd6a77a75a87cc25f990d6ca"} Sep 09 23:13:05.177003 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:13:05.176969 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8eb6951b-4a31-41cb-ad67-acca8d2633f8","Type":"ContainerStarted","Data":"939fbee1edb416c847dccf986c4abad58b4b2d20939a7122982f22d79440b6a7"} Sep 09 23:13:05.177420 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:13:05.177043 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8eb6951b-4a31-41cb-ad67-acca8d2633f8","Type":"ContainerStarted","Data":"467780ccc19de0d06af5c2db6d3dbe03068ddf90b3414da601a57c0c43533302"} Sep 09 23:13:05.177420 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:13:05.177072 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8eb6951b-4a31-41cb-ad67-acca8d2633f8","Type":"ContainerStarted","Data":"3c98aa65c928627da1f4afcb78ce4c4c36a6d394d6f267228df97f392ad3b01c"} Sep 09 23:13:05.177420 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:13:05.177118 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8eb6951b-4a31-41cb-ad67-acca8d2633f8","Type":"ContainerStarted","Data":"0a42cb8288aa3faab87d45974717157fdf6bc3ac8b61823c147dc16e53a6fb2c"} Sep 09 23:13:05.177420 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:13:05.177145 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8eb6951b-4a31-41cb-ad67-acca8d2633f8","Type":"ContainerStarted","Data":"a12568b029f339e78088426ffcc17f1f7efb93d4d452fc06ab69b07290ef2343"} Sep 09 23:13:05.177420 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:13:05.177173 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8eb6951b-4a31-41cb-ad67-acca8d2633f8","Type":"ContainerStarted","Data":"aa0b9fa5ca9ad2ce72e1296fd93c6acfc4ad0da8c0083148336c84cccddff066"} Sep 09 23:13:05.180150 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:13:05.180125 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6dbc848f7f-ll2ll" event={"ID":"c5d3fec8-dee1-4746-8bc9-6c0d873f9698","Type":"ContainerStarted","Data":"afee685169994f2c3156ed6d9f69e380cbcfb5f4a1a9c24288fec8d697821ced"} Sep 09 23:13:05.180275 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:13:05.180259 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-6dbc848f7f-ll2ll" Sep 09 23:13:05.181626 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:13:05.181603 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-78c7c65684-56vmn" event={"ID":"7b984e06-8e7a-44b1-b4f1-3404f0be716c","Type":"ContainerStarted","Data":"78f8e27c1e2110002fbeaedfc2bafd756b5601b3064a620954ad7bca174e7ea3"} Sep 09 23:13:05.183328 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:13:05.183308 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-rdcr7" event={"ID":"4a45b8ea-3eff-465e-859b-df7b0909fbc3","Type":"ContainerStarted","Data":"1a93484ccc34010bf7c0350017cc809a76328546b3950dbce14b6209594b3b55"} Sep 09 23:13:05.183521 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:13:05.183495 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-rdcr7" Sep 09 23:13:05.188762 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:13:05.188745 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-rdcr7" Sep 09 23:13:05.204685 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:13:05.204645 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=4.10463429 podStartE2EDuration="8.204631443s" totalImagesPullingTime="4.079282088s" totalInitContainerRuntime="20.715065ms" isStatefulPod=false podCreationTimestamp="2026-09-09 23:12:57 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:13:05.202726505 +0000 UTC m=+293.578300606" watchObservedRunningTime="2026-09-09 23:13:05.204631443 +0000 UTC m=+293.580205513" Sep 09 23:13:05.228241 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:13:05.228051 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-6dbc848f7f-ll2ll" podStartSLOduration=3.740094379 podStartE2EDuration="7.228029098s" totalImagesPullingTime="3.487934719s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:12:58 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:13:05.22669123 +0000 UTC m=+293.602265291" watchObservedRunningTime="2026-09-09 23:13:05.228029098 +0000 UTC m=+293.603603161" Sep 09 23:13:05.242281 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:13:05.242234 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-rdcr7" podStartSLOduration=2.004583477 podStartE2EDuration="4.242219632s" totalImagesPullingTime="2.237636155s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:13:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:13:05.241137267 +0000 UTC m=+293.616711352" watchObservedRunningTime="2026-09-09 23:13:05.242219632 +0000 UTC m=+293.617793691" Sep 09 23:13:05.257633 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:13:05.257586 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-78c7c65684-56vmn" podStartSLOduration=1.825035868 podStartE2EDuration="4.257569105s" totalImagesPullingTime="2.432533237s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:13:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:13:05.256858971 +0000 UTC m=+293.632433067" watchObservedRunningTime="2026-09-09 23:13:05.257569105 +0000 UTC m=+293.633143167" Sep 09 23:13:06.194007 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:13:06.193980 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-6dbc848f7f-ll2ll" Sep 09 23:13:07.112985 ip-10-0-132-204 kubenswrapper[2561]: E0909 23:13:07.112948 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-ktqck" podUID="77df7cc0-0e7e-468f-89d9-b055af5de0b3" Sep 09 23:13:08.928258 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:13:08.928230 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-85d98c998f-gqw8t"] Sep 09 23:13:08.932538 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:13:08.932522 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-85d98c998f-gqw8t" Sep 09 23:13:08.935780 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:13:08.935752 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Sep 09 23:13:08.936182 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:13:08.936165 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Sep 09 23:13:08.936250 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:13:08.936235 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-b5sbj\"" Sep 09 23:13:08.952592 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:13:08.952572 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-85d98c998f-gqw8t"] Sep 09 23:13:08.962969 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:13:08.962945 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rmcvk\" (UniqueName: \"kubernetes.io/projected/33187b1c-2f16-4d27-9de0-860af5debc69-kube-api-access-rmcvk\") pod \"downloads-85d98c998f-gqw8t\" (UID: \"33187b1c-2f16-4d27-9de0-860af5debc69\") " pod="openshift-console/downloads-85d98c998f-gqw8t" Sep 09 23:13:09.063595 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:13:09.063562 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rmcvk\" (UniqueName: \"kubernetes.io/projected/33187b1c-2f16-4d27-9de0-860af5debc69-kube-api-access-rmcvk\") pod \"downloads-85d98c998f-gqw8t\" (UID: \"33187b1c-2f16-4d27-9de0-860af5debc69\") " pod="openshift-console/downloads-85d98c998f-gqw8t" Sep 09 23:13:09.073265 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:13:09.073243 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rmcvk\" (UniqueName: \"kubernetes.io/projected/33187b1c-2f16-4d27-9de0-860af5debc69-kube-api-access-rmcvk\") pod \"downloads-85d98c998f-gqw8t\" (UID: \"33187b1c-2f16-4d27-9de0-860af5debc69\") " pod="openshift-console/downloads-85d98c998f-gqw8t" Sep 09 23:13:09.242204 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:13:09.242178 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-85d98c998f-gqw8t" Sep 09 23:13:09.523443 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:13:09.523356 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-85d98c998f-gqw8t"] Sep 09 23:13:09.541496 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:13:09.541469 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod33187b1c_2f16_4d27_9de0_860af5debc69.slice/crio-55d58191d363c30e2eaf0b8d48969baa767814848c80dd5bd9e79f1a388b0c28 WatchSource:0}: Error finding container 55d58191d363c30e2eaf0b8d48969baa767814848c80dd5bd9e79f1a388b0c28: Status 404 returned error can't find the container with id 55d58191d363c30e2eaf0b8d48969baa767814848c80dd5bd9e79f1a388b0c28 Sep 09 23:13:10.149641 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:13:10.149617 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-cvlgc" Sep 09 23:13:10.212855 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:13:10.212815 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-85d98c998f-gqw8t" event={"ID":"33187b1c-2f16-4d27-9de0-860af5debc69","Type":"ContainerStarted","Data":"55d58191d363c30e2eaf0b8d48969baa767814848c80dd5bd9e79f1a388b0c28"} Sep 09 23:13:12.083614 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:13:12.083590 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pl5tw_6942a2c5-1a59-4ea7-b78d-d131103de85f/ovn-acl-logging/0.log" Sep 09 23:13:12.085080 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:13:12.085060 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pl5tw_6942a2c5-1a59-4ea7-b78d-d131103de85f/ovn-acl-logging/0.log" Sep 09 23:13:12.087250 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:13:12.087230 2561 kubelet.go:1648] "Image garbage collection succeeded" Sep 09 23:13:12.142385 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:13:12.142232 2561 patch_prober.go:28] interesting pod/image-registry-6c744854f9-4vtjs container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Sep 09 23:13:12.142385 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:13:12.142286 2561 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-6c744854f9-4vtjs" podUID="20c1b743-eb6e-4d7c-84f2-f4450c1a7dd9" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Sep 09 23:13:14.077692 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:13:14.077658 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-6c744854f9-4vtjs" Sep 09 23:13:14.999442 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:13:14.999405 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-b66947c67-92mlr"] Sep 09 23:13:15.002878 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:13:15.002855 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-b66947c67-92mlr" Sep 09 23:13:15.006815 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:13:15.006790 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Sep 09 23:13:15.006926 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:13:15.006832 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Sep 09 23:13:15.006926 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:13:15.006866 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Sep 09 23:13:15.007138 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:13:15.007120 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-95jjj\"" Sep 09 23:13:15.007220 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:13:15.007150 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Sep 09 23:13:15.007220 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:13:15.007152 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Sep 09 23:13:15.012336 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:13:15.012316 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-b66947c67-92mlr"] Sep 09 23:13:15.121762 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:13:15.121731 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4d49a06f-f2d4-4c98-9ab2-b0afed3b31b3-console-oauth-config\") pod \"console-b66947c67-92mlr\" (UID: \"4d49a06f-f2d4-4c98-9ab2-b0afed3b31b3\") " pod="openshift-console/console-b66947c67-92mlr" Sep 09 23:13:15.122178 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:13:15.121771 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4d49a06f-f2d4-4c98-9ab2-b0afed3b31b3-console-serving-cert\") pod \"console-b66947c67-92mlr\" (UID: \"4d49a06f-f2d4-4c98-9ab2-b0afed3b31b3\") " pod="openshift-console/console-b66947c67-92mlr" Sep 09 23:13:15.122178 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:13:15.121807 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4d49a06f-f2d4-4c98-9ab2-b0afed3b31b3-service-ca\") pod \"console-b66947c67-92mlr\" (UID: \"4d49a06f-f2d4-4c98-9ab2-b0afed3b31b3\") " pod="openshift-console/console-b66947c67-92mlr" Sep 09 23:13:15.122178 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:13:15.121842 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4d49a06f-f2d4-4c98-9ab2-b0afed3b31b3-console-config\") pod \"console-b66947c67-92mlr\" (UID: \"4d49a06f-f2d4-4c98-9ab2-b0afed3b31b3\") " pod="openshift-console/console-b66947c67-92mlr" Sep 09 23:13:15.122178 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:13:15.121880 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4d49a06f-f2d4-4c98-9ab2-b0afed3b31b3-oauth-serving-cert\") pod \"console-b66947c67-92mlr\" (UID: \"4d49a06f-f2d4-4c98-9ab2-b0afed3b31b3\") " pod="openshift-console/console-b66947c67-92mlr" Sep 09 23:13:15.122178 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:13:15.121948 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rdlz8\" (UniqueName: \"kubernetes.io/projected/4d49a06f-f2d4-4c98-9ab2-b0afed3b31b3-kube-api-access-rdlz8\") pod \"console-b66947c67-92mlr\" (UID: \"4d49a06f-f2d4-4c98-9ab2-b0afed3b31b3\") " pod="openshift-console/console-b66947c67-92mlr" Sep 09 23:13:15.222973 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:13:15.222931 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4d49a06f-f2d4-4c98-9ab2-b0afed3b31b3-console-oauth-config\") pod \"console-b66947c67-92mlr\" (UID: \"4d49a06f-f2d4-4c98-9ab2-b0afed3b31b3\") " pod="openshift-console/console-b66947c67-92mlr" Sep 09 23:13:15.222973 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:13:15.222968 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4d49a06f-f2d4-4c98-9ab2-b0afed3b31b3-console-serving-cert\") pod \"console-b66947c67-92mlr\" (UID: \"4d49a06f-f2d4-4c98-9ab2-b0afed3b31b3\") " pod="openshift-console/console-b66947c67-92mlr" Sep 09 23:13:15.223201 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:13:15.223002 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4d49a06f-f2d4-4c98-9ab2-b0afed3b31b3-service-ca\") pod \"console-b66947c67-92mlr\" (UID: \"4d49a06f-f2d4-4c98-9ab2-b0afed3b31b3\") " pod="openshift-console/console-b66947c67-92mlr" Sep 09 23:13:15.223201 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:13:15.223040 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4d49a06f-f2d4-4c98-9ab2-b0afed3b31b3-console-config\") pod \"console-b66947c67-92mlr\" (UID: \"4d49a06f-f2d4-4c98-9ab2-b0afed3b31b3\") " pod="openshift-console/console-b66947c67-92mlr" Sep 09 23:13:15.223201 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:13:15.223101 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4d49a06f-f2d4-4c98-9ab2-b0afed3b31b3-oauth-serving-cert\") pod \"console-b66947c67-92mlr\" (UID: \"4d49a06f-f2d4-4c98-9ab2-b0afed3b31b3\") " pod="openshift-console/console-b66947c67-92mlr" Sep 09 23:13:15.223201 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:13:15.223149 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rdlz8\" (UniqueName: \"kubernetes.io/projected/4d49a06f-f2d4-4c98-9ab2-b0afed3b31b3-kube-api-access-rdlz8\") pod \"console-b66947c67-92mlr\" (UID: \"4d49a06f-f2d4-4c98-9ab2-b0afed3b31b3\") " pod="openshift-console/console-b66947c67-92mlr" Sep 09 23:13:15.223935 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:13:15.223833 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4d49a06f-f2d4-4c98-9ab2-b0afed3b31b3-service-ca\") pod \"console-b66947c67-92mlr\" (UID: \"4d49a06f-f2d4-4c98-9ab2-b0afed3b31b3\") " pod="openshift-console/console-b66947c67-92mlr" Sep 09 23:13:15.224216 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:13:15.224189 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4d49a06f-f2d4-4c98-9ab2-b0afed3b31b3-oauth-serving-cert\") pod \"console-b66947c67-92mlr\" (UID: \"4d49a06f-f2d4-4c98-9ab2-b0afed3b31b3\") " pod="openshift-console/console-b66947c67-92mlr" Sep 09 23:13:15.224320 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:13:15.224295 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4d49a06f-f2d4-4c98-9ab2-b0afed3b31b3-console-config\") pod \"console-b66947c67-92mlr\" (UID: \"4d49a06f-f2d4-4c98-9ab2-b0afed3b31b3\") " pod="openshift-console/console-b66947c67-92mlr" Sep 09 23:13:15.225922 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:13:15.225898 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4d49a06f-f2d4-4c98-9ab2-b0afed3b31b3-console-oauth-config\") pod \"console-b66947c67-92mlr\" (UID: \"4d49a06f-f2d4-4c98-9ab2-b0afed3b31b3\") " pod="openshift-console/console-b66947c67-92mlr" Sep 09 23:13:15.226021 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:13:15.225972 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4d49a06f-f2d4-4c98-9ab2-b0afed3b31b3-console-serving-cert\") pod \"console-b66947c67-92mlr\" (UID: \"4d49a06f-f2d4-4c98-9ab2-b0afed3b31b3\") " pod="openshift-console/console-b66947c67-92mlr" Sep 09 23:13:15.231476 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:13:15.231456 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rdlz8\" (UniqueName: \"kubernetes.io/projected/4d49a06f-f2d4-4c98-9ab2-b0afed3b31b3-kube-api-access-rdlz8\") pod \"console-b66947c67-92mlr\" (UID: \"4d49a06f-f2d4-4c98-9ab2-b0afed3b31b3\") " pod="openshift-console/console-b66947c67-92mlr" Sep 09 23:13:15.314343 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:13:15.314264 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-b66947c67-92mlr" Sep 09 23:13:15.592398 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:13:15.592296 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-b66947c67-92mlr"] Sep 09 23:13:15.595430 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:13:15.595399 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4d49a06f_f2d4_4c98_9ab2_b0afed3b31b3.slice/crio-072b208b3bdd639db719b8ad9e6dbd4662ba6c8e9d6d65e765a84e8e0c45a4cb WatchSource:0}: Error finding container 072b208b3bdd639db719b8ad9e6dbd4662ba6c8e9d6d65e765a84e8e0c45a4cb: Status 404 returned error can't find the container with id 072b208b3bdd639db719b8ad9e6dbd4662ba6c8e9d6d65e765a84e8e0c45a4cb Sep 09 23:13:15.597955 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:13:15.597933 2561 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 09 23:13:16.241676 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:13:16.241634 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-b66947c67-92mlr" event={"ID":"4d49a06f-f2d4-4c98-9ab2-b0afed3b31b3","Type":"ContainerStarted","Data":"072b208b3bdd639db719b8ad9e6dbd4662ba6c8e9d6d65e765a84e8e0c45a4cb"} Sep 09 23:13:19.258542 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:13:19.258499 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-b66947c67-92mlr" event={"ID":"4d49a06f-f2d4-4c98-9ab2-b0afed3b31b3","Type":"ContainerStarted","Data":"ff191447d6da828fb5a15115138b2d9377cf0e65dded1d40edbe06139d6bbce2"} Sep 09 23:13:19.286672 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:13:19.286623 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-b66947c67-92mlr" podStartSLOduration=2.042499376 podStartE2EDuration="5.286607442s" totalImagesPullingTime="3.244108066s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:13:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:13:19.284731915 +0000 UTC m=+307.660305977" watchObservedRunningTime="2026-09-09 23:13:19.286607442 +0000 UTC m=+307.662181505" Sep 09 23:13:21.611904 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:13:21.611854 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-78c7c65684-56vmn" Sep 09 23:13:21.612326 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:13:21.611937 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-78c7c65684-56vmn" Sep 09 23:13:22.112791 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:13:22.112760 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ktqck" Sep 09 23:13:24.221869 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:13:24.221837 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5967cd457c-k44kw"] Sep 09 23:13:24.267990 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:13:24.267949 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5967cd457c-k44kw"] Sep 09 23:13:24.268207 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:13:24.268057 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5967cd457c-k44kw" Sep 09 23:13:24.276576 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:13:24.276298 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Sep 09 23:13:24.415850 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:13:24.415807 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4a980521-6191-410e-bd23-9a9af868aa60-trusted-ca-bundle\") pod \"console-5967cd457c-k44kw\" (UID: \"4a980521-6191-410e-bd23-9a9af868aa60\") " pod="openshift-console/console-5967cd457c-k44kw" Sep 09 23:13:24.416034 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:13:24.415888 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4a980521-6191-410e-bd23-9a9af868aa60-service-ca\") pod \"console-5967cd457c-k44kw\" (UID: \"4a980521-6191-410e-bd23-9a9af868aa60\") " pod="openshift-console/console-5967cd457c-k44kw" Sep 09 23:13:24.416034 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:13:24.415935 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m72sm\" (UniqueName: \"kubernetes.io/projected/4a980521-6191-410e-bd23-9a9af868aa60-kube-api-access-m72sm\") pod \"console-5967cd457c-k44kw\" (UID: \"4a980521-6191-410e-bd23-9a9af868aa60\") " pod="openshift-console/console-5967cd457c-k44kw" Sep 09 23:13:24.416034 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:13:24.415980 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4a980521-6191-410e-bd23-9a9af868aa60-console-config\") pod \"console-5967cd457c-k44kw\" (UID: \"4a980521-6191-410e-bd23-9a9af868aa60\") " pod="openshift-console/console-5967cd457c-k44kw" Sep 09 23:13:24.416236 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:13:24.416066 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4a980521-6191-410e-bd23-9a9af868aa60-console-oauth-config\") pod \"console-5967cd457c-k44kw\" (UID: \"4a980521-6191-410e-bd23-9a9af868aa60\") " pod="openshift-console/console-5967cd457c-k44kw" Sep 09 23:13:24.416236 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:13:24.416095 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4a980521-6191-410e-bd23-9a9af868aa60-oauth-serving-cert\") pod \"console-5967cd457c-k44kw\" (UID: \"4a980521-6191-410e-bd23-9a9af868aa60\") " pod="openshift-console/console-5967cd457c-k44kw" Sep 09 23:13:24.416236 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:13:24.416124 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4a980521-6191-410e-bd23-9a9af868aa60-console-serving-cert\") pod \"console-5967cd457c-k44kw\" (UID: \"4a980521-6191-410e-bd23-9a9af868aa60\") " pod="openshift-console/console-5967cd457c-k44kw" Sep 09 23:13:24.517473 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:13:24.517439 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4a980521-6191-410e-bd23-9a9af868aa60-console-oauth-config\") pod \"console-5967cd457c-k44kw\" (UID: \"4a980521-6191-410e-bd23-9a9af868aa60\") " pod="openshift-console/console-5967cd457c-k44kw" Sep 09 23:13:24.517473 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:13:24.517474 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4a980521-6191-410e-bd23-9a9af868aa60-oauth-serving-cert\") pod \"console-5967cd457c-k44kw\" (UID: \"4a980521-6191-410e-bd23-9a9af868aa60\") " pod="openshift-console/console-5967cd457c-k44kw" Sep 09 23:13:24.517708 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:13:24.517493 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4a980521-6191-410e-bd23-9a9af868aa60-console-serving-cert\") pod \"console-5967cd457c-k44kw\" (UID: \"4a980521-6191-410e-bd23-9a9af868aa60\") " pod="openshift-console/console-5967cd457c-k44kw" Sep 09 23:13:24.517708 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:13:24.517535 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4a980521-6191-410e-bd23-9a9af868aa60-trusted-ca-bundle\") pod \"console-5967cd457c-k44kw\" (UID: \"4a980521-6191-410e-bd23-9a9af868aa60\") " pod="openshift-console/console-5967cd457c-k44kw" Sep 09 23:13:24.517708 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:13:24.517574 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4a980521-6191-410e-bd23-9a9af868aa60-service-ca\") pod \"console-5967cd457c-k44kw\" (UID: \"4a980521-6191-410e-bd23-9a9af868aa60\") " pod="openshift-console/console-5967cd457c-k44kw" Sep 09 23:13:24.517708 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:13:24.517618 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m72sm\" (UniqueName: \"kubernetes.io/projected/4a980521-6191-410e-bd23-9a9af868aa60-kube-api-access-m72sm\") pod \"console-5967cd457c-k44kw\" (UID: \"4a980521-6191-410e-bd23-9a9af868aa60\") " pod="openshift-console/console-5967cd457c-k44kw" Sep 09 23:13:24.517708 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:13:24.517671 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4a980521-6191-410e-bd23-9a9af868aa60-console-config\") pod \"console-5967cd457c-k44kw\" (UID: \"4a980521-6191-410e-bd23-9a9af868aa60\") " pod="openshift-console/console-5967cd457c-k44kw" Sep 09 23:13:24.518353 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:13:24.518299 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4a980521-6191-410e-bd23-9a9af868aa60-oauth-serving-cert\") pod \"console-5967cd457c-k44kw\" (UID: \"4a980521-6191-410e-bd23-9a9af868aa60\") " pod="openshift-console/console-5967cd457c-k44kw" Sep 09 23:13:24.518502 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:13:24.518402 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4a980521-6191-410e-bd23-9a9af868aa60-service-ca\") pod \"console-5967cd457c-k44kw\" (UID: \"4a980521-6191-410e-bd23-9a9af868aa60\") " pod="openshift-console/console-5967cd457c-k44kw" Sep 09 23:13:24.518502 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:13:24.518419 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4a980521-6191-410e-bd23-9a9af868aa60-console-config\") pod \"console-5967cd457c-k44kw\" (UID: \"4a980521-6191-410e-bd23-9a9af868aa60\") " pod="openshift-console/console-5967cd457c-k44kw" Sep 09 23:13:24.518502 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:13:24.518491 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4a980521-6191-410e-bd23-9a9af868aa60-trusted-ca-bundle\") pod \"console-5967cd457c-k44kw\" (UID: \"4a980521-6191-410e-bd23-9a9af868aa60\") " pod="openshift-console/console-5967cd457c-k44kw" Sep 09 23:13:24.520342 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:13:24.520319 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4a980521-6191-410e-bd23-9a9af868aa60-console-oauth-config\") pod \"console-5967cd457c-k44kw\" (UID: \"4a980521-6191-410e-bd23-9a9af868aa60\") " pod="openshift-console/console-5967cd457c-k44kw" Sep 09 23:13:24.520541 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:13:24.520522 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4a980521-6191-410e-bd23-9a9af868aa60-console-serving-cert\") pod \"console-5967cd457c-k44kw\" (UID: \"4a980521-6191-410e-bd23-9a9af868aa60\") " pod="openshift-console/console-5967cd457c-k44kw" Sep 09 23:13:24.528900 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:13:24.528875 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m72sm\" (UniqueName: \"kubernetes.io/projected/4a980521-6191-410e-bd23-9a9af868aa60-kube-api-access-m72sm\") pod \"console-5967cd457c-k44kw\" (UID: \"4a980521-6191-410e-bd23-9a9af868aa60\") " pod="openshift-console/console-5967cd457c-k44kw" Sep 09 23:13:24.579572 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:13:24.579537 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5967cd457c-k44kw" Sep 09 23:13:25.314983 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:13:25.314942 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-b66947c67-92mlr" Sep 09 23:13:25.315445 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:13:25.315018 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-b66947c67-92mlr" Sep 09 23:13:25.320697 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:13:25.320673 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-b66947c67-92mlr" Sep 09 23:13:26.260985 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:13:26.260914 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5967cd457c-k44kw"] Sep 09 23:13:26.295486 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:13:26.295451 2561 generic.go:356] "Generic (PLEG): container finished" podID="90ae4174-3e12-48c2-af21-cee4d17b6a79" containerID="5fa2ae34bc61d225ac2e2dc091f075c47976ffb4e5c98b76dbc9c0c91c5fe391" exitCode=0 Sep 09 23:13:26.295626 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:13:26.295501 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-76bcd6ccf5-pqpnz" event={"ID":"90ae4174-3e12-48c2-af21-cee4d17b6a79","Type":"ContainerDied","Data":"5fa2ae34bc61d225ac2e2dc091f075c47976ffb4e5c98b76dbc9c0c91c5fe391"} Sep 09 23:13:26.296071 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:13:26.296037 2561 scope.go:117] "RemoveContainer" containerID="5fa2ae34bc61d225ac2e2dc091f075c47976ffb4e5c98b76dbc9c0c91c5fe391" Sep 09 23:13:26.299477 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:13:26.299450 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-b66947c67-92mlr" Sep 09 23:13:26.373044 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:13:26.373012 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4a980521_6191_410e_bd23_9a9af868aa60.slice/crio-473327fca006147b7567605ed334c4980df1c1410e780c43814f5afdb7650378 WatchSource:0}: Error finding container 473327fca006147b7567605ed334c4980df1c1410e780c43814f5afdb7650378: Status 404 returned error can't find the container with id 473327fca006147b7567605ed334c4980df1c1410e780c43814f5afdb7650378 Sep 09 23:13:27.303553 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:13:27.303510 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-76bcd6ccf5-pqpnz" event={"ID":"90ae4174-3e12-48c2-af21-cee4d17b6a79","Type":"ContainerStarted","Data":"d436cfbeaeaa38d6d5dba29e4cebca04b921deae15de4de0d8d4c3c3cde6dda3"} Sep 09 23:13:27.305740 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:13:27.305710 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-85d98c998f-gqw8t" event={"ID":"33187b1c-2f16-4d27-9de0-860af5debc69","Type":"ContainerStarted","Data":"41c0528f3a8c7ebb8ab58ee49302d83e001f08c9566224a3d7c137cdbcc5e88b"} Sep 09 23:13:27.305907 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:13:27.305879 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-85d98c998f-gqw8t" Sep 09 23:13:27.308158 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:13:27.308126 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5967cd457c-k44kw" event={"ID":"4a980521-6191-410e-bd23-9a9af868aa60","Type":"ContainerStarted","Data":"0d97ceef0eee4c9d49877f72612a9ecdac2102d572f10fdfb45141501582ff05"} Sep 09 23:13:27.308292 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:13:27.308174 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5967cd457c-k44kw" event={"ID":"4a980521-6191-410e-bd23-9a9af868aa60","Type":"ContainerStarted","Data":"473327fca006147b7567605ed334c4980df1c1410e780c43814f5afdb7650378"} Sep 09 23:13:27.318474 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:13:27.318452 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-85d98c998f-gqw8t" Sep 09 23:13:27.352142 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:13:27.350843 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5967cd457c-k44kw" podStartSLOduration=3.350819516 podStartE2EDuration="3.350819516s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:13:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:13:27.350125003 +0000 UTC m=+315.725699066" watchObservedRunningTime="2026-09-09 23:13:27.350819516 +0000 UTC m=+315.726393577" Sep 09 23:13:27.370351 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:13:27.370297 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-85d98c998f-gqw8t" podStartSLOduration=2.461276816 podStartE2EDuration="19.370275894s" totalImagesPullingTime="16.908999078s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:13:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:13:27.368806168 +0000 UTC m=+315.744380232" watchObservedRunningTime="2026-09-09 23:13:27.370275894 +0000 UTC m=+315.745849957" Sep 09 23:13:34.580316 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:13:34.580279 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5967cd457c-k44kw" Sep 09 23:13:34.580883 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:13:34.580356 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5967cd457c-k44kw" Sep 09 23:13:34.585601 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:13:34.585573 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5967cd457c-k44kw" Sep 09 23:13:35.353845 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:13:35.353779 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5967cd457c-k44kw" Sep 09 23:13:35.398296 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:13:35.398263 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-b66947c67-92mlr"] Sep 09 23:13:41.617755 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:13:41.617725 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-78c7c65684-56vmn" Sep 09 23:13:41.621518 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:13:41.621498 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-78c7c65684-56vmn" Sep 09 23:13:48.396600 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:13:48.396565 2561 generic.go:356] "Generic (PLEG): container finished" podID="905ebf0d-8b71-444f-ac69-999fccfb8c1a" containerID="1dc1abef3edbb2057e04923677db89c4571f91d06e06d446725f3ae77cb461df" exitCode=0 Sep 09 23:13:48.397009 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:13:48.396638 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-hhbq5" event={"ID":"905ebf0d-8b71-444f-ac69-999fccfb8c1a","Type":"ContainerDied","Data":"1dc1abef3edbb2057e04923677db89c4571f91d06e06d446725f3ae77cb461df"} Sep 09 23:13:48.397009 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:13:48.396974 2561 scope.go:117] "RemoveContainer" containerID="1dc1abef3edbb2057e04923677db89c4571f91d06e06d446725f3ae77cb461df" Sep 09 23:13:49.402127 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:13:49.402093 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-hhbq5" event={"ID":"905ebf0d-8b71-444f-ac69-999fccfb8c1a","Type":"ContainerStarted","Data":"80d16d27883eda99093a31bdf714cd1d68eb84ac4355158af72e2fdc6facb9b9"} Sep 09 23:14:00.429596 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:14:00.429551 2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-b66947c67-92mlr" podUID="4d49a06f-f2d4-4c98-9ab2-b0afed3b31b3" containerName="console" containerID="cri-o://ff191447d6da828fb5a15115138b2d9377cf0e65dded1d40edbe06139d6bbce2" gracePeriod=15 Sep 09 23:14:00.702722 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:14:00.702660 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-b66947c67-92mlr" Sep 09 23:14:00.722324 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:14:00.722264 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4d49a06f-f2d4-4c98-9ab2-b0afed3b31b3-oauth-serving-cert\") pod \"4d49a06f-f2d4-4c98-9ab2-b0afed3b31b3\" (UID: \"4d49a06f-f2d4-4c98-9ab2-b0afed3b31b3\") " Sep 09 23:14:00.722477 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:14:00.722348 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4d49a06f-f2d4-4c98-9ab2-b0afed3b31b3-console-serving-cert\") pod \"4d49a06f-f2d4-4c98-9ab2-b0afed3b31b3\" (UID: \"4d49a06f-f2d4-4c98-9ab2-b0afed3b31b3\") " Sep 09 23:14:00.722676 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:14:00.722643 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4d49a06f-f2d4-4c98-9ab2-b0afed3b31b3-service-ca\") pod \"4d49a06f-f2d4-4c98-9ab2-b0afed3b31b3\" (UID: \"4d49a06f-f2d4-4c98-9ab2-b0afed3b31b3\") " Sep 09 23:14:00.722802 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:14:00.722706 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rdlz8\" (UniqueName: \"kubernetes.io/projected/4d49a06f-f2d4-4c98-9ab2-b0afed3b31b3-kube-api-access-rdlz8\") pod \"4d49a06f-f2d4-4c98-9ab2-b0afed3b31b3\" (UID: \"4d49a06f-f2d4-4c98-9ab2-b0afed3b31b3\") " Sep 09 23:14:00.722802 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:14:00.722737 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4d49a06f-f2d4-4c98-9ab2-b0afed3b31b3-console-oauth-config\") pod \"4d49a06f-f2d4-4c98-9ab2-b0afed3b31b3\" (UID: \"4d49a06f-f2d4-4c98-9ab2-b0afed3b31b3\") " Sep 09 23:14:00.722802 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:14:00.722767 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4d49a06f-f2d4-4c98-9ab2-b0afed3b31b3-console-config\") pod \"4d49a06f-f2d4-4c98-9ab2-b0afed3b31b3\" (UID: \"4d49a06f-f2d4-4c98-9ab2-b0afed3b31b3\") " Sep 09 23:14:00.723029 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:14:00.723003 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4d49a06f-f2d4-4c98-9ab2-b0afed3b31b3-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "4d49a06f-f2d4-4c98-9ab2-b0afed3b31b3" (UID: "4d49a06f-f2d4-4c98-9ab2-b0afed3b31b3"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 09 23:14:00.723029 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:14:00.723013 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4d49a06f-f2d4-4c98-9ab2-b0afed3b31b3-service-ca" (OuterVolumeSpecName: "service-ca") pod "4d49a06f-f2d4-4c98-9ab2-b0afed3b31b3" (UID: "4d49a06f-f2d4-4c98-9ab2-b0afed3b31b3"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 09 23:14:00.723407 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:14:00.723340 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4d49a06f-f2d4-4c98-9ab2-b0afed3b31b3-console-config" (OuterVolumeSpecName: "console-config") pod "4d49a06f-f2d4-4c98-9ab2-b0afed3b31b3" (UID: "4d49a06f-f2d4-4c98-9ab2-b0afed3b31b3"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 09 23:14:00.725647 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:14:00.725597 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4d49a06f-f2d4-4c98-9ab2-b0afed3b31b3-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "4d49a06f-f2d4-4c98-9ab2-b0afed3b31b3" (UID: "4d49a06f-f2d4-4c98-9ab2-b0afed3b31b3"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 09 23:14:00.725732 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:14:00.725660 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4d49a06f-f2d4-4c98-9ab2-b0afed3b31b3-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "4d49a06f-f2d4-4c98-9ab2-b0afed3b31b3" (UID: "4d49a06f-f2d4-4c98-9ab2-b0afed3b31b3"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 09 23:14:00.725778 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:14:00.725728 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4d49a06f-f2d4-4c98-9ab2-b0afed3b31b3-kube-api-access-rdlz8" (OuterVolumeSpecName: "kube-api-access-rdlz8") pod "4d49a06f-f2d4-4c98-9ab2-b0afed3b31b3" (UID: "4d49a06f-f2d4-4c98-9ab2-b0afed3b31b3"). InnerVolumeSpecName "kube-api-access-rdlz8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 09 23:14:00.824254 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:14:00.824223 2561 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4d49a06f-f2d4-4c98-9ab2-b0afed3b31b3-oauth-serving-cert\") on node \"ip-10-0-132-204.ec2.internal\" DevicePath \"\"" Sep 09 23:14:00.824254 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:14:00.824249 2561 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4d49a06f-f2d4-4c98-9ab2-b0afed3b31b3-console-serving-cert\") on node \"ip-10-0-132-204.ec2.internal\" DevicePath \"\"" Sep 09 23:14:00.824254 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:14:00.824258 2561 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4d49a06f-f2d4-4c98-9ab2-b0afed3b31b3-service-ca\") on node \"ip-10-0-132-204.ec2.internal\" DevicePath \"\"" Sep 09 23:14:00.824479 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:14:00.824268 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rdlz8\" (UniqueName: \"kubernetes.io/projected/4d49a06f-f2d4-4c98-9ab2-b0afed3b31b3-kube-api-access-rdlz8\") on node \"ip-10-0-132-204.ec2.internal\" DevicePath \"\"" Sep 09 23:14:00.824479 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:14:00.824276 2561 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4d49a06f-f2d4-4c98-9ab2-b0afed3b31b3-console-oauth-config\") on node \"ip-10-0-132-204.ec2.internal\" DevicePath \"\"" Sep 09 23:14:00.824479 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:14:00.824284 2561 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4d49a06f-f2d4-4c98-9ab2-b0afed3b31b3-console-config\") on node \"ip-10-0-132-204.ec2.internal\" DevicePath \"\"" Sep 09 23:14:01.448797 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:14:01.448762 2561 generic.go:356] "Generic (PLEG): container finished" podID="4d49a06f-f2d4-4c98-9ab2-b0afed3b31b3" containerID="ff191447d6da828fb5a15115138b2d9377cf0e65dded1d40edbe06139d6bbce2" exitCode=0 Sep 09 23:14:01.449248 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:14:01.448807 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-b66947c67-92mlr" Sep 09 23:14:01.449248 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:14:01.448854 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-b66947c67-92mlr" event={"ID":"4d49a06f-f2d4-4c98-9ab2-b0afed3b31b3","Type":"ContainerDied","Data":"ff191447d6da828fb5a15115138b2d9377cf0e65dded1d40edbe06139d6bbce2"} Sep 09 23:14:01.449248 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:14:01.448915 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-b66947c67-92mlr" event={"ID":"4d49a06f-f2d4-4c98-9ab2-b0afed3b31b3","Type":"ContainerDied","Data":"072b208b3bdd639db719b8ad9e6dbd4662ba6c8e9d6d65e765a84e8e0c45a4cb"} Sep 09 23:14:01.449248 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:14:01.448946 2561 scope.go:117] "RemoveContainer" containerID="ff191447d6da828fb5a15115138b2d9377cf0e65dded1d40edbe06139d6bbce2" Sep 09 23:14:01.459255 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:14:01.459232 2561 scope.go:117] "RemoveContainer" containerID="ff191447d6da828fb5a15115138b2d9377cf0e65dded1d40edbe06139d6bbce2" Sep 09 23:14:01.459906 ip-10-0-132-204 kubenswrapper[2561]: E0909 23:14:01.459884 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ff191447d6da828fb5a15115138b2d9377cf0e65dded1d40edbe06139d6bbce2\": container with ID starting with ff191447d6da828fb5a15115138b2d9377cf0e65dded1d40edbe06139d6bbce2 not found: ID does not exist" containerID="ff191447d6da828fb5a15115138b2d9377cf0e65dded1d40edbe06139d6bbce2" Sep 09 23:14:01.460005 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:14:01.459914 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ff191447d6da828fb5a15115138b2d9377cf0e65dded1d40edbe06139d6bbce2"} err="failed to get container status \"ff191447d6da828fb5a15115138b2d9377cf0e65dded1d40edbe06139d6bbce2\": rpc error: code = NotFound desc = could not find container \"ff191447d6da828fb5a15115138b2d9377cf0e65dded1d40edbe06139d6bbce2\": container with ID starting with ff191447d6da828fb5a15115138b2d9377cf0e65dded1d40edbe06139d6bbce2 not found: ID does not exist" Sep 09 23:14:01.486847 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:14:01.486826 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-b66947c67-92mlr"] Sep 09 23:14:01.495894 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:14:01.495871 2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-b66947c67-92mlr"] Sep 09 23:14:02.116573 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:14:02.116542 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4d49a06f-f2d4-4c98-9ab2-b0afed3b31b3" path="/var/lib/kubelet/pods/4d49a06f-f2d4-4c98-9ab2-b0afed3b31b3/volumes" Sep 09 23:14:17.191962 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:14:17.191931 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 09 23:14:17.192435 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:14:17.192182 2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="8eb6951b-4a31-41cb-ad67-acca8d2633f8" containerName="alertmanager" containerID="cri-o://aa0b9fa5ca9ad2ce72e1296fd93c6acfc4ad0da8c0083148336c84cccddff066" gracePeriod=120 Sep 09 23:14:17.192435 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:14:17.192261 2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="8eb6951b-4a31-41cb-ad67-acca8d2633f8" containerName="kube-rbac-proxy-metric" containerID="cri-o://467780ccc19de0d06af5c2db6d3dbe03068ddf90b3414da601a57c0c43533302" gracePeriod=120 Sep 09 23:14:17.192435 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:14:17.192326 2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="8eb6951b-4a31-41cb-ad67-acca8d2633f8" containerName="prom-label-proxy" containerID="cri-o://939fbee1edb416c847dccf986c4abad58b4b2d20939a7122982f22d79440b6a7" gracePeriod=120 Sep 09 23:14:17.192435 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:14:17.192352 2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="8eb6951b-4a31-41cb-ad67-acca8d2633f8" containerName="kube-rbac-proxy" containerID="cri-o://3c98aa65c928627da1f4afcb78ce4c4c36a6d394d6f267228df97f392ad3b01c" gracePeriod=120 Sep 09 23:14:17.192700 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:14:17.192310 2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="8eb6951b-4a31-41cb-ad67-acca8d2633f8" containerName="config-reloader" containerID="cri-o://a12568b029f339e78088426ffcc17f1f7efb93d4d452fc06ab69b07290ef2343" gracePeriod=120 Sep 09 23:14:17.192700 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:14:17.192293 2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="8eb6951b-4a31-41cb-ad67-acca8d2633f8" containerName="kube-rbac-proxy-web" containerID="cri-o://0a42cb8288aa3faab87d45974717157fdf6bc3ac8b61823c147dc16e53a6fb2c" gracePeriod=120 Sep 09 23:14:17.515657 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:14:17.515625 2561 generic.go:356] "Generic (PLEG): container finished" podID="8eb6951b-4a31-41cb-ad67-acca8d2633f8" containerID="939fbee1edb416c847dccf986c4abad58b4b2d20939a7122982f22d79440b6a7" exitCode=0 Sep 09 23:14:17.515657 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:14:17.515648 2561 generic.go:356] "Generic (PLEG): container finished" podID="8eb6951b-4a31-41cb-ad67-acca8d2633f8" containerID="467780ccc19de0d06af5c2db6d3dbe03068ddf90b3414da601a57c0c43533302" exitCode=0 Sep 09 23:14:17.515657 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:14:17.515654 2561 generic.go:356] "Generic (PLEG): container finished" podID="8eb6951b-4a31-41cb-ad67-acca8d2633f8" containerID="3c98aa65c928627da1f4afcb78ce4c4c36a6d394d6f267228df97f392ad3b01c" exitCode=0 Sep 09 23:14:17.515657 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:14:17.515660 2561 generic.go:356] "Generic (PLEG): container finished" podID="8eb6951b-4a31-41cb-ad67-acca8d2633f8" containerID="a12568b029f339e78088426ffcc17f1f7efb93d4d452fc06ab69b07290ef2343" exitCode=0 Sep 09 23:14:17.515657 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:14:17.515665 2561 generic.go:356] "Generic (PLEG): container finished" podID="8eb6951b-4a31-41cb-ad67-acca8d2633f8" containerID="aa0b9fa5ca9ad2ce72e1296fd93c6acfc4ad0da8c0083148336c84cccddff066" exitCode=0 Sep 09 23:14:17.516007 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:14:17.515697 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8eb6951b-4a31-41cb-ad67-acca8d2633f8","Type":"ContainerDied","Data":"939fbee1edb416c847dccf986c4abad58b4b2d20939a7122982f22d79440b6a7"} Sep 09 23:14:17.516007 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:14:17.515758 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8eb6951b-4a31-41cb-ad67-acca8d2633f8","Type":"ContainerDied","Data":"467780ccc19de0d06af5c2db6d3dbe03068ddf90b3414da601a57c0c43533302"} Sep 09 23:14:17.516007 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:14:17.515786 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8eb6951b-4a31-41cb-ad67-acca8d2633f8","Type":"ContainerDied","Data":"3c98aa65c928627da1f4afcb78ce4c4c36a6d394d6f267228df97f392ad3b01c"} Sep 09 23:14:17.516007 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:14:17.515812 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8eb6951b-4a31-41cb-ad67-acca8d2633f8","Type":"ContainerDied","Data":"a12568b029f339e78088426ffcc17f1f7efb93d4d452fc06ab69b07290ef2343"} Sep 09 23:14:17.516007 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:14:17.515837 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8eb6951b-4a31-41cb-ad67-acca8d2633f8","Type":"ContainerDied","Data":"aa0b9fa5ca9ad2ce72e1296fd93c6acfc4ad0da8c0083148336c84cccddff066"} Sep 09 23:14:18.434346 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:14:18.434320 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:14:18.523639 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:14:18.523561 2561 generic.go:356] "Generic (PLEG): container finished" podID="8eb6951b-4a31-41cb-ad67-acca8d2633f8" containerID="0a42cb8288aa3faab87d45974717157fdf6bc3ac8b61823c147dc16e53a6fb2c" exitCode=0 Sep 09 23:14:18.523639 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:14:18.523607 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8eb6951b-4a31-41cb-ad67-acca8d2633f8","Type":"ContainerDied","Data":"0a42cb8288aa3faab87d45974717157fdf6bc3ac8b61823c147dc16e53a6fb2c"} Sep 09 23:14:18.523809 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:14:18.523650 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:14:18.523809 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:14:18.523680 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8eb6951b-4a31-41cb-ad67-acca8d2633f8","Type":"ContainerDied","Data":"b335c38308564e396c6c78292a35db1f7fa8134d49bd7584660f6d9aa24a9f16"} Sep 09 23:14:18.523809 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:14:18.523728 2561 scope.go:117] "RemoveContainer" containerID="939fbee1edb416c847dccf986c4abad58b4b2d20939a7122982f22d79440b6a7" Sep 09 23:14:18.531355 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:14:18.531335 2561 scope.go:117] "RemoveContainer" containerID="467780ccc19de0d06af5c2db6d3dbe03068ddf90b3414da601a57c0c43533302" Sep 09 23:14:18.538282 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:14:18.538266 2561 scope.go:117] "RemoveContainer" containerID="3c98aa65c928627da1f4afcb78ce4c4c36a6d394d6f267228df97f392ad3b01c" Sep 09 23:14:18.546911 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:14:18.546891 2561 scope.go:117] "RemoveContainer" containerID="0a42cb8288aa3faab87d45974717157fdf6bc3ac8b61823c147dc16e53a6fb2c" Sep 09 23:14:18.553552 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:14:18.553538 2561 scope.go:117] "RemoveContainer" containerID="a12568b029f339e78088426ffcc17f1f7efb93d4d452fc06ab69b07290ef2343" Sep 09 23:14:18.560406 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:14:18.560390 2561 scope.go:117] "RemoveContainer" containerID="aa0b9fa5ca9ad2ce72e1296fd93c6acfc4ad0da8c0083148336c84cccddff066" Sep 09 23:14:18.567191 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:14:18.567174 2561 scope.go:117] "RemoveContainer" containerID="5401c9b52ccf8ff9500aaea476661dda53ede7888a8883877064717e0708350f" Sep 09 23:14:18.572484 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:14:18.572466 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/8eb6951b-4a31-41cb-ad67-acca8d2633f8-config-volume\") pod \"8eb6951b-4a31-41cb-ad67-acca8d2633f8\" (UID: \"8eb6951b-4a31-41cb-ad67-acca8d2633f8\") " Sep 09 23:14:18.572574 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:14:18.572495 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8eb6951b-4a31-41cb-ad67-acca8d2633f8-secret-alertmanager-kube-rbac-proxy\") pod \"8eb6951b-4a31-41cb-ad67-acca8d2633f8\" (UID: \"8eb6951b-4a31-41cb-ad67-acca8d2633f8\") " Sep 09 23:14:18.572574 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:14:18.572520 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8eb6951b-4a31-41cb-ad67-acca8d2633f8-alertmanager-trusted-ca-bundle\") pod \"8eb6951b-4a31-41cb-ad67-acca8d2633f8\" (UID: \"8eb6951b-4a31-41cb-ad67-acca8d2633f8\") " Sep 09 23:14:18.572657 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:14:18.572597 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8eb6951b-4a31-41cb-ad67-acca8d2633f8-tls-assets\") pod \"8eb6951b-4a31-41cb-ad67-acca8d2633f8\" (UID: \"8eb6951b-4a31-41cb-ad67-acca8d2633f8\") " Sep 09 23:14:18.572657 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:14:18.572637 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8eb6951b-4a31-41cb-ad67-acca8d2633f8-secret-alertmanager-kube-rbac-proxy-web\") pod \"8eb6951b-4a31-41cb-ad67-acca8d2633f8\" (UID: \"8eb6951b-4a31-41cb-ad67-acca8d2633f8\") " Sep 09 23:14:18.572741 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:14:18.572681 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/8eb6951b-4a31-41cb-ad67-acca8d2633f8-alertmanager-main-db\") pod \"8eb6951b-4a31-41cb-ad67-acca8d2633f8\" (UID: \"8eb6951b-4a31-41cb-ad67-acca8d2633f8\") " Sep 09 23:14:18.572741 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:14:18.572722 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/8eb6951b-4a31-41cb-ad67-acca8d2633f8-secret-alertmanager-kube-rbac-proxy-metric\") pod \"8eb6951b-4a31-41cb-ad67-acca8d2633f8\" (UID: \"8eb6951b-4a31-41cb-ad67-acca8d2633f8\") " Sep 09 23:14:18.572845 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:14:18.572750 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8eb6951b-4a31-41cb-ad67-acca8d2633f8-metrics-client-ca\") pod \"8eb6951b-4a31-41cb-ad67-acca8d2633f8\" (UID: \"8eb6951b-4a31-41cb-ad67-acca8d2633f8\") " Sep 09 23:14:18.572845 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:14:18.572773 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/8eb6951b-4a31-41cb-ad67-acca8d2633f8-secret-alertmanager-main-tls\") pod \"8eb6951b-4a31-41cb-ad67-acca8d2633f8\" (UID: \"8eb6951b-4a31-41cb-ad67-acca8d2633f8\") " Sep 09 23:14:18.572845 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:14:18.572807 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8eb6951b-4a31-41cb-ad67-acca8d2633f8-web-config\") pod \"8eb6951b-4a31-41cb-ad67-acca8d2633f8\" (UID: \"8eb6951b-4a31-41cb-ad67-acca8d2633f8\") " Sep 09 23:14:18.572845 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:14:18.572839 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w6kt2\" (UniqueName: \"kubernetes.io/projected/8eb6951b-4a31-41cb-ad67-acca8d2633f8-kube-api-access-w6kt2\") pod \"8eb6951b-4a31-41cb-ad67-acca8d2633f8\" (UID: \"8eb6951b-4a31-41cb-ad67-acca8d2633f8\") " Sep 09 23:14:18.573040 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:14:18.572880 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8eb6951b-4a31-41cb-ad67-acca8d2633f8-config-out\") pod \"8eb6951b-4a31-41cb-ad67-acca8d2633f8\" (UID: \"8eb6951b-4a31-41cb-ad67-acca8d2633f8\") " Sep 09 23:14:18.573040 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:14:18.572915 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/8eb6951b-4a31-41cb-ad67-acca8d2633f8-cluster-tls-config\") pod \"8eb6951b-4a31-41cb-ad67-acca8d2633f8\" (UID: \"8eb6951b-4a31-41cb-ad67-acca8d2633f8\") " Sep 09 23:14:18.573146 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:14:18.572971 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8eb6951b-4a31-41cb-ad67-acca8d2633f8-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "8eb6951b-4a31-41cb-ad67-acca8d2633f8" (UID: "8eb6951b-4a31-41cb-ad67-acca8d2633f8"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 09 23:14:18.573399 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:14:18.573246 2561 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8eb6951b-4a31-41cb-ad67-acca8d2633f8-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-132-204.ec2.internal\" DevicePath \"\"" Sep 09 23:14:18.575078 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:14:18.574717 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8eb6951b-4a31-41cb-ad67-acca8d2633f8-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "8eb6951b-4a31-41cb-ad67-acca8d2633f8" (UID: "8eb6951b-4a31-41cb-ad67-acca8d2633f8"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 09 23:14:18.575078 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:14:18.574781 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8eb6951b-4a31-41cb-ad67-acca8d2633f8-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "8eb6951b-4a31-41cb-ad67-acca8d2633f8" (UID: "8eb6951b-4a31-41cb-ad67-acca8d2633f8"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 09 23:14:18.576199 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:14:18.575755 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8eb6951b-4a31-41cb-ad67-acca8d2633f8-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "8eb6951b-4a31-41cb-ad67-acca8d2633f8" (UID: "8eb6951b-4a31-41cb-ad67-acca8d2633f8"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 09 23:14:18.576199 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:14:18.575916 2561 scope.go:117] "RemoveContainer" containerID="939fbee1edb416c847dccf986c4abad58b4b2d20939a7122982f22d79440b6a7" Sep 09 23:14:18.576199 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:14:18.576124 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8eb6951b-4a31-41cb-ad67-acca8d2633f8-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "8eb6951b-4a31-41cb-ad67-acca8d2633f8" (UID: "8eb6951b-4a31-41cb-ad67-acca8d2633f8"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 09 23:14:18.576199 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:14:18.576119 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8eb6951b-4a31-41cb-ad67-acca8d2633f8-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "8eb6951b-4a31-41cb-ad67-acca8d2633f8" (UID: "8eb6951b-4a31-41cb-ad67-acca8d2633f8"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 09 23:14:18.576510 ip-10-0-132-204 kubenswrapper[2561]: E0909 23:14:18.576407 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"939fbee1edb416c847dccf986c4abad58b4b2d20939a7122982f22d79440b6a7\": container with ID starting with 939fbee1edb416c847dccf986c4abad58b4b2d20939a7122982f22d79440b6a7 not found: ID does not exist" containerID="939fbee1edb416c847dccf986c4abad58b4b2d20939a7122982f22d79440b6a7" Sep 09 23:14:18.576510 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:14:18.576439 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"939fbee1edb416c847dccf986c4abad58b4b2d20939a7122982f22d79440b6a7"} err="failed to get container status \"939fbee1edb416c847dccf986c4abad58b4b2d20939a7122982f22d79440b6a7\": rpc error: code = NotFound desc = could not find container \"939fbee1edb416c847dccf986c4abad58b4b2d20939a7122982f22d79440b6a7\": container with ID starting with 939fbee1edb416c847dccf986c4abad58b4b2d20939a7122982f22d79440b6a7 not found: ID does not exist" Sep 09 23:14:18.576510 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:14:18.576466 2561 scope.go:117] "RemoveContainer" containerID="467780ccc19de0d06af5c2db6d3dbe03068ddf90b3414da601a57c0c43533302" Sep 09 23:14:18.577149 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:14:18.576941 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8eb6951b-4a31-41cb-ad67-acca8d2633f8-config-volume" (OuterVolumeSpecName: "config-volume") pod "8eb6951b-4a31-41cb-ad67-acca8d2633f8" (UID: "8eb6951b-4a31-41cb-ad67-acca8d2633f8"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 09 23:14:18.577745 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:14:18.577713 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8eb6951b-4a31-41cb-ad67-acca8d2633f8-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "8eb6951b-4a31-41cb-ad67-acca8d2633f8" (UID: "8eb6951b-4a31-41cb-ad67-acca8d2633f8"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 09 23:14:18.583287 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:14:18.581024 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8eb6951b-4a31-41cb-ad67-acca8d2633f8-kube-api-access-w6kt2" (OuterVolumeSpecName: "kube-api-access-w6kt2") pod "8eb6951b-4a31-41cb-ad67-acca8d2633f8" (UID: "8eb6951b-4a31-41cb-ad67-acca8d2633f8"). InnerVolumeSpecName "kube-api-access-w6kt2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 09 23:14:18.583287 ip-10-0-132-204 kubenswrapper[2561]: E0909 23:14:18.581720 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"467780ccc19de0d06af5c2db6d3dbe03068ddf90b3414da601a57c0c43533302\": container with ID starting with 467780ccc19de0d06af5c2db6d3dbe03068ddf90b3414da601a57c0c43533302 not found: ID does not exist" containerID="467780ccc19de0d06af5c2db6d3dbe03068ddf90b3414da601a57c0c43533302" Sep 09 23:14:18.583287 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:14:18.581755 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"467780ccc19de0d06af5c2db6d3dbe03068ddf90b3414da601a57c0c43533302"} err="failed to get container status \"467780ccc19de0d06af5c2db6d3dbe03068ddf90b3414da601a57c0c43533302\": rpc error: code = NotFound desc = could not find container \"467780ccc19de0d06af5c2db6d3dbe03068ddf90b3414da601a57c0c43533302\": container with ID starting with 467780ccc19de0d06af5c2db6d3dbe03068ddf90b3414da601a57c0c43533302 not found: ID does not exist" Sep 09 23:14:18.583287 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:14:18.581779 2561 scope.go:117] "RemoveContainer" containerID="3c98aa65c928627da1f4afcb78ce4c4c36a6d394d6f267228df97f392ad3b01c" Sep 09 23:14:18.583287 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:14:18.582725 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8eb6951b-4a31-41cb-ad67-acca8d2633f8-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "8eb6951b-4a31-41cb-ad67-acca8d2633f8" (UID: "8eb6951b-4a31-41cb-ad67-acca8d2633f8"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 09 23:14:18.583780 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:14:18.583664 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8eb6951b-4a31-41cb-ad67-acca8d2633f8-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "8eb6951b-4a31-41cb-ad67-acca8d2633f8" (UID: "8eb6951b-4a31-41cb-ad67-acca8d2633f8"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 09 23:14:18.584390 ip-10-0-132-204 kubenswrapper[2561]: E0909 23:14:18.584123 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3c98aa65c928627da1f4afcb78ce4c4c36a6d394d6f267228df97f392ad3b01c\": container with ID starting with 3c98aa65c928627da1f4afcb78ce4c4c36a6d394d6f267228df97f392ad3b01c not found: ID does not exist" containerID="3c98aa65c928627da1f4afcb78ce4c4c36a6d394d6f267228df97f392ad3b01c" Sep 09 23:14:18.584390 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:14:18.584160 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3c98aa65c928627da1f4afcb78ce4c4c36a6d394d6f267228df97f392ad3b01c"} err="failed to get container status \"3c98aa65c928627da1f4afcb78ce4c4c36a6d394d6f267228df97f392ad3b01c\": rpc error: code = NotFound desc = could not find container \"3c98aa65c928627da1f4afcb78ce4c4c36a6d394d6f267228df97f392ad3b01c\": container with ID starting with 3c98aa65c928627da1f4afcb78ce4c4c36a6d394d6f267228df97f392ad3b01c not found: ID does not exist" Sep 09 23:14:18.584390 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:14:18.584182 2561 scope.go:117] "RemoveContainer" containerID="0a42cb8288aa3faab87d45974717157fdf6bc3ac8b61823c147dc16e53a6fb2c" Sep 09 23:14:18.584906 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:14:18.584883 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8eb6951b-4a31-41cb-ad67-acca8d2633f8-config-out" (OuterVolumeSpecName: "config-out") pod "8eb6951b-4a31-41cb-ad67-acca8d2633f8" (UID: "8eb6951b-4a31-41cb-ad67-acca8d2633f8"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 09 23:14:18.584996 ip-10-0-132-204 kubenswrapper[2561]: E0909 23:14:18.584899 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0a42cb8288aa3faab87d45974717157fdf6bc3ac8b61823c147dc16e53a6fb2c\": container with ID starting with 0a42cb8288aa3faab87d45974717157fdf6bc3ac8b61823c147dc16e53a6fb2c not found: ID does not exist" containerID="0a42cb8288aa3faab87d45974717157fdf6bc3ac8b61823c147dc16e53a6fb2c" Sep 09 23:14:18.584996 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:14:18.584939 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0a42cb8288aa3faab87d45974717157fdf6bc3ac8b61823c147dc16e53a6fb2c"} err="failed to get container status \"0a42cb8288aa3faab87d45974717157fdf6bc3ac8b61823c147dc16e53a6fb2c\": rpc error: code = NotFound desc = could not find container \"0a42cb8288aa3faab87d45974717157fdf6bc3ac8b61823c147dc16e53a6fb2c\": container with ID starting with 0a42cb8288aa3faab87d45974717157fdf6bc3ac8b61823c147dc16e53a6fb2c not found: ID does not exist" Sep 09 23:14:18.584996 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:14:18.584955 2561 scope.go:117] "RemoveContainer" containerID="a12568b029f339e78088426ffcc17f1f7efb93d4d452fc06ab69b07290ef2343" Sep 09 23:14:18.585298 ip-10-0-132-204 kubenswrapper[2561]: E0909 23:14:18.585223 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a12568b029f339e78088426ffcc17f1f7efb93d4d452fc06ab69b07290ef2343\": container with ID starting with a12568b029f339e78088426ffcc17f1f7efb93d4d452fc06ab69b07290ef2343 not found: ID does not exist" containerID="a12568b029f339e78088426ffcc17f1f7efb93d4d452fc06ab69b07290ef2343" Sep 09 23:14:18.585298 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:14:18.585260 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a12568b029f339e78088426ffcc17f1f7efb93d4d452fc06ab69b07290ef2343"} err="failed to get container status \"a12568b029f339e78088426ffcc17f1f7efb93d4d452fc06ab69b07290ef2343\": rpc error: code = NotFound desc = could not find container \"a12568b029f339e78088426ffcc17f1f7efb93d4d452fc06ab69b07290ef2343\": container with ID starting with a12568b029f339e78088426ffcc17f1f7efb93d4d452fc06ab69b07290ef2343 not found: ID does not exist" Sep 09 23:14:18.585298 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:14:18.585280 2561 scope.go:117] "RemoveContainer" containerID="aa0b9fa5ca9ad2ce72e1296fd93c6acfc4ad0da8c0083148336c84cccddff066" Sep 09 23:14:18.585591 ip-10-0-132-204 kubenswrapper[2561]: E0909 23:14:18.585572 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"aa0b9fa5ca9ad2ce72e1296fd93c6acfc4ad0da8c0083148336c84cccddff066\": container with ID starting with aa0b9fa5ca9ad2ce72e1296fd93c6acfc4ad0da8c0083148336c84cccddff066 not found: ID does not exist" containerID="aa0b9fa5ca9ad2ce72e1296fd93c6acfc4ad0da8c0083148336c84cccddff066" Sep 09 23:14:18.585650 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:14:18.585597 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aa0b9fa5ca9ad2ce72e1296fd93c6acfc4ad0da8c0083148336c84cccddff066"} err="failed to get container status \"aa0b9fa5ca9ad2ce72e1296fd93c6acfc4ad0da8c0083148336c84cccddff066\": rpc error: code = NotFound desc = could not find container \"aa0b9fa5ca9ad2ce72e1296fd93c6acfc4ad0da8c0083148336c84cccddff066\": container with ID starting with aa0b9fa5ca9ad2ce72e1296fd93c6acfc4ad0da8c0083148336c84cccddff066 not found: ID does not exist" Sep 09 23:14:18.585650 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:14:18.585611 2561 scope.go:117] "RemoveContainer" containerID="5401c9b52ccf8ff9500aaea476661dda53ede7888a8883877064717e0708350f" Sep 09 23:14:18.586030 ip-10-0-132-204 kubenswrapper[2561]: E0909 23:14:18.586006 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5401c9b52ccf8ff9500aaea476661dda53ede7888a8883877064717e0708350f\": container with ID starting with 5401c9b52ccf8ff9500aaea476661dda53ede7888a8883877064717e0708350f not found: ID does not exist" containerID="5401c9b52ccf8ff9500aaea476661dda53ede7888a8883877064717e0708350f" Sep 09 23:14:18.586147 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:14:18.586037 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5401c9b52ccf8ff9500aaea476661dda53ede7888a8883877064717e0708350f"} err="failed to get container status \"5401c9b52ccf8ff9500aaea476661dda53ede7888a8883877064717e0708350f\": rpc error: code = NotFound desc = could not find container \"5401c9b52ccf8ff9500aaea476661dda53ede7888a8883877064717e0708350f\": container with ID starting with 5401c9b52ccf8ff9500aaea476661dda53ede7888a8883877064717e0708350f not found: ID does not exist" Sep 09 23:14:18.593506 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:14:18.593487 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8eb6951b-4a31-41cb-ad67-acca8d2633f8-web-config" (OuterVolumeSpecName: "web-config") pod "8eb6951b-4a31-41cb-ad67-acca8d2633f8" (UID: "8eb6951b-4a31-41cb-ad67-acca8d2633f8"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 09 23:14:18.674587 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:14:18.674559 2561 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/8eb6951b-4a31-41cb-ad67-acca8d2633f8-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-132-204.ec2.internal\" DevicePath \"\"" Sep 09 23:14:18.674587 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:14:18.674585 2561 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8eb6951b-4a31-41cb-ad67-acca8d2633f8-metrics-client-ca\") on node \"ip-10-0-132-204.ec2.internal\" DevicePath \"\"" Sep 09 23:14:18.674719 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:14:18.674595 2561 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/8eb6951b-4a31-41cb-ad67-acca8d2633f8-secret-alertmanager-main-tls\") on node \"ip-10-0-132-204.ec2.internal\" DevicePath \"\"" Sep 09 23:14:18.674719 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:14:18.674604 2561 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8eb6951b-4a31-41cb-ad67-acca8d2633f8-web-config\") on node \"ip-10-0-132-204.ec2.internal\" DevicePath \"\"" Sep 09 23:14:18.674719 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:14:18.674613 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w6kt2\" (UniqueName: \"kubernetes.io/projected/8eb6951b-4a31-41cb-ad67-acca8d2633f8-kube-api-access-w6kt2\") on node \"ip-10-0-132-204.ec2.internal\" DevicePath \"\"" Sep 09 23:14:18.674719 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:14:18.674622 2561 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8eb6951b-4a31-41cb-ad67-acca8d2633f8-config-out\") on node \"ip-10-0-132-204.ec2.internal\" DevicePath \"\"" Sep 09 23:14:18.674719 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:14:18.674630 2561 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/8eb6951b-4a31-41cb-ad67-acca8d2633f8-cluster-tls-config\") on node \"ip-10-0-132-204.ec2.internal\" DevicePath \"\"" Sep 09 23:14:18.674719 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:14:18.674637 2561 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/8eb6951b-4a31-41cb-ad67-acca8d2633f8-config-volume\") on node \"ip-10-0-132-204.ec2.internal\" DevicePath \"\"" Sep 09 23:14:18.674719 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:14:18.674645 2561 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8eb6951b-4a31-41cb-ad67-acca8d2633f8-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-132-204.ec2.internal\" DevicePath \"\"" Sep 09 23:14:18.674719 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:14:18.674653 2561 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8eb6951b-4a31-41cb-ad67-acca8d2633f8-tls-assets\") on node \"ip-10-0-132-204.ec2.internal\" DevicePath \"\"" Sep 09 23:14:18.674719 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:14:18.674661 2561 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8eb6951b-4a31-41cb-ad67-acca8d2633f8-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-132-204.ec2.internal\" DevicePath \"\"" Sep 09 23:14:18.674719 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:14:18.674668 2561 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/8eb6951b-4a31-41cb-ad67-acca8d2633f8-alertmanager-main-db\") on node \"ip-10-0-132-204.ec2.internal\" DevicePath \"\"" Sep 09 23:14:18.855858 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:14:18.855827 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 09 23:14:18.860271 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:14:18.860247 2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 09 23:14:18.901405 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:14:18.901380 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 09 23:14:18.901682 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:14:18.901671 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8eb6951b-4a31-41cb-ad67-acca8d2633f8" containerName="config-reloader" Sep 09 23:14:18.901733 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:14:18.901684 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="8eb6951b-4a31-41cb-ad67-acca8d2633f8" containerName="config-reloader" Sep 09 23:14:18.901733 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:14:18.901693 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8eb6951b-4a31-41cb-ad67-acca8d2633f8" containerName="kube-rbac-proxy-web" Sep 09 23:14:18.901733 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:14:18.901698 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="8eb6951b-4a31-41cb-ad67-acca8d2633f8" containerName="kube-rbac-proxy-web" Sep 09 23:14:18.901733 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:14:18.901705 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8eb6951b-4a31-41cb-ad67-acca8d2633f8" containerName="alertmanager" Sep 09 23:14:18.901733 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:14:18.901710 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="8eb6951b-4a31-41cb-ad67-acca8d2633f8" containerName="alertmanager" Sep 09 23:14:18.901733 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:14:18.901720 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8eb6951b-4a31-41cb-ad67-acca8d2633f8" containerName="init-config-reloader" Sep 09 23:14:18.901733 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:14:18.901725 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="8eb6951b-4a31-41cb-ad67-acca8d2633f8" containerName="init-config-reloader" Sep 09 23:14:18.901733 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:14:18.901732 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8eb6951b-4a31-41cb-ad67-acca8d2633f8" containerName="kube-rbac-proxy-metric" Sep 09 23:14:18.901976 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:14:18.901737 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="8eb6951b-4a31-41cb-ad67-acca8d2633f8" containerName="kube-rbac-proxy-metric" Sep 09 23:14:18.901976 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:14:18.901747 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8eb6951b-4a31-41cb-ad67-acca8d2633f8" containerName="kube-rbac-proxy" Sep 09 23:14:18.901976 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:14:18.901752 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="8eb6951b-4a31-41cb-ad67-acca8d2633f8" containerName="kube-rbac-proxy" Sep 09 23:14:18.901976 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:14:18.901760 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8eb6951b-4a31-41cb-ad67-acca8d2633f8" containerName="prom-label-proxy" Sep 09 23:14:18.901976 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:14:18.901765 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="8eb6951b-4a31-41cb-ad67-acca8d2633f8" containerName="prom-label-proxy" Sep 09 23:14:18.901976 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:14:18.901774 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4d49a06f-f2d4-4c98-9ab2-b0afed3b31b3" containerName="console" Sep 09 23:14:18.901976 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:14:18.901778 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="4d49a06f-f2d4-4c98-9ab2-b0afed3b31b3" containerName="console" Sep 09 23:14:18.901976 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:14:18.901828 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="8eb6951b-4a31-41cb-ad67-acca8d2633f8" containerName="kube-rbac-proxy-web" Sep 09 23:14:18.901976 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:14:18.901836 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="8eb6951b-4a31-41cb-ad67-acca8d2633f8" containerName="kube-rbac-proxy" Sep 09 23:14:18.901976 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:14:18.901844 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="4d49a06f-f2d4-4c98-9ab2-b0afed3b31b3" containerName="console" Sep 09 23:14:18.901976 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:14:18.901848 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="8eb6951b-4a31-41cb-ad67-acca8d2633f8" containerName="kube-rbac-proxy-metric" Sep 09 23:14:18.901976 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:14:18.901853 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="8eb6951b-4a31-41cb-ad67-acca8d2633f8" containerName="config-reloader" Sep 09 23:14:18.901976 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:14:18.901860 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="8eb6951b-4a31-41cb-ad67-acca8d2633f8" containerName="alertmanager" Sep 09 23:14:18.901976 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:14:18.901865 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="8eb6951b-4a31-41cb-ad67-acca8d2633f8" containerName="prom-label-proxy" Sep 09 23:14:18.906962 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:14:18.906946 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:14:18.912231 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:14:18.912211 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Sep 09 23:14:18.912231 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:14:18.912224 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Sep 09 23:14:18.912450 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:14:18.912226 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Sep 09 23:14:18.912450 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:14:18.912297 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Sep 09 23:14:18.912450 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:14:18.912213 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Sep 09 23:14:18.912450 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:14:18.912228 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Sep 09 23:14:18.912575 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:14:18.912489 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Sep 09 23:14:18.912607 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:14:18.912575 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-xwk2g\"" Sep 09 23:14:18.913029 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:14:18.913011 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Sep 09 23:14:18.918771 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:14:18.918754 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Sep 09 23:14:18.931574 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:14:18.931553 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 09 23:14:18.978234 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:14:18.978205 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/fdb2d647-9aa7-4a2a-bff9-faea1bd65032-tls-assets\") pod \"alertmanager-main-0\" (UID: \"fdb2d647-9aa7-4a2a-bff9-faea1bd65032\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:14:18.978395 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:14:18.978244 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/fdb2d647-9aa7-4a2a-bff9-faea1bd65032-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"fdb2d647-9aa7-4a2a-bff9-faea1bd65032\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:14:18.978395 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:14:18.978267 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/fdb2d647-9aa7-4a2a-bff9-faea1bd65032-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"fdb2d647-9aa7-4a2a-bff9-faea1bd65032\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:14:18.978395 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:14:18.978311 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/fdb2d647-9aa7-4a2a-bff9-faea1bd65032-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"fdb2d647-9aa7-4a2a-bff9-faea1bd65032\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:14:18.978395 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:14:18.978354 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/fdb2d647-9aa7-4a2a-bff9-faea1bd65032-config-volume\") pod \"alertmanager-main-0\" (UID: \"fdb2d647-9aa7-4a2a-bff9-faea1bd65032\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:14:18.978543 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:14:18.978399 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/fdb2d647-9aa7-4a2a-bff9-faea1bd65032-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"fdb2d647-9aa7-4a2a-bff9-faea1bd65032\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:14:18.978543 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:14:18.978426 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/fdb2d647-9aa7-4a2a-bff9-faea1bd65032-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"fdb2d647-9aa7-4a2a-bff9-faea1bd65032\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:14:18.978543 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:14:18.978450 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fdb2d647-9aa7-4a2a-bff9-faea1bd65032-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"fdb2d647-9aa7-4a2a-bff9-faea1bd65032\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:14:18.978543 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:14:18.978470 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fdb2d647-9aa7-4a2a-bff9-faea1bd65032-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"fdb2d647-9aa7-4a2a-bff9-faea1bd65032\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:14:18.978543 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:14:18.978509 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9pbqt\" (UniqueName: \"kubernetes.io/projected/fdb2d647-9aa7-4a2a-bff9-faea1bd65032-kube-api-access-9pbqt\") pod \"alertmanager-main-0\" (UID: \"fdb2d647-9aa7-4a2a-bff9-faea1bd65032\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:14:18.978705 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:14:18.978572 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/fdb2d647-9aa7-4a2a-bff9-faea1bd65032-web-config\") pod \"alertmanager-main-0\" (UID: \"fdb2d647-9aa7-4a2a-bff9-faea1bd65032\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:14:18.978705 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:14:18.978613 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/fdb2d647-9aa7-4a2a-bff9-faea1bd65032-config-out\") pod \"alertmanager-main-0\" (UID: \"fdb2d647-9aa7-4a2a-bff9-faea1bd65032\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:14:18.978705 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:14:18.978644 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/fdb2d647-9aa7-4a2a-bff9-faea1bd65032-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"fdb2d647-9aa7-4a2a-bff9-faea1bd65032\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:14:19.079222 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:14:19.079191 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/fdb2d647-9aa7-4a2a-bff9-faea1bd65032-config-out\") pod \"alertmanager-main-0\" (UID: \"fdb2d647-9aa7-4a2a-bff9-faea1bd65032\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:14:19.079339 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:14:19.079230 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/fdb2d647-9aa7-4a2a-bff9-faea1bd65032-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"fdb2d647-9aa7-4a2a-bff9-faea1bd65032\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:14:19.079339 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:14:19.079247 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/fdb2d647-9aa7-4a2a-bff9-faea1bd65032-tls-assets\") pod \"alertmanager-main-0\" (UID: \"fdb2d647-9aa7-4a2a-bff9-faea1bd65032\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:14:19.079339 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:14:19.079271 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/fdb2d647-9aa7-4a2a-bff9-faea1bd65032-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"fdb2d647-9aa7-4a2a-bff9-faea1bd65032\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:14:19.079339 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:14:19.079301 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/fdb2d647-9aa7-4a2a-bff9-faea1bd65032-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"fdb2d647-9aa7-4a2a-bff9-faea1bd65032\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:14:19.079339 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:14:19.079318 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/fdb2d647-9aa7-4a2a-bff9-faea1bd65032-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"fdb2d647-9aa7-4a2a-bff9-faea1bd65032\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:14:19.079339 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:14:19.079336 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/fdb2d647-9aa7-4a2a-bff9-faea1bd65032-config-volume\") pod \"alertmanager-main-0\" (UID: \"fdb2d647-9aa7-4a2a-bff9-faea1bd65032\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:14:19.079642 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:14:19.079357 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/fdb2d647-9aa7-4a2a-bff9-faea1bd65032-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"fdb2d647-9aa7-4a2a-bff9-faea1bd65032\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:14:19.079642 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:14:19.079398 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/fdb2d647-9aa7-4a2a-bff9-faea1bd65032-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"fdb2d647-9aa7-4a2a-bff9-faea1bd65032\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:14:19.079745 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:14:19.079693 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/fdb2d647-9aa7-4a2a-bff9-faea1bd65032-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"fdb2d647-9aa7-4a2a-bff9-faea1bd65032\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:14:19.079811 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:14:19.079746 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fdb2d647-9aa7-4a2a-bff9-faea1bd65032-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"fdb2d647-9aa7-4a2a-bff9-faea1bd65032\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:14:19.079811 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:14:19.079773 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fdb2d647-9aa7-4a2a-bff9-faea1bd65032-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"fdb2d647-9aa7-4a2a-bff9-faea1bd65032\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:14:19.079811 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:14:19.079806 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9pbqt\" (UniqueName: \"kubernetes.io/projected/fdb2d647-9aa7-4a2a-bff9-faea1bd65032-kube-api-access-9pbqt\") pod \"alertmanager-main-0\" (UID: \"fdb2d647-9aa7-4a2a-bff9-faea1bd65032\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:14:19.079952 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:14:19.079864 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/fdb2d647-9aa7-4a2a-bff9-faea1bd65032-web-config\") pod \"alertmanager-main-0\" (UID: \"fdb2d647-9aa7-4a2a-bff9-faea1bd65032\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:14:19.082298 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:14:19.081153 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fdb2d647-9aa7-4a2a-bff9-faea1bd65032-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"fdb2d647-9aa7-4a2a-bff9-faea1bd65032\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:14:19.082298 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:14:19.081655 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fdb2d647-9aa7-4a2a-bff9-faea1bd65032-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"fdb2d647-9aa7-4a2a-bff9-faea1bd65032\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:14:19.082921 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:14:19.082702 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/fdb2d647-9aa7-4a2a-bff9-faea1bd65032-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"fdb2d647-9aa7-4a2a-bff9-faea1bd65032\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:14:19.082921 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:14:19.082881 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/fdb2d647-9aa7-4a2a-bff9-faea1bd65032-config-out\") pod \"alertmanager-main-0\" (UID: \"fdb2d647-9aa7-4a2a-bff9-faea1bd65032\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:14:19.083072 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:14:19.082996 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/fdb2d647-9aa7-4a2a-bff9-faea1bd65032-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"fdb2d647-9aa7-4a2a-bff9-faea1bd65032\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:14:19.083111 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:14:19.083072 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/fdb2d647-9aa7-4a2a-bff9-faea1bd65032-web-config\") pod \"alertmanager-main-0\" (UID: \"fdb2d647-9aa7-4a2a-bff9-faea1bd65032\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:14:19.083178 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:14:19.083157 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/fdb2d647-9aa7-4a2a-bff9-faea1bd65032-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"fdb2d647-9aa7-4a2a-bff9-faea1bd65032\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:14:19.083306 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:14:19.083284 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/fdb2d647-9aa7-4a2a-bff9-faea1bd65032-config-volume\") pod \"alertmanager-main-0\" (UID: \"fdb2d647-9aa7-4a2a-bff9-faea1bd65032\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:14:19.083533 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:14:19.083518 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/fdb2d647-9aa7-4a2a-bff9-faea1bd65032-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"fdb2d647-9aa7-4a2a-bff9-faea1bd65032\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:14:19.083644 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:14:19.083619 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/fdb2d647-9aa7-4a2a-bff9-faea1bd65032-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"fdb2d647-9aa7-4a2a-bff9-faea1bd65032\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:14:19.083889 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:14:19.083872 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/fdb2d647-9aa7-4a2a-bff9-faea1bd65032-tls-assets\") pod \"alertmanager-main-0\" (UID: \"fdb2d647-9aa7-4a2a-bff9-faea1bd65032\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:14:19.088931 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:14:19.088906 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9pbqt\" (UniqueName: \"kubernetes.io/projected/fdb2d647-9aa7-4a2a-bff9-faea1bd65032-kube-api-access-9pbqt\") pod \"alertmanager-main-0\" (UID: \"fdb2d647-9aa7-4a2a-bff9-faea1bd65032\") " pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:14:19.216378 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:14:19.216337 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 09 23:14:19.501082 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:14:19.501061 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 09 23:14:19.502952 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:14:19.502928 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfdb2d647_9aa7_4a2a_bff9_faea1bd65032.slice/crio-b29817a542b5726b5737e0fe56c57a431caff5e809a6d0fab21804269897592c WatchSource:0}: Error finding container b29817a542b5726b5737e0fe56c57a431caff5e809a6d0fab21804269897592c: Status 404 returned error can't find the container with id b29817a542b5726b5737e0fe56c57a431caff5e809a6d0fab21804269897592c Sep 09 23:14:19.530152 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:14:19.530130 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"fdb2d647-9aa7-4a2a-bff9-faea1bd65032","Type":"ContainerStarted","Data":"b29817a542b5726b5737e0fe56c57a431caff5e809a6d0fab21804269897592c"} Sep 09 23:14:20.116253 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:14:20.116216 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8eb6951b-4a31-41cb-ad67-acca8d2633f8" path="/var/lib/kubelet/pods/8eb6951b-4a31-41cb-ad67-acca8d2633f8/volumes" Sep 09 23:14:20.535954 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:14:20.535924 2561 generic.go:356] "Generic (PLEG): container finished" podID="fdb2d647-9aa7-4a2a-bff9-faea1bd65032" containerID="ae7c7af26400684956525abd0de9b8d921492fdbe888742d1721775f88e670c3" exitCode=0 Sep 09 23:14:20.536443 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:14:20.536018 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"fdb2d647-9aa7-4a2a-bff9-faea1bd65032","Type":"ContainerDied","Data":"ae7c7af26400684956525abd0de9b8d921492fdbe888742d1721775f88e670c3"} Sep 09 23:14:21.260273 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:14:21.260238 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-847fc9b467-6647q"] Sep 09 23:14:21.263724 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:14:21.263704 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-847fc9b467-6647q" Sep 09 23:14:21.271533 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:14:21.271512 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Sep 09 23:14:21.272128 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:14:21.272110 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Sep 09 23:14:21.272187 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:14:21.272166 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-gdqbf\"" Sep 09 23:14:21.272339 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:14:21.272323 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Sep 09 23:14:21.272452 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:14:21.272434 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Sep 09 23:14:21.272883 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:14:21.272869 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Sep 09 23:14:21.276628 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:14:21.276608 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Sep 09 23:14:21.315881 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:14:21.315851 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-847fc9b467-6647q"] Sep 09 23:14:21.401750 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:14:21.401716 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t8g9w\" (UniqueName: \"kubernetes.io/projected/bf9c31af-0b7a-4f4a-9502-ec2267abc7dd-kube-api-access-t8g9w\") pod \"telemeter-client-847fc9b467-6647q\" (UID: \"bf9c31af-0b7a-4f4a-9502-ec2267abc7dd\") " pod="openshift-monitoring/telemeter-client-847fc9b467-6647q" Sep 09 23:14:21.401903 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:14:21.401810 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/bf9c31af-0b7a-4f4a-9502-ec2267abc7dd-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-847fc9b467-6647q\" (UID: \"bf9c31af-0b7a-4f4a-9502-ec2267abc7dd\") " pod="openshift-monitoring/telemeter-client-847fc9b467-6647q" Sep 09 23:14:21.401903 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:14:21.401855 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/bf9c31af-0b7a-4f4a-9502-ec2267abc7dd-secret-telemeter-client\") pod \"telemeter-client-847fc9b467-6647q\" (UID: \"bf9c31af-0b7a-4f4a-9502-ec2267abc7dd\") " pod="openshift-monitoring/telemeter-client-847fc9b467-6647q" Sep 09 23:14:21.401903 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:14:21.401877 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/bf9c31af-0b7a-4f4a-9502-ec2267abc7dd-federate-client-tls\") pod \"telemeter-client-847fc9b467-6647q\" (UID: \"bf9c31af-0b7a-4f4a-9502-ec2267abc7dd\") " pod="openshift-monitoring/telemeter-client-847fc9b467-6647q" Sep 09 23:14:21.401903 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:14:21.401902 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bf9c31af-0b7a-4f4a-9502-ec2267abc7dd-metrics-client-ca\") pod \"telemeter-client-847fc9b467-6647q\" (UID: \"bf9c31af-0b7a-4f4a-9502-ec2267abc7dd\") " pod="openshift-monitoring/telemeter-client-847fc9b467-6647q" Sep 09 23:14:21.402021 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:14:21.401928 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bf9c31af-0b7a-4f4a-9502-ec2267abc7dd-serving-certs-ca-bundle\") pod \"telemeter-client-847fc9b467-6647q\" (UID: \"bf9c31af-0b7a-4f4a-9502-ec2267abc7dd\") " pod="openshift-monitoring/telemeter-client-847fc9b467-6647q" Sep 09 23:14:21.402021 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:14:21.401976 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/bf9c31af-0b7a-4f4a-9502-ec2267abc7dd-telemeter-client-tls\") pod \"telemeter-client-847fc9b467-6647q\" (UID: \"bf9c31af-0b7a-4f4a-9502-ec2267abc7dd\") " pod="openshift-monitoring/telemeter-client-847fc9b467-6647q" Sep 09 23:14:21.402021 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:14:21.401990 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bf9c31af-0b7a-4f4a-9502-ec2267abc7dd-telemeter-trusted-ca-bundle\") pod \"telemeter-client-847fc9b467-6647q\" (UID: \"bf9c31af-0b7a-4f4a-9502-ec2267abc7dd\") " pod="openshift-monitoring/telemeter-client-847fc9b467-6647q" Sep 09 23:14:21.503395 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:14:21.503319 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/bf9c31af-0b7a-4f4a-9502-ec2267abc7dd-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-847fc9b467-6647q\" (UID: \"bf9c31af-0b7a-4f4a-9502-ec2267abc7dd\") " pod="openshift-monitoring/telemeter-client-847fc9b467-6647q" Sep 09 23:14:21.503560 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:14:21.503419 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/bf9c31af-0b7a-4f4a-9502-ec2267abc7dd-secret-telemeter-client\") pod \"telemeter-client-847fc9b467-6647q\" (UID: \"bf9c31af-0b7a-4f4a-9502-ec2267abc7dd\") " pod="openshift-monitoring/telemeter-client-847fc9b467-6647q" Sep 09 23:14:21.503560 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:14:21.503443 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/bf9c31af-0b7a-4f4a-9502-ec2267abc7dd-federate-client-tls\") pod \"telemeter-client-847fc9b467-6647q\" (UID: \"bf9c31af-0b7a-4f4a-9502-ec2267abc7dd\") " pod="openshift-monitoring/telemeter-client-847fc9b467-6647q" Sep 09 23:14:21.503560 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:14:21.503477 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bf9c31af-0b7a-4f4a-9502-ec2267abc7dd-metrics-client-ca\") pod \"telemeter-client-847fc9b467-6647q\" (UID: \"bf9c31af-0b7a-4f4a-9502-ec2267abc7dd\") " pod="openshift-monitoring/telemeter-client-847fc9b467-6647q" Sep 09 23:14:21.503560 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:14:21.503503 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bf9c31af-0b7a-4f4a-9502-ec2267abc7dd-serving-certs-ca-bundle\") pod \"telemeter-client-847fc9b467-6647q\" (UID: \"bf9c31af-0b7a-4f4a-9502-ec2267abc7dd\") " pod="openshift-monitoring/telemeter-client-847fc9b467-6647q" Sep 09 23:14:21.503560 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:14:21.503538 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/bf9c31af-0b7a-4f4a-9502-ec2267abc7dd-telemeter-client-tls\") pod \"telemeter-client-847fc9b467-6647q\" (UID: \"bf9c31af-0b7a-4f4a-9502-ec2267abc7dd\") " pod="openshift-monitoring/telemeter-client-847fc9b467-6647q" Sep 09 23:14:21.503808 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:14:21.503558 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bf9c31af-0b7a-4f4a-9502-ec2267abc7dd-telemeter-trusted-ca-bundle\") pod \"telemeter-client-847fc9b467-6647q\" (UID: \"bf9c31af-0b7a-4f4a-9502-ec2267abc7dd\") " pod="openshift-monitoring/telemeter-client-847fc9b467-6647q" Sep 09 23:14:21.503808 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:14:21.503584 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t8g9w\" (UniqueName: \"kubernetes.io/projected/bf9c31af-0b7a-4f4a-9502-ec2267abc7dd-kube-api-access-t8g9w\") pod \"telemeter-client-847fc9b467-6647q\" (UID: \"bf9c31af-0b7a-4f4a-9502-ec2267abc7dd\") " pod="openshift-monitoring/telemeter-client-847fc9b467-6647q" Sep 09 23:14:21.504492 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:14:21.504469 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bf9c31af-0b7a-4f4a-9502-ec2267abc7dd-telemeter-trusted-ca-bundle\") pod \"telemeter-client-847fc9b467-6647q\" (UID: \"bf9c31af-0b7a-4f4a-9502-ec2267abc7dd\") " pod="openshift-monitoring/telemeter-client-847fc9b467-6647q" Sep 09 23:14:21.504578 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:14:21.504542 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bf9c31af-0b7a-4f4a-9502-ec2267abc7dd-metrics-client-ca\") pod \"telemeter-client-847fc9b467-6647q\" (UID: \"bf9c31af-0b7a-4f4a-9502-ec2267abc7dd\") " pod="openshift-monitoring/telemeter-client-847fc9b467-6647q" Sep 09 23:14:21.504707 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:14:21.504683 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bf9c31af-0b7a-4f4a-9502-ec2267abc7dd-serving-certs-ca-bundle\") pod \"telemeter-client-847fc9b467-6647q\" (UID: \"bf9c31af-0b7a-4f4a-9502-ec2267abc7dd\") " pod="openshift-monitoring/telemeter-client-847fc9b467-6647q" Sep 09 23:14:21.506273 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:14:21.506250 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/bf9c31af-0b7a-4f4a-9502-ec2267abc7dd-telemeter-client-tls\") pod \"telemeter-client-847fc9b467-6647q\" (UID: \"bf9c31af-0b7a-4f4a-9502-ec2267abc7dd\") " pod="openshift-monitoring/telemeter-client-847fc9b467-6647q" Sep 09 23:14:21.506418 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:14:21.506394 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/bf9c31af-0b7a-4f4a-9502-ec2267abc7dd-secret-telemeter-client\") pod \"telemeter-client-847fc9b467-6647q\" (UID: \"bf9c31af-0b7a-4f4a-9502-ec2267abc7dd\") " pod="openshift-monitoring/telemeter-client-847fc9b467-6647q" Sep 09 23:14:21.506569 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:14:21.506549 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/bf9c31af-0b7a-4f4a-9502-ec2267abc7dd-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-847fc9b467-6647q\" (UID: \"bf9c31af-0b7a-4f4a-9502-ec2267abc7dd\") " pod="openshift-monitoring/telemeter-client-847fc9b467-6647q" Sep 09 23:14:21.506607 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:14:21.506557 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/bf9c31af-0b7a-4f4a-9502-ec2267abc7dd-federate-client-tls\") pod \"telemeter-client-847fc9b467-6647q\" (UID: \"bf9c31af-0b7a-4f4a-9502-ec2267abc7dd\") " pod="openshift-monitoring/telemeter-client-847fc9b467-6647q" Sep 09 23:14:21.513901 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:14:21.513831 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t8g9w\" (UniqueName: \"kubernetes.io/projected/bf9c31af-0b7a-4f4a-9502-ec2267abc7dd-kube-api-access-t8g9w\") pod \"telemeter-client-847fc9b467-6647q\" (UID: \"bf9c31af-0b7a-4f4a-9502-ec2267abc7dd\") " pod="openshift-monitoring/telemeter-client-847fc9b467-6647q" Sep 09 23:14:21.544109 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:14:21.544073 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"fdb2d647-9aa7-4a2a-bff9-faea1bd65032","Type":"ContainerStarted","Data":"895bc7488f1b9851a599b8b8bae3c84962a8fa0dc8551d3c14a65b3d37cdc8ea"} Sep 09 23:14:21.544459 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:14:21.544141 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"fdb2d647-9aa7-4a2a-bff9-faea1bd65032","Type":"ContainerStarted","Data":"8df7b40c0209d8c8f873a4385676e0165a6802ed1bd16160e1bbaf3a11d73f49"} Sep 09 23:14:21.544459 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:14:21.544169 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"fdb2d647-9aa7-4a2a-bff9-faea1bd65032","Type":"ContainerStarted","Data":"be8f8d20d485334e745fff7ea590120c898fa4e292abb0ca7773384bd80f3f17"} Sep 09 23:14:21.544459 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:14:21.544201 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"fdb2d647-9aa7-4a2a-bff9-faea1bd65032","Type":"ContainerStarted","Data":"b785febfee440200978443ef8224abd265dfc33f49de7d467971c10c97e2a98b"} Sep 09 23:14:21.544459 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:14:21.544254 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"fdb2d647-9aa7-4a2a-bff9-faea1bd65032","Type":"ContainerStarted","Data":"db55f9242275702a6b58611b6fcb9da77d38144c8be9aece4fac5ee7525d1b3d"} Sep 09 23:14:21.544459 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:14:21.544284 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"fdb2d647-9aa7-4a2a-bff9-faea1bd65032","Type":"ContainerStarted","Data":"eebfb4ff1c25f8e2419e0f34f743ec48efe59968691f50f584443935b3847b86"} Sep 09 23:14:21.572971 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:14:21.572945 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-847fc9b467-6647q" Sep 09 23:14:21.881288 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:14:21.881179 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=3.863431954 podStartE2EDuration="3.881161875s" totalImagesPullingTime="0s" totalInitContainerRuntime="17.729921ms" isStatefulPod=false podCreationTimestamp="2026-09-09 23:14:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:14:21.580563777 +0000 UTC m=+369.956137886" watchObservedRunningTime="2026-09-09 23:14:21.881161875 +0000 UTC m=+370.256735937" Sep 09 23:14:21.882666 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:14:21.882617 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-847fc9b467-6647q"] Sep 09 23:14:21.886219 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:14:21.886187 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbf9c31af_0b7a_4f4a_9502_ec2267abc7dd.slice/crio-3f1a9aeec43187dd7cb8dd81e1570cd1d0147ab5859314ccbe43786d80a1d731 WatchSource:0}: Error finding container 3f1a9aeec43187dd7cb8dd81e1570cd1d0147ab5859314ccbe43786d80a1d731: Status 404 returned error can't find the container with id 3f1a9aeec43187dd7cb8dd81e1570cd1d0147ab5859314ccbe43786d80a1d731 Sep 09 23:14:22.550207 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:14:22.550173 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-847fc9b467-6647q" event={"ID":"bf9c31af-0b7a-4f4a-9502-ec2267abc7dd","Type":"ContainerStarted","Data":"3f1a9aeec43187dd7cb8dd81e1570cd1d0147ab5859314ccbe43786d80a1d731"} Sep 09 23:14:24.559586 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:14:24.559546 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-847fc9b467-6647q" event={"ID":"bf9c31af-0b7a-4f4a-9502-ec2267abc7dd","Type":"ContainerStarted","Data":"2a1600b8ec843bcb94c95e79751969954008964f84644c426663330eb59c6fd3"} Sep 09 23:14:24.559981 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:14:24.559599 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-847fc9b467-6647q" event={"ID":"bf9c31af-0b7a-4f4a-9502-ec2267abc7dd","Type":"ContainerStarted","Data":"f05e7065ba582b57e8d686c7b8a03363c8fe34e3002f7641a8aba50be95c106d"} Sep 09 23:14:24.559981 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:14:24.559619 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-847fc9b467-6647q" event={"ID":"bf9c31af-0b7a-4f4a-9502-ec2267abc7dd","Type":"ContainerStarted","Data":"ead2edcc4dfafe217fd562ae7c1dd0c1048aca0493c10698a1300c3c94529862"} Sep 09 23:14:24.587350 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:14:24.587280 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-847fc9b467-6647q" podStartSLOduration=1.9041056570000001 podStartE2EDuration="3.587265377s" totalImagesPullingTime="1.68315972s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:14:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:14:24.58494435 +0000 UTC m=+372.960518412" watchObservedRunningTime="2026-09-09 23:14:24.587265377 +0000 UTC m=+372.962839438" Sep 09 23:14:24.687761 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:14:24.687731 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-675b654868-6vg96"] Sep 09 23:14:24.691095 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:14:24.691078 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-675b654868-6vg96" Sep 09 23:14:24.702927 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:14:24.702905 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-675b654868-6vg96"] Sep 09 23:14:24.831326 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:14:24.831224 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2ed5e731-ef29-4b48-a93a-0121db57a176-trusted-ca-bundle\") pod \"console-675b654868-6vg96\" (UID: \"2ed5e731-ef29-4b48-a93a-0121db57a176\") " pod="openshift-console/console-675b654868-6vg96" Sep 09 23:14:24.831326 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:14:24.831289 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2ed5e731-ef29-4b48-a93a-0121db57a176-service-ca\") pod \"console-675b654868-6vg96\" (UID: \"2ed5e731-ef29-4b48-a93a-0121db57a176\") " pod="openshift-console/console-675b654868-6vg96" Sep 09 23:14:24.831558 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:14:24.831341 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2ed5e731-ef29-4b48-a93a-0121db57a176-console-oauth-config\") pod \"console-675b654868-6vg96\" (UID: \"2ed5e731-ef29-4b48-a93a-0121db57a176\") " pod="openshift-console/console-675b654868-6vg96" Sep 09 23:14:24.831558 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:14:24.831401 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2ed5e731-ef29-4b48-a93a-0121db57a176-console-serving-cert\") pod \"console-675b654868-6vg96\" (UID: \"2ed5e731-ef29-4b48-a93a-0121db57a176\") " pod="openshift-console/console-675b654868-6vg96" Sep 09 23:14:24.831558 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:14:24.831443 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2ed5e731-ef29-4b48-a93a-0121db57a176-console-config\") pod \"console-675b654868-6vg96\" (UID: \"2ed5e731-ef29-4b48-a93a-0121db57a176\") " pod="openshift-console/console-675b654868-6vg96" Sep 09 23:14:24.831558 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:14:24.831498 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2ed5e731-ef29-4b48-a93a-0121db57a176-oauth-serving-cert\") pod \"console-675b654868-6vg96\" (UID: \"2ed5e731-ef29-4b48-a93a-0121db57a176\") " pod="openshift-console/console-675b654868-6vg96" Sep 09 23:14:24.831558 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:14:24.831531 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vtz9c\" (UniqueName: \"kubernetes.io/projected/2ed5e731-ef29-4b48-a93a-0121db57a176-kube-api-access-vtz9c\") pod \"console-675b654868-6vg96\" (UID: \"2ed5e731-ef29-4b48-a93a-0121db57a176\") " pod="openshift-console/console-675b654868-6vg96" Sep 09 23:14:24.932109 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:14:24.932068 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2ed5e731-ef29-4b48-a93a-0121db57a176-console-config\") pod \"console-675b654868-6vg96\" (UID: \"2ed5e731-ef29-4b48-a93a-0121db57a176\") " pod="openshift-console/console-675b654868-6vg96" Sep 09 23:14:24.932294 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:14:24.932128 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2ed5e731-ef29-4b48-a93a-0121db57a176-oauth-serving-cert\") pod \"console-675b654868-6vg96\" (UID: \"2ed5e731-ef29-4b48-a93a-0121db57a176\") " pod="openshift-console/console-675b654868-6vg96" Sep 09 23:14:24.932294 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:14:24.932158 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/77df7cc0-0e7e-468f-89d9-b055af5de0b3-metrics-certs\") pod \"network-metrics-daemon-ktqck\" (UID: \"77df7cc0-0e7e-468f-89d9-b055af5de0b3\") " pod="openshift-multus/network-metrics-daemon-ktqck" Sep 09 23:14:24.932294 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:14:24.932182 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vtz9c\" (UniqueName: \"kubernetes.io/projected/2ed5e731-ef29-4b48-a93a-0121db57a176-kube-api-access-vtz9c\") pod \"console-675b654868-6vg96\" (UID: \"2ed5e731-ef29-4b48-a93a-0121db57a176\") " pod="openshift-console/console-675b654868-6vg96" Sep 09 23:14:24.932294 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:14:24.932209 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2ed5e731-ef29-4b48-a93a-0121db57a176-trusted-ca-bundle\") pod \"console-675b654868-6vg96\" (UID: \"2ed5e731-ef29-4b48-a93a-0121db57a176\") " pod="openshift-console/console-675b654868-6vg96" Sep 09 23:14:24.932294 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:14:24.932266 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2ed5e731-ef29-4b48-a93a-0121db57a176-service-ca\") pod \"console-675b654868-6vg96\" (UID: \"2ed5e731-ef29-4b48-a93a-0121db57a176\") " pod="openshift-console/console-675b654868-6vg96" Sep 09 23:14:24.932586 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:14:24.932300 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2ed5e731-ef29-4b48-a93a-0121db57a176-console-oauth-config\") pod \"console-675b654868-6vg96\" (UID: \"2ed5e731-ef29-4b48-a93a-0121db57a176\") " pod="openshift-console/console-675b654868-6vg96" Sep 09 23:14:24.932586 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:14:24.932331 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2ed5e731-ef29-4b48-a93a-0121db57a176-console-serving-cert\") pod \"console-675b654868-6vg96\" (UID: \"2ed5e731-ef29-4b48-a93a-0121db57a176\") " pod="openshift-console/console-675b654868-6vg96" Sep 09 23:14:24.933202 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:14:24.932970 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2ed5e731-ef29-4b48-a93a-0121db57a176-service-ca\") pod \"console-675b654868-6vg96\" (UID: \"2ed5e731-ef29-4b48-a93a-0121db57a176\") " pod="openshift-console/console-675b654868-6vg96" Sep 09 23:14:24.933202 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:14:24.933103 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2ed5e731-ef29-4b48-a93a-0121db57a176-console-config\") pod \"console-675b654868-6vg96\" (UID: \"2ed5e731-ef29-4b48-a93a-0121db57a176\") " pod="openshift-console/console-675b654868-6vg96" Sep 09 23:14:24.933391 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:14:24.933310 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2ed5e731-ef29-4b48-a93a-0121db57a176-oauth-serving-cert\") pod \"console-675b654868-6vg96\" (UID: \"2ed5e731-ef29-4b48-a93a-0121db57a176\") " pod="openshift-console/console-675b654868-6vg96" Sep 09 23:14:24.933457 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:14:24.933438 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2ed5e731-ef29-4b48-a93a-0121db57a176-trusted-ca-bundle\") pod \"console-675b654868-6vg96\" (UID: \"2ed5e731-ef29-4b48-a93a-0121db57a176\") " pod="openshift-console/console-675b654868-6vg96" Sep 09 23:14:24.934684 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:14:24.934663 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/77df7cc0-0e7e-468f-89d9-b055af5de0b3-metrics-certs\") pod \"network-metrics-daemon-ktqck\" (UID: \"77df7cc0-0e7e-468f-89d9-b055af5de0b3\") " pod="openshift-multus/network-metrics-daemon-ktqck" Sep 09 23:14:24.934957 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:14:24.934938 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2ed5e731-ef29-4b48-a93a-0121db57a176-console-serving-cert\") pod \"console-675b654868-6vg96\" (UID: \"2ed5e731-ef29-4b48-a93a-0121db57a176\") " pod="openshift-console/console-675b654868-6vg96" Sep 09 23:14:24.935037 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:14:24.935021 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2ed5e731-ef29-4b48-a93a-0121db57a176-console-oauth-config\") pod \"console-675b654868-6vg96\" (UID: \"2ed5e731-ef29-4b48-a93a-0121db57a176\") " pod="openshift-console/console-675b654868-6vg96" Sep 09 23:14:24.941812 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:14:24.941790 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vtz9c\" (UniqueName: \"kubernetes.io/projected/2ed5e731-ef29-4b48-a93a-0121db57a176-kube-api-access-vtz9c\") pod \"console-675b654868-6vg96\" (UID: \"2ed5e731-ef29-4b48-a93a-0121db57a176\") " pod="openshift-console/console-675b654868-6vg96" Sep 09 23:14:24.999862 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:14:24.999826 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-675b654868-6vg96" Sep 09 23:14:25.116722 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:14:25.116647 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-hgrbx\"" Sep 09 23:14:25.124089 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:14:25.124073 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ktqck" Sep 09 23:14:25.274633 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:14:25.274448 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-675b654868-6vg96"] Sep 09 23:14:25.276750 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:14:25.276727 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2ed5e731_ef29_4b48_a93a_0121db57a176.slice/crio-ec03af0c102cbbf1e4205f2b0b43f33e2af82a003cc96d0cc3f4fe3f938ed535 WatchSource:0}: Error finding container ec03af0c102cbbf1e4205f2b0b43f33e2af82a003cc96d0cc3f4fe3f938ed535: Status 404 returned error can't find the container with id ec03af0c102cbbf1e4205f2b0b43f33e2af82a003cc96d0cc3f4fe3f938ed535 Sep 09 23:14:25.425163 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:14:25.425140 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-ktqck"] Sep 09 23:14:25.427159 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:14:25.427126 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod77df7cc0_0e7e_468f_89d9_b055af5de0b3.slice/crio-19312531cfd0475f70bd10c5bd84d53ba75930f3e46ec808a862f9da798e1547 WatchSource:0}: Error finding container 19312531cfd0475f70bd10c5bd84d53ba75930f3e46ec808a862f9da798e1547: Status 404 returned error can't find the container with id 19312531cfd0475f70bd10c5bd84d53ba75930f3e46ec808a862f9da798e1547 Sep 09 23:14:25.564958 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:14:25.564921 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-ktqck" event={"ID":"77df7cc0-0e7e-468f-89d9-b055af5de0b3","Type":"ContainerStarted","Data":"19312531cfd0475f70bd10c5bd84d53ba75930f3e46ec808a862f9da798e1547"} Sep 09 23:14:25.566599 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:14:25.566573 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-675b654868-6vg96" event={"ID":"2ed5e731-ef29-4b48-a93a-0121db57a176","Type":"ContainerStarted","Data":"84c1713b9bd94083f8e19dcd7b6ef0166f0036d10d717238fb1a6100b74a1d48"} Sep 09 23:14:25.566733 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:14:25.566624 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-675b654868-6vg96" event={"ID":"2ed5e731-ef29-4b48-a93a-0121db57a176","Type":"ContainerStarted","Data":"ec03af0c102cbbf1e4205f2b0b43f33e2af82a003cc96d0cc3f4fe3f938ed535"} Sep 09 23:14:25.609593 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:14:25.609543 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-675b654868-6vg96" podStartSLOduration=1.60952687 podStartE2EDuration="1.60952687s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:14:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:14:25.608113256 +0000 UTC m=+373.983687317" watchObservedRunningTime="2026-09-09 23:14:25.60952687 +0000 UTC m=+373.985100933" Sep 09 23:14:26.572727 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:14:26.572640 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-ktqck" event={"ID":"77df7cc0-0e7e-468f-89d9-b055af5de0b3","Type":"ContainerStarted","Data":"7ad64af73ced3ac21b247f24342e71dc105dbb3389d26c279f21ac6326993283"} Sep 09 23:14:26.572727 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:14:26.572718 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-ktqck" event={"ID":"77df7cc0-0e7e-468f-89d9-b055af5de0b3","Type":"ContainerStarted","Data":"68035e98a89ac3f199b0ffc9190eb7787721e9756cf05b0c11d7bf1cb30bf42a"} Sep 09 23:14:26.592219 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:14:26.592175 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-ktqck" podStartSLOduration=372.732958917 podStartE2EDuration="6m13.592161647s" totalImagesPullingTime="859.20273ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:08:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:14:26.590660758 +0000 UTC m=+374.966234821" watchObservedRunningTime="2026-09-09 23:14:26.592161647 +0000 UTC m=+374.967735745" Sep 09 23:14:35.000329 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:14:35.000294 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-675b654868-6vg96" Sep 09 23:14:35.000745 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:14:35.000355 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-675b654868-6vg96" Sep 09 23:14:35.004898 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:14:35.004876 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-675b654868-6vg96" Sep 09 23:14:35.613935 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:14:35.613908 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-675b654868-6vg96" Sep 09 23:14:35.660636 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:14:35.660605 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5967cd457c-k44kw"] Sep 09 23:15:00.681403 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:15:00.681324 2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-5967cd457c-k44kw" podUID="4a980521-6191-410e-bd23-9a9af868aa60" containerName="console" containerID="cri-o://0d97ceef0eee4c9d49877f72612a9ecdac2102d572f10fdfb45141501582ff05" gracePeriod=15 Sep 09 23:15:00.925407 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:15:00.925358 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5967cd457c-k44kw" Sep 09 23:15:01.045912 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:15:01.045885 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4a980521-6191-410e-bd23-9a9af868aa60-trusted-ca-bundle\") pod \"4a980521-6191-410e-bd23-9a9af868aa60\" (UID: \"4a980521-6191-410e-bd23-9a9af868aa60\") " Sep 09 23:15:01.046100 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:15:01.045947 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4a980521-6191-410e-bd23-9a9af868aa60-oauth-serving-cert\") pod \"4a980521-6191-410e-bd23-9a9af868aa60\" (UID: \"4a980521-6191-410e-bd23-9a9af868aa60\") " Sep 09 23:15:01.046100 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:15:01.045976 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4a980521-6191-410e-bd23-9a9af868aa60-console-serving-cert\") pod \"4a980521-6191-410e-bd23-9a9af868aa60\" (UID: \"4a980521-6191-410e-bd23-9a9af868aa60\") " Sep 09 23:15:01.046100 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:15:01.046012 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4a980521-6191-410e-bd23-9a9af868aa60-service-ca\") pod \"4a980521-6191-410e-bd23-9a9af868aa60\" (UID: \"4a980521-6191-410e-bd23-9a9af868aa60\") " Sep 09 23:15:01.046100 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:15:01.046027 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4a980521-6191-410e-bd23-9a9af868aa60-console-config\") pod \"4a980521-6191-410e-bd23-9a9af868aa60\" (UID: \"4a980521-6191-410e-bd23-9a9af868aa60\") " Sep 09 23:15:01.046100 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:15:01.046042 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4a980521-6191-410e-bd23-9a9af868aa60-console-oauth-config\") pod \"4a980521-6191-410e-bd23-9a9af868aa60\" (UID: \"4a980521-6191-410e-bd23-9a9af868aa60\") " Sep 09 23:15:01.046100 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:15:01.046088 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m72sm\" (UniqueName: \"kubernetes.io/projected/4a980521-6191-410e-bd23-9a9af868aa60-kube-api-access-m72sm\") pod \"4a980521-6191-410e-bd23-9a9af868aa60\" (UID: \"4a980521-6191-410e-bd23-9a9af868aa60\") " Sep 09 23:15:01.046481 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:15:01.046456 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4a980521-6191-410e-bd23-9a9af868aa60-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "4a980521-6191-410e-bd23-9a9af868aa60" (UID: "4a980521-6191-410e-bd23-9a9af868aa60"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 09 23:15:01.046545 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:15:01.046473 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4a980521-6191-410e-bd23-9a9af868aa60-console-config" (OuterVolumeSpecName: "console-config") pod "4a980521-6191-410e-bd23-9a9af868aa60" (UID: "4a980521-6191-410e-bd23-9a9af868aa60"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 09 23:15:01.046545 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:15:01.046506 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4a980521-6191-410e-bd23-9a9af868aa60-service-ca" (OuterVolumeSpecName: "service-ca") pod "4a980521-6191-410e-bd23-9a9af868aa60" (UID: "4a980521-6191-410e-bd23-9a9af868aa60"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 09 23:15:01.046545 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:15:01.046516 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4a980521-6191-410e-bd23-9a9af868aa60-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "4a980521-6191-410e-bd23-9a9af868aa60" (UID: "4a980521-6191-410e-bd23-9a9af868aa60"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 09 23:15:01.048468 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:15:01.048437 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4a980521-6191-410e-bd23-9a9af868aa60-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "4a980521-6191-410e-bd23-9a9af868aa60" (UID: "4a980521-6191-410e-bd23-9a9af868aa60"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 09 23:15:01.048579 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:15:01.048519 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4a980521-6191-410e-bd23-9a9af868aa60-kube-api-access-m72sm" (OuterVolumeSpecName: "kube-api-access-m72sm") pod "4a980521-6191-410e-bd23-9a9af868aa60" (UID: "4a980521-6191-410e-bd23-9a9af868aa60"). InnerVolumeSpecName "kube-api-access-m72sm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 09 23:15:01.048579 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:15:01.048534 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4a980521-6191-410e-bd23-9a9af868aa60-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "4a980521-6191-410e-bd23-9a9af868aa60" (UID: "4a980521-6191-410e-bd23-9a9af868aa60"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 09 23:15:01.146940 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:15:01.146906 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m72sm\" (UniqueName: \"kubernetes.io/projected/4a980521-6191-410e-bd23-9a9af868aa60-kube-api-access-m72sm\") on node \"ip-10-0-132-204.ec2.internal\" DevicePath \"\"" Sep 09 23:15:01.146940 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:15:01.146934 2561 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4a980521-6191-410e-bd23-9a9af868aa60-trusted-ca-bundle\") on node \"ip-10-0-132-204.ec2.internal\" DevicePath \"\"" Sep 09 23:15:01.146940 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:15:01.146945 2561 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4a980521-6191-410e-bd23-9a9af868aa60-oauth-serving-cert\") on node \"ip-10-0-132-204.ec2.internal\" DevicePath \"\"" Sep 09 23:15:01.147140 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:15:01.146954 2561 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4a980521-6191-410e-bd23-9a9af868aa60-console-serving-cert\") on node \"ip-10-0-132-204.ec2.internal\" DevicePath \"\"" Sep 09 23:15:01.147140 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:15:01.146965 2561 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4a980521-6191-410e-bd23-9a9af868aa60-service-ca\") on node \"ip-10-0-132-204.ec2.internal\" DevicePath \"\"" Sep 09 23:15:01.147140 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:15:01.146973 2561 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4a980521-6191-410e-bd23-9a9af868aa60-console-config\") on node \"ip-10-0-132-204.ec2.internal\" DevicePath \"\"" Sep 09 23:15:01.147140 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:15:01.146980 2561 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4a980521-6191-410e-bd23-9a9af868aa60-console-oauth-config\") on node \"ip-10-0-132-204.ec2.internal\" DevicePath \"\"" Sep 09 23:15:01.717724 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:15:01.717689 2561 generic.go:356] "Generic (PLEG): container finished" podID="4a980521-6191-410e-bd23-9a9af868aa60" containerID="0d97ceef0eee4c9d49877f72612a9ecdac2102d572f10fdfb45141501582ff05" exitCode=0 Sep 09 23:15:01.718174 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:15:01.717733 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5967cd457c-k44kw" Sep 09 23:15:01.718174 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:15:01.717773 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5967cd457c-k44kw" event={"ID":"4a980521-6191-410e-bd23-9a9af868aa60","Type":"ContainerDied","Data":"0d97ceef0eee4c9d49877f72612a9ecdac2102d572f10fdfb45141501582ff05"} Sep 09 23:15:01.718174 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:15:01.717828 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5967cd457c-k44kw" event={"ID":"4a980521-6191-410e-bd23-9a9af868aa60","Type":"ContainerDied","Data":"473327fca006147b7567605ed334c4980df1c1410e780c43814f5afdb7650378"} Sep 09 23:15:01.718174 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:15:01.717854 2561 scope.go:117] "RemoveContainer" containerID="0d97ceef0eee4c9d49877f72612a9ecdac2102d572f10fdfb45141501582ff05" Sep 09 23:15:01.728806 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:15:01.728784 2561 scope.go:117] "RemoveContainer" containerID="0d97ceef0eee4c9d49877f72612a9ecdac2102d572f10fdfb45141501582ff05" Sep 09 23:15:01.729321 ip-10-0-132-204 kubenswrapper[2561]: E0909 23:15:01.729305 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0d97ceef0eee4c9d49877f72612a9ecdac2102d572f10fdfb45141501582ff05\": container with ID starting with 0d97ceef0eee4c9d49877f72612a9ecdac2102d572f10fdfb45141501582ff05 not found: ID does not exist" containerID="0d97ceef0eee4c9d49877f72612a9ecdac2102d572f10fdfb45141501582ff05" Sep 09 23:15:01.729389 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:15:01.729331 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0d97ceef0eee4c9d49877f72612a9ecdac2102d572f10fdfb45141501582ff05"} err="failed to get container status \"0d97ceef0eee4c9d49877f72612a9ecdac2102d572f10fdfb45141501582ff05\": rpc error: code = NotFound desc = could not find container \"0d97ceef0eee4c9d49877f72612a9ecdac2102d572f10fdfb45141501582ff05\": container with ID starting with 0d97ceef0eee4c9d49877f72612a9ecdac2102d572f10fdfb45141501582ff05 not found: ID does not exist" Sep 09 23:15:01.740268 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:15:01.740248 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5967cd457c-k44kw"] Sep 09 23:15:01.743672 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:15:01.743648 2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5967cd457c-k44kw"] Sep 09 23:15:02.120134 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:15:02.120103 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4a980521-6191-410e-bd23-9a9af868aa60" path="/var/lib/kubelet/pods/4a980521-6191-410e-bd23-9a9af868aa60/volumes" Sep 09 23:16:08.926196 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:16:08.926158 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7989569fb4-4t2qm"] Sep 09 23:16:08.926661 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:16:08.926532 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4a980521-6191-410e-bd23-9a9af868aa60" containerName="console" Sep 09 23:16:08.926661 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:16:08.926545 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="4a980521-6191-410e-bd23-9a9af868aa60" containerName="console" Sep 09 23:16:08.926661 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:16:08.926600 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="4a980521-6191-410e-bd23-9a9af868aa60" containerName="console" Sep 09 23:16:08.929505 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:16:08.929487 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7989569fb4-4t2qm" Sep 09 23:16:08.940176 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:16:08.940151 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7989569fb4-4t2qm"] Sep 09 23:16:09.111947 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:16:09.111911 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8a08013e-082b-41ce-92f8-2ea8be10a5d2-console-config\") pod \"console-7989569fb4-4t2qm\" (UID: \"8a08013e-082b-41ce-92f8-2ea8be10a5d2\") " pod="openshift-console/console-7989569fb4-4t2qm" Sep 09 23:16:09.112110 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:16:09.111956 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2wpwv\" (UniqueName: \"kubernetes.io/projected/8a08013e-082b-41ce-92f8-2ea8be10a5d2-kube-api-access-2wpwv\") pod \"console-7989569fb4-4t2qm\" (UID: \"8a08013e-082b-41ce-92f8-2ea8be10a5d2\") " pod="openshift-console/console-7989569fb4-4t2qm" Sep 09 23:16:09.112110 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:16:09.111989 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8a08013e-082b-41ce-92f8-2ea8be10a5d2-trusted-ca-bundle\") pod \"console-7989569fb4-4t2qm\" (UID: \"8a08013e-082b-41ce-92f8-2ea8be10a5d2\") " pod="openshift-console/console-7989569fb4-4t2qm" Sep 09 23:16:09.112110 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:16:09.112044 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8a08013e-082b-41ce-92f8-2ea8be10a5d2-service-ca\") pod \"console-7989569fb4-4t2qm\" (UID: \"8a08013e-082b-41ce-92f8-2ea8be10a5d2\") " pod="openshift-console/console-7989569fb4-4t2qm" Sep 09 23:16:09.112110 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:16:09.112089 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8a08013e-082b-41ce-92f8-2ea8be10a5d2-console-oauth-config\") pod \"console-7989569fb4-4t2qm\" (UID: \"8a08013e-082b-41ce-92f8-2ea8be10a5d2\") " pod="openshift-console/console-7989569fb4-4t2qm" Sep 09 23:16:09.112110 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:16:09.112112 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8a08013e-082b-41ce-92f8-2ea8be10a5d2-console-serving-cert\") pod \"console-7989569fb4-4t2qm\" (UID: \"8a08013e-082b-41ce-92f8-2ea8be10a5d2\") " pod="openshift-console/console-7989569fb4-4t2qm" Sep 09 23:16:09.112288 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:16:09.112128 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8a08013e-082b-41ce-92f8-2ea8be10a5d2-oauth-serving-cert\") pod \"console-7989569fb4-4t2qm\" (UID: \"8a08013e-082b-41ce-92f8-2ea8be10a5d2\") " pod="openshift-console/console-7989569fb4-4t2qm" Sep 09 23:16:09.213408 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:16:09.213282 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8a08013e-082b-41ce-92f8-2ea8be10a5d2-console-serving-cert\") pod \"console-7989569fb4-4t2qm\" (UID: \"8a08013e-082b-41ce-92f8-2ea8be10a5d2\") " pod="openshift-console/console-7989569fb4-4t2qm" Sep 09 23:16:09.213408 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:16:09.213343 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8a08013e-082b-41ce-92f8-2ea8be10a5d2-oauth-serving-cert\") pod \"console-7989569fb4-4t2qm\" (UID: \"8a08013e-082b-41ce-92f8-2ea8be10a5d2\") " pod="openshift-console/console-7989569fb4-4t2qm" Sep 09 23:16:09.213606 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:16:09.213423 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8a08013e-082b-41ce-92f8-2ea8be10a5d2-console-config\") pod \"console-7989569fb4-4t2qm\" (UID: \"8a08013e-082b-41ce-92f8-2ea8be10a5d2\") " pod="openshift-console/console-7989569fb4-4t2qm" Sep 09 23:16:09.213606 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:16:09.213453 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2wpwv\" (UniqueName: \"kubernetes.io/projected/8a08013e-082b-41ce-92f8-2ea8be10a5d2-kube-api-access-2wpwv\") pod \"console-7989569fb4-4t2qm\" (UID: \"8a08013e-082b-41ce-92f8-2ea8be10a5d2\") " pod="openshift-console/console-7989569fb4-4t2qm" Sep 09 23:16:09.213715 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:16:09.213669 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8a08013e-082b-41ce-92f8-2ea8be10a5d2-trusted-ca-bundle\") pod \"console-7989569fb4-4t2qm\" (UID: \"8a08013e-082b-41ce-92f8-2ea8be10a5d2\") " pod="openshift-console/console-7989569fb4-4t2qm" Sep 09 23:16:09.213767 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:16:09.213718 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8a08013e-082b-41ce-92f8-2ea8be10a5d2-service-ca\") pod \"console-7989569fb4-4t2qm\" (UID: \"8a08013e-082b-41ce-92f8-2ea8be10a5d2\") " pod="openshift-console/console-7989569fb4-4t2qm" Sep 09 23:16:09.213767 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:16:09.213761 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8a08013e-082b-41ce-92f8-2ea8be10a5d2-console-oauth-config\") pod \"console-7989569fb4-4t2qm\" (UID: \"8a08013e-082b-41ce-92f8-2ea8be10a5d2\") " pod="openshift-console/console-7989569fb4-4t2qm" Sep 09 23:16:09.214122 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:16:09.214094 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8a08013e-082b-41ce-92f8-2ea8be10a5d2-oauth-serving-cert\") pod \"console-7989569fb4-4t2qm\" (UID: \"8a08013e-082b-41ce-92f8-2ea8be10a5d2\") " pod="openshift-console/console-7989569fb4-4t2qm" Sep 09 23:16:09.214122 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:16:09.214115 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8a08013e-082b-41ce-92f8-2ea8be10a5d2-console-config\") pod \"console-7989569fb4-4t2qm\" (UID: \"8a08013e-082b-41ce-92f8-2ea8be10a5d2\") " pod="openshift-console/console-7989569fb4-4t2qm" Sep 09 23:16:09.214483 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:16:09.214466 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8a08013e-082b-41ce-92f8-2ea8be10a5d2-trusted-ca-bundle\") pod \"console-7989569fb4-4t2qm\" (UID: \"8a08013e-082b-41ce-92f8-2ea8be10a5d2\") " pod="openshift-console/console-7989569fb4-4t2qm" Sep 09 23:16:09.214718 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:16:09.214694 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8a08013e-082b-41ce-92f8-2ea8be10a5d2-service-ca\") pod \"console-7989569fb4-4t2qm\" (UID: \"8a08013e-082b-41ce-92f8-2ea8be10a5d2\") " pod="openshift-console/console-7989569fb4-4t2qm" Sep 09 23:16:09.216187 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:16:09.216163 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8a08013e-082b-41ce-92f8-2ea8be10a5d2-console-oauth-config\") pod \"console-7989569fb4-4t2qm\" (UID: \"8a08013e-082b-41ce-92f8-2ea8be10a5d2\") " pod="openshift-console/console-7989569fb4-4t2qm" Sep 09 23:16:09.216401 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:16:09.216354 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8a08013e-082b-41ce-92f8-2ea8be10a5d2-console-serving-cert\") pod \"console-7989569fb4-4t2qm\" (UID: \"8a08013e-082b-41ce-92f8-2ea8be10a5d2\") " pod="openshift-console/console-7989569fb4-4t2qm" Sep 09 23:16:09.221923 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:16:09.221903 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2wpwv\" (UniqueName: \"kubernetes.io/projected/8a08013e-082b-41ce-92f8-2ea8be10a5d2-kube-api-access-2wpwv\") pod \"console-7989569fb4-4t2qm\" (UID: \"8a08013e-082b-41ce-92f8-2ea8be10a5d2\") " pod="openshift-console/console-7989569fb4-4t2qm" Sep 09 23:16:09.238627 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:16:09.238607 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7989569fb4-4t2qm" Sep 09 23:16:09.511061 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:16:09.511038 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7989569fb4-4t2qm"] Sep 09 23:16:09.513621 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:16:09.513594 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8a08013e_082b_41ce_92f8_2ea8be10a5d2.slice/crio-61c01f094a4edb0188b7b2dfc50e0bbea87afb17803692d33680895ca79dc40f WatchSource:0}: Error finding container 61c01f094a4edb0188b7b2dfc50e0bbea87afb17803692d33680895ca79dc40f: Status 404 returned error can't find the container with id 61c01f094a4edb0188b7b2dfc50e0bbea87afb17803692d33680895ca79dc40f Sep 09 23:16:09.994543 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:16:09.994503 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7989569fb4-4t2qm" event={"ID":"8a08013e-082b-41ce-92f8-2ea8be10a5d2","Type":"ContainerStarted","Data":"b6073f69fac7841521253a4211c70b6cb5bbfeb9d5f2a5a7e7815fc34a794605"} Sep 09 23:16:09.994893 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:16:09.994558 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7989569fb4-4t2qm" event={"ID":"8a08013e-082b-41ce-92f8-2ea8be10a5d2","Type":"ContainerStarted","Data":"61c01f094a4edb0188b7b2dfc50e0bbea87afb17803692d33680895ca79dc40f"} Sep 09 23:16:10.013621 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:16:10.013570 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7989569fb4-4t2qm" podStartSLOduration=2.013555128 podStartE2EDuration="2.013555128s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:16:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:16:10.012063248 +0000 UTC m=+478.387637307" watchObservedRunningTime="2026-09-09 23:16:10.013555128 +0000 UTC m=+478.389129190" Sep 09 23:16:19.239380 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:16:19.239338 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7989569fb4-4t2qm" Sep 09 23:16:19.239933 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:16:19.239414 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7989569fb4-4t2qm" Sep 09 23:16:19.244574 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:16:19.244550 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7989569fb4-4t2qm" Sep 09 23:16:20.041486 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:16:20.041458 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7989569fb4-4t2qm" Sep 09 23:16:20.093224 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:16:20.093182 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-675b654868-6vg96"] Sep 09 23:16:39.265127 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:16:39.265091 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540sp5cp"] Sep 09 23:16:39.268567 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:16:39.268551 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540sp5cp" Sep 09 23:16:39.271204 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:16:39.271173 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Sep 09 23:16:39.271204 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:16:39.271195 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Sep 09 23:16:39.272281 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:16:39.272259 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-ksmhc\"" Sep 09 23:16:39.275984 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:16:39.275964 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540sp5cp"] Sep 09 23:16:39.371792 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:16:39.371758 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0ed4bb41-c366-4596-a7f4-856d218f3f74-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540sp5cp\" (UID: \"0ed4bb41-c366-4596-a7f4-856d218f3f74\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540sp5cp" Sep 09 23:16:39.371792 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:16:39.371793 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0ed4bb41-c366-4596-a7f4-856d218f3f74-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540sp5cp\" (UID: \"0ed4bb41-c366-4596-a7f4-856d218f3f74\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540sp5cp" Sep 09 23:16:39.371995 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:16:39.371816 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j44hj\" (UniqueName: \"kubernetes.io/projected/0ed4bb41-c366-4596-a7f4-856d218f3f74-kube-api-access-j44hj\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540sp5cp\" (UID: \"0ed4bb41-c366-4596-a7f4-856d218f3f74\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540sp5cp" Sep 09 23:16:39.472838 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:16:39.472807 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0ed4bb41-c366-4596-a7f4-856d218f3f74-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540sp5cp\" (UID: \"0ed4bb41-c366-4596-a7f4-856d218f3f74\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540sp5cp" Sep 09 23:16:39.472838 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:16:39.472842 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0ed4bb41-c366-4596-a7f4-856d218f3f74-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540sp5cp\" (UID: \"0ed4bb41-c366-4596-a7f4-856d218f3f74\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540sp5cp" Sep 09 23:16:39.473061 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:16:39.472863 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j44hj\" (UniqueName: \"kubernetes.io/projected/0ed4bb41-c366-4596-a7f4-856d218f3f74-kube-api-access-j44hj\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540sp5cp\" (UID: \"0ed4bb41-c366-4596-a7f4-856d218f3f74\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540sp5cp" Sep 09 23:16:39.473202 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:16:39.473182 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0ed4bb41-c366-4596-a7f4-856d218f3f74-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540sp5cp\" (UID: \"0ed4bb41-c366-4596-a7f4-856d218f3f74\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540sp5cp" Sep 09 23:16:39.473270 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:16:39.473206 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0ed4bb41-c366-4596-a7f4-856d218f3f74-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540sp5cp\" (UID: \"0ed4bb41-c366-4596-a7f4-856d218f3f74\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540sp5cp" Sep 09 23:16:39.482085 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:16:39.482053 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j44hj\" (UniqueName: \"kubernetes.io/projected/0ed4bb41-c366-4596-a7f4-856d218f3f74-kube-api-access-j44hj\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540sp5cp\" (UID: \"0ed4bb41-c366-4596-a7f4-856d218f3f74\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540sp5cp" Sep 09 23:16:39.577974 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:16:39.577917 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540sp5cp" Sep 09 23:16:39.846806 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:16:39.846769 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540sp5cp"] Sep 09 23:16:39.849167 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:16:39.849144 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0ed4bb41_c366_4596_a7f4_856d218f3f74.slice/crio-2b8c3adafde20ff9d330a181c8425a1110674bbdbebc8e755a0804f3b502d182 WatchSource:0}: Error finding container 2b8c3adafde20ff9d330a181c8425a1110674bbdbebc8e755a0804f3b502d182: Status 404 returned error can't find the container with id 2b8c3adafde20ff9d330a181c8425a1110674bbdbebc8e755a0804f3b502d182 Sep 09 23:16:40.123169 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:16:40.123098 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540sp5cp" event={"ID":"0ed4bb41-c366-4596-a7f4-856d218f3f74","Type":"ContainerStarted","Data":"2b8c3adafde20ff9d330a181c8425a1110674bbdbebc8e755a0804f3b502d182"} Sep 09 23:16:45.114745 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:16:45.114699 2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-675b654868-6vg96" podUID="2ed5e731-ef29-4b48-a93a-0121db57a176" containerName="console" containerID="cri-o://84c1713b9bd94083f8e19dcd7b6ef0166f0036d10d717238fb1a6100b74a1d48" gracePeriod=15 Sep 09 23:16:45.610686 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:16:45.610651 2561 patch_prober.go:28] interesting pod/console-675b654868-6vg96 container/console namespace/openshift-console: Readiness probe status=failure output="Get \"https://10.133.0.25:8443/health\": dial tcp 10.133.0.25:8443: connect: connection refused" start-of-body= Sep 09 23:16:45.610813 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:16:45.610706 2561 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-console/console-675b654868-6vg96" podUID="2ed5e731-ef29-4b48-a93a-0121db57a176" containerName="console" probeResult="failure" output="Get \"https://10.133.0.25:8443/health\": dial tcp 10.133.0.25:8443: connect: connection refused" Sep 09 23:16:45.724708 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:16:45.724684 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-675b654868-6vg96" Sep 09 23:16:45.830563 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:16:45.830475 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2ed5e731-ef29-4b48-a93a-0121db57a176-console-serving-cert\") pod \"2ed5e731-ef29-4b48-a93a-0121db57a176\" (UID: \"2ed5e731-ef29-4b48-a93a-0121db57a176\") " Sep 09 23:16:45.830563 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:16:45.830542 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2ed5e731-ef29-4b48-a93a-0121db57a176-console-oauth-config\") pod \"2ed5e731-ef29-4b48-a93a-0121db57a176\" (UID: \"2ed5e731-ef29-4b48-a93a-0121db57a176\") " Sep 09 23:16:45.830771 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:16:45.830604 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2ed5e731-ef29-4b48-a93a-0121db57a176-oauth-serving-cert\") pod \"2ed5e731-ef29-4b48-a93a-0121db57a176\" (UID: \"2ed5e731-ef29-4b48-a93a-0121db57a176\") " Sep 09 23:16:45.830771 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:16:45.830627 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2ed5e731-ef29-4b48-a93a-0121db57a176-trusted-ca-bundle\") pod \"2ed5e731-ef29-4b48-a93a-0121db57a176\" (UID: \"2ed5e731-ef29-4b48-a93a-0121db57a176\") " Sep 09 23:16:45.830771 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:16:45.830740 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2ed5e731-ef29-4b48-a93a-0121db57a176-console-config\") pod \"2ed5e731-ef29-4b48-a93a-0121db57a176\" (UID: \"2ed5e731-ef29-4b48-a93a-0121db57a176\") " Sep 09 23:16:45.830916 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:16:45.830793 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vtz9c\" (UniqueName: \"kubernetes.io/projected/2ed5e731-ef29-4b48-a93a-0121db57a176-kube-api-access-vtz9c\") pod \"2ed5e731-ef29-4b48-a93a-0121db57a176\" (UID: \"2ed5e731-ef29-4b48-a93a-0121db57a176\") " Sep 09 23:16:45.830916 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:16:45.830852 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2ed5e731-ef29-4b48-a93a-0121db57a176-service-ca\") pod \"2ed5e731-ef29-4b48-a93a-0121db57a176\" (UID: \"2ed5e731-ef29-4b48-a93a-0121db57a176\") " Sep 09 23:16:45.831024 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:16:45.831003 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2ed5e731-ef29-4b48-a93a-0121db57a176-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "2ed5e731-ef29-4b48-a93a-0121db57a176" (UID: "2ed5e731-ef29-4b48-a93a-0121db57a176"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 09 23:16:45.831079 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:16:45.831011 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2ed5e731-ef29-4b48-a93a-0121db57a176-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "2ed5e731-ef29-4b48-a93a-0121db57a176" (UID: "2ed5e731-ef29-4b48-a93a-0121db57a176"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 09 23:16:45.831258 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:16:45.831240 2561 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2ed5e731-ef29-4b48-a93a-0121db57a176-oauth-serving-cert\") on node \"ip-10-0-132-204.ec2.internal\" DevicePath \"\"" Sep 09 23:16:45.831329 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:16:45.831264 2561 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2ed5e731-ef29-4b48-a93a-0121db57a176-trusted-ca-bundle\") on node \"ip-10-0-132-204.ec2.internal\" DevicePath \"\"" Sep 09 23:16:45.831555 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:16:45.831523 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2ed5e731-ef29-4b48-a93a-0121db57a176-service-ca" (OuterVolumeSpecName: "service-ca") pod "2ed5e731-ef29-4b48-a93a-0121db57a176" (UID: "2ed5e731-ef29-4b48-a93a-0121db57a176"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 09 23:16:45.831684 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:16:45.831611 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2ed5e731-ef29-4b48-a93a-0121db57a176-console-config" (OuterVolumeSpecName: "console-config") pod "2ed5e731-ef29-4b48-a93a-0121db57a176" (UID: "2ed5e731-ef29-4b48-a93a-0121db57a176"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 09 23:16:45.832897 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:16:45.832870 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2ed5e731-ef29-4b48-a93a-0121db57a176-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "2ed5e731-ef29-4b48-a93a-0121db57a176" (UID: "2ed5e731-ef29-4b48-a93a-0121db57a176"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 09 23:16:45.832897 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:16:45.832887 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2ed5e731-ef29-4b48-a93a-0121db57a176-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "2ed5e731-ef29-4b48-a93a-0121db57a176" (UID: "2ed5e731-ef29-4b48-a93a-0121db57a176"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 09 23:16:45.833305 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:16:45.833287 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2ed5e731-ef29-4b48-a93a-0121db57a176-kube-api-access-vtz9c" (OuterVolumeSpecName: "kube-api-access-vtz9c") pod "2ed5e731-ef29-4b48-a93a-0121db57a176" (UID: "2ed5e731-ef29-4b48-a93a-0121db57a176"). InnerVolumeSpecName "kube-api-access-vtz9c". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 09 23:16:45.931920 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:16:45.931887 2561 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2ed5e731-ef29-4b48-a93a-0121db57a176-console-config\") on node \"ip-10-0-132-204.ec2.internal\" DevicePath \"\"" Sep 09 23:16:45.931920 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:16:45.931911 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vtz9c\" (UniqueName: \"kubernetes.io/projected/2ed5e731-ef29-4b48-a93a-0121db57a176-kube-api-access-vtz9c\") on node \"ip-10-0-132-204.ec2.internal\" DevicePath \"\"" Sep 09 23:16:45.931920 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:16:45.931921 2561 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2ed5e731-ef29-4b48-a93a-0121db57a176-service-ca\") on node \"ip-10-0-132-204.ec2.internal\" DevicePath \"\"" Sep 09 23:16:45.931920 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:16:45.931930 2561 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2ed5e731-ef29-4b48-a93a-0121db57a176-console-serving-cert\") on node \"ip-10-0-132-204.ec2.internal\" DevicePath \"\"" Sep 09 23:16:45.932158 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:16:45.931937 2561 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2ed5e731-ef29-4b48-a93a-0121db57a176-console-oauth-config\") on node \"ip-10-0-132-204.ec2.internal\" DevicePath \"\"" Sep 09 23:16:46.149690 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:16:46.149661 2561 generic.go:356] "Generic (PLEG): container finished" podID="0ed4bb41-c366-4596-a7f4-856d218f3f74" containerID="774f29de92c730afc971664983e457af8355d7fc1f898aef0b5e0f636ed8ca69" exitCode=0 Sep 09 23:16:46.150039 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:16:46.149753 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540sp5cp" event={"ID":"0ed4bb41-c366-4596-a7f4-856d218f3f74","Type":"ContainerDied","Data":"774f29de92c730afc971664983e457af8355d7fc1f898aef0b5e0f636ed8ca69"} Sep 09 23:16:46.151142 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:16:46.151116 2561 generic.go:356] "Generic (PLEG): container finished" podID="2ed5e731-ef29-4b48-a93a-0121db57a176" containerID="84c1713b9bd94083f8e19dcd7b6ef0166f0036d10d717238fb1a6100b74a1d48" exitCode=0 Sep 09 23:16:46.151236 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:16:46.151162 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-675b654868-6vg96" Sep 09 23:16:46.151236 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:16:46.151192 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-675b654868-6vg96" event={"ID":"2ed5e731-ef29-4b48-a93a-0121db57a176","Type":"ContainerDied","Data":"84c1713b9bd94083f8e19dcd7b6ef0166f0036d10d717238fb1a6100b74a1d48"} Sep 09 23:16:46.151376 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:16:46.151238 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-675b654868-6vg96" event={"ID":"2ed5e731-ef29-4b48-a93a-0121db57a176","Type":"ContainerDied","Data":"ec03af0c102cbbf1e4205f2b0b43f33e2af82a003cc96d0cc3f4fe3f938ed535"} Sep 09 23:16:46.151376 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:16:46.151265 2561 scope.go:117] "RemoveContainer" containerID="84c1713b9bd94083f8e19dcd7b6ef0166f0036d10d717238fb1a6100b74a1d48" Sep 09 23:16:46.159531 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:16:46.159512 2561 scope.go:117] "RemoveContainer" containerID="84c1713b9bd94083f8e19dcd7b6ef0166f0036d10d717238fb1a6100b74a1d48" Sep 09 23:16:46.159795 ip-10-0-132-204 kubenswrapper[2561]: E0909 23:16:46.159775 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"84c1713b9bd94083f8e19dcd7b6ef0166f0036d10d717238fb1a6100b74a1d48\": container with ID starting with 84c1713b9bd94083f8e19dcd7b6ef0166f0036d10d717238fb1a6100b74a1d48 not found: ID does not exist" containerID="84c1713b9bd94083f8e19dcd7b6ef0166f0036d10d717238fb1a6100b74a1d48" Sep 09 23:16:46.159882 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:16:46.159800 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"84c1713b9bd94083f8e19dcd7b6ef0166f0036d10d717238fb1a6100b74a1d48"} err="failed to get container status \"84c1713b9bd94083f8e19dcd7b6ef0166f0036d10d717238fb1a6100b74a1d48\": rpc error: code = NotFound desc = could not find container \"84c1713b9bd94083f8e19dcd7b6ef0166f0036d10d717238fb1a6100b74a1d48\": container with ID starting with 84c1713b9bd94083f8e19dcd7b6ef0166f0036d10d717238fb1a6100b74a1d48 not found: ID does not exist" Sep 09 23:16:46.178826 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:16:46.178805 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-675b654868-6vg96"] Sep 09 23:16:46.180415 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:16:46.180394 2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-675b654868-6vg96"] Sep 09 23:16:48.116499 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:16:48.116463 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2ed5e731-ef29-4b48-a93a-0121db57a176" path="/var/lib/kubelet/pods/2ed5e731-ef29-4b48-a93a-0121db57a176/volumes" Sep 09 23:16:49.168846 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:16:49.168813 2561 generic.go:356] "Generic (PLEG): container finished" podID="0ed4bb41-c366-4596-a7f4-856d218f3f74" containerID="0de61cbfd02c11c982e4792ce3a73124fd5863fdd6430a7512d6fc2ef2418c8a" exitCode=0 Sep 09 23:16:49.169214 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:16:49.168880 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540sp5cp" event={"ID":"0ed4bb41-c366-4596-a7f4-856d218f3f74","Type":"ContainerDied","Data":"0de61cbfd02c11c982e4792ce3a73124fd5863fdd6430a7512d6fc2ef2418c8a"} Sep 09 23:16:56.202259 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:16:56.202172 2561 generic.go:356] "Generic (PLEG): container finished" podID="0ed4bb41-c366-4596-a7f4-856d218f3f74" containerID="da7fda5822a98377166382b9cb1bced0e872fed03d5045296d15eee79c57f8f6" exitCode=0 Sep 09 23:16:56.202658 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:16:56.202264 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540sp5cp" event={"ID":"0ed4bb41-c366-4596-a7f4-856d218f3f74","Type":"ContainerDied","Data":"da7fda5822a98377166382b9cb1bced0e872fed03d5045296d15eee79c57f8f6"} Sep 09 23:16:57.329168 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:16:57.329144 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540sp5cp" Sep 09 23:16:57.331553 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:16:57.331536 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0ed4bb41-c366-4596-a7f4-856d218f3f74-util\") pod \"0ed4bb41-c366-4596-a7f4-856d218f3f74\" (UID: \"0ed4bb41-c366-4596-a7f4-856d218f3f74\") " Sep 09 23:16:57.331608 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:16:57.331575 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j44hj\" (UniqueName: \"kubernetes.io/projected/0ed4bb41-c366-4596-a7f4-856d218f3f74-kube-api-access-j44hj\") pod \"0ed4bb41-c366-4596-a7f4-856d218f3f74\" (UID: \"0ed4bb41-c366-4596-a7f4-856d218f3f74\") " Sep 09 23:16:57.331643 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:16:57.331610 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0ed4bb41-c366-4596-a7f4-856d218f3f74-bundle\") pod \"0ed4bb41-c366-4596-a7f4-856d218f3f74\" (UID: \"0ed4bb41-c366-4596-a7f4-856d218f3f74\") " Sep 09 23:16:57.332300 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:16:57.332274 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0ed4bb41-c366-4596-a7f4-856d218f3f74-bundle" (OuterVolumeSpecName: "bundle") pod "0ed4bb41-c366-4596-a7f4-856d218f3f74" (UID: "0ed4bb41-c366-4596-a7f4-856d218f3f74"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 09 23:16:57.334009 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:16:57.333987 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0ed4bb41-c366-4596-a7f4-856d218f3f74-kube-api-access-j44hj" (OuterVolumeSpecName: "kube-api-access-j44hj") pod "0ed4bb41-c366-4596-a7f4-856d218f3f74" (UID: "0ed4bb41-c366-4596-a7f4-856d218f3f74"). InnerVolumeSpecName "kube-api-access-j44hj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 09 23:16:57.335549 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:16:57.335527 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0ed4bb41-c366-4596-a7f4-856d218f3f74-util" (OuterVolumeSpecName: "util") pod "0ed4bb41-c366-4596-a7f4-856d218f3f74" (UID: "0ed4bb41-c366-4596-a7f4-856d218f3f74"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 09 23:16:57.432123 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:16:57.432092 2561 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0ed4bb41-c366-4596-a7f4-856d218f3f74-util\") on node \"ip-10-0-132-204.ec2.internal\" DevicePath \"\"" Sep 09 23:16:57.432123 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:16:57.432114 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j44hj\" (UniqueName: \"kubernetes.io/projected/0ed4bb41-c366-4596-a7f4-856d218f3f74-kube-api-access-j44hj\") on node \"ip-10-0-132-204.ec2.internal\" DevicePath \"\"" Sep 09 23:16:57.432123 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:16:57.432127 2561 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0ed4bb41-c366-4596-a7f4-856d218f3f74-bundle\") on node \"ip-10-0-132-204.ec2.internal\" DevicePath \"\"" Sep 09 23:16:58.211686 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:16:58.211657 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540sp5cp" event={"ID":"0ed4bb41-c366-4596-a7f4-856d218f3f74","Type":"ContainerDied","Data":"2b8c3adafde20ff9d330a181c8425a1110674bbdbebc8e755a0804f3b502d182"} Sep 09 23:16:58.211805 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:16:58.211701 2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2b8c3adafde20ff9d330a181c8425a1110674bbdbebc8e755a0804f3b502d182" Sep 09 23:16:58.211805 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:16:58.211703 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540sp5cp" Sep 09 23:17:02.237964 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:17:02.237935 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-m76z7"] Sep 09 23:17:02.238427 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:17:02.238283 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0ed4bb41-c366-4596-a7f4-856d218f3f74" containerName="util" Sep 09 23:17:02.238427 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:17:02.238295 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="0ed4bb41-c366-4596-a7f4-856d218f3f74" containerName="util" Sep 09 23:17:02.238427 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:17:02.238313 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2ed5e731-ef29-4b48-a93a-0121db57a176" containerName="console" Sep 09 23:17:02.238427 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:17:02.238320 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="2ed5e731-ef29-4b48-a93a-0121db57a176" containerName="console" Sep 09 23:17:02.238427 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:17:02.238329 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0ed4bb41-c366-4596-a7f4-856d218f3f74" containerName="pull" Sep 09 23:17:02.238427 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:17:02.238334 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="0ed4bb41-c366-4596-a7f4-856d218f3f74" containerName="pull" Sep 09 23:17:02.238427 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:17:02.238341 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0ed4bb41-c366-4596-a7f4-856d218f3f74" containerName="extract" Sep 09 23:17:02.238427 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:17:02.238347 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="0ed4bb41-c366-4596-a7f4-856d218f3f74" containerName="extract" Sep 09 23:17:02.238718 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:17:02.238435 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="2ed5e731-ef29-4b48-a93a-0121db57a176" containerName="console" Sep 09 23:17:02.238718 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:17:02.238447 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="0ed4bb41-c366-4596-a7f4-856d218f3f74" containerName="extract" Sep 09 23:17:02.292897 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:17:02.292856 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-m76z7"] Sep 09 23:17:02.293048 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:17:02.292963 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-m76z7" Sep 09 23:17:02.295939 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:17:02.295914 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Sep 09 23:17:02.296406 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:17:02.296391 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-mdsfj\"" Sep 09 23:17:02.296507 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:17:02.296491 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Sep 09 23:17:02.373127 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:17:02.373097 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9289af05-204f-4aad-8090-7f51e4319e5f-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-m76z7\" (UID: \"9289af05-204f-4aad-8090-7f51e4319e5f\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-m76z7" Sep 09 23:17:02.373250 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:17:02.373143 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qfnz7\" (UniqueName: \"kubernetes.io/projected/9289af05-204f-4aad-8090-7f51e4319e5f-kube-api-access-qfnz7\") pod \"cert-manager-operator-controller-manager-55c444bf86-m76z7\" (UID: \"9289af05-204f-4aad-8090-7f51e4319e5f\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-m76z7" Sep 09 23:17:02.474044 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:17:02.474017 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9289af05-204f-4aad-8090-7f51e4319e5f-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-m76z7\" (UID: \"9289af05-204f-4aad-8090-7f51e4319e5f\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-m76z7" Sep 09 23:17:02.474139 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:17:02.474062 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qfnz7\" (UniqueName: \"kubernetes.io/projected/9289af05-204f-4aad-8090-7f51e4319e5f-kube-api-access-qfnz7\") pod \"cert-manager-operator-controller-manager-55c444bf86-m76z7\" (UID: \"9289af05-204f-4aad-8090-7f51e4319e5f\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-m76z7" Sep 09 23:17:02.474391 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:17:02.474349 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9289af05-204f-4aad-8090-7f51e4319e5f-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-m76z7\" (UID: \"9289af05-204f-4aad-8090-7f51e4319e5f\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-m76z7" Sep 09 23:17:02.486450 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:17:02.486427 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qfnz7\" (UniqueName: \"kubernetes.io/projected/9289af05-204f-4aad-8090-7f51e4319e5f-kube-api-access-qfnz7\") pod \"cert-manager-operator-controller-manager-55c444bf86-m76z7\" (UID: \"9289af05-204f-4aad-8090-7f51e4319e5f\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-m76z7" Sep 09 23:17:02.601747 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:17:02.601661 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-m76z7" Sep 09 23:17:02.901854 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:17:02.901824 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-m76z7"] Sep 09 23:17:02.904952 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:17:02.904923 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9289af05_204f_4aad_8090_7f51e4319e5f.slice/crio-aac62516a04aad0512081b8b06dadc4913910bd3cb5a5c4e7325abff07cf3074 WatchSource:0}: Error finding container aac62516a04aad0512081b8b06dadc4913910bd3cb5a5c4e7325abff07cf3074: Status 404 returned error can't find the container with id aac62516a04aad0512081b8b06dadc4913910bd3cb5a5c4e7325abff07cf3074 Sep 09 23:17:03.238613 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:17:03.238545 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-m76z7" event={"ID":"9289af05-204f-4aad-8090-7f51e4319e5f","Type":"ContainerStarted","Data":"aac62516a04aad0512081b8b06dadc4913910bd3cb5a5c4e7325abff07cf3074"} Sep 09 23:17:05.250691 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:17:05.250656 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-m76z7" event={"ID":"9289af05-204f-4aad-8090-7f51e4319e5f","Type":"ContainerStarted","Data":"1c955aa2a6d3dbf1508bf61198f58b7cd854eb079454682d6b77cf2888027654"} Sep 09 23:17:06.278229 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:17:06.278173 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-m76z7" podStartSLOduration=2.082959575 podStartE2EDuration="4.278157634s" totalImagesPullingTime="2.195198059s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:17:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:17:06.275814758 +0000 UTC m=+534.651388811" watchObservedRunningTime="2026-09-09 23:17:06.278157634 +0000 UTC m=+534.653731696" Sep 09 23:17:06.927701 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:17:06.927667 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvq478"] Sep 09 23:17:06.947054 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:17:06.947020 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvq478"] Sep 09 23:17:06.947229 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:17:06.947126 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvq478" Sep 09 23:17:06.950292 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:17:06.950273 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-ksmhc\"" Sep 09 23:17:06.950531 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:17:06.950516 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Sep 09 23:17:06.951191 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:17:06.951170 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Sep 09 23:17:07.012692 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:17:07.012663 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sbvvd\" (UniqueName: \"kubernetes.io/projected/cc6113c9-20b6-426f-8957-fee139878786-kube-api-access-sbvvd\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvq478\" (UID: \"cc6113c9-20b6-426f-8957-fee139878786\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvq478" Sep 09 23:17:07.012817 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:17:07.012719 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cc6113c9-20b6-426f-8957-fee139878786-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvq478\" (UID: \"cc6113c9-20b6-426f-8957-fee139878786\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvq478" Sep 09 23:17:07.012817 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:17:07.012768 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cc6113c9-20b6-426f-8957-fee139878786-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvq478\" (UID: \"cc6113c9-20b6-426f-8957-fee139878786\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvq478" Sep 09 23:17:07.114108 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:17:07.114073 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cc6113c9-20b6-426f-8957-fee139878786-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvq478\" (UID: \"cc6113c9-20b6-426f-8957-fee139878786\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvq478" Sep 09 23:17:07.114244 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:17:07.114138 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sbvvd\" (UniqueName: \"kubernetes.io/projected/cc6113c9-20b6-426f-8957-fee139878786-kube-api-access-sbvvd\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvq478\" (UID: \"cc6113c9-20b6-426f-8957-fee139878786\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvq478" Sep 09 23:17:07.114244 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:17:07.114189 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cc6113c9-20b6-426f-8957-fee139878786-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvq478\" (UID: \"cc6113c9-20b6-426f-8957-fee139878786\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvq478" Sep 09 23:17:07.114457 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:17:07.114440 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cc6113c9-20b6-426f-8957-fee139878786-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvq478\" (UID: \"cc6113c9-20b6-426f-8957-fee139878786\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvq478" Sep 09 23:17:07.114538 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:17:07.114522 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cc6113c9-20b6-426f-8957-fee139878786-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvq478\" (UID: \"cc6113c9-20b6-426f-8957-fee139878786\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvq478" Sep 09 23:17:07.123110 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:17:07.123084 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sbvvd\" (UniqueName: \"kubernetes.io/projected/cc6113c9-20b6-426f-8957-fee139878786-kube-api-access-sbvvd\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvq478\" (UID: \"cc6113c9-20b6-426f-8957-fee139878786\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvq478" Sep 09 23:17:07.258829 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:17:07.258804 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvq478" Sep 09 23:17:07.563097 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:17:07.562993 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvq478"] Sep 09 23:17:07.565585 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:17:07.565556 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcc6113c9_20b6_426f_8957_fee139878786.slice/crio-11cb9870329c6cbf4dc18c519738883a46a2c96f1629dbd17f507968657eba5b WatchSource:0}: Error finding container 11cb9870329c6cbf4dc18c519738883a46a2c96f1629dbd17f507968657eba5b: Status 404 returned error can't find the container with id 11cb9870329c6cbf4dc18c519738883a46a2c96f1629dbd17f507968657eba5b Sep 09 23:17:08.264522 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:17:08.264487 2561 generic.go:356] "Generic (PLEG): container finished" podID="cc6113c9-20b6-426f-8957-fee139878786" containerID="7c46593a28ab17dfa80aa19e0a48450da1102fb5c2cedb192a3f53c7afce19f1" exitCode=0 Sep 09 23:17:08.264678 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:17:08.264569 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvq478" event={"ID":"cc6113c9-20b6-426f-8957-fee139878786","Type":"ContainerDied","Data":"7c46593a28ab17dfa80aa19e0a48450da1102fb5c2cedb192a3f53c7afce19f1"} Sep 09 23:17:08.264678 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:17:08.264609 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvq478" event={"ID":"cc6113c9-20b6-426f-8957-fee139878786","Type":"ContainerStarted","Data":"11cb9870329c6cbf4dc18c519738883a46a2c96f1629dbd17f507968657eba5b"} Sep 09 23:17:10.276704 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:17:10.276674 2561 generic.go:356] "Generic (PLEG): container finished" podID="cc6113c9-20b6-426f-8957-fee139878786" containerID="5758e27dbfc91a3034e3a088a4d1cb56fa9bb7d6491aae6d4347ba9cc0e1e965" exitCode=0 Sep 09 23:17:10.277021 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:17:10.276758 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvq478" event={"ID":"cc6113c9-20b6-426f-8957-fee139878786","Type":"ContainerDied","Data":"5758e27dbfc91a3034e3a088a4d1cb56fa9bb7d6491aae6d4347ba9cc0e1e965"} Sep 09 23:17:11.283569 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:17:11.283534 2561 generic.go:356] "Generic (PLEG): container finished" podID="cc6113c9-20b6-426f-8957-fee139878786" containerID="329119f33b55a243d56a7bba379a52a964dcda87b09264267986c056bf949a63" exitCode=0 Sep 09 23:17:11.283569 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:17:11.283571 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvq478" event={"ID":"cc6113c9-20b6-426f-8957-fee139878786","Type":"ContainerDied","Data":"329119f33b55a243d56a7bba379a52a964dcda87b09264267986c056bf949a63"} Sep 09 23:17:12.408807 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:17:12.408784 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvq478" Sep 09 23:17:12.457481 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:17:12.457455 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sbvvd\" (UniqueName: \"kubernetes.io/projected/cc6113c9-20b6-426f-8957-fee139878786-kube-api-access-sbvvd\") pod \"cc6113c9-20b6-426f-8957-fee139878786\" (UID: \"cc6113c9-20b6-426f-8957-fee139878786\") " Sep 09 23:17:12.457645 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:17:12.457498 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cc6113c9-20b6-426f-8957-fee139878786-bundle\") pod \"cc6113c9-20b6-426f-8957-fee139878786\" (UID: \"cc6113c9-20b6-426f-8957-fee139878786\") " Sep 09 23:17:12.457645 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:17:12.457518 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cc6113c9-20b6-426f-8957-fee139878786-util\") pod \"cc6113c9-20b6-426f-8957-fee139878786\" (UID: \"cc6113c9-20b6-426f-8957-fee139878786\") " Sep 09 23:17:12.457903 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:17:12.457874 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cc6113c9-20b6-426f-8957-fee139878786-bundle" (OuterVolumeSpecName: "bundle") pod "cc6113c9-20b6-426f-8957-fee139878786" (UID: "cc6113c9-20b6-426f-8957-fee139878786"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 09 23:17:12.459447 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:17:12.459421 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cc6113c9-20b6-426f-8957-fee139878786-kube-api-access-sbvvd" (OuterVolumeSpecName: "kube-api-access-sbvvd") pod "cc6113c9-20b6-426f-8957-fee139878786" (UID: "cc6113c9-20b6-426f-8957-fee139878786"). InnerVolumeSpecName "kube-api-access-sbvvd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 09 23:17:12.463128 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:17:12.463102 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cc6113c9-20b6-426f-8957-fee139878786-util" (OuterVolumeSpecName: "util") pod "cc6113c9-20b6-426f-8957-fee139878786" (UID: "cc6113c9-20b6-426f-8957-fee139878786"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 09 23:17:12.558203 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:17:12.558173 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sbvvd\" (UniqueName: \"kubernetes.io/projected/cc6113c9-20b6-426f-8957-fee139878786-kube-api-access-sbvvd\") on node \"ip-10-0-132-204.ec2.internal\" DevicePath \"\"" Sep 09 23:17:12.558203 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:17:12.558198 2561 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cc6113c9-20b6-426f-8957-fee139878786-bundle\") on node \"ip-10-0-132-204.ec2.internal\" DevicePath \"\"" Sep 09 23:17:12.558203 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:17:12.558207 2561 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cc6113c9-20b6-426f-8957-fee139878786-util\") on node \"ip-10-0-132-204.ec2.internal\" DevicePath \"\"" Sep 09 23:17:13.298023 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:17:13.297985 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvq478" event={"ID":"cc6113c9-20b6-426f-8957-fee139878786","Type":"ContainerDied","Data":"11cb9870329c6cbf4dc18c519738883a46a2c96f1629dbd17f507968657eba5b"} Sep 09 23:17:13.298023 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:17:13.298029 2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="11cb9870329c6cbf4dc18c519738883a46a2c96f1629dbd17f507968657eba5b" Sep 09 23:17:13.298222 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:17:13.298029 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fvq478" Sep 09 23:17:17.119046 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:17:17.119013 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-lpn9q"] Sep 09 23:17:17.119417 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:17:17.119331 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cc6113c9-20b6-426f-8957-fee139878786" containerName="pull" Sep 09 23:17:17.119417 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:17:17.119341 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="cc6113c9-20b6-426f-8957-fee139878786" containerName="pull" Sep 09 23:17:17.119417 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:17:17.119351 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cc6113c9-20b6-426f-8957-fee139878786" containerName="extract" Sep 09 23:17:17.119417 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:17:17.119356 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="cc6113c9-20b6-426f-8957-fee139878786" containerName="extract" Sep 09 23:17:17.119417 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:17:17.119381 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cc6113c9-20b6-426f-8957-fee139878786" containerName="util" Sep 09 23:17:17.119417 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:17:17.119386 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="cc6113c9-20b6-426f-8957-fee139878786" containerName="util" Sep 09 23:17:17.119612 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:17:17.119435 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="cc6113c9-20b6-426f-8957-fee139878786" containerName="extract" Sep 09 23:17:17.122408 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:17:17.122389 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-lpn9q" Sep 09 23:17:17.125038 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:17:17.125013 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Sep 09 23:17:17.126093 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:17:17.126077 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Sep 09 23:17:17.126093 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:17:17.126087 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-hq4mf\"" Sep 09 23:17:17.132608 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:17:17.132586 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-lpn9q"] Sep 09 23:17:17.196210 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:17:17.196180 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0a8eaad0-5419-4762-b9ae-ef0489a2f47b-tmp\") pod \"openshift-lws-operator-fd8ccff4c-lpn9q\" (UID: \"0a8eaad0-5419-4762-b9ae-ef0489a2f47b\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-lpn9q" Sep 09 23:17:17.196332 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:17:17.196228 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hqxgj\" (UniqueName: \"kubernetes.io/projected/0a8eaad0-5419-4762-b9ae-ef0489a2f47b-kube-api-access-hqxgj\") pod \"openshift-lws-operator-fd8ccff4c-lpn9q\" (UID: \"0a8eaad0-5419-4762-b9ae-ef0489a2f47b\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-lpn9q" Sep 09 23:17:17.297048 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:17:17.297015 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0a8eaad0-5419-4762-b9ae-ef0489a2f47b-tmp\") pod \"openshift-lws-operator-fd8ccff4c-lpn9q\" (UID: \"0a8eaad0-5419-4762-b9ae-ef0489a2f47b\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-lpn9q" Sep 09 23:17:17.297210 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:17:17.297062 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hqxgj\" (UniqueName: \"kubernetes.io/projected/0a8eaad0-5419-4762-b9ae-ef0489a2f47b-kube-api-access-hqxgj\") pod \"openshift-lws-operator-fd8ccff4c-lpn9q\" (UID: \"0a8eaad0-5419-4762-b9ae-ef0489a2f47b\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-lpn9q" Sep 09 23:17:17.297421 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:17:17.297403 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0a8eaad0-5419-4762-b9ae-ef0489a2f47b-tmp\") pod \"openshift-lws-operator-fd8ccff4c-lpn9q\" (UID: \"0a8eaad0-5419-4762-b9ae-ef0489a2f47b\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-lpn9q" Sep 09 23:17:17.310450 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:17:17.310421 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hqxgj\" (UniqueName: \"kubernetes.io/projected/0a8eaad0-5419-4762-b9ae-ef0489a2f47b-kube-api-access-hqxgj\") pod \"openshift-lws-operator-fd8ccff4c-lpn9q\" (UID: \"0a8eaad0-5419-4762-b9ae-ef0489a2f47b\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-lpn9q" Sep 09 23:17:17.438768 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:17:17.438685 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-lpn9q" Sep 09 23:17:17.708921 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:17:17.708896 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-lpn9q"] Sep 09 23:17:17.711552 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:17:17.711524 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0a8eaad0_5419_4762_b9ae_ef0489a2f47b.slice/crio-7df08a07d9d626f5eef087fd60181c69267e2bee2dc02a0ffee8bfd9739e9092 WatchSource:0}: Error finding container 7df08a07d9d626f5eef087fd60181c69267e2bee2dc02a0ffee8bfd9739e9092: Status 404 returned error can't find the container with id 7df08a07d9d626f5eef087fd60181c69267e2bee2dc02a0ffee8bfd9739e9092 Sep 09 23:17:18.321350 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:17:18.321320 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-lpn9q" event={"ID":"0a8eaad0-5419-4762-b9ae-ef0489a2f47b","Type":"ContainerStarted","Data":"7df08a07d9d626f5eef087fd60181c69267e2bee2dc02a0ffee8bfd9739e9092"} Sep 09 23:17:20.332455 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:17:20.332420 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-lpn9q" event={"ID":"0a8eaad0-5419-4762-b9ae-ef0489a2f47b","Type":"ContainerStarted","Data":"4f393a1b573f4e3d893f7d74188f62c5d0726d359990cfa9be6d7932315aa74b"} Sep 09 23:17:20.349802 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:17:20.349754 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-lpn9q" podStartSLOduration=1.459397519 podStartE2EDuration="3.349737142s" totalImagesPullingTime="1.890339623s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:17:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:17:20.347894589 +0000 UTC m=+548.723468650" watchObservedRunningTime="2026-09-09 23:17:20.349737142 +0000 UTC m=+548.725311195" Sep 09 23:17:23.088400 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:17:23.088354 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwb9nz"] Sep 09 23:17:23.092082 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:17:23.092066 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwb9nz" Sep 09 23:17:23.094984 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:17:23.094957 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Sep 09 23:17:23.095100 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:17:23.095051 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-ksmhc\"" Sep 09 23:17:23.095100 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:17:23.095062 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Sep 09 23:17:23.100656 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:17:23.100635 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwb9nz"] Sep 09 23:17:23.152900 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:17:23.152871 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/173c721b-06e5-4620-a421-baa5be9e88dd-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwb9nz\" (UID: \"173c721b-06e5-4620-a421-baa5be9e88dd\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwb9nz" Sep 09 23:17:23.153032 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:17:23.152906 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q7x4n\" (UniqueName: \"kubernetes.io/projected/173c721b-06e5-4620-a421-baa5be9e88dd-kube-api-access-q7x4n\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwb9nz\" (UID: \"173c721b-06e5-4620-a421-baa5be9e88dd\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwb9nz" Sep 09 23:17:23.153032 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:17:23.152934 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/173c721b-06e5-4620-a421-baa5be9e88dd-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwb9nz\" (UID: \"173c721b-06e5-4620-a421-baa5be9e88dd\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwb9nz" Sep 09 23:17:23.253793 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:17:23.253761 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/173c721b-06e5-4620-a421-baa5be9e88dd-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwb9nz\" (UID: \"173c721b-06e5-4620-a421-baa5be9e88dd\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwb9nz" Sep 09 23:17:23.253945 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:17:23.253805 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q7x4n\" (UniqueName: \"kubernetes.io/projected/173c721b-06e5-4620-a421-baa5be9e88dd-kube-api-access-q7x4n\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwb9nz\" (UID: \"173c721b-06e5-4620-a421-baa5be9e88dd\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwb9nz" Sep 09 23:17:23.253945 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:17:23.253842 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/173c721b-06e5-4620-a421-baa5be9e88dd-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwb9nz\" (UID: \"173c721b-06e5-4620-a421-baa5be9e88dd\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwb9nz" Sep 09 23:17:23.254127 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:17:23.254105 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/173c721b-06e5-4620-a421-baa5be9e88dd-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwb9nz\" (UID: \"173c721b-06e5-4620-a421-baa5be9e88dd\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwb9nz" Sep 09 23:17:23.254225 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:17:23.254205 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/173c721b-06e5-4620-a421-baa5be9e88dd-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwb9nz\" (UID: \"173c721b-06e5-4620-a421-baa5be9e88dd\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwb9nz" Sep 09 23:17:23.261838 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:17:23.261814 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q7x4n\" (UniqueName: \"kubernetes.io/projected/173c721b-06e5-4620-a421-baa5be9e88dd-kube-api-access-q7x4n\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwb9nz\" (UID: \"173c721b-06e5-4620-a421-baa5be9e88dd\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwb9nz" Sep 09 23:17:23.402426 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:17:23.402341 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwb9nz" Sep 09 23:17:23.673676 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:17:23.673652 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwb9nz"] Sep 09 23:17:23.675786 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:17:23.675761 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod173c721b_06e5_4620_a421_baa5be9e88dd.slice/crio-e561cfffdadce0957053f90026c9dad816019d9e7b3488b18cb43d3211f905af WatchSource:0}: Error finding container e561cfffdadce0957053f90026c9dad816019d9e7b3488b18cb43d3211f905af: Status 404 returned error can't find the container with id e561cfffdadce0957053f90026c9dad816019d9e7b3488b18cb43d3211f905af Sep 09 23:17:24.351693 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:17:24.351660 2561 generic.go:356] "Generic (PLEG): container finished" podID="173c721b-06e5-4620-a421-baa5be9e88dd" containerID="b7dd7f56f5a1cd36e32963d8ad399f4269f09b71c9d4de01ad1103adbfe9cbfb" exitCode=0 Sep 09 23:17:24.352067 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:17:24.351725 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwb9nz" event={"ID":"173c721b-06e5-4620-a421-baa5be9e88dd","Type":"ContainerDied","Data":"b7dd7f56f5a1cd36e32963d8ad399f4269f09b71c9d4de01ad1103adbfe9cbfb"} Sep 09 23:17:24.352067 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:17:24.351761 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwb9nz" event={"ID":"173c721b-06e5-4620-a421-baa5be9e88dd","Type":"ContainerStarted","Data":"e561cfffdadce0957053f90026c9dad816019d9e7b3488b18cb43d3211f905af"} Sep 09 23:17:25.357662 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:17:25.357627 2561 generic.go:356] "Generic (PLEG): container finished" podID="173c721b-06e5-4620-a421-baa5be9e88dd" containerID="defea6f9f8932c6c1b527fb39c9dce8e44aaa92cc1d639ebfd97964d87719d8f" exitCode=0 Sep 09 23:17:25.358052 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:17:25.357710 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwb9nz" event={"ID":"173c721b-06e5-4620-a421-baa5be9e88dd","Type":"ContainerDied","Data":"defea6f9f8932c6c1b527fb39c9dce8e44aaa92cc1d639ebfd97964d87719d8f"} Sep 09 23:17:26.364449 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:17:26.364417 2561 generic.go:356] "Generic (PLEG): container finished" podID="173c721b-06e5-4620-a421-baa5be9e88dd" containerID="d010cee82d3b97ec0184c7ca8a061406da6d0b5dc18230f65acac6fe37205bd4" exitCode=0 Sep 09 23:17:26.364804 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:17:26.364504 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwb9nz" event={"ID":"173c721b-06e5-4620-a421-baa5be9e88dd","Type":"ContainerDied","Data":"d010cee82d3b97ec0184c7ca8a061406da6d0b5dc18230f65acac6fe37205bd4"} Sep 09 23:17:27.494905 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:17:27.494880 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwb9nz" Sep 09 23:17:27.590344 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:17:27.590313 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/173c721b-06e5-4620-a421-baa5be9e88dd-bundle\") pod \"173c721b-06e5-4620-a421-baa5be9e88dd\" (UID: \"173c721b-06e5-4620-a421-baa5be9e88dd\") " Sep 09 23:17:27.590518 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:17:27.590410 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/173c721b-06e5-4620-a421-baa5be9e88dd-util\") pod \"173c721b-06e5-4620-a421-baa5be9e88dd\" (UID: \"173c721b-06e5-4620-a421-baa5be9e88dd\") " Sep 09 23:17:27.590518 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:17:27.590437 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q7x4n\" (UniqueName: \"kubernetes.io/projected/173c721b-06e5-4620-a421-baa5be9e88dd-kube-api-access-q7x4n\") pod \"173c721b-06e5-4620-a421-baa5be9e88dd\" (UID: \"173c721b-06e5-4620-a421-baa5be9e88dd\") " Sep 09 23:17:27.591013 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:17:27.590985 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/173c721b-06e5-4620-a421-baa5be9e88dd-bundle" (OuterVolumeSpecName: "bundle") pod "173c721b-06e5-4620-a421-baa5be9e88dd" (UID: "173c721b-06e5-4620-a421-baa5be9e88dd"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 09 23:17:27.592652 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:17:27.592624 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/173c721b-06e5-4620-a421-baa5be9e88dd-kube-api-access-q7x4n" (OuterVolumeSpecName: "kube-api-access-q7x4n") pod "173c721b-06e5-4620-a421-baa5be9e88dd" (UID: "173c721b-06e5-4620-a421-baa5be9e88dd"). InnerVolumeSpecName "kube-api-access-q7x4n". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 09 23:17:27.596059 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:17:27.596037 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/173c721b-06e5-4620-a421-baa5be9e88dd-util" (OuterVolumeSpecName: "util") pod "173c721b-06e5-4620-a421-baa5be9e88dd" (UID: "173c721b-06e5-4620-a421-baa5be9e88dd"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 09 23:17:27.691775 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:17:27.691717 2561 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/173c721b-06e5-4620-a421-baa5be9e88dd-bundle\") on node \"ip-10-0-132-204.ec2.internal\" DevicePath \"\"" Sep 09 23:17:27.691775 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:17:27.691740 2561 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/173c721b-06e5-4620-a421-baa5be9e88dd-util\") on node \"ip-10-0-132-204.ec2.internal\" DevicePath \"\"" Sep 09 23:17:27.691775 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:17:27.691750 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q7x4n\" (UniqueName: \"kubernetes.io/projected/173c721b-06e5-4620-a421-baa5be9e88dd-kube-api-access-q7x4n\") on node \"ip-10-0-132-204.ec2.internal\" DevicePath \"\"" Sep 09 23:17:28.375822 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:17:28.375734 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwb9nz" event={"ID":"173c721b-06e5-4620-a421-baa5be9e88dd","Type":"ContainerDied","Data":"e561cfffdadce0957053f90026c9dad816019d9e7b3488b18cb43d3211f905af"} Sep 09 23:17:28.375822 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:17:28.375777 2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e561cfffdadce0957053f90026c9dad816019d9e7b3488b18cb43d3211f905af" Sep 09 23:17:28.375822 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:17:28.375785 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwb9nz" Sep 09 23:17:36.100803 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:17:36.100767 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b065fmj"] Sep 09 23:17:36.101160 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:17:36.101079 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="173c721b-06e5-4620-a421-baa5be9e88dd" containerName="pull" Sep 09 23:17:36.101160 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:17:36.101089 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="173c721b-06e5-4620-a421-baa5be9e88dd" containerName="pull" Sep 09 23:17:36.101160 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:17:36.101110 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="173c721b-06e5-4620-a421-baa5be9e88dd" containerName="util" Sep 09 23:17:36.101160 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:17:36.101115 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="173c721b-06e5-4620-a421-baa5be9e88dd" containerName="util" Sep 09 23:17:36.101160 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:17:36.101124 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="173c721b-06e5-4620-a421-baa5be9e88dd" containerName="extract" Sep 09 23:17:36.101160 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:17:36.101129 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="173c721b-06e5-4620-a421-baa5be9e88dd" containerName="extract" Sep 09 23:17:36.101338 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:17:36.101179 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="173c721b-06e5-4620-a421-baa5be9e88dd" containerName="extract" Sep 09 23:17:36.104200 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:17:36.104183 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b065fmj" Sep 09 23:17:36.107237 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:17:36.107214 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Sep 09 23:17:36.107387 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:17:36.107254 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Sep 09 23:17:36.107451 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:17:36.107412 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-ksmhc\"" Sep 09 23:17:36.117080 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:17:36.117061 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b065fmj"] Sep 09 23:17:36.265865 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:17:36.265833 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8cf0ca06-d680-4768-8fa3-acc10922b30d-util\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b065fmj\" (UID: \"8cf0ca06-d680-4768-8fa3-acc10922b30d\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b065fmj" Sep 09 23:17:36.265865 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:17:36.265867 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bwn8j\" (UniqueName: \"kubernetes.io/projected/8cf0ca06-d680-4768-8fa3-acc10922b30d-kube-api-access-bwn8j\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b065fmj\" (UID: \"8cf0ca06-d680-4768-8fa3-acc10922b30d\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b065fmj" Sep 09 23:17:36.266056 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:17:36.265948 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8cf0ca06-d680-4768-8fa3-acc10922b30d-bundle\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b065fmj\" (UID: \"8cf0ca06-d680-4768-8fa3-acc10922b30d\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b065fmj" Sep 09 23:17:36.366984 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:17:36.366897 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8cf0ca06-d680-4768-8fa3-acc10922b30d-bundle\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b065fmj\" (UID: \"8cf0ca06-d680-4768-8fa3-acc10922b30d\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b065fmj" Sep 09 23:17:36.366984 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:17:36.366964 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8cf0ca06-d680-4768-8fa3-acc10922b30d-util\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b065fmj\" (UID: \"8cf0ca06-d680-4768-8fa3-acc10922b30d\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b065fmj" Sep 09 23:17:36.366984 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:17:36.366986 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bwn8j\" (UniqueName: \"kubernetes.io/projected/8cf0ca06-d680-4768-8fa3-acc10922b30d-kube-api-access-bwn8j\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b065fmj\" (UID: \"8cf0ca06-d680-4768-8fa3-acc10922b30d\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b065fmj" Sep 09 23:17:36.367293 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:17:36.367275 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8cf0ca06-d680-4768-8fa3-acc10922b30d-bundle\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b065fmj\" (UID: \"8cf0ca06-d680-4768-8fa3-acc10922b30d\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b065fmj" Sep 09 23:17:36.367332 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:17:36.367300 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8cf0ca06-d680-4768-8fa3-acc10922b30d-util\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b065fmj\" (UID: \"8cf0ca06-d680-4768-8fa3-acc10922b30d\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b065fmj" Sep 09 23:17:36.375381 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:17:36.375350 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bwn8j\" (UniqueName: \"kubernetes.io/projected/8cf0ca06-d680-4768-8fa3-acc10922b30d-kube-api-access-bwn8j\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b065fmj\" (UID: \"8cf0ca06-d680-4768-8fa3-acc10922b30d\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b065fmj" Sep 09 23:17:36.413808 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:17:36.413781 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b065fmj" Sep 09 23:17:36.686889 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:17:36.686820 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b065fmj"] Sep 09 23:17:36.690033 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:17:36.690007 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8cf0ca06_d680_4768_8fa3_acc10922b30d.slice/crio-92cc9e0cd251d2276b244cd89fc8ca60a3df83148d1c6c497455a3c3130ee4e1 WatchSource:0}: Error finding container 92cc9e0cd251d2276b244cd89fc8ca60a3df83148d1c6c497455a3c3130ee4e1: Status 404 returned error can't find the container with id 92cc9e0cd251d2276b244cd89fc8ca60a3df83148d1c6c497455a3c3130ee4e1 Sep 09 23:17:37.419714 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:17:37.419680 2561 generic.go:356] "Generic (PLEG): container finished" podID="8cf0ca06-d680-4768-8fa3-acc10922b30d" containerID="ed04a12813bb6164d6c085be4bbb48551de70715f8454c431185a87cbb2906b3" exitCode=0 Sep 09 23:17:37.420081 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:17:37.419736 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b065fmj" event={"ID":"8cf0ca06-d680-4768-8fa3-acc10922b30d","Type":"ContainerDied","Data":"ed04a12813bb6164d6c085be4bbb48551de70715f8454c431185a87cbb2906b3"} Sep 09 23:17:37.420081 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:17:37.419782 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b065fmj" event={"ID":"8cf0ca06-d680-4768-8fa3-acc10922b30d","Type":"ContainerStarted","Data":"92cc9e0cd251d2276b244cd89fc8ca60a3df83148d1c6c497455a3c3130ee4e1"} Sep 09 23:17:38.334685 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:17:38.334651 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-68fd95c47c-p6x7t"] Sep 09 23:17:38.338045 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:17:38.338030 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-68fd95c47c-p6x7t" Sep 09 23:17:38.341419 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:17:38.341356 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-n2m42\"" Sep 09 23:17:38.341419 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:17:38.341412 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Sep 09 23:17:38.341749 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:17:38.341729 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Sep 09 23:17:38.342031 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:17:38.342012 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Sep 09 23:17:38.342553 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:17:38.342540 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Sep 09 23:17:38.370402 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:17:38.370352 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-68fd95c47c-p6x7t"] Sep 09 23:17:38.427335 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:17:38.427298 2561 generic.go:356] "Generic (PLEG): container finished" podID="8cf0ca06-d680-4768-8fa3-acc10922b30d" containerID="cf5168db721e3e8ce283a067262fc5297cc026e00b522a169ce762ecd8679acf" exitCode=0 Sep 09 23:17:38.427790 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:17:38.427395 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b065fmj" event={"ID":"8cf0ca06-d680-4768-8fa3-acc10922b30d","Type":"ContainerDied","Data":"cf5168db721e3e8ce283a067262fc5297cc026e00b522a169ce762ecd8679acf"} Sep 09 23:17:38.486356 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:17:38.486334 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/691fe9da-083d-46f8-8d63-9d6dcd34aa29-tmp\") pod \"opendatahub-operator-controller-manager-68fd95c47c-p6x7t\" (UID: \"691fe9da-083d-46f8-8d63-9d6dcd34aa29\") " pod="opendatahub/opendatahub-operator-controller-manager-68fd95c47c-p6x7t" Sep 09 23:17:38.486481 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:17:38.486392 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/691fe9da-083d-46f8-8d63-9d6dcd34aa29-manifests\") pod \"opendatahub-operator-controller-manager-68fd95c47c-p6x7t\" (UID: \"691fe9da-083d-46f8-8d63-9d6dcd34aa29\") " pod="opendatahub/opendatahub-operator-controller-manager-68fd95c47c-p6x7t" Sep 09 23:17:38.486481 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:17:38.486411 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wdm4q\" (UniqueName: \"kubernetes.io/projected/691fe9da-083d-46f8-8d63-9d6dcd34aa29-kube-api-access-wdm4q\") pod \"opendatahub-operator-controller-manager-68fd95c47c-p6x7t\" (UID: \"691fe9da-083d-46f8-8d63-9d6dcd34aa29\") " pod="opendatahub/opendatahub-operator-controller-manager-68fd95c47c-p6x7t" Sep 09 23:17:38.486481 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:17:38.486430 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/691fe9da-083d-46f8-8d63-9d6dcd34aa29-webhook-cert\") pod \"opendatahub-operator-controller-manager-68fd95c47c-p6x7t\" (UID: \"691fe9da-083d-46f8-8d63-9d6dcd34aa29\") " pod="opendatahub/opendatahub-operator-controller-manager-68fd95c47c-p6x7t" Sep 09 23:17:38.486681 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:17:38.486531 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/691fe9da-083d-46f8-8d63-9d6dcd34aa29-apiservice-cert\") pod \"opendatahub-operator-controller-manager-68fd95c47c-p6x7t\" (UID: \"691fe9da-083d-46f8-8d63-9d6dcd34aa29\") " pod="opendatahub/opendatahub-operator-controller-manager-68fd95c47c-p6x7t" Sep 09 23:17:38.587687 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:17:38.587606 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/691fe9da-083d-46f8-8d63-9d6dcd34aa29-tmp\") pod \"opendatahub-operator-controller-manager-68fd95c47c-p6x7t\" (UID: \"691fe9da-083d-46f8-8d63-9d6dcd34aa29\") " pod="opendatahub/opendatahub-operator-controller-manager-68fd95c47c-p6x7t" Sep 09 23:17:38.587687 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:17:38.587665 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/691fe9da-083d-46f8-8d63-9d6dcd34aa29-manifests\") pod \"opendatahub-operator-controller-manager-68fd95c47c-p6x7t\" (UID: \"691fe9da-083d-46f8-8d63-9d6dcd34aa29\") " pod="opendatahub/opendatahub-operator-controller-manager-68fd95c47c-p6x7t" Sep 09 23:17:38.587932 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:17:38.587691 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wdm4q\" (UniqueName: \"kubernetes.io/projected/691fe9da-083d-46f8-8d63-9d6dcd34aa29-kube-api-access-wdm4q\") pod \"opendatahub-operator-controller-manager-68fd95c47c-p6x7t\" (UID: \"691fe9da-083d-46f8-8d63-9d6dcd34aa29\") " pod="opendatahub/opendatahub-operator-controller-manager-68fd95c47c-p6x7t" Sep 09 23:17:38.587932 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:17:38.587716 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/691fe9da-083d-46f8-8d63-9d6dcd34aa29-webhook-cert\") pod \"opendatahub-operator-controller-manager-68fd95c47c-p6x7t\" (UID: \"691fe9da-083d-46f8-8d63-9d6dcd34aa29\") " pod="opendatahub/opendatahub-operator-controller-manager-68fd95c47c-p6x7t" Sep 09 23:17:38.587932 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:17:38.587758 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/691fe9da-083d-46f8-8d63-9d6dcd34aa29-apiservice-cert\") pod \"opendatahub-operator-controller-manager-68fd95c47c-p6x7t\" (UID: \"691fe9da-083d-46f8-8d63-9d6dcd34aa29\") " pod="opendatahub/opendatahub-operator-controller-manager-68fd95c47c-p6x7t" Sep 09 23:17:38.588172 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:17:38.588145 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/691fe9da-083d-46f8-8d63-9d6dcd34aa29-manifests\") pod \"opendatahub-operator-controller-manager-68fd95c47c-p6x7t\" (UID: \"691fe9da-083d-46f8-8d63-9d6dcd34aa29\") " pod="opendatahub/opendatahub-operator-controller-manager-68fd95c47c-p6x7t" Sep 09 23:17:38.590029 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:17:38.590007 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/691fe9da-083d-46f8-8d63-9d6dcd34aa29-tmp\") pod \"opendatahub-operator-controller-manager-68fd95c47c-p6x7t\" (UID: \"691fe9da-083d-46f8-8d63-9d6dcd34aa29\") " pod="opendatahub/opendatahub-operator-controller-manager-68fd95c47c-p6x7t" Sep 09 23:17:38.590424 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:17:38.590401 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/691fe9da-083d-46f8-8d63-9d6dcd34aa29-webhook-cert\") pod \"opendatahub-operator-controller-manager-68fd95c47c-p6x7t\" (UID: \"691fe9da-083d-46f8-8d63-9d6dcd34aa29\") " pod="opendatahub/opendatahub-operator-controller-manager-68fd95c47c-p6x7t" Sep 09 23:17:38.590542 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:17:38.590529 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/691fe9da-083d-46f8-8d63-9d6dcd34aa29-apiservice-cert\") pod \"opendatahub-operator-controller-manager-68fd95c47c-p6x7t\" (UID: \"691fe9da-083d-46f8-8d63-9d6dcd34aa29\") " pod="opendatahub/opendatahub-operator-controller-manager-68fd95c47c-p6x7t" Sep 09 23:17:38.600271 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:17:38.600250 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wdm4q\" (UniqueName: \"kubernetes.io/projected/691fe9da-083d-46f8-8d63-9d6dcd34aa29-kube-api-access-wdm4q\") pod \"opendatahub-operator-controller-manager-68fd95c47c-p6x7t\" (UID: \"691fe9da-083d-46f8-8d63-9d6dcd34aa29\") " pod="opendatahub/opendatahub-operator-controller-manager-68fd95c47c-p6x7t" Sep 09 23:17:38.648294 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:17:38.648273 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-68fd95c47c-p6x7t" Sep 09 23:17:38.922764 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:17:38.922695 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-68fd95c47c-p6x7t"] Sep 09 23:17:38.926269 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:17:38.926247 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod691fe9da_083d_46f8_8d63_9d6dcd34aa29.slice/crio-a4324a2ed9e1eeeda52a5329a414717d8c8176a23fe392d5128b08ff7aafb44c WatchSource:0}: Error finding container a4324a2ed9e1eeeda52a5329a414717d8c8176a23fe392d5128b08ff7aafb44c: Status 404 returned error can't find the container with id a4324a2ed9e1eeeda52a5329a414717d8c8176a23fe392d5128b08ff7aafb44c Sep 09 23:17:39.437513 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:17:39.437417 2561 generic.go:356] "Generic (PLEG): container finished" podID="8cf0ca06-d680-4768-8fa3-acc10922b30d" containerID="6e8e7e1dfe846ad9e50bc16a4b2787c630a1c57c9476d0530ec563d18b77ffae" exitCode=0 Sep 09 23:17:39.437940 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:17:39.437527 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b065fmj" event={"ID":"8cf0ca06-d680-4768-8fa3-acc10922b30d","Type":"ContainerDied","Data":"6e8e7e1dfe846ad9e50bc16a4b2787c630a1c57c9476d0530ec563d18b77ffae"} Sep 09 23:17:39.439598 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:17:39.439567 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-68fd95c47c-p6x7t" event={"ID":"691fe9da-083d-46f8-8d63-9d6dcd34aa29","Type":"ContainerStarted","Data":"a4324a2ed9e1eeeda52a5329a414717d8c8176a23fe392d5128b08ff7aafb44c"} Sep 09 23:17:41.786840 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:17:41.786814 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b065fmj" Sep 09 23:17:41.920804 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:17:41.920782 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8cf0ca06-d680-4768-8fa3-acc10922b30d-bundle\") pod \"8cf0ca06-d680-4768-8fa3-acc10922b30d\" (UID: \"8cf0ca06-d680-4768-8fa3-acc10922b30d\") " Sep 09 23:17:41.920914 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:17:41.920850 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bwn8j\" (UniqueName: \"kubernetes.io/projected/8cf0ca06-d680-4768-8fa3-acc10922b30d-kube-api-access-bwn8j\") pod \"8cf0ca06-d680-4768-8fa3-acc10922b30d\" (UID: \"8cf0ca06-d680-4768-8fa3-acc10922b30d\") " Sep 09 23:17:41.920914 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:17:41.920871 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8cf0ca06-d680-4768-8fa3-acc10922b30d-util\") pod \"8cf0ca06-d680-4768-8fa3-acc10922b30d\" (UID: \"8cf0ca06-d680-4768-8fa3-acc10922b30d\") " Sep 09 23:17:41.921526 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:17:41.921504 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8cf0ca06-d680-4768-8fa3-acc10922b30d-bundle" (OuterVolumeSpecName: "bundle") pod "8cf0ca06-d680-4768-8fa3-acc10922b30d" (UID: "8cf0ca06-d680-4768-8fa3-acc10922b30d"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 09 23:17:41.923037 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:17:41.923013 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8cf0ca06-d680-4768-8fa3-acc10922b30d-kube-api-access-bwn8j" (OuterVolumeSpecName: "kube-api-access-bwn8j") pod "8cf0ca06-d680-4768-8fa3-acc10922b30d" (UID: "8cf0ca06-d680-4768-8fa3-acc10922b30d"). InnerVolumeSpecName "kube-api-access-bwn8j". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 09 23:17:41.926093 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:17:41.926075 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8cf0ca06-d680-4768-8fa3-acc10922b30d-util" (OuterVolumeSpecName: "util") pod "8cf0ca06-d680-4768-8fa3-acc10922b30d" (UID: "8cf0ca06-d680-4768-8fa3-acc10922b30d"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 09 23:17:42.022239 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:17:42.022175 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bwn8j\" (UniqueName: \"kubernetes.io/projected/8cf0ca06-d680-4768-8fa3-acc10922b30d-kube-api-access-bwn8j\") on node \"ip-10-0-132-204.ec2.internal\" DevicePath \"\"" Sep 09 23:17:42.022239 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:17:42.022201 2561 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8cf0ca06-d680-4768-8fa3-acc10922b30d-util\") on node \"ip-10-0-132-204.ec2.internal\" DevicePath \"\"" Sep 09 23:17:42.022239 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:17:42.022210 2561 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8cf0ca06-d680-4768-8fa3-acc10922b30d-bundle\") on node \"ip-10-0-132-204.ec2.internal\" DevicePath \"\"" Sep 09 23:17:42.456823 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:17:42.456746 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b065fmj" Sep 09 23:17:42.456941 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:17:42.456745 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b065fmj" event={"ID":"8cf0ca06-d680-4768-8fa3-acc10922b30d","Type":"ContainerDied","Data":"92cc9e0cd251d2276b244cd89fc8ca60a3df83148d1c6c497455a3c3130ee4e1"} Sep 09 23:17:42.456941 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:17:42.456867 2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="92cc9e0cd251d2276b244cd89fc8ca60a3df83148d1c6c497455a3c3130ee4e1" Sep 09 23:17:42.458507 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:17:42.458484 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-68fd95c47c-p6x7t" event={"ID":"691fe9da-083d-46f8-8d63-9d6dcd34aa29","Type":"ContainerStarted","Data":"a2c200595a83ba23fac67c53723969a1e45c14b99b94528ca156e715509f67f8"} Sep 09 23:17:43.465016 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:17:43.464979 2561 generic.go:356] "Generic (PLEG): container finished" podID="691fe9da-083d-46f8-8d63-9d6dcd34aa29" containerID="a2c200595a83ba23fac67c53723969a1e45c14b99b94528ca156e715509f67f8" exitCode=0 Sep 09 23:17:43.465418 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:17:43.465061 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-68fd95c47c-p6x7t" event={"ID":"691fe9da-083d-46f8-8d63-9d6dcd34aa29","Type":"ContainerDied","Data":"a2c200595a83ba23fac67c53723969a1e45c14b99b94528ca156e715509f67f8"} Sep 09 23:17:44.471962 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:17:44.471926 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-68fd95c47c-p6x7t" event={"ID":"691fe9da-083d-46f8-8d63-9d6dcd34aa29","Type":"ContainerStarted","Data":"fb084a4ef90ff105c9130ad015f5898ef039657b9010680226ff1385172ac127"} Sep 09 23:17:44.472337 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:17:44.472067 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-68fd95c47c-p6x7t" Sep 09 23:17:44.492998 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:17:44.492950 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-68fd95c47c-p6x7t" podStartSLOduration=2.0534678140000002 podStartE2EDuration="6.492933691s" totalImagesPullingTime="3.352888168s" totalInitContainerRuntime="1.086577709s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:17:38 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:17:44.490932269 +0000 UTC m=+572.866506343" watchObservedRunningTime="2026-09-09 23:17:44.492933691 +0000 UTC m=+572.868507752" Sep 09 23:17:55.479776 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:17:55.479746 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-68fd95c47c-p6x7t" Sep 09 23:17:57.605202 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:17:57.605170 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-576f68f9bc-nd249"] Sep 09 23:17:57.605610 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:17:57.605499 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8cf0ca06-d680-4768-8fa3-acc10922b30d" containerName="extract" Sep 09 23:17:57.605610 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:17:57.605510 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="8cf0ca06-d680-4768-8fa3-acc10922b30d" containerName="extract" Sep 09 23:17:57.605610 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:17:57.605526 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8cf0ca06-d680-4768-8fa3-acc10922b30d" containerName="util" Sep 09 23:17:57.605610 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:17:57.605532 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="8cf0ca06-d680-4768-8fa3-acc10922b30d" containerName="util" Sep 09 23:17:57.605610 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:17:57.605538 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8cf0ca06-d680-4768-8fa3-acc10922b30d" containerName="pull" Sep 09 23:17:57.605610 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:17:57.605544 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="8cf0ca06-d680-4768-8fa3-acc10922b30d" containerName="pull" Sep 09 23:17:57.605610 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:17:57.605605 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="8cf0ca06-d680-4768-8fa3-acc10922b30d" containerName="extract" Sep 09 23:17:57.614083 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:17:57.614062 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-576f68f9bc-nd249" Sep 09 23:17:57.617119 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:17:57.617098 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Sep 09 23:17:57.617241 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:17:57.617159 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Sep 09 23:17:57.617241 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:17:57.617159 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-ll5zx\"" Sep 09 23:17:57.622607 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:17:57.622583 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-576f68f9bc-nd249"] Sep 09 23:17:57.663123 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:17:57.663101 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fa8bc2b3-b8f5-401a-ab8d-d080de3ba60a-tmp\") pod \"kube-auth-proxy-576f68f9bc-nd249\" (UID: \"fa8bc2b3-b8f5-401a-ab8d-d080de3ba60a\") " pod="openshift-ingress/kube-auth-proxy-576f68f9bc-nd249" Sep 09 23:17:57.663255 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:17:57.663148 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fa8bc2b3-b8f5-401a-ab8d-d080de3ba60a-tls-certs\") pod \"kube-auth-proxy-576f68f9bc-nd249\" (UID: \"fa8bc2b3-b8f5-401a-ab8d-d080de3ba60a\") " pod="openshift-ingress/kube-auth-proxy-576f68f9bc-nd249" Sep 09 23:17:57.663255 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:17:57.663183 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fx7r9\" (UniqueName: \"kubernetes.io/projected/fa8bc2b3-b8f5-401a-ab8d-d080de3ba60a-kube-api-access-fx7r9\") pod \"kube-auth-proxy-576f68f9bc-nd249\" (UID: \"fa8bc2b3-b8f5-401a-ab8d-d080de3ba60a\") " pod="openshift-ingress/kube-auth-proxy-576f68f9bc-nd249" Sep 09 23:17:57.764376 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:17:57.764345 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fx7r9\" (UniqueName: \"kubernetes.io/projected/fa8bc2b3-b8f5-401a-ab8d-d080de3ba60a-kube-api-access-fx7r9\") pod \"kube-auth-proxy-576f68f9bc-nd249\" (UID: \"fa8bc2b3-b8f5-401a-ab8d-d080de3ba60a\") " pod="openshift-ingress/kube-auth-proxy-576f68f9bc-nd249" Sep 09 23:17:57.764503 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:17:57.764458 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fa8bc2b3-b8f5-401a-ab8d-d080de3ba60a-tmp\") pod \"kube-auth-proxy-576f68f9bc-nd249\" (UID: \"fa8bc2b3-b8f5-401a-ab8d-d080de3ba60a\") " pod="openshift-ingress/kube-auth-proxy-576f68f9bc-nd249" Sep 09 23:17:57.764563 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:17:57.764518 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fa8bc2b3-b8f5-401a-ab8d-d080de3ba60a-tls-certs\") pod \"kube-auth-proxy-576f68f9bc-nd249\" (UID: \"fa8bc2b3-b8f5-401a-ab8d-d080de3ba60a\") " pod="openshift-ingress/kube-auth-proxy-576f68f9bc-nd249" Sep 09 23:17:57.764624 ip-10-0-132-204 kubenswrapper[2561]: E0909 23:17:57.764613 2561 secret.go:189] Couldn't get secret openshift-ingress/kube-auth-proxy-tls: secret "kube-auth-proxy-tls" not found Sep 09 23:17:57.764708 ip-10-0-132-204 kubenswrapper[2561]: E0909 23:17:57.764695 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fa8bc2b3-b8f5-401a-ab8d-d080de3ba60a-tls-certs podName:fa8bc2b3-b8f5-401a-ab8d-d080de3ba60a nodeName:}" failed. No retries permitted until 2026-09-09 23:17:58.264676011 +0000 UTC m=+586.640250054 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/fa8bc2b3-b8f5-401a-ab8d-d080de3ba60a-tls-certs") pod "kube-auth-proxy-576f68f9bc-nd249" (UID: "fa8bc2b3-b8f5-401a-ab8d-d080de3ba60a") : secret "kube-auth-proxy-tls" not found Sep 09 23:17:57.766872 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:17:57.766852 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fa8bc2b3-b8f5-401a-ab8d-d080de3ba60a-tmp\") pod \"kube-auth-proxy-576f68f9bc-nd249\" (UID: \"fa8bc2b3-b8f5-401a-ab8d-d080de3ba60a\") " pod="openshift-ingress/kube-auth-proxy-576f68f9bc-nd249" Sep 09 23:17:57.782646 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:17:57.782618 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fx7r9\" (UniqueName: \"kubernetes.io/projected/fa8bc2b3-b8f5-401a-ab8d-d080de3ba60a-kube-api-access-fx7r9\") pod \"kube-auth-proxy-576f68f9bc-nd249\" (UID: \"fa8bc2b3-b8f5-401a-ab8d-d080de3ba60a\") " pod="openshift-ingress/kube-auth-proxy-576f68f9bc-nd249" Sep 09 23:17:58.268902 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:17:58.268869 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fa8bc2b3-b8f5-401a-ab8d-d080de3ba60a-tls-certs\") pod \"kube-auth-proxy-576f68f9bc-nd249\" (UID: \"fa8bc2b3-b8f5-401a-ab8d-d080de3ba60a\") " pod="openshift-ingress/kube-auth-proxy-576f68f9bc-nd249" Sep 09 23:17:58.271423 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:17:58.271398 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fa8bc2b3-b8f5-401a-ab8d-d080de3ba60a-tls-certs\") pod \"kube-auth-proxy-576f68f9bc-nd249\" (UID: \"fa8bc2b3-b8f5-401a-ab8d-d080de3ba60a\") " pod="openshift-ingress/kube-auth-proxy-576f68f9bc-nd249" Sep 09 23:17:58.523936 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:17:58.523859 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-576f68f9bc-nd249" Sep 09 23:17:58.798852 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:17:58.798826 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-576f68f9bc-nd249"] Sep 09 23:17:58.801200 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:17:58.801170 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfa8bc2b3_b8f5_401a_ab8d_d080de3ba60a.slice/crio-598adb218aec2827ecd23334999edd5238bb1df21bf0b59c0d2f4ec34f6cfa91 WatchSource:0}: Error finding container 598adb218aec2827ecd23334999edd5238bb1df21bf0b59c0d2f4ec34f6cfa91: Status 404 returned error can't find the container with id 598adb218aec2827ecd23334999edd5238bb1df21bf0b59c0d2f4ec34f6cfa91 Sep 09 23:17:59.003533 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:17:59.003488 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-fs244"] Sep 09 23:17:59.008282 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:17:59.008264 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-fs244" Sep 09 23:17:59.011239 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:17:59.011220 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Sep 09 23:17:59.011360 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:17:59.011220 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Sep 09 23:17:59.011360 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:17:59.011312 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-ww24w\"" Sep 09 23:17:59.011520 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:17:59.011356 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Sep 09 23:17:59.011520 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:17:59.011404 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Sep 09 23:17:59.019862 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:17:59.019841 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-fs244"] Sep 09 23:17:59.075090 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:17:59.075028 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xsscl\" (UniqueName: \"kubernetes.io/projected/5b811a8e-1fb4-4273-8cf4-4ee6c7bf256f-kube-api-access-xsscl\") pod \"istiod-openshift-gateway-7b7995d5cd-fs244\" (UID: \"5b811a8e-1fb4-4273-8cf4-4ee6c7bf256f\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-fs244" Sep 09 23:17:59.075090 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:17:59.075066 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/5b811a8e-1fb4-4273-8cf4-4ee6c7bf256f-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-fs244\" (UID: \"5b811a8e-1fb4-4273-8cf4-4ee6c7bf256f\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-fs244" Sep 09 23:17:59.075090 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:17:59.075089 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5b811a8e-1fb4-4273-8cf4-4ee6c7bf256f-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-fs244\" (UID: \"5b811a8e-1fb4-4273-8cf4-4ee6c7bf256f\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-fs244" Sep 09 23:17:59.075283 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:17:59.075106 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/5b811a8e-1fb4-4273-8cf4-4ee6c7bf256f-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-fs244\" (UID: \"5b811a8e-1fb4-4273-8cf4-4ee6c7bf256f\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-fs244" Sep 09 23:17:59.075283 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:17:59.075167 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/5b811a8e-1fb4-4273-8cf4-4ee6c7bf256f-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-fs244\" (UID: \"5b811a8e-1fb4-4273-8cf4-4ee6c7bf256f\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-fs244" Sep 09 23:17:59.075283 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:17:59.075214 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/5b811a8e-1fb4-4273-8cf4-4ee6c7bf256f-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-fs244\" (UID: \"5b811a8e-1fb4-4273-8cf4-4ee6c7bf256f\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-fs244" Sep 09 23:17:59.075283 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:17:59.075239 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/5b811a8e-1fb4-4273-8cf4-4ee6c7bf256f-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-fs244\" (UID: \"5b811a8e-1fb4-4273-8cf4-4ee6c7bf256f\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-fs244" Sep 09 23:17:59.175662 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:17:59.175630 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/5b811a8e-1fb4-4273-8cf4-4ee6c7bf256f-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-fs244\" (UID: \"5b811a8e-1fb4-4273-8cf4-4ee6c7bf256f\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-fs244" Sep 09 23:17:59.175802 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:17:59.175682 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xsscl\" (UniqueName: \"kubernetes.io/projected/5b811a8e-1fb4-4273-8cf4-4ee6c7bf256f-kube-api-access-xsscl\") pod \"istiod-openshift-gateway-7b7995d5cd-fs244\" (UID: \"5b811a8e-1fb4-4273-8cf4-4ee6c7bf256f\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-fs244" Sep 09 23:17:59.175802 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:17:59.175714 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/5b811a8e-1fb4-4273-8cf4-4ee6c7bf256f-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-fs244\" (UID: \"5b811a8e-1fb4-4273-8cf4-4ee6c7bf256f\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-fs244" Sep 09 23:17:59.175802 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:17:59.175734 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5b811a8e-1fb4-4273-8cf4-4ee6c7bf256f-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-fs244\" (UID: \"5b811a8e-1fb4-4273-8cf4-4ee6c7bf256f\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-fs244" Sep 09 23:17:59.175802 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:17:59.175750 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/5b811a8e-1fb4-4273-8cf4-4ee6c7bf256f-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-fs244\" (UID: \"5b811a8e-1fb4-4273-8cf4-4ee6c7bf256f\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-fs244" Sep 09 23:17:59.175802 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:17:59.175778 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/5b811a8e-1fb4-4273-8cf4-4ee6c7bf256f-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-fs244\" (UID: \"5b811a8e-1fb4-4273-8cf4-4ee6c7bf256f\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-fs244" Sep 09 23:17:59.176038 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:17:59.175818 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/5b811a8e-1fb4-4273-8cf4-4ee6c7bf256f-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-fs244\" (UID: \"5b811a8e-1fb4-4273-8cf4-4ee6c7bf256f\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-fs244" Sep 09 23:17:59.176304 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:17:59.176278 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/5b811a8e-1fb4-4273-8cf4-4ee6c7bf256f-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-fs244\" (UID: \"5b811a8e-1fb4-4273-8cf4-4ee6c7bf256f\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-fs244" Sep 09 23:17:59.178167 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:17:59.178143 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/5b811a8e-1fb4-4273-8cf4-4ee6c7bf256f-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-fs244\" (UID: \"5b811a8e-1fb4-4273-8cf4-4ee6c7bf256f\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-fs244" Sep 09 23:17:59.178357 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:17:59.178341 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/5b811a8e-1fb4-4273-8cf4-4ee6c7bf256f-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-fs244\" (UID: \"5b811a8e-1fb4-4273-8cf4-4ee6c7bf256f\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-fs244" Sep 09 23:17:59.178428 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:17:59.178413 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/5b811a8e-1fb4-4273-8cf4-4ee6c7bf256f-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-fs244\" (UID: \"5b811a8e-1fb4-4273-8cf4-4ee6c7bf256f\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-fs244" Sep 09 23:17:59.178594 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:17:59.178575 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/5b811a8e-1fb4-4273-8cf4-4ee6c7bf256f-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-fs244\" (UID: \"5b811a8e-1fb4-4273-8cf4-4ee6c7bf256f\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-fs244" Sep 09 23:17:59.184037 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:17:59.184019 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5b811a8e-1fb4-4273-8cf4-4ee6c7bf256f-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-fs244\" (UID: \"5b811a8e-1fb4-4273-8cf4-4ee6c7bf256f\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-fs244" Sep 09 23:17:59.184804 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:17:59.184781 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xsscl\" (UniqueName: \"kubernetes.io/projected/5b811a8e-1fb4-4273-8cf4-4ee6c7bf256f-kube-api-access-xsscl\") pod \"istiod-openshift-gateway-7b7995d5cd-fs244\" (UID: \"5b811a8e-1fb4-4273-8cf4-4ee6c7bf256f\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-fs244" Sep 09 23:17:59.318338 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:17:59.318299 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-fs244" Sep 09 23:17:59.549686 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:17:59.549645 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-576f68f9bc-nd249" event={"ID":"fa8bc2b3-b8f5-401a-ab8d-d080de3ba60a","Type":"ContainerStarted","Data":"598adb218aec2827ecd23334999edd5238bb1df21bf0b59c0d2f4ec34f6cfa91"} Sep 09 23:17:59.606570 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:17:59.606331 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-fs244"] Sep 09 23:17:59.609468 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:17:59.609427 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5b811a8e_1fb4_4273_8cf4_4ee6c7bf256f.slice/crio-8715cefd4e24b94cc30f7154756feb190473da0565be8d5f604bfd69911a95b8 WatchSource:0}: Error finding container 8715cefd4e24b94cc30f7154756feb190473da0565be8d5f604bfd69911a95b8: Status 404 returned error can't find the container with id 8715cefd4e24b94cc30f7154756feb190473da0565be8d5f604bfd69911a95b8 Sep 09 23:18:00.556952 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:18:00.556907 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-fs244" event={"ID":"5b811a8e-1fb4-4273-8cf4-4ee6c7bf256f","Type":"ContainerStarted","Data":"8715cefd4e24b94cc30f7154756feb190473da0565be8d5f604bfd69911a95b8"} Sep 09 23:18:01.565730 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:18:01.565683 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-576f68f9bc-nd249" event={"ID":"fa8bc2b3-b8f5-401a-ab8d-d080de3ba60a","Type":"ContainerStarted","Data":"217c742d551decd57840d593891610b4524c7206673eba2e6c968b68148c9a20"} Sep 09 23:18:01.588270 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:18:01.588197 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-576f68f9bc-nd249" podStartSLOduration=1.946667742 podStartE2EDuration="4.588177131s" totalImagesPullingTime="2.641509389s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:17:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:18:01.586967599 +0000 UTC m=+589.962541665" watchObservedRunningTime="2026-09-09 23:18:01.588177131 +0000 UTC m=+589.963751194" Sep 09 23:18:03.269051 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:18:03.269011 2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"} Sep 09 23:18:03.269431 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:18:03.269118 2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"} Sep 09 23:18:03.579886 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:18:03.579789 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-fs244" event={"ID":"5b811a8e-1fb4-4273-8cf4-4ee6c7bf256f","Type":"ContainerStarted","Data":"1ebc504eabf8459b68c03f997dc6ec1c6e202fb97ef7e806723768ff34dbb658"} Sep 09 23:18:03.580031 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:18:03.579936 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-fs244" Sep 09 23:18:03.602660 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:18:03.602606 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-fs244" podStartSLOduration=1.94601039 podStartE2EDuration="5.602588306s" totalImagesPullingTime="3.656577916s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:17:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:18:03.599275981 +0000 UTC m=+591.974850042" watchObservedRunningTime="2026-09-09 23:18:03.602588306 +0000 UTC m=+591.978162369" Sep 09 23:18:04.587010 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:18:04.586977 2561 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7b7995d5cd-fs244 container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Sep 09 23:18:04.587391 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:18:04.587027 2561 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-fs244" podUID="5b811a8e-1fb4-4273-8cf4-4ee6c7bf256f" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503" Sep 09 23:18:07.586058 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:18:07.586022 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-fs244" Sep 09 23:18:12.120986 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:18:12.120955 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pl5tw_6942a2c5-1a59-4ea7-b78d-d131103de85f/ovn-acl-logging/0.log" Sep 09 23:18:12.121903 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:18:12.121883 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pl5tw_6942a2c5-1a59-4ea7-b78d-d131103de85f/ovn-acl-logging/0.log" Sep 09 23:18:15.604145 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:18:15.604100 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5f9b59867f-7b784"] Sep 09 23:18:15.609550 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:18:15.609535 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5f9b59867f-7b784" Sep 09 23:18:15.635745 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:18:15.635721 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-66c6d9b8f-2bz5h"] Sep 09 23:18:15.639077 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:18:15.639057 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-66c6d9b8f-2bz5h" Sep 09 23:18:15.649385 ip-10-0-132-204 kubenswrapper[2561]: E0909 23:18:15.649350 2561 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"webhook-server-cert\" is forbidden: User \"system:node:ip-10-0-132-204.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-lws-operator\": no relationship found between node 'ip-10-0-132-204.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" type="*v1.Secret" Sep 09 23:18:15.651587 ip-10-0-132-204 kubenswrapper[2561]: E0909 23:18:15.651561 2561 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"lws-controller-manager-dockercfg-4dpxv\" is forbidden: User \"system:node:ip-10-0-132-204.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-lws-operator\": no relationship found between node 'ip-10-0-132-204.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-4dpxv\"" type="*v1.Secret" Sep 09 23:18:15.651743 ip-10-0-132-204 kubenswrapper[2561]: E0909 23:18:15.651726 2561 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"metrics-server-cert\" is forbidden: User \"system:node:ip-10-0-132-204.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-lws-operator\": no relationship found between node 'ip-10-0-132-204.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" type="*v1.Secret" Sep 09 23:18:15.651743 ip-10-0-132-204 kubenswrapper[2561]: E0909 23:18:15.651731 2561 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"lws-manager-config\" is forbidden: User \"system:node:ip-10-0-132-204.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"openshift-lws-operator\": no relationship found between node 'ip-10-0-132-204.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" type="*v1.ConfigMap" Sep 09 23:18:15.675257 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:18:15.675229 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5f9b59867f-7b784"] Sep 09 23:18:15.695488 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:18:15.695464 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-66c6d9b8f-2bz5h"] Sep 09 23:18:15.729659 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:18:15.729632 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/04245465-cec9-49e3-a976-60a47338b1a4-cert\") pod \"lws-controller-manager-66c6d9b8f-2bz5h\" (UID: \"04245465-cec9-49e3-a976-60a47338b1a4\") " pod="openshift-lws-operator/lws-controller-manager-66c6d9b8f-2bz5h" Sep 09 23:18:15.729784 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:18:15.729668 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/04245465-cec9-49e3-a976-60a47338b1a4-manager-config\") pod \"lws-controller-manager-66c6d9b8f-2bz5h\" (UID: \"04245465-cec9-49e3-a976-60a47338b1a4\") " pod="openshift-lws-operator/lws-controller-manager-66c6d9b8f-2bz5h" Sep 09 23:18:15.729784 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:18:15.729685 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/54d5dfe2-6f96-448d-959e-43b6dce9275b-trusted-ca-bundle\") pod \"console-5f9b59867f-7b784\" (UID: \"54d5dfe2-6f96-448d-959e-43b6dce9275b\") " pod="openshift-console/console-5f9b59867f-7b784" Sep 09 23:18:15.729784 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:18:15.729705 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/54d5dfe2-6f96-448d-959e-43b6dce9275b-console-serving-cert\") pod \"console-5f9b59867f-7b784\" (UID: \"54d5dfe2-6f96-448d-959e-43b6dce9275b\") " pod="openshift-console/console-5f9b59867f-7b784" Sep 09 23:18:15.729886 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:18:15.729780 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/54d5dfe2-6f96-448d-959e-43b6dce9275b-console-oauth-config\") pod \"console-5f9b59867f-7b784\" (UID: \"54d5dfe2-6f96-448d-959e-43b6dce9275b\") " pod="openshift-console/console-5f9b59867f-7b784" Sep 09 23:18:15.729886 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:18:15.729821 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8gr7w\" (UniqueName: \"kubernetes.io/projected/04245465-cec9-49e3-a976-60a47338b1a4-kube-api-access-8gr7w\") pod \"lws-controller-manager-66c6d9b8f-2bz5h\" (UID: \"04245465-cec9-49e3-a976-60a47338b1a4\") " pod="openshift-lws-operator/lws-controller-manager-66c6d9b8f-2bz5h" Sep 09 23:18:15.729886 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:18:15.729844 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/54d5dfe2-6f96-448d-959e-43b6dce9275b-service-ca\") pod \"console-5f9b59867f-7b784\" (UID: \"54d5dfe2-6f96-448d-959e-43b6dce9275b\") " pod="openshift-console/console-5f9b59867f-7b784" Sep 09 23:18:15.729886 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:18:15.729876 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/54d5dfe2-6f96-448d-959e-43b6dce9275b-oauth-serving-cert\") pod \"console-5f9b59867f-7b784\" (UID: \"54d5dfe2-6f96-448d-959e-43b6dce9275b\") " pod="openshift-console/console-5f9b59867f-7b784" Sep 09 23:18:15.730002 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:18:15.729945 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hhvht\" (UniqueName: \"kubernetes.io/projected/54d5dfe2-6f96-448d-959e-43b6dce9275b-kube-api-access-hhvht\") pod \"console-5f9b59867f-7b784\" (UID: \"54d5dfe2-6f96-448d-959e-43b6dce9275b\") " pod="openshift-console/console-5f9b59867f-7b784" Sep 09 23:18:15.730002 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:18:15.729983 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/54d5dfe2-6f96-448d-959e-43b6dce9275b-console-config\") pod \"console-5f9b59867f-7b784\" (UID: \"54d5dfe2-6f96-448d-959e-43b6dce9275b\") " pod="openshift-console/console-5f9b59867f-7b784" Sep 09 23:18:15.730064 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:18:15.730016 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/04245465-cec9-49e3-a976-60a47338b1a4-metrics-cert\") pod \"lws-controller-manager-66c6d9b8f-2bz5h\" (UID: \"04245465-cec9-49e3-a976-60a47338b1a4\") " pod="openshift-lws-operator/lws-controller-manager-66c6d9b8f-2bz5h" Sep 09 23:18:15.830480 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:18:15.830446 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/54d5dfe2-6f96-448d-959e-43b6dce9275b-console-oauth-config\") pod \"console-5f9b59867f-7b784\" (UID: \"54d5dfe2-6f96-448d-959e-43b6dce9275b\") " pod="openshift-console/console-5f9b59867f-7b784" Sep 09 23:18:15.830658 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:18:15.830491 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8gr7w\" (UniqueName: \"kubernetes.io/projected/04245465-cec9-49e3-a976-60a47338b1a4-kube-api-access-8gr7w\") pod \"lws-controller-manager-66c6d9b8f-2bz5h\" (UID: \"04245465-cec9-49e3-a976-60a47338b1a4\") " pod="openshift-lws-operator/lws-controller-manager-66c6d9b8f-2bz5h" Sep 09 23:18:15.830658 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:18:15.830508 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/54d5dfe2-6f96-448d-959e-43b6dce9275b-service-ca\") pod \"console-5f9b59867f-7b784\" (UID: \"54d5dfe2-6f96-448d-959e-43b6dce9275b\") " pod="openshift-console/console-5f9b59867f-7b784" Sep 09 23:18:15.830658 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:18:15.830531 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/54d5dfe2-6f96-448d-959e-43b6dce9275b-oauth-serving-cert\") pod \"console-5f9b59867f-7b784\" (UID: \"54d5dfe2-6f96-448d-959e-43b6dce9275b\") " pod="openshift-console/console-5f9b59867f-7b784" Sep 09 23:18:15.830658 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:18:15.830561 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hhvht\" (UniqueName: \"kubernetes.io/projected/54d5dfe2-6f96-448d-959e-43b6dce9275b-kube-api-access-hhvht\") pod \"console-5f9b59867f-7b784\" (UID: \"54d5dfe2-6f96-448d-959e-43b6dce9275b\") " pod="openshift-console/console-5f9b59867f-7b784" Sep 09 23:18:15.830658 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:18:15.830585 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/54d5dfe2-6f96-448d-959e-43b6dce9275b-console-config\") pod \"console-5f9b59867f-7b784\" (UID: \"54d5dfe2-6f96-448d-959e-43b6dce9275b\") " pod="openshift-console/console-5f9b59867f-7b784" Sep 09 23:18:15.830658 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:18:15.830605 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/04245465-cec9-49e3-a976-60a47338b1a4-metrics-cert\") pod \"lws-controller-manager-66c6d9b8f-2bz5h\" (UID: \"04245465-cec9-49e3-a976-60a47338b1a4\") " pod="openshift-lws-operator/lws-controller-manager-66c6d9b8f-2bz5h" Sep 09 23:18:15.830658 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:18:15.830650 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/04245465-cec9-49e3-a976-60a47338b1a4-cert\") pod \"lws-controller-manager-66c6d9b8f-2bz5h\" (UID: \"04245465-cec9-49e3-a976-60a47338b1a4\") " pod="openshift-lws-operator/lws-controller-manager-66c6d9b8f-2bz5h" Sep 09 23:18:15.830958 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:18:15.830687 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/04245465-cec9-49e3-a976-60a47338b1a4-manager-config\") pod \"lws-controller-manager-66c6d9b8f-2bz5h\" (UID: \"04245465-cec9-49e3-a976-60a47338b1a4\") " pod="openshift-lws-operator/lws-controller-manager-66c6d9b8f-2bz5h" Sep 09 23:18:15.830958 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:18:15.830710 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/54d5dfe2-6f96-448d-959e-43b6dce9275b-trusted-ca-bundle\") pod \"console-5f9b59867f-7b784\" (UID: \"54d5dfe2-6f96-448d-959e-43b6dce9275b\") " pod="openshift-console/console-5f9b59867f-7b784" Sep 09 23:18:15.830958 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:18:15.830814 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/54d5dfe2-6f96-448d-959e-43b6dce9275b-console-serving-cert\") pod \"console-5f9b59867f-7b784\" (UID: \"54d5dfe2-6f96-448d-959e-43b6dce9275b\") " pod="openshift-console/console-5f9b59867f-7b784" Sep 09 23:18:15.831609 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:18:15.831583 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/54d5dfe2-6f96-448d-959e-43b6dce9275b-service-ca\") pod \"console-5f9b59867f-7b784\" (UID: \"54d5dfe2-6f96-448d-959e-43b6dce9275b\") " pod="openshift-console/console-5f9b59867f-7b784" Sep 09 23:18:15.831741 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:18:15.831636 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/54d5dfe2-6f96-448d-959e-43b6dce9275b-oauth-serving-cert\") pod \"console-5f9b59867f-7b784\" (UID: \"54d5dfe2-6f96-448d-959e-43b6dce9275b\") " pod="openshift-console/console-5f9b59867f-7b784" Sep 09 23:18:15.831812 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:18:15.831762 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/54d5dfe2-6f96-448d-959e-43b6dce9275b-trusted-ca-bundle\") pod \"console-5f9b59867f-7b784\" (UID: \"54d5dfe2-6f96-448d-959e-43b6dce9275b\") " pod="openshift-console/console-5f9b59867f-7b784" Sep 09 23:18:15.831882 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:18:15.831862 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/54d5dfe2-6f96-448d-959e-43b6dce9275b-console-config\") pod \"console-5f9b59867f-7b784\" (UID: \"54d5dfe2-6f96-448d-959e-43b6dce9275b\") " pod="openshift-console/console-5f9b59867f-7b784" Sep 09 23:18:15.833146 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:18:15.833127 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/54d5dfe2-6f96-448d-959e-43b6dce9275b-console-oauth-config\") pod \"console-5f9b59867f-7b784\" (UID: \"54d5dfe2-6f96-448d-959e-43b6dce9275b\") " pod="openshift-console/console-5f9b59867f-7b784" Sep 09 23:18:15.833500 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:18:15.833480 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/54d5dfe2-6f96-448d-959e-43b6dce9275b-console-serving-cert\") pod \"console-5f9b59867f-7b784\" (UID: \"54d5dfe2-6f96-448d-959e-43b6dce9275b\") " pod="openshift-console/console-5f9b59867f-7b784" Sep 09 23:18:15.840152 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:18:15.840129 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8gr7w\" (UniqueName: \"kubernetes.io/projected/04245465-cec9-49e3-a976-60a47338b1a4-kube-api-access-8gr7w\") pod \"lws-controller-manager-66c6d9b8f-2bz5h\" (UID: \"04245465-cec9-49e3-a976-60a47338b1a4\") " pod="openshift-lws-operator/lws-controller-manager-66c6d9b8f-2bz5h" Sep 09 23:18:15.842776 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:18:15.842755 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hhvht\" (UniqueName: \"kubernetes.io/projected/54d5dfe2-6f96-448d-959e-43b6dce9275b-kube-api-access-hhvht\") pod \"console-5f9b59867f-7b784\" (UID: \"54d5dfe2-6f96-448d-959e-43b6dce9275b\") " pod="openshift-console/console-5f9b59867f-7b784" Sep 09 23:18:15.919117 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:18:15.919060 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5f9b59867f-7b784" Sep 09 23:18:16.208746 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:18:16.208686 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5f9b59867f-7b784"] Sep 09 23:18:16.210708 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:18:16.210685 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod54d5dfe2_6f96_448d_959e_43b6dce9275b.slice/crio-ab380a2c8d29196271269e8a88adbdbd61cfd719cabe188c1fcdf1953de17a27 WatchSource:0}: Error finding container ab380a2c8d29196271269e8a88adbdbd61cfd719cabe188c1fcdf1953de17a27: Status 404 returned error can't find the container with id ab380a2c8d29196271269e8a88adbdbd61cfd719cabe188c1fcdf1953de17a27 Sep 09 23:18:16.646431 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:18:16.646395 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5f9b59867f-7b784" event={"ID":"54d5dfe2-6f96-448d-959e-43b6dce9275b","Type":"ContainerStarted","Data":"f5485378b14a4950fcd7210073c9ee35da89d3e7da663e70f32b44a6bce6e2a7"} Sep 09 23:18:16.646877 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:18:16.646452 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5f9b59867f-7b784" event={"ID":"54d5dfe2-6f96-448d-959e-43b6dce9275b","Type":"ContainerStarted","Data":"ab380a2c8d29196271269e8a88adbdbd61cfd719cabe188c1fcdf1953de17a27"} Sep 09 23:18:16.689267 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:18:16.689220 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5f9b59867f-7b784" podStartSLOduration=1.689204634 podStartE2EDuration="1.689204634s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:18:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:18:16.687469964 +0000 UTC m=+605.063044036" watchObservedRunningTime="2026-09-09 23:18:16.689204634 +0000 UTC m=+605.064778696" Sep 09 23:18:16.726600 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:18:16.726572 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-4dpxv\"" Sep 09 23:18:16.805275 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:18:16.805249 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Sep 09 23:18:16.813361 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:18:16.813332 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/04245465-cec9-49e3-a976-60a47338b1a4-cert\") pod \"lws-controller-manager-66c6d9b8f-2bz5h\" (UID: \"04245465-cec9-49e3-a976-60a47338b1a4\") " pod="openshift-lws-operator/lws-controller-manager-66c6d9b8f-2bz5h" Sep 09 23:18:16.831281 ip-10-0-132-204 kubenswrapper[2561]: E0909 23:18:16.831261 2561 configmap.go:193] Couldn't get configMap openshift-lws-operator/lws-manager-config: failed to sync configmap cache: timed out waiting for the condition Sep 09 23:18:16.831349 ip-10-0-132-204 kubenswrapper[2561]: E0909 23:18:16.831336 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/04245465-cec9-49e3-a976-60a47338b1a4-manager-config podName:04245465-cec9-49e3-a976-60a47338b1a4 nodeName:}" failed. No retries permitted until 2026-09-09 23:18:17.331321951 +0000 UTC m=+605.706895991 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "manager-config" (UniqueName: "kubernetes.io/configmap/04245465-cec9-49e3-a976-60a47338b1a4-manager-config") pod "lws-controller-manager-66c6d9b8f-2bz5h" (UID: "04245465-cec9-49e3-a976-60a47338b1a4") : failed to sync configmap cache: timed out waiting for the condition Sep 09 23:18:16.831423 ip-10-0-132-204 kubenswrapper[2561]: E0909 23:18:16.831261 2561 secret.go:189] Couldn't get secret openshift-lws-operator/metrics-server-cert: failed to sync secret cache: timed out waiting for the condition Sep 09 23:18:16.831423 ip-10-0-132-204 kubenswrapper[2561]: E0909 23:18:16.831411 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/04245465-cec9-49e3-a976-60a47338b1a4-metrics-cert podName:04245465-cec9-49e3-a976-60a47338b1a4 nodeName:}" failed. No retries permitted until 2026-09-09 23:18:17.3313988 +0000 UTC m=+605.706972859 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-cert" (UniqueName: "kubernetes.io/secret/04245465-cec9-49e3-a976-60a47338b1a4-metrics-cert") pod "lws-controller-manager-66c6d9b8f-2bz5h" (UID: "04245465-cec9-49e3-a976-60a47338b1a4") : failed to sync secret cache: timed out waiting for the condition Sep 09 23:18:17.011816 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:18:17.011786 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Sep 09 23:18:17.230841 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:18:17.230817 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Sep 09 23:18:17.351212 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:18:17.351111 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/04245465-cec9-49e3-a976-60a47338b1a4-metrics-cert\") pod \"lws-controller-manager-66c6d9b8f-2bz5h\" (UID: \"04245465-cec9-49e3-a976-60a47338b1a4\") " pod="openshift-lws-operator/lws-controller-manager-66c6d9b8f-2bz5h" Sep 09 23:18:17.351212 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:18:17.351168 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/04245465-cec9-49e3-a976-60a47338b1a4-manager-config\") pod \"lws-controller-manager-66c6d9b8f-2bz5h\" (UID: \"04245465-cec9-49e3-a976-60a47338b1a4\") " pod="openshift-lws-operator/lws-controller-manager-66c6d9b8f-2bz5h" Sep 09 23:18:17.351765 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:18:17.351743 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/04245465-cec9-49e3-a976-60a47338b1a4-manager-config\") pod \"lws-controller-manager-66c6d9b8f-2bz5h\" (UID: \"04245465-cec9-49e3-a976-60a47338b1a4\") " pod="openshift-lws-operator/lws-controller-manager-66c6d9b8f-2bz5h" Sep 09 23:18:17.353745 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:18:17.353717 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/04245465-cec9-49e3-a976-60a47338b1a4-metrics-cert\") pod \"lws-controller-manager-66c6d9b8f-2bz5h\" (UID: \"04245465-cec9-49e3-a976-60a47338b1a4\") " pod="openshift-lws-operator/lws-controller-manager-66c6d9b8f-2bz5h" Sep 09 23:18:17.447808 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:18:17.447777 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-66c6d9b8f-2bz5h" Sep 09 23:18:17.766606 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:18:17.766575 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-66c6d9b8f-2bz5h"] Sep 09 23:18:17.771156 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:18:17.771128 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod04245465_cec9_49e3_a976_60a47338b1a4.slice/crio-75b2c036bea3039cf923462b6760770530011a8f4a8ffd4dae04250124ec929d WatchSource:0}: Error finding container 75b2c036bea3039cf923462b6760770530011a8f4a8ffd4dae04250124ec929d: Status 404 returned error can't find the container with id 75b2c036bea3039cf923462b6760770530011a8f4a8ffd4dae04250124ec929d Sep 09 23:18:17.773120 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:18:17.773104 2561 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 09 23:18:18.658981 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:18:18.658945 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-66c6d9b8f-2bz5h" event={"ID":"04245465-cec9-49e3-a976-60a47338b1a4","Type":"ContainerStarted","Data":"75b2c036bea3039cf923462b6760770530011a8f4a8ffd4dae04250124ec929d"} Sep 09 23:18:19.665690 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:18:19.665653 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-66c6d9b8f-2bz5h" event={"ID":"04245465-cec9-49e3-a976-60a47338b1a4","Type":"ContainerStarted","Data":"4f652382ab8469e6340c93314efb89f5245c8b8c6fdcf7d0a4c5d1ef93878c49"} Sep 09 23:18:19.666085 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:18:19.665769 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-66c6d9b8f-2bz5h" Sep 09 23:18:19.683174 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:18:19.683133 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-66c6d9b8f-2bz5h" podStartSLOduration=3.285544099 podStartE2EDuration="4.683119853s" totalImagesPullingTime="1.397575754s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:18:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:18:19.681250726 +0000 UTC m=+608.056824789" watchObservedRunningTime="2026-09-09 23:18:19.683119853 +0000 UTC m=+608.058693915" Sep 09 23:18:19.784237 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:18:19.784203 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-fs244"] Sep 09 23:18:19.784433 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:18:19.784411 2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-fs244" podUID="5b811a8e-1fb4-4273-8cf4-4ee6c7bf256f" containerName="discovery" containerID="cri-o://1ebc504eabf8459b68c03f997dc6ec1c6e202fb97ef7e806723768ff34dbb658" gracePeriod=30 Sep 09 23:18:20.022419 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:18:20.022395 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-fs244" Sep 09 23:18:20.076683 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:18:20.076650 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xsscl\" (UniqueName: \"kubernetes.io/projected/5b811a8e-1fb4-4273-8cf4-4ee6c7bf256f-kube-api-access-xsscl\") pod \"5b811a8e-1fb4-4273-8cf4-4ee6c7bf256f\" (UID: \"5b811a8e-1fb4-4273-8cf4-4ee6c7bf256f\") " Sep 09 23:18:20.076683 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:18:20.076689 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/5b811a8e-1fb4-4273-8cf4-4ee6c7bf256f-istio-csr-dns-cert\") pod \"5b811a8e-1fb4-4273-8cf4-4ee6c7bf256f\" (UID: \"5b811a8e-1fb4-4273-8cf4-4ee6c7bf256f\") " Sep 09 23:18:20.076942 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:18:20.076723 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/5b811a8e-1fb4-4273-8cf4-4ee6c7bf256f-local-certs\") pod \"5b811a8e-1fb4-4273-8cf4-4ee6c7bf256f\" (UID: \"5b811a8e-1fb4-4273-8cf4-4ee6c7bf256f\") " Sep 09 23:18:20.076942 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:18:20.076746 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/5b811a8e-1fb4-4273-8cf4-4ee6c7bf256f-istio-kubeconfig\") pod \"5b811a8e-1fb4-4273-8cf4-4ee6c7bf256f\" (UID: \"5b811a8e-1fb4-4273-8cf4-4ee6c7bf256f\") " Sep 09 23:18:20.076942 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:18:20.076866 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/5b811a8e-1fb4-4273-8cf4-4ee6c7bf256f-istio-csr-ca-configmap\") pod \"5b811a8e-1fb4-4273-8cf4-4ee6c7bf256f\" (UID: \"5b811a8e-1fb4-4273-8cf4-4ee6c7bf256f\") " Sep 09 23:18:20.077110 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:18:20.076957 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/5b811a8e-1fb4-4273-8cf4-4ee6c7bf256f-cacerts\") pod \"5b811a8e-1fb4-4273-8cf4-4ee6c7bf256f\" (UID: \"5b811a8e-1fb4-4273-8cf4-4ee6c7bf256f\") " Sep 09 23:18:20.077110 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:18:20.077027 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5b811a8e-1fb4-4273-8cf4-4ee6c7bf256f-istio-token\") pod \"5b811a8e-1fb4-4273-8cf4-4ee6c7bf256f\" (UID: \"5b811a8e-1fb4-4273-8cf4-4ee6c7bf256f\") " Sep 09 23:18:20.077348 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:18:20.077310 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5b811a8e-1fb4-4273-8cf4-4ee6c7bf256f-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "5b811a8e-1fb4-4273-8cf4-4ee6c7bf256f" (UID: "5b811a8e-1fb4-4273-8cf4-4ee6c7bf256f"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 09 23:18:20.077503 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:18:20.077465 2561 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/5b811a8e-1fb4-4273-8cf4-4ee6c7bf256f-istio-csr-ca-configmap\") on node \"ip-10-0-132-204.ec2.internal\" DevicePath \"\"" Sep 09 23:18:20.079470 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:18:20.079438 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5b811a8e-1fb4-4273-8cf4-4ee6c7bf256f-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "5b811a8e-1fb4-4273-8cf4-4ee6c7bf256f" (UID: "5b811a8e-1fb4-4273-8cf4-4ee6c7bf256f"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 09 23:18:20.079600 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:18:20.079575 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5b811a8e-1fb4-4273-8cf4-4ee6c7bf256f-istio-token" (OuterVolumeSpecName: "istio-token") pod "5b811a8e-1fb4-4273-8cf4-4ee6c7bf256f" (UID: "5b811a8e-1fb4-4273-8cf4-4ee6c7bf256f"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 09 23:18:20.079744 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:18:20.079729 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5b811a8e-1fb4-4273-8cf4-4ee6c7bf256f-kube-api-access-xsscl" (OuterVolumeSpecName: "kube-api-access-xsscl") pod "5b811a8e-1fb4-4273-8cf4-4ee6c7bf256f" (UID: "5b811a8e-1fb4-4273-8cf4-4ee6c7bf256f"). InnerVolumeSpecName "kube-api-access-xsscl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 09 23:18:20.079800 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:18:20.079778 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5b811a8e-1fb4-4273-8cf4-4ee6c7bf256f-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "5b811a8e-1fb4-4273-8cf4-4ee6c7bf256f" (UID: "5b811a8e-1fb4-4273-8cf4-4ee6c7bf256f"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 09 23:18:20.079845 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:18:20.079797 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5b811a8e-1fb4-4273-8cf4-4ee6c7bf256f-cacerts" (OuterVolumeSpecName: "cacerts") pod "5b811a8e-1fb4-4273-8cf4-4ee6c7bf256f" (UID: "5b811a8e-1fb4-4273-8cf4-4ee6c7bf256f"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 09 23:18:20.079918 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:18:20.079906 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5b811a8e-1fb4-4273-8cf4-4ee6c7bf256f-local-certs" (OuterVolumeSpecName: "local-certs") pod "5b811a8e-1fb4-4273-8cf4-4ee6c7bf256f" (UID: "5b811a8e-1fb4-4273-8cf4-4ee6c7bf256f"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 09 23:18:20.178623 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:18:20.178591 2561 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/5b811a8e-1fb4-4273-8cf4-4ee6c7bf256f-local-certs\") on node \"ip-10-0-132-204.ec2.internal\" DevicePath \"\"" Sep 09 23:18:20.178623 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:18:20.178623 2561 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/5b811a8e-1fb4-4273-8cf4-4ee6c7bf256f-istio-kubeconfig\") on node \"ip-10-0-132-204.ec2.internal\" DevicePath \"\"" Sep 09 23:18:20.178795 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:18:20.178634 2561 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/5b811a8e-1fb4-4273-8cf4-4ee6c7bf256f-cacerts\") on node \"ip-10-0-132-204.ec2.internal\" DevicePath \"\"" Sep 09 23:18:20.178795 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:18:20.178646 2561 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5b811a8e-1fb4-4273-8cf4-4ee6c7bf256f-istio-token\") on node \"ip-10-0-132-204.ec2.internal\" DevicePath \"\"" Sep 09 23:18:20.178795 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:18:20.178660 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xsscl\" (UniqueName: \"kubernetes.io/projected/5b811a8e-1fb4-4273-8cf4-4ee6c7bf256f-kube-api-access-xsscl\") on node \"ip-10-0-132-204.ec2.internal\" DevicePath \"\"" Sep 09 23:18:20.178795 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:18:20.178671 2561 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/5b811a8e-1fb4-4273-8cf4-4ee6c7bf256f-istio-csr-dns-cert\") on node \"ip-10-0-132-204.ec2.internal\" DevicePath \"\"" Sep 09 23:18:20.672422 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:18:20.672386 2561 generic.go:356] "Generic (PLEG): container finished" podID="5b811a8e-1fb4-4273-8cf4-4ee6c7bf256f" containerID="1ebc504eabf8459b68c03f997dc6ec1c6e202fb97ef7e806723768ff34dbb658" exitCode=0 Sep 09 23:18:20.672422 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:18:20.672425 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-fs244" Sep 09 23:18:20.672924 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:18:20.672479 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-fs244" event={"ID":"5b811a8e-1fb4-4273-8cf4-4ee6c7bf256f","Type":"ContainerDied","Data":"1ebc504eabf8459b68c03f997dc6ec1c6e202fb97ef7e806723768ff34dbb658"} Sep 09 23:18:20.672924 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:18:20.672549 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-fs244" event={"ID":"5b811a8e-1fb4-4273-8cf4-4ee6c7bf256f","Type":"ContainerDied","Data":"8715cefd4e24b94cc30f7154756feb190473da0565be8d5f604bfd69911a95b8"} Sep 09 23:18:20.672924 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:18:20.672582 2561 scope.go:117] "RemoveContainer" containerID="1ebc504eabf8459b68c03f997dc6ec1c6e202fb97ef7e806723768ff34dbb658" Sep 09 23:18:20.681496 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:18:20.681478 2561 scope.go:117] "RemoveContainer" containerID="1ebc504eabf8459b68c03f997dc6ec1c6e202fb97ef7e806723768ff34dbb658" Sep 09 23:18:20.681778 ip-10-0-132-204 kubenswrapper[2561]: E0909 23:18:20.681756 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1ebc504eabf8459b68c03f997dc6ec1c6e202fb97ef7e806723768ff34dbb658\": container with ID starting with 1ebc504eabf8459b68c03f997dc6ec1c6e202fb97ef7e806723768ff34dbb658 not found: ID does not exist" containerID="1ebc504eabf8459b68c03f997dc6ec1c6e202fb97ef7e806723768ff34dbb658" Sep 09 23:18:20.681853 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:18:20.681785 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1ebc504eabf8459b68c03f997dc6ec1c6e202fb97ef7e806723768ff34dbb658"} err="failed to get container status \"1ebc504eabf8459b68c03f997dc6ec1c6e202fb97ef7e806723768ff34dbb658\": rpc error: code = NotFound desc = could not find container \"1ebc504eabf8459b68c03f997dc6ec1c6e202fb97ef7e806723768ff34dbb658\": container with ID starting with 1ebc504eabf8459b68c03f997dc6ec1c6e202fb97ef7e806723768ff34dbb658 not found: ID does not exist" Sep 09 23:18:20.692294 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:18:20.692266 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-fs244"] Sep 09 23:18:20.695661 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:18:20.695639 2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-fs244"] Sep 09 23:18:22.116888 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:18:22.116854 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5b811a8e-1fb4-4273-8cf4-4ee6c7bf256f" path="/var/lib/kubelet/pods/5b811a8e-1fb4-4273-8cf4-4ee6c7bf256f/volumes" Sep 09 23:18:25.919465 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:18:25.919434 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5f9b59867f-7b784" Sep 09 23:18:25.919844 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:18:25.919481 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5f9b59867f-7b784" Sep 09 23:18:25.924218 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:18:25.924196 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5f9b59867f-7b784" Sep 09 23:18:26.706239 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:18:26.706209 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5f9b59867f-7b784" Sep 09 23:18:26.753546 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:18:26.753515 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7989569fb4-4t2qm"] Sep 09 23:18:30.674932 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:18:30.674901 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-66c6d9b8f-2bz5h" Sep 09 23:18:51.776124 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:18:51.776078 2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-7989569fb4-4t2qm" podUID="8a08013e-082b-41ce-92f8-2ea8be10a5d2" containerName="console" containerID="cri-o://b6073f69fac7841521253a4211c70b6cb5bbfeb9d5f2a5a7e7815fc34a794605" gracePeriod=15 Sep 09 23:18:52.022897 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:18:52.022869 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7989569fb4-4t2qm" Sep 09 23:18:52.156785 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:18:52.156694 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8a08013e-082b-41ce-92f8-2ea8be10a5d2-console-config\") pod \"8a08013e-082b-41ce-92f8-2ea8be10a5d2\" (UID: \"8a08013e-082b-41ce-92f8-2ea8be10a5d2\") " Sep 09 23:18:52.156785 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:18:52.156731 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2wpwv\" (UniqueName: \"kubernetes.io/projected/8a08013e-082b-41ce-92f8-2ea8be10a5d2-kube-api-access-2wpwv\") pod \"8a08013e-082b-41ce-92f8-2ea8be10a5d2\" (UID: \"8a08013e-082b-41ce-92f8-2ea8be10a5d2\") " Sep 09 23:18:52.156785 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:18:52.156756 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8a08013e-082b-41ce-92f8-2ea8be10a5d2-oauth-serving-cert\") pod \"8a08013e-082b-41ce-92f8-2ea8be10a5d2\" (UID: \"8a08013e-082b-41ce-92f8-2ea8be10a5d2\") " Sep 09 23:18:52.157047 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:18:52.156794 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8a08013e-082b-41ce-92f8-2ea8be10a5d2-trusted-ca-bundle\") pod \"8a08013e-082b-41ce-92f8-2ea8be10a5d2\" (UID: \"8a08013e-082b-41ce-92f8-2ea8be10a5d2\") " Sep 09 23:18:52.157047 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:18:52.156831 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8a08013e-082b-41ce-92f8-2ea8be10a5d2-console-oauth-config\") pod \"8a08013e-082b-41ce-92f8-2ea8be10a5d2\" (UID: \"8a08013e-082b-41ce-92f8-2ea8be10a5d2\") " Sep 09 23:18:52.157047 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:18:52.156883 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8a08013e-082b-41ce-92f8-2ea8be10a5d2-service-ca\") pod \"8a08013e-082b-41ce-92f8-2ea8be10a5d2\" (UID: \"8a08013e-082b-41ce-92f8-2ea8be10a5d2\") " Sep 09 23:18:52.157047 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:18:52.156904 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8a08013e-082b-41ce-92f8-2ea8be10a5d2-console-serving-cert\") pod \"8a08013e-082b-41ce-92f8-2ea8be10a5d2\" (UID: \"8a08013e-082b-41ce-92f8-2ea8be10a5d2\") " Sep 09 23:18:52.157235 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:18:52.157178 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8a08013e-082b-41ce-92f8-2ea8be10a5d2-console-config" (OuterVolumeSpecName: "console-config") pod "8a08013e-082b-41ce-92f8-2ea8be10a5d2" (UID: "8a08013e-082b-41ce-92f8-2ea8be10a5d2"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 09 23:18:52.157309 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:18:52.157280 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8a08013e-082b-41ce-92f8-2ea8be10a5d2-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "8a08013e-082b-41ce-92f8-2ea8be10a5d2" (UID: "8a08013e-082b-41ce-92f8-2ea8be10a5d2"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 09 23:18:52.157309 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:18:52.157291 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8a08013e-082b-41ce-92f8-2ea8be10a5d2-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "8a08013e-082b-41ce-92f8-2ea8be10a5d2" (UID: "8a08013e-082b-41ce-92f8-2ea8be10a5d2"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 09 23:18:52.157453 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:18:52.157315 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8a08013e-082b-41ce-92f8-2ea8be10a5d2-service-ca" (OuterVolumeSpecName: "service-ca") pod "8a08013e-082b-41ce-92f8-2ea8be10a5d2" (UID: "8a08013e-082b-41ce-92f8-2ea8be10a5d2"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 09 23:18:52.159120 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:18:52.159094 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8a08013e-082b-41ce-92f8-2ea8be10a5d2-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "8a08013e-082b-41ce-92f8-2ea8be10a5d2" (UID: "8a08013e-082b-41ce-92f8-2ea8be10a5d2"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 09 23:18:52.159227 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:18:52.159170 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8a08013e-082b-41ce-92f8-2ea8be10a5d2-kube-api-access-2wpwv" (OuterVolumeSpecName: "kube-api-access-2wpwv") pod "8a08013e-082b-41ce-92f8-2ea8be10a5d2" (UID: "8a08013e-082b-41ce-92f8-2ea8be10a5d2"). InnerVolumeSpecName "kube-api-access-2wpwv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 09 23:18:52.159286 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:18:52.159269 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8a08013e-082b-41ce-92f8-2ea8be10a5d2-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "8a08013e-082b-41ce-92f8-2ea8be10a5d2" (UID: "8a08013e-082b-41ce-92f8-2ea8be10a5d2"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 09 23:18:52.257656 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:18:52.257623 2561 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8a08013e-082b-41ce-92f8-2ea8be10a5d2-trusted-ca-bundle\") on node \"ip-10-0-132-204.ec2.internal\" DevicePath \"\"" Sep 09 23:18:52.257656 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:18:52.257652 2561 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8a08013e-082b-41ce-92f8-2ea8be10a5d2-console-oauth-config\") on node \"ip-10-0-132-204.ec2.internal\" DevicePath \"\"" Sep 09 23:18:52.257656 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:18:52.257663 2561 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8a08013e-082b-41ce-92f8-2ea8be10a5d2-service-ca\") on node \"ip-10-0-132-204.ec2.internal\" DevicePath \"\"" Sep 09 23:18:52.257891 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:18:52.257671 2561 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8a08013e-082b-41ce-92f8-2ea8be10a5d2-console-serving-cert\") on node \"ip-10-0-132-204.ec2.internal\" DevicePath \"\"" Sep 09 23:18:52.257891 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:18:52.257679 2561 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8a08013e-082b-41ce-92f8-2ea8be10a5d2-console-config\") on node \"ip-10-0-132-204.ec2.internal\" DevicePath \"\"" Sep 09 23:18:52.257891 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:18:52.257687 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2wpwv\" (UniqueName: \"kubernetes.io/projected/8a08013e-082b-41ce-92f8-2ea8be10a5d2-kube-api-access-2wpwv\") on node \"ip-10-0-132-204.ec2.internal\" DevicePath \"\"" Sep 09 23:18:52.257891 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:18:52.257695 2561 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8a08013e-082b-41ce-92f8-2ea8be10a5d2-oauth-serving-cert\") on node \"ip-10-0-132-204.ec2.internal\" DevicePath \"\"" Sep 09 23:18:52.833274 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:18:52.833241 2561 generic.go:356] "Generic (PLEG): container finished" podID="8a08013e-082b-41ce-92f8-2ea8be10a5d2" containerID="b6073f69fac7841521253a4211c70b6cb5bbfeb9d5f2a5a7e7815fc34a794605" exitCode=0 Sep 09 23:18:52.833702 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:18:52.833287 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7989569fb4-4t2qm" Sep 09 23:18:52.833702 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:18:52.833328 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7989569fb4-4t2qm" event={"ID":"8a08013e-082b-41ce-92f8-2ea8be10a5d2","Type":"ContainerDied","Data":"b6073f69fac7841521253a4211c70b6cb5bbfeb9d5f2a5a7e7815fc34a794605"} Sep 09 23:18:52.833702 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:18:52.833396 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7989569fb4-4t2qm" event={"ID":"8a08013e-082b-41ce-92f8-2ea8be10a5d2","Type":"ContainerDied","Data":"61c01f094a4edb0188b7b2dfc50e0bbea87afb17803692d33680895ca79dc40f"} Sep 09 23:18:52.833702 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:18:52.833418 2561 scope.go:117] "RemoveContainer" containerID="b6073f69fac7841521253a4211c70b6cb5bbfeb9d5f2a5a7e7815fc34a794605" Sep 09 23:18:52.842880 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:18:52.842861 2561 scope.go:117] "RemoveContainer" containerID="b6073f69fac7841521253a4211c70b6cb5bbfeb9d5f2a5a7e7815fc34a794605" Sep 09 23:18:52.843224 ip-10-0-132-204 kubenswrapper[2561]: E0909 23:18:52.843202 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b6073f69fac7841521253a4211c70b6cb5bbfeb9d5f2a5a7e7815fc34a794605\": container with ID starting with b6073f69fac7841521253a4211c70b6cb5bbfeb9d5f2a5a7e7815fc34a794605 not found: ID does not exist" containerID="b6073f69fac7841521253a4211c70b6cb5bbfeb9d5f2a5a7e7815fc34a794605" Sep 09 23:18:52.843325 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:18:52.843231 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b6073f69fac7841521253a4211c70b6cb5bbfeb9d5f2a5a7e7815fc34a794605"} err="failed to get container status \"b6073f69fac7841521253a4211c70b6cb5bbfeb9d5f2a5a7e7815fc34a794605\": rpc error: code = NotFound desc = could not find container \"b6073f69fac7841521253a4211c70b6cb5bbfeb9d5f2a5a7e7815fc34a794605\": container with ID starting with b6073f69fac7841521253a4211c70b6cb5bbfeb9d5f2a5a7e7815fc34a794605 not found: ID does not exist" Sep 09 23:18:52.855729 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:18:52.855700 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7989569fb4-4t2qm"] Sep 09 23:18:52.861576 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:18:52.861554 2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7989569fb4-4t2qm"] Sep 09 23:18:54.117155 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:18:54.117120 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8a08013e-082b-41ce-92f8-2ea8be10a5d2" path="/var/lib/kubelet/pods/8a08013e-082b-41ce-92f8-2ea8be10a5d2/volumes" Sep 09 23:19:13.185522 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:19:13.185477 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cxrdz2"] Sep 09 23:19:13.185894 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:19:13.185820 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8a08013e-082b-41ce-92f8-2ea8be10a5d2" containerName="console" Sep 09 23:19:13.185894 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:19:13.185831 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="8a08013e-082b-41ce-92f8-2ea8be10a5d2" containerName="console" Sep 09 23:19:13.185894 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:19:13.185853 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5b811a8e-1fb4-4273-8cf4-4ee6c7bf256f" containerName="discovery" Sep 09 23:19:13.185894 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:19:13.185858 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="5b811a8e-1fb4-4273-8cf4-4ee6c7bf256f" containerName="discovery" Sep 09 23:19:13.186017 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:19:13.185907 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="5b811a8e-1fb4-4273-8cf4-4ee6c7bf256f" containerName="discovery" Sep 09 23:19:13.186017 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:19:13.185915 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="8a08013e-082b-41ce-92f8-2ea8be10a5d2" containerName="console" Sep 09 23:19:13.190429 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:19:13.190412 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cxrdz2" Sep 09 23:19:13.193086 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:19:13.193063 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-ksmhc\"" Sep 09 23:19:13.193207 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:19:13.193150 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Sep 09 23:19:13.193296 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:19:13.193281 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Sep 09 23:19:13.197001 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:19:13.196971 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cxrdz2"] Sep 09 23:19:13.227031 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:19:13.226998 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b230a4b7-3039-4bfa-8f8e-a7d2e08d0d3c-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cxrdz2\" (UID: \"b230a4b7-3039-4bfa-8f8e-a7d2e08d0d3c\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cxrdz2" Sep 09 23:19:13.227170 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:19:13.227041 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xfxds\" (UniqueName: \"kubernetes.io/projected/b230a4b7-3039-4bfa-8f8e-a7d2e08d0d3c-kube-api-access-xfxds\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cxrdz2\" (UID: \"b230a4b7-3039-4bfa-8f8e-a7d2e08d0d3c\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cxrdz2" Sep 09 23:19:13.227170 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:19:13.227112 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b230a4b7-3039-4bfa-8f8e-a7d2e08d0d3c-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cxrdz2\" (UID: \"b230a4b7-3039-4bfa-8f8e-a7d2e08d0d3c\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cxrdz2" Sep 09 23:19:13.284806 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:19:13.284774 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d72fpgd"] Sep 09 23:19:13.288282 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:19:13.288266 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d72fpgd" Sep 09 23:19:13.296735 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:19:13.296713 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d72fpgd"] Sep 09 23:19:13.327681 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:19:13.327654 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q2g5t\" (UniqueName: \"kubernetes.io/projected/5df9bb7f-0d27-427a-a545-8b251d19bef6-kube-api-access-q2g5t\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d72fpgd\" (UID: \"5df9bb7f-0d27-427a-a545-8b251d19bef6\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d72fpgd" Sep 09 23:19:13.327789 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:19:13.327695 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5df9bb7f-0d27-427a-a545-8b251d19bef6-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d72fpgd\" (UID: \"5df9bb7f-0d27-427a-a545-8b251d19bef6\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d72fpgd" Sep 09 23:19:13.327789 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:19:13.327726 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b230a4b7-3039-4bfa-8f8e-a7d2e08d0d3c-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cxrdz2\" (UID: \"b230a4b7-3039-4bfa-8f8e-a7d2e08d0d3c\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cxrdz2" Sep 09 23:19:13.327789 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:19:13.327753 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xfxds\" (UniqueName: \"kubernetes.io/projected/b230a4b7-3039-4bfa-8f8e-a7d2e08d0d3c-kube-api-access-xfxds\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cxrdz2\" (UID: \"b230a4b7-3039-4bfa-8f8e-a7d2e08d0d3c\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cxrdz2" Sep 09 23:19:13.327908 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:19:13.327790 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5df9bb7f-0d27-427a-a545-8b251d19bef6-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d72fpgd\" (UID: \"5df9bb7f-0d27-427a-a545-8b251d19bef6\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d72fpgd" Sep 09 23:19:13.327908 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:19:13.327855 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b230a4b7-3039-4bfa-8f8e-a7d2e08d0d3c-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cxrdz2\" (UID: \"b230a4b7-3039-4bfa-8f8e-a7d2e08d0d3c\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cxrdz2" Sep 09 23:19:13.328170 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:19:13.328152 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b230a4b7-3039-4bfa-8f8e-a7d2e08d0d3c-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cxrdz2\" (UID: \"b230a4b7-3039-4bfa-8f8e-a7d2e08d0d3c\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cxrdz2" Sep 09 23:19:13.328208 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:19:13.328165 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b230a4b7-3039-4bfa-8f8e-a7d2e08d0d3c-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cxrdz2\" (UID: \"b230a4b7-3039-4bfa-8f8e-a7d2e08d0d3c\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cxrdz2" Sep 09 23:19:13.336206 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:19:13.336186 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xfxds\" (UniqueName: \"kubernetes.io/projected/b230a4b7-3039-4bfa-8f8e-a7d2e08d0d3c-kube-api-access-xfxds\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cxrdz2\" (UID: \"b230a4b7-3039-4bfa-8f8e-a7d2e08d0d3c\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cxrdz2" Sep 09 23:19:13.382944 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:19:13.382914 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6rclxn"] Sep 09 23:19:13.386673 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:19:13.386657 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6rclxn" Sep 09 23:19:13.394923 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:19:13.394905 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6rclxn"] Sep 09 23:19:13.428736 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:19:13.428706 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0dc8ab69-bc39-47e4-9ed7-d0fdfc5e2a37-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6rclxn\" (UID: \"0dc8ab69-bc39-47e4-9ed7-d0fdfc5e2a37\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6rclxn" Sep 09 23:19:13.428883 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:19:13.428753 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0dc8ab69-bc39-47e4-9ed7-d0fdfc5e2a37-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6rclxn\" (UID: \"0dc8ab69-bc39-47e4-9ed7-d0fdfc5e2a37\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6rclxn" Sep 09 23:19:13.428883 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:19:13.428783 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5df9bb7f-0d27-427a-a545-8b251d19bef6-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d72fpgd\" (UID: \"5df9bb7f-0d27-427a-a545-8b251d19bef6\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d72fpgd" Sep 09 23:19:13.428883 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:19:13.428799 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4l527\" (UniqueName: \"kubernetes.io/projected/0dc8ab69-bc39-47e4-9ed7-d0fdfc5e2a37-kube-api-access-4l527\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6rclxn\" (UID: \"0dc8ab69-bc39-47e4-9ed7-d0fdfc5e2a37\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6rclxn" Sep 09 23:19:13.428883 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:19:13.428865 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q2g5t\" (UniqueName: \"kubernetes.io/projected/5df9bb7f-0d27-427a-a545-8b251d19bef6-kube-api-access-q2g5t\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d72fpgd\" (UID: \"5df9bb7f-0d27-427a-a545-8b251d19bef6\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d72fpgd" Sep 09 23:19:13.429100 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:19:13.428895 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5df9bb7f-0d27-427a-a545-8b251d19bef6-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d72fpgd\" (UID: \"5df9bb7f-0d27-427a-a545-8b251d19bef6\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d72fpgd" Sep 09 23:19:13.429206 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:19:13.429186 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5df9bb7f-0d27-427a-a545-8b251d19bef6-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d72fpgd\" (UID: \"5df9bb7f-0d27-427a-a545-8b251d19bef6\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d72fpgd" Sep 09 23:19:13.429206 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:19:13.429200 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5df9bb7f-0d27-427a-a545-8b251d19bef6-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d72fpgd\" (UID: \"5df9bb7f-0d27-427a-a545-8b251d19bef6\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d72fpgd" Sep 09 23:19:13.437415 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:19:13.437335 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q2g5t\" (UniqueName: \"kubernetes.io/projected/5df9bb7f-0d27-427a-a545-8b251d19bef6-kube-api-access-q2g5t\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d72fpgd\" (UID: \"5df9bb7f-0d27-427a-a545-8b251d19bef6\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d72fpgd" Sep 09 23:19:13.487191 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:19:13.487161 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ahgc5z"] Sep 09 23:19:13.490928 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:19:13.490910 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ahgc5z" Sep 09 23:19:13.498948 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:19:13.498922 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ahgc5z"] Sep 09 23:19:13.500220 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:19:13.500202 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cxrdz2" Sep 09 23:19:13.530255 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:19:13.530212 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/683ad63f-595e-4823-bcce-e497cfde3332-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ahgc5z\" (UID: \"683ad63f-595e-4823-bcce-e497cfde3332\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ahgc5z" Sep 09 23:19:13.530255 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:19:13.530244 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/683ad63f-595e-4823-bcce-e497cfde3332-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ahgc5z\" (UID: \"683ad63f-595e-4823-bcce-e497cfde3332\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ahgc5z" Sep 09 23:19:13.530508 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:19:13.530281 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0dc8ab69-bc39-47e4-9ed7-d0fdfc5e2a37-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6rclxn\" (UID: \"0dc8ab69-bc39-47e4-9ed7-d0fdfc5e2a37\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6rclxn" Sep 09 23:19:13.530508 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:19:13.530302 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0dc8ab69-bc39-47e4-9ed7-d0fdfc5e2a37-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6rclxn\" (UID: \"0dc8ab69-bc39-47e4-9ed7-d0fdfc5e2a37\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6rclxn" Sep 09 23:19:13.530508 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:19:13.530318 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j7dhm\" (UniqueName: \"kubernetes.io/projected/683ad63f-595e-4823-bcce-e497cfde3332-kube-api-access-j7dhm\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ahgc5z\" (UID: \"683ad63f-595e-4823-bcce-e497cfde3332\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ahgc5z" Sep 09 23:19:13.530508 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:19:13.530410 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4l527\" (UniqueName: \"kubernetes.io/projected/0dc8ab69-bc39-47e4-9ed7-d0fdfc5e2a37-kube-api-access-4l527\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6rclxn\" (UID: \"0dc8ab69-bc39-47e4-9ed7-d0fdfc5e2a37\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6rclxn" Sep 09 23:19:13.530725 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:19:13.530640 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0dc8ab69-bc39-47e4-9ed7-d0fdfc5e2a37-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6rclxn\" (UID: \"0dc8ab69-bc39-47e4-9ed7-d0fdfc5e2a37\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6rclxn" Sep 09 23:19:13.530725 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:19:13.530657 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0dc8ab69-bc39-47e4-9ed7-d0fdfc5e2a37-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6rclxn\" (UID: \"0dc8ab69-bc39-47e4-9ed7-d0fdfc5e2a37\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6rclxn" Sep 09 23:19:13.539046 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:19:13.539019 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4l527\" (UniqueName: \"kubernetes.io/projected/0dc8ab69-bc39-47e4-9ed7-d0fdfc5e2a37-kube-api-access-4l527\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6rclxn\" (UID: \"0dc8ab69-bc39-47e4-9ed7-d0fdfc5e2a37\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6rclxn" Sep 09 23:19:13.597955 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:19:13.597926 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d72fpgd" Sep 09 23:19:13.631488 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:19:13.631456 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/683ad63f-595e-4823-bcce-e497cfde3332-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ahgc5z\" (UID: \"683ad63f-595e-4823-bcce-e497cfde3332\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ahgc5z" Sep 09 23:19:13.631488 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:19:13.631491 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/683ad63f-595e-4823-bcce-e497cfde3332-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ahgc5z\" (UID: \"683ad63f-595e-4823-bcce-e497cfde3332\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ahgc5z" Sep 09 23:19:13.631714 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:19:13.631539 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j7dhm\" (UniqueName: \"kubernetes.io/projected/683ad63f-595e-4823-bcce-e497cfde3332-kube-api-access-j7dhm\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ahgc5z\" (UID: \"683ad63f-595e-4823-bcce-e497cfde3332\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ahgc5z" Sep 09 23:19:13.631916 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:19:13.631889 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/683ad63f-595e-4823-bcce-e497cfde3332-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ahgc5z\" (UID: \"683ad63f-595e-4823-bcce-e497cfde3332\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ahgc5z" Sep 09 23:19:13.631994 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:19:13.631892 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/683ad63f-595e-4823-bcce-e497cfde3332-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ahgc5z\" (UID: \"683ad63f-595e-4823-bcce-e497cfde3332\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ahgc5z" Sep 09 23:19:13.640897 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:19:13.640874 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j7dhm\" (UniqueName: \"kubernetes.io/projected/683ad63f-595e-4823-bcce-e497cfde3332-kube-api-access-j7dhm\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ahgc5z\" (UID: \"683ad63f-595e-4823-bcce-e497cfde3332\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ahgc5z" Sep 09 23:19:13.696507 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:19:13.696439 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6rclxn" Sep 09 23:19:13.775652 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:19:13.775625 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb230a4b7_3039_4bfa_8f8e_a7d2e08d0d3c.slice/crio-3c83d786bc39afe8789828d92ae0fd75756ab48bdf711eef25cf1df4b245bc9f WatchSource:0}: Error finding container 3c83d786bc39afe8789828d92ae0fd75756ab48bdf711eef25cf1df4b245bc9f: Status 404 returned error can't find the container with id 3c83d786bc39afe8789828d92ae0fd75756ab48bdf711eef25cf1df4b245bc9f Sep 09 23:19:13.776009 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:19:13.775984 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cxrdz2"] Sep 09 23:19:13.802472 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:19:13.802449 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ahgc5z" Sep 09 23:19:13.876757 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:19:13.876722 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5df9bb7f_0d27_427a_a545_8b251d19bef6.slice/crio-6f07dfdc5049d26daa0c0cf98ccece0c9c2d2da81cd58fe5f0f86c3d58221ece WatchSource:0}: Error finding container 6f07dfdc5049d26daa0c0cf98ccece0c9c2d2da81cd58fe5f0f86c3d58221ece: Status 404 returned error can't find the container with id 6f07dfdc5049d26daa0c0cf98ccece0c9c2d2da81cd58fe5f0f86c3d58221ece Sep 09 23:19:13.876883 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:19:13.876842 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d72fpgd"] Sep 09 23:19:13.934972 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:19:13.934940 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d72fpgd" event={"ID":"5df9bb7f-0d27-427a-a545-8b251d19bef6","Type":"ContainerStarted","Data":"6f07dfdc5049d26daa0c0cf98ccece0c9c2d2da81cd58fe5f0f86c3d58221ece"} Sep 09 23:19:13.936651 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:19:13.936621 2561 generic.go:356] "Generic (PLEG): container finished" podID="b230a4b7-3039-4bfa-8f8e-a7d2e08d0d3c" containerID="330af0027e476f1251624fc3d2261ca6b14ef2dc9ff0b450775f5a9bb9f72c67" exitCode=0 Sep 09 23:19:13.936805 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:19:13.936701 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cxrdz2" event={"ID":"b230a4b7-3039-4bfa-8f8e-a7d2e08d0d3c","Type":"ContainerDied","Data":"330af0027e476f1251624fc3d2261ca6b14ef2dc9ff0b450775f5a9bb9f72c67"} Sep 09 23:19:13.936805 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:19:13.936739 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cxrdz2" event={"ID":"b230a4b7-3039-4bfa-8f8e-a7d2e08d0d3c","Type":"ContainerStarted","Data":"3c83d786bc39afe8789828d92ae0fd75756ab48bdf711eef25cf1df4b245bc9f"} Sep 09 23:19:13.970261 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:19:13.970238 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6rclxn"] Sep 09 23:19:13.971539 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:19:13.971516 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0dc8ab69_bc39_47e4_9ed7_d0fdfc5e2a37.slice/crio-8a0ba4bf88a1e5cd8f59dcfd27e60414945ed3ce34374baf8a168aed16bb4f7b WatchSource:0}: Error finding container 8a0ba4bf88a1e5cd8f59dcfd27e60414945ed3ce34374baf8a168aed16bb4f7b: Status 404 returned error can't find the container with id 8a0ba4bf88a1e5cd8f59dcfd27e60414945ed3ce34374baf8a168aed16bb4f7b Sep 09 23:19:14.077644 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:19:14.077617 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ahgc5z"] Sep 09 23:19:14.080850 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:19:14.080824 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod683ad63f_595e_4823_bcce_e497cfde3332.slice/crio-ef0aa8a2d9fa85b6cc0fc68319320cf2d90ed775668c32d095cccdbb1bfacc97 WatchSource:0}: Error finding container ef0aa8a2d9fa85b6cc0fc68319320cf2d90ed775668c32d095cccdbb1bfacc97: Status 404 returned error can't find the container with id ef0aa8a2d9fa85b6cc0fc68319320cf2d90ed775668c32d095cccdbb1bfacc97 Sep 09 23:19:14.944061 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:19:14.944025 2561 generic.go:356] "Generic (PLEG): container finished" podID="5df9bb7f-0d27-427a-a545-8b251d19bef6" containerID="2697b11f61c2e7d2abebc2b8df67feabae9a3b4d5c29901895eae2b60e3a5155" exitCode=0 Sep 09 23:19:14.944543 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:19:14.944112 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d72fpgd" event={"ID":"5df9bb7f-0d27-427a-a545-8b251d19bef6","Type":"ContainerDied","Data":"2697b11f61c2e7d2abebc2b8df67feabae9a3b4d5c29901895eae2b60e3a5155"} Sep 09 23:19:14.945710 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:19:14.945677 2561 generic.go:356] "Generic (PLEG): container finished" podID="683ad63f-595e-4823-bcce-e497cfde3332" containerID="ae2bb47406e245c54997b537625d6db9ae7c5f40b5fe7859b67860fe9be4fb88" exitCode=0 Sep 09 23:19:14.945785 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:19:14.945728 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ahgc5z" event={"ID":"683ad63f-595e-4823-bcce-e497cfde3332","Type":"ContainerDied","Data":"ae2bb47406e245c54997b537625d6db9ae7c5f40b5fe7859b67860fe9be4fb88"} Sep 09 23:19:14.945843 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:19:14.945788 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ahgc5z" event={"ID":"683ad63f-595e-4823-bcce-e497cfde3332","Type":"ContainerStarted","Data":"ef0aa8a2d9fa85b6cc0fc68319320cf2d90ed775668c32d095cccdbb1bfacc97"} Sep 09 23:19:14.947451 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:19:14.947419 2561 generic.go:356] "Generic (PLEG): container finished" podID="0dc8ab69-bc39-47e4-9ed7-d0fdfc5e2a37" containerID="e0bb301d4426befae521e67eb804b85154f0298b97e486eef56a60cae25826da" exitCode=0 Sep 09 23:19:14.947585 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:19:14.947526 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6rclxn" event={"ID":"0dc8ab69-bc39-47e4-9ed7-d0fdfc5e2a37","Type":"ContainerDied","Data":"e0bb301d4426befae521e67eb804b85154f0298b97e486eef56a60cae25826da"} Sep 09 23:19:14.947585 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:19:14.947562 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6rclxn" event={"ID":"0dc8ab69-bc39-47e4-9ed7-d0fdfc5e2a37","Type":"ContainerStarted","Data":"8a0ba4bf88a1e5cd8f59dcfd27e60414945ed3ce34374baf8a168aed16bb4f7b"} Sep 09 23:19:14.949657 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:19:14.949637 2561 generic.go:356] "Generic (PLEG): container finished" podID="b230a4b7-3039-4bfa-8f8e-a7d2e08d0d3c" containerID="cee6305241d059302227c2253d336de59b5ffa7d0448773d2c6ada5b569b4552" exitCode=0 Sep 09 23:19:14.949740 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:19:14.949665 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cxrdz2" event={"ID":"b230a4b7-3039-4bfa-8f8e-a7d2e08d0d3c","Type":"ContainerDied","Data":"cee6305241d059302227c2253d336de59b5ffa7d0448773d2c6ada5b569b4552"} Sep 09 23:19:15.958111 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:19:15.958080 2561 generic.go:356] "Generic (PLEG): container finished" podID="0dc8ab69-bc39-47e4-9ed7-d0fdfc5e2a37" containerID="1eed34cf47acfaf5180d86478a359ef4ee125fbd7113f49704e9cf2a3d861fa1" exitCode=0 Sep 09 23:19:15.958439 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:19:15.958156 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6rclxn" event={"ID":"0dc8ab69-bc39-47e4-9ed7-d0fdfc5e2a37","Type":"ContainerDied","Data":"1eed34cf47acfaf5180d86478a359ef4ee125fbd7113f49704e9cf2a3d861fa1"} Sep 09 23:19:15.960336 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:19:15.960318 2561 generic.go:356] "Generic (PLEG): container finished" podID="b230a4b7-3039-4bfa-8f8e-a7d2e08d0d3c" containerID="d7ca143a0346c7adea980ef96137155c8245430e2feaf6ed4a2228b765da3074" exitCode=0 Sep 09 23:19:15.960443 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:19:15.960407 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cxrdz2" event={"ID":"b230a4b7-3039-4bfa-8f8e-a7d2e08d0d3c","Type":"ContainerDied","Data":"d7ca143a0346c7adea980ef96137155c8245430e2feaf6ed4a2228b765da3074"} Sep 09 23:19:16.968010 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:19:16.967976 2561 generic.go:356] "Generic (PLEG): container finished" podID="5df9bb7f-0d27-427a-a545-8b251d19bef6" containerID="c02f42d803ab718cedf8bbecd15eef0da153b9626ab79faba00e6dc2c24814f6" exitCode=0 Sep 09 23:19:16.968471 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:19:16.968061 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d72fpgd" event={"ID":"5df9bb7f-0d27-427a-a545-8b251d19bef6","Type":"ContainerDied","Data":"c02f42d803ab718cedf8bbecd15eef0da153b9626ab79faba00e6dc2c24814f6"} Sep 09 23:19:16.970165 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:19:16.970141 2561 generic.go:356] "Generic (PLEG): container finished" podID="683ad63f-595e-4823-bcce-e497cfde3332" containerID="9e13ec35cbbb3461677244a873b4962bba94e98eeb2351a5d718f51e83bd363c" exitCode=0 Sep 09 23:19:16.970240 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:19:16.970228 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ahgc5z" event={"ID":"683ad63f-595e-4823-bcce-e497cfde3332","Type":"ContainerDied","Data":"9e13ec35cbbb3461677244a873b4962bba94e98eeb2351a5d718f51e83bd363c"} Sep 09 23:19:16.972536 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:19:16.972516 2561 generic.go:356] "Generic (PLEG): container finished" podID="0dc8ab69-bc39-47e4-9ed7-d0fdfc5e2a37" containerID="58b346cba0e3d04e03b2214a4d5862ec2b454d44c2d2b0b1e50d42c01a77d768" exitCode=0 Sep 09 23:19:16.972636 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:19:16.972581 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6rclxn" event={"ID":"0dc8ab69-bc39-47e4-9ed7-d0fdfc5e2a37","Type":"ContainerDied","Data":"58b346cba0e3d04e03b2214a4d5862ec2b454d44c2d2b0b1e50d42c01a77d768"} Sep 09 23:19:17.118181 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:19:17.118152 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cxrdz2" Sep 09 23:19:17.164326 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:19:17.164296 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b230a4b7-3039-4bfa-8f8e-a7d2e08d0d3c-bundle\") pod \"b230a4b7-3039-4bfa-8f8e-a7d2e08d0d3c\" (UID: \"b230a4b7-3039-4bfa-8f8e-a7d2e08d0d3c\") " Sep 09 23:19:17.164466 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:19:17.164337 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xfxds\" (UniqueName: \"kubernetes.io/projected/b230a4b7-3039-4bfa-8f8e-a7d2e08d0d3c-kube-api-access-xfxds\") pod \"b230a4b7-3039-4bfa-8f8e-a7d2e08d0d3c\" (UID: \"b230a4b7-3039-4bfa-8f8e-a7d2e08d0d3c\") " Sep 09 23:19:17.164466 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:19:17.164417 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b230a4b7-3039-4bfa-8f8e-a7d2e08d0d3c-util\") pod \"b230a4b7-3039-4bfa-8f8e-a7d2e08d0d3c\" (UID: \"b230a4b7-3039-4bfa-8f8e-a7d2e08d0d3c\") " Sep 09 23:19:17.164987 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:19:17.164955 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b230a4b7-3039-4bfa-8f8e-a7d2e08d0d3c-bundle" (OuterVolumeSpecName: "bundle") pod "b230a4b7-3039-4bfa-8f8e-a7d2e08d0d3c" (UID: "b230a4b7-3039-4bfa-8f8e-a7d2e08d0d3c"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 09 23:19:17.167122 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:19:17.167098 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b230a4b7-3039-4bfa-8f8e-a7d2e08d0d3c-kube-api-access-xfxds" (OuterVolumeSpecName: "kube-api-access-xfxds") pod "b230a4b7-3039-4bfa-8f8e-a7d2e08d0d3c" (UID: "b230a4b7-3039-4bfa-8f8e-a7d2e08d0d3c"). InnerVolumeSpecName "kube-api-access-xfxds". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 09 23:19:17.171414 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:19:17.171380 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b230a4b7-3039-4bfa-8f8e-a7d2e08d0d3c-util" (OuterVolumeSpecName: "util") pod "b230a4b7-3039-4bfa-8f8e-a7d2e08d0d3c" (UID: "b230a4b7-3039-4bfa-8f8e-a7d2e08d0d3c"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 09 23:19:17.266225 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:19:17.266195 2561 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b230a4b7-3039-4bfa-8f8e-a7d2e08d0d3c-bundle\") on node \"ip-10-0-132-204.ec2.internal\" DevicePath \"\"" Sep 09 23:19:17.266225 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:19:17.266221 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xfxds\" (UniqueName: \"kubernetes.io/projected/b230a4b7-3039-4bfa-8f8e-a7d2e08d0d3c-kube-api-access-xfxds\") on node \"ip-10-0-132-204.ec2.internal\" DevicePath \"\"" Sep 09 23:19:17.266402 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:19:17.266231 2561 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b230a4b7-3039-4bfa-8f8e-a7d2e08d0d3c-util\") on node \"ip-10-0-132-204.ec2.internal\" DevicePath \"\"" Sep 09 23:19:17.979571 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:19:17.979537 2561 generic.go:356] "Generic (PLEG): container finished" podID="5df9bb7f-0d27-427a-a545-8b251d19bef6" containerID="fbaa66400c528eef196e7e43906fba400d5519e6e59499ab014c70040bffed04" exitCode=0 Sep 09 23:19:17.980047 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:19:17.979623 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d72fpgd" event={"ID":"5df9bb7f-0d27-427a-a545-8b251d19bef6","Type":"ContainerDied","Data":"fbaa66400c528eef196e7e43906fba400d5519e6e59499ab014c70040bffed04"} Sep 09 23:19:17.981693 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:19:17.981659 2561 generic.go:356] "Generic (PLEG): container finished" podID="683ad63f-595e-4823-bcce-e497cfde3332" containerID="b64498dfb5b52122cf95fae2f09f22c3112bfc0ef7f31093bd27b79cf1154d04" exitCode=0 Sep 09 23:19:17.981820 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:19:17.981746 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ahgc5z" event={"ID":"683ad63f-595e-4823-bcce-e497cfde3332","Type":"ContainerDied","Data":"b64498dfb5b52122cf95fae2f09f22c3112bfc0ef7f31093bd27b79cf1154d04"} Sep 09 23:19:17.983634 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:19:17.983610 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cxrdz2" Sep 09 23:19:17.983634 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:19:17.983629 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cxrdz2" event={"ID":"b230a4b7-3039-4bfa-8f8e-a7d2e08d0d3c","Type":"ContainerDied","Data":"3c83d786bc39afe8789828d92ae0fd75756ab48bdf711eef25cf1df4b245bc9f"} Sep 09 23:19:17.983781 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:19:17.983665 2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3c83d786bc39afe8789828d92ae0fd75756ab48bdf711eef25cf1df4b245bc9f" Sep 09 23:19:18.111914 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:19:18.111891 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6rclxn" Sep 09 23:19:18.174694 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:19:18.174620 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0dc8ab69-bc39-47e4-9ed7-d0fdfc5e2a37-util\") pod \"0dc8ab69-bc39-47e4-9ed7-d0fdfc5e2a37\" (UID: \"0dc8ab69-bc39-47e4-9ed7-d0fdfc5e2a37\") " Sep 09 23:19:18.174694 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:19:18.174664 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0dc8ab69-bc39-47e4-9ed7-d0fdfc5e2a37-bundle\") pod \"0dc8ab69-bc39-47e4-9ed7-d0fdfc5e2a37\" (UID: \"0dc8ab69-bc39-47e4-9ed7-d0fdfc5e2a37\") " Sep 09 23:19:18.174887 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:19:18.174724 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4l527\" (UniqueName: \"kubernetes.io/projected/0dc8ab69-bc39-47e4-9ed7-d0fdfc5e2a37-kube-api-access-4l527\") pod \"0dc8ab69-bc39-47e4-9ed7-d0fdfc5e2a37\" (UID: \"0dc8ab69-bc39-47e4-9ed7-d0fdfc5e2a37\") " Sep 09 23:19:18.175331 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:19:18.175185 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0dc8ab69-bc39-47e4-9ed7-d0fdfc5e2a37-bundle" (OuterVolumeSpecName: "bundle") pod "0dc8ab69-bc39-47e4-9ed7-d0fdfc5e2a37" (UID: "0dc8ab69-bc39-47e4-9ed7-d0fdfc5e2a37"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 09 23:19:18.175331 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:19:18.175264 2561 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0dc8ab69-bc39-47e4-9ed7-d0fdfc5e2a37-bundle\") on node \"ip-10-0-132-204.ec2.internal\" DevicePath \"\"" Sep 09 23:19:18.177089 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:19:18.177066 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0dc8ab69-bc39-47e4-9ed7-d0fdfc5e2a37-kube-api-access-4l527" (OuterVolumeSpecName: "kube-api-access-4l527") pod "0dc8ab69-bc39-47e4-9ed7-d0fdfc5e2a37" (UID: "0dc8ab69-bc39-47e4-9ed7-d0fdfc5e2a37"). InnerVolumeSpecName "kube-api-access-4l527". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 09 23:19:18.180249 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:19:18.180219 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0dc8ab69-bc39-47e4-9ed7-d0fdfc5e2a37-util" (OuterVolumeSpecName: "util") pod "0dc8ab69-bc39-47e4-9ed7-d0fdfc5e2a37" (UID: "0dc8ab69-bc39-47e4-9ed7-d0fdfc5e2a37"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 09 23:19:18.276172 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:19:18.276146 2561 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0dc8ab69-bc39-47e4-9ed7-d0fdfc5e2a37-util\") on node \"ip-10-0-132-204.ec2.internal\" DevicePath \"\"" Sep 09 23:19:18.276172 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:19:18.276170 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4l527\" (UniqueName: \"kubernetes.io/projected/0dc8ab69-bc39-47e4-9ed7-d0fdfc5e2a37-kube-api-access-4l527\") on node \"ip-10-0-132-204.ec2.internal\" DevicePath \"\"" Sep 09 23:19:18.990761 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:19:18.990733 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6rclxn" Sep 09 23:19:18.991146 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:19:18.990737 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6rclxn" event={"ID":"0dc8ab69-bc39-47e4-9ed7-d0fdfc5e2a37","Type":"ContainerDied","Data":"8a0ba4bf88a1e5cd8f59dcfd27e60414945ed3ce34374baf8a168aed16bb4f7b"} Sep 09 23:19:18.991146 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:19:18.990847 2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8a0ba4bf88a1e5cd8f59dcfd27e60414945ed3ce34374baf8a168aed16bb4f7b" Sep 09 23:19:19.131547 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:19:19.131523 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d72fpgd" Sep 09 23:19:19.145496 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:19:19.145478 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ahgc5z" Sep 09 23:19:19.185496 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:19:19.185468 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q2g5t\" (UniqueName: \"kubernetes.io/projected/5df9bb7f-0d27-427a-a545-8b251d19bef6-kube-api-access-q2g5t\") pod \"5df9bb7f-0d27-427a-a545-8b251d19bef6\" (UID: \"5df9bb7f-0d27-427a-a545-8b251d19bef6\") " Sep 09 23:19:19.185623 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:19:19.185515 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/683ad63f-595e-4823-bcce-e497cfde3332-bundle\") pod \"683ad63f-595e-4823-bcce-e497cfde3332\" (UID: \"683ad63f-595e-4823-bcce-e497cfde3332\") " Sep 09 23:19:19.185623 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:19:19.185558 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/683ad63f-595e-4823-bcce-e497cfde3332-util\") pod \"683ad63f-595e-4823-bcce-e497cfde3332\" (UID: \"683ad63f-595e-4823-bcce-e497cfde3332\") " Sep 09 23:19:19.185746 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:19:19.185723 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j7dhm\" (UniqueName: \"kubernetes.io/projected/683ad63f-595e-4823-bcce-e497cfde3332-kube-api-access-j7dhm\") pod \"683ad63f-595e-4823-bcce-e497cfde3332\" (UID: \"683ad63f-595e-4823-bcce-e497cfde3332\") " Sep 09 23:19:19.185839 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:19:19.185822 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5df9bb7f-0d27-427a-a545-8b251d19bef6-util\") pod \"5df9bb7f-0d27-427a-a545-8b251d19bef6\" (UID: \"5df9bb7f-0d27-427a-a545-8b251d19bef6\") " Sep 09 23:19:19.185919 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:19:19.185888 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5df9bb7f-0d27-427a-a545-8b251d19bef6-bundle\") pod \"5df9bb7f-0d27-427a-a545-8b251d19bef6\" (UID: \"5df9bb7f-0d27-427a-a545-8b251d19bef6\") " Sep 09 23:19:19.186545 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:19:19.186423 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/683ad63f-595e-4823-bcce-e497cfde3332-bundle" (OuterVolumeSpecName: "bundle") pod "683ad63f-595e-4823-bcce-e497cfde3332" (UID: "683ad63f-595e-4823-bcce-e497cfde3332"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 09 23:19:19.186545 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:19:19.186515 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5df9bb7f-0d27-427a-a545-8b251d19bef6-bundle" (OuterVolumeSpecName: "bundle") pod "5df9bb7f-0d27-427a-a545-8b251d19bef6" (UID: "5df9bb7f-0d27-427a-a545-8b251d19bef6"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 09 23:19:19.188261 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:19:19.188236 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/683ad63f-595e-4823-bcce-e497cfde3332-kube-api-access-j7dhm" (OuterVolumeSpecName: "kube-api-access-j7dhm") pod "683ad63f-595e-4823-bcce-e497cfde3332" (UID: "683ad63f-595e-4823-bcce-e497cfde3332"). InnerVolumeSpecName "kube-api-access-j7dhm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 09 23:19:19.188484 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:19:19.188294 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5df9bb7f-0d27-427a-a545-8b251d19bef6-kube-api-access-q2g5t" (OuterVolumeSpecName: "kube-api-access-q2g5t") pod "5df9bb7f-0d27-427a-a545-8b251d19bef6" (UID: "5df9bb7f-0d27-427a-a545-8b251d19bef6"). InnerVolumeSpecName "kube-api-access-q2g5t". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 09 23:19:19.191784 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:19:19.191761 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5df9bb7f-0d27-427a-a545-8b251d19bef6-util" (OuterVolumeSpecName: "util") pod "5df9bb7f-0d27-427a-a545-8b251d19bef6" (UID: "5df9bb7f-0d27-427a-a545-8b251d19bef6"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 09 23:19:19.192318 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:19:19.192299 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/683ad63f-595e-4823-bcce-e497cfde3332-util" (OuterVolumeSpecName: "util") pod "683ad63f-595e-4823-bcce-e497cfde3332" (UID: "683ad63f-595e-4823-bcce-e497cfde3332"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 09 23:19:19.287564 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:19:19.287473 2561 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5df9bb7f-0d27-427a-a545-8b251d19bef6-bundle\") on node \"ip-10-0-132-204.ec2.internal\" DevicePath \"\"" Sep 09 23:19:19.287564 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:19:19.287501 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q2g5t\" (UniqueName: \"kubernetes.io/projected/5df9bb7f-0d27-427a-a545-8b251d19bef6-kube-api-access-q2g5t\") on node \"ip-10-0-132-204.ec2.internal\" DevicePath \"\"" Sep 09 23:19:19.287564 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:19:19.287513 2561 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/683ad63f-595e-4823-bcce-e497cfde3332-bundle\") on node \"ip-10-0-132-204.ec2.internal\" DevicePath \"\"" Sep 09 23:19:19.287564 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:19:19.287521 2561 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/683ad63f-595e-4823-bcce-e497cfde3332-util\") on node \"ip-10-0-132-204.ec2.internal\" DevicePath \"\"" Sep 09 23:19:19.287564 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:19:19.287529 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j7dhm\" (UniqueName: \"kubernetes.io/projected/683ad63f-595e-4823-bcce-e497cfde3332-kube-api-access-j7dhm\") on node \"ip-10-0-132-204.ec2.internal\" DevicePath \"\"" Sep 09 23:19:19.287564 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:19:19.287537 2561 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5df9bb7f-0d27-427a-a545-8b251d19bef6-util\") on node \"ip-10-0-132-204.ec2.internal\" DevicePath \"\"" Sep 09 23:19:19.998216 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:19:19.998186 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d72fpgd" Sep 09 23:19:19.998661 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:19:19.998177 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d72fpgd" event={"ID":"5df9bb7f-0d27-427a-a545-8b251d19bef6","Type":"ContainerDied","Data":"6f07dfdc5049d26daa0c0cf98ccece0c9c2d2da81cd58fe5f0f86c3d58221ece"} Sep 09 23:19:19.998661 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:19:19.998316 2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6f07dfdc5049d26daa0c0cf98ccece0c9c2d2da81cd58fe5f0f86c3d58221ece" Sep 09 23:19:20.000100 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:19:20.000079 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ahgc5z" event={"ID":"683ad63f-595e-4823-bcce-e497cfde3332","Type":"ContainerDied","Data":"ef0aa8a2d9fa85b6cc0fc68319320cf2d90ed775668c32d095cccdbb1bfacc97"} Sep 09 23:19:20.000204 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:19:20.000105 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ahgc5z" Sep 09 23:19:20.000204 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:19:20.000116 2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ef0aa8a2d9fa85b6cc0fc68319320cf2d90ed775668c32d095cccdbb1bfacc97" Sep 09 23:19:37.206289 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:19:37.206257 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-fbdd4f445-v8lg2"] Sep 09 23:19:37.206739 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:19:37.206615 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="683ad63f-595e-4823-bcce-e497cfde3332" containerName="extract" Sep 09 23:19:37.206739 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:19:37.206626 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="683ad63f-595e-4823-bcce-e497cfde3332" containerName="extract" Sep 09 23:19:37.206739 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:19:37.206636 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b230a4b7-3039-4bfa-8f8e-a7d2e08d0d3c" containerName="extract" Sep 09 23:19:37.206739 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:19:37.206642 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="b230a4b7-3039-4bfa-8f8e-a7d2e08d0d3c" containerName="extract" Sep 09 23:19:37.206739 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:19:37.206650 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b230a4b7-3039-4bfa-8f8e-a7d2e08d0d3c" containerName="pull" Sep 09 23:19:37.206739 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:19:37.206655 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="b230a4b7-3039-4bfa-8f8e-a7d2e08d0d3c" containerName="pull" Sep 09 23:19:37.206739 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:19:37.206662 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0dc8ab69-bc39-47e4-9ed7-d0fdfc5e2a37" containerName="util" Sep 09 23:19:37.206739 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:19:37.206666 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="0dc8ab69-bc39-47e4-9ed7-d0fdfc5e2a37" containerName="util" Sep 09 23:19:37.206739 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:19:37.206676 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="683ad63f-595e-4823-bcce-e497cfde3332" containerName="util" Sep 09 23:19:37.206739 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:19:37.206681 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="683ad63f-595e-4823-bcce-e497cfde3332" containerName="util" Sep 09 23:19:37.206739 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:19:37.206688 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0dc8ab69-bc39-47e4-9ed7-d0fdfc5e2a37" containerName="pull" Sep 09 23:19:37.206739 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:19:37.206692 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="0dc8ab69-bc39-47e4-9ed7-d0fdfc5e2a37" containerName="pull" Sep 09 23:19:37.206739 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:19:37.206697 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5df9bb7f-0d27-427a-a545-8b251d19bef6" containerName="pull" Sep 09 23:19:37.206739 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:19:37.206702 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="5df9bb7f-0d27-427a-a545-8b251d19bef6" containerName="pull" Sep 09 23:19:37.206739 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:19:37.206707 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="683ad63f-595e-4823-bcce-e497cfde3332" containerName="pull" Sep 09 23:19:37.206739 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:19:37.206711 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="683ad63f-595e-4823-bcce-e497cfde3332" containerName="pull" Sep 09 23:19:37.206739 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:19:37.206717 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b230a4b7-3039-4bfa-8f8e-a7d2e08d0d3c" containerName="util" Sep 09 23:19:37.206739 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:19:37.206723 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="b230a4b7-3039-4bfa-8f8e-a7d2e08d0d3c" containerName="util" Sep 09 23:19:37.206739 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:19:37.206728 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5df9bb7f-0d27-427a-a545-8b251d19bef6" containerName="extract" Sep 09 23:19:37.206739 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:19:37.206732 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="5df9bb7f-0d27-427a-a545-8b251d19bef6" containerName="extract" Sep 09 23:19:37.206739 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:19:37.206741 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5df9bb7f-0d27-427a-a545-8b251d19bef6" containerName="util" Sep 09 23:19:37.206739 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:19:37.206746 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="5df9bb7f-0d27-427a-a545-8b251d19bef6" containerName="util" Sep 09 23:19:37.207446 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:19:37.206753 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0dc8ab69-bc39-47e4-9ed7-d0fdfc5e2a37" containerName="extract" Sep 09 23:19:37.207446 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:19:37.206757 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="0dc8ab69-bc39-47e4-9ed7-d0fdfc5e2a37" containerName="extract" Sep 09 23:19:37.207446 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:19:37.206810 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="5df9bb7f-0d27-427a-a545-8b251d19bef6" containerName="extract" Sep 09 23:19:37.207446 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:19:37.206818 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="683ad63f-595e-4823-bcce-e497cfde3332" containerName="extract" Sep 09 23:19:37.207446 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:19:37.206825 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="b230a4b7-3039-4bfa-8f8e-a7d2e08d0d3c" containerName="extract" Sep 09 23:19:37.207446 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:19:37.206831 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="0dc8ab69-bc39-47e4-9ed7-d0fdfc5e2a37" containerName="extract" Sep 09 23:19:37.209805 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:19:37.209790 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-v8lg2" Sep 09 23:19:37.212480 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:19:37.212450 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\"" Sep 09 23:19:37.212620 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:19:37.212515 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Sep 09 23:19:37.212620 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:19:37.212533 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-gqj2n\"" Sep 09 23:19:37.212620 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:19:37.212461 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Sep 09 23:19:37.212620 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:19:37.212461 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\"" Sep 09 23:19:37.217606 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:19:37.217308 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-fbdd4f445-v8lg2"] Sep 09 23:19:37.350414 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:19:37.350355 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/16c0220c-601b-4610-b516-d6a3894a9143-plugin-serving-cert\") pod \"kuadrant-console-plugin-fbdd4f445-v8lg2\" (UID: \"16c0220c-601b-4610-b516-d6a3894a9143\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-v8lg2" Sep 09 23:19:37.350577 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:19:37.350427 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/16c0220c-601b-4610-b516-d6a3894a9143-nginx-conf\") pod \"kuadrant-console-plugin-fbdd4f445-v8lg2\" (UID: \"16c0220c-601b-4610-b516-d6a3894a9143\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-v8lg2" Sep 09 23:19:37.350577 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:19:37.350491 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vnrfl\" (UniqueName: \"kubernetes.io/projected/16c0220c-601b-4610-b516-d6a3894a9143-kube-api-access-vnrfl\") pod \"kuadrant-console-plugin-fbdd4f445-v8lg2\" (UID: \"16c0220c-601b-4610-b516-d6a3894a9143\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-v8lg2" Sep 09 23:19:37.451204 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:19:37.451174 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/16c0220c-601b-4610-b516-d6a3894a9143-plugin-serving-cert\") pod \"kuadrant-console-plugin-fbdd4f445-v8lg2\" (UID: \"16c0220c-601b-4610-b516-d6a3894a9143\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-v8lg2" Sep 09 23:19:37.451410 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:19:37.451222 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/16c0220c-601b-4610-b516-d6a3894a9143-nginx-conf\") pod \"kuadrant-console-plugin-fbdd4f445-v8lg2\" (UID: \"16c0220c-601b-4610-b516-d6a3894a9143\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-v8lg2" Sep 09 23:19:37.451410 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:19:37.451335 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vnrfl\" (UniqueName: \"kubernetes.io/projected/16c0220c-601b-4610-b516-d6a3894a9143-kube-api-access-vnrfl\") pod \"kuadrant-console-plugin-fbdd4f445-v8lg2\" (UID: \"16c0220c-601b-4610-b516-d6a3894a9143\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-v8lg2" Sep 09 23:19:37.451812 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:19:37.451794 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/16c0220c-601b-4610-b516-d6a3894a9143-nginx-conf\") pod \"kuadrant-console-plugin-fbdd4f445-v8lg2\" (UID: \"16c0220c-601b-4610-b516-d6a3894a9143\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-v8lg2" Sep 09 23:19:37.453794 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:19:37.453771 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/16c0220c-601b-4610-b516-d6a3894a9143-plugin-serving-cert\") pod \"kuadrant-console-plugin-fbdd4f445-v8lg2\" (UID: \"16c0220c-601b-4610-b516-d6a3894a9143\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-v8lg2" Sep 09 23:19:37.461202 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:19:37.461141 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vnrfl\" (UniqueName: \"kubernetes.io/projected/16c0220c-601b-4610-b516-d6a3894a9143-kube-api-access-vnrfl\") pod \"kuadrant-console-plugin-fbdd4f445-v8lg2\" (UID: \"16c0220c-601b-4610-b516-d6a3894a9143\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-v8lg2" Sep 09 23:19:37.520182 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:19:37.520161 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-v8lg2" Sep 09 23:19:37.792572 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:19:37.792545 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-fbdd4f445-v8lg2"] Sep 09 23:19:37.794609 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:19:37.794578 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod16c0220c_601b_4610_b516_d6a3894a9143.slice/crio-de4a59675a64474208ab9ba18fdc09421517b9c9f16dfe81ee9088c9feafa126 WatchSource:0}: Error finding container de4a59675a64474208ab9ba18fdc09421517b9c9f16dfe81ee9088c9feafa126: Status 404 returned error can't find the container with id de4a59675a64474208ab9ba18fdc09421517b9c9f16dfe81ee9088c9feafa126 Sep 09 23:19:38.100232 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:19:38.100149 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-v8lg2" event={"ID":"16c0220c-601b-4610-b516-d6a3894a9143","Type":"ContainerStarted","Data":"de4a59675a64474208ab9ba18fdc09421517b9c9f16dfe81ee9088c9feafa126"} Sep 09 23:19:44.134111 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:19:44.134068 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-v8lg2" event={"ID":"16c0220c-601b-4610-b516-d6a3894a9143","Type":"ContainerStarted","Data":"1523f168858fe154c8ec087efefdb5bf63d7eb3ead9281f5a6809ca706bf86dc"} Sep 09 23:19:44.152186 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:19:44.152140 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-v8lg2" podStartSLOduration=1.83051797 podStartE2EDuration="7.152126345s" totalImagesPullingTime="5.321608375s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:19:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:19:44.150959167 +0000 UTC m=+692.526533241" watchObservedRunningTime="2026-09-09 23:19:44.152126345 +0000 UTC m=+692.527700435" Sep 09 23:20:36.720780 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:20:36.720747 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-257nv"] Sep 09 23:20:36.724158 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:20:36.724141 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-84994f7ffc-257nv" Sep 09 23:20:36.726730 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:20:36.726709 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Sep 09 23:20:36.733320 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:20:36.733297 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-257nv"] Sep 09 23:20:36.759501 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:20:36.759476 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-257nv"] Sep 09 23:20:36.840713 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:20:36.840683 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/99edc6a9-42aa-40bb-a292-9649d5367b3c-config-file\") pod \"limitador-limitador-84994f7ffc-257nv\" (UID: \"99edc6a9-42aa-40bb-a292-9649d5367b3c\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-257nv" Sep 09 23:20:36.840849 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:20:36.840745 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rw66z\" (UniqueName: \"kubernetes.io/projected/99edc6a9-42aa-40bb-a292-9649d5367b3c-kube-api-access-rw66z\") pod \"limitador-limitador-84994f7ffc-257nv\" (UID: \"99edc6a9-42aa-40bb-a292-9649d5367b3c\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-257nv" Sep 09 23:20:36.941953 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:20:36.941921 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/99edc6a9-42aa-40bb-a292-9649d5367b3c-config-file\") pod \"limitador-limitador-84994f7ffc-257nv\" (UID: \"99edc6a9-42aa-40bb-a292-9649d5367b3c\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-257nv" Sep 09 23:20:36.942126 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:20:36.941964 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rw66z\" (UniqueName: \"kubernetes.io/projected/99edc6a9-42aa-40bb-a292-9649d5367b3c-kube-api-access-rw66z\") pod \"limitador-limitador-84994f7ffc-257nv\" (UID: \"99edc6a9-42aa-40bb-a292-9649d5367b3c\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-257nv" Sep 09 23:20:36.942621 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:20:36.942603 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/99edc6a9-42aa-40bb-a292-9649d5367b3c-config-file\") pod \"limitador-limitador-84994f7ffc-257nv\" (UID: \"99edc6a9-42aa-40bb-a292-9649d5367b3c\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-257nv" Sep 09 23:20:36.950191 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:20:36.950167 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rw66z\" (UniqueName: \"kubernetes.io/projected/99edc6a9-42aa-40bb-a292-9649d5367b3c-kube-api-access-rw66z\") pod \"limitador-limitador-84994f7ffc-257nv\" (UID: \"99edc6a9-42aa-40bb-a292-9649d5367b3c\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-257nv" Sep 09 23:20:37.035182 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:20:37.035152 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-84994f7ffc-257nv" Sep 09 23:20:37.213599 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:20:37.213561 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-nq2zb"] Sep 09 23:20:37.217248 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:20:37.217228 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7bcfd8f9cd-nq2zb" Sep 09 23:20:37.219624 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:20:37.219609 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-5smj5\"" Sep 09 23:20:37.223572 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:20:37.223551 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-nq2zb"] Sep 09 23:20:37.309726 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:20:37.309700 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-257nv"] Sep 09 23:20:37.311562 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:20:37.311538 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod99edc6a9_42aa_40bb_a292_9649d5367b3c.slice/crio-6d912e8c044e4149782c10480957c7eb8cba7128ad9654c8ca6b1919abff1291 WatchSource:0}: Error finding container 6d912e8c044e4149782c10480957c7eb8cba7128ad9654c8ca6b1919abff1291: Status 404 returned error can't find the container with id 6d912e8c044e4149782c10480957c7eb8cba7128ad9654c8ca6b1919abff1291 Sep 09 23:20:37.346001 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:20:37.345978 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cr2wv\" (UniqueName: \"kubernetes.io/projected/f4968a11-9c03-49ed-be6b-a5f0c4c0232d-kube-api-access-cr2wv\") pod \"authorino-7bcfd8f9cd-nq2zb\" (UID: \"f4968a11-9c03-49ed-be6b-a5f0c4c0232d\") " pod="kuadrant-system/authorino-7bcfd8f9cd-nq2zb" Sep 09 23:20:37.409810 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:20:37.409776 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-84994f7ffc-257nv" event={"ID":"99edc6a9-42aa-40bb-a292-9649d5367b3c","Type":"ContainerStarted","Data":"6d912e8c044e4149782c10480957c7eb8cba7128ad9654c8ca6b1919abff1291"} Sep 09 23:20:37.447302 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:20:37.447272 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cr2wv\" (UniqueName: \"kubernetes.io/projected/f4968a11-9c03-49ed-be6b-a5f0c4c0232d-kube-api-access-cr2wv\") pod \"authorino-7bcfd8f9cd-nq2zb\" (UID: \"f4968a11-9c03-49ed-be6b-a5f0c4c0232d\") " pod="kuadrant-system/authorino-7bcfd8f9cd-nq2zb" Sep 09 23:20:37.455149 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:20:37.455125 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cr2wv\" (UniqueName: \"kubernetes.io/projected/f4968a11-9c03-49ed-be6b-a5f0c4c0232d-kube-api-access-cr2wv\") pod \"authorino-7bcfd8f9cd-nq2zb\" (UID: \"f4968a11-9c03-49ed-be6b-a5f0c4c0232d\") " pod="kuadrant-system/authorino-7bcfd8f9cd-nq2zb" Sep 09 23:20:37.527950 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:20:37.527919 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7bcfd8f9cd-nq2zb" Sep 09 23:20:37.798552 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:20:37.798515 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-nq2zb"] Sep 09 23:20:37.801443 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:20:37.801417 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf4968a11_9c03_49ed_be6b_a5f0c4c0232d.slice/crio-d0befa978c48be63e6e119f9470d8f8e37dfde53ebb6238a0af89dcc1ff97b86 WatchSource:0}: Error finding container d0befa978c48be63e6e119f9470d8f8e37dfde53ebb6238a0af89dcc1ff97b86: Status 404 returned error can't find the container with id d0befa978c48be63e6e119f9470d8f8e37dfde53ebb6238a0af89dcc1ff97b86 Sep 09 23:20:38.419853 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:20:38.419814 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7bcfd8f9cd-nq2zb" event={"ID":"f4968a11-9c03-49ed-be6b-a5f0c4c0232d","Type":"ContainerStarted","Data":"d0befa978c48be63e6e119f9470d8f8e37dfde53ebb6238a0af89dcc1ff97b86"} Sep 09 23:20:40.053999 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:20:40.053962 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-nq2zb"] Sep 09 23:20:40.436235 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:20:40.436107 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-84994f7ffc-257nv" event={"ID":"99edc6a9-42aa-40bb-a292-9649d5367b3c","Type":"ContainerStarted","Data":"d6913c8c468651faf4f8c2b53c3e21bf8cd680fc477ee36a4eb67d5312bd80ba"} Sep 09 23:20:40.436235 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:20:40.436222 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-84994f7ffc-257nv" Sep 09 23:20:40.437980 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:20:40.437953 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7bcfd8f9cd-nq2zb" event={"ID":"f4968a11-9c03-49ed-be6b-a5f0c4c0232d","Type":"ContainerStarted","Data":"77ca33bce16ab4e1617bc094c79d6c0ec15d7556c6279840afabd339dc7a41cd"} Sep 09 23:20:40.438117 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:20:40.438004 2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-7bcfd8f9cd-nq2zb" podUID="f4968a11-9c03-49ed-be6b-a5f0c4c0232d" containerName="authorino" containerID="cri-o://77ca33bce16ab4e1617bc094c79d6c0ec15d7556c6279840afabd339dc7a41cd" gracePeriod=30 Sep 09 23:20:40.458148 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:20:40.458105 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-84994f7ffc-257nv" podStartSLOduration=1.471438389 podStartE2EDuration="4.458090352s" totalImagesPullingTime="2.986651963s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:20:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:20:40.455310179 +0000 UTC m=+748.830884244" watchObservedRunningTime="2026-09-09 23:20:40.458090352 +0000 UTC m=+748.833664444" Sep 09 23:20:40.469909 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:20:40.469869 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-7bcfd8f9cd-nq2zb" podStartSLOduration=0.965237756 podStartE2EDuration="3.469854978s" totalImagesPullingTime="2.504617222s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:20:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:20:40.468038868 +0000 UTC m=+748.843612929" watchObservedRunningTime="2026-09-09 23:20:40.469854978 +0000 UTC m=+748.845429040" Sep 09 23:20:40.680411 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:20:40.680387 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7bcfd8f9cd-nq2zb" Sep 09 23:20:40.787355 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:20:40.787312 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cr2wv\" (UniqueName: \"kubernetes.io/projected/f4968a11-9c03-49ed-be6b-a5f0c4c0232d-kube-api-access-cr2wv\") pod \"f4968a11-9c03-49ed-be6b-a5f0c4c0232d\" (UID: \"f4968a11-9c03-49ed-be6b-a5f0c4c0232d\") " Sep 09 23:20:40.789646 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:20:40.789613 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f4968a11-9c03-49ed-be6b-a5f0c4c0232d-kube-api-access-cr2wv" (OuterVolumeSpecName: "kube-api-access-cr2wv") pod "f4968a11-9c03-49ed-be6b-a5f0c4c0232d" (UID: "f4968a11-9c03-49ed-be6b-a5f0c4c0232d"). InnerVolumeSpecName "kube-api-access-cr2wv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 09 23:20:40.888910 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:20:40.888835 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cr2wv\" (UniqueName: \"kubernetes.io/projected/f4968a11-9c03-49ed-be6b-a5f0c4c0232d-kube-api-access-cr2wv\") on node \"ip-10-0-132-204.ec2.internal\" DevicePath \"\"" Sep 09 23:20:41.444689 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:20:41.444648 2561 generic.go:356] "Generic (PLEG): container finished" podID="f4968a11-9c03-49ed-be6b-a5f0c4c0232d" containerID="77ca33bce16ab4e1617bc094c79d6c0ec15d7556c6279840afabd339dc7a41cd" exitCode=0 Sep 09 23:20:41.444689 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:20:41.444682 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7bcfd8f9cd-nq2zb" event={"ID":"f4968a11-9c03-49ed-be6b-a5f0c4c0232d","Type":"ContainerDied","Data":"77ca33bce16ab4e1617bc094c79d6c0ec15d7556c6279840afabd339dc7a41cd"} Sep 09 23:20:41.445168 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:20:41.444727 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7bcfd8f9cd-nq2zb" event={"ID":"f4968a11-9c03-49ed-be6b-a5f0c4c0232d","Type":"ContainerDied","Data":"d0befa978c48be63e6e119f9470d8f8e37dfde53ebb6238a0af89dcc1ff97b86"} Sep 09 23:20:41.445168 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:20:41.444744 2561 scope.go:117] "RemoveContainer" containerID="77ca33bce16ab4e1617bc094c79d6c0ec15d7556c6279840afabd339dc7a41cd" Sep 09 23:20:41.445168 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:20:41.444693 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7bcfd8f9cd-nq2zb" Sep 09 23:20:41.454267 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:20:41.454250 2561 scope.go:117] "RemoveContainer" containerID="77ca33bce16ab4e1617bc094c79d6c0ec15d7556c6279840afabd339dc7a41cd" Sep 09 23:20:41.454554 ip-10-0-132-204 kubenswrapper[2561]: E0909 23:20:41.454535 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"77ca33bce16ab4e1617bc094c79d6c0ec15d7556c6279840afabd339dc7a41cd\": container with ID starting with 77ca33bce16ab4e1617bc094c79d6c0ec15d7556c6279840afabd339dc7a41cd not found: ID does not exist" containerID="77ca33bce16ab4e1617bc094c79d6c0ec15d7556c6279840afabd339dc7a41cd" Sep 09 23:20:41.454623 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:20:41.454568 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"77ca33bce16ab4e1617bc094c79d6c0ec15d7556c6279840afabd339dc7a41cd"} err="failed to get container status \"77ca33bce16ab4e1617bc094c79d6c0ec15d7556c6279840afabd339dc7a41cd\": rpc error: code = NotFound desc = could not find container \"77ca33bce16ab4e1617bc094c79d6c0ec15d7556c6279840afabd339dc7a41cd\": container with ID starting with 77ca33bce16ab4e1617bc094c79d6c0ec15d7556c6279840afabd339dc7a41cd not found: ID does not exist" Sep 09 23:20:41.466224 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:20:41.466203 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-nq2zb"] Sep 09 23:20:41.469768 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:20:41.469749 2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-nq2zb"] Sep 09 23:20:42.117716 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:20:42.117682 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f4968a11-9c03-49ed-be6b-a5f0c4c0232d" path="/var/lib/kubelet/pods/f4968a11-9c03-49ed-be6b-a5f0c4c0232d/volumes" Sep 09 23:20:51.446444 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:20:51.446417 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-84994f7ffc-257nv" Sep 09 23:21:08.007198 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:21:08.007161 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-557f876f69-j6pt7"] Sep 09 23:21:08.007584 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:21:08.007559 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f4968a11-9c03-49ed-be6b-a5f0c4c0232d" containerName="authorino" Sep 09 23:21:08.007584 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:21:08.007573 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="f4968a11-9c03-49ed-be6b-a5f0c4c0232d" containerName="authorino" Sep 09 23:21:08.007667 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:21:08.007643 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="f4968a11-9c03-49ed-be6b-a5f0c4c0232d" containerName="authorino" Sep 09 23:21:08.012096 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:21:08.012079 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-557f876f69-j6pt7" Sep 09 23:21:08.014633 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:21:08.014605 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-5smj5\"" Sep 09 23:21:08.016909 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:21:08.016886 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-557f876f69-j6pt7"] Sep 09 23:21:08.065267 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:21:08.065239 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-557f876f69-j6pt7"] Sep 09 23:21:08.065516 ip-10-0-132-204 kubenswrapper[2561]: E0909 23:21:08.065497 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-cqvb4], unattached volumes=[], failed to process volumes=[kube-api-access-cqvb4]: context canceled" pod="kuadrant-system/authorino-557f876f69-j6pt7" podUID="53ff24e5-1eb5-42e2-bcb9-7074f360d405" Sep 09 23:21:08.093186 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:21:08.093159 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-6d4dfc649f-gs8dv"] Sep 09 23:21:08.099430 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:21:08.099415 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6d4dfc649f-gs8dv" Sep 09 23:21:08.101925 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:21:08.101905 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" Sep 09 23:21:08.102790 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:21:08.102769 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6d4dfc649f-gs8dv"] Sep 09 23:21:08.128657 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:21:08.128631 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cqvb4\" (UniqueName: \"kubernetes.io/projected/53ff24e5-1eb5-42e2-bcb9-7074f360d405-kube-api-access-cqvb4\") pod \"authorino-557f876f69-j6pt7\" (UID: \"53ff24e5-1eb5-42e2-bcb9-7074f360d405\") " pod="kuadrant-system/authorino-557f876f69-j6pt7" Sep 09 23:21:08.229344 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:21:08.229315 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ddxw5\" (UniqueName: \"kubernetes.io/projected/b6850a80-8bf8-4afb-b033-0ef6b1fccb00-kube-api-access-ddxw5\") pod \"authorino-6d4dfc649f-gs8dv\" (UID: \"b6850a80-8bf8-4afb-b033-0ef6b1fccb00\") " pod="kuadrant-system/authorino-6d4dfc649f-gs8dv" Sep 09 23:21:08.229477 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:21:08.229347 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/b6850a80-8bf8-4afb-b033-0ef6b1fccb00-tls-cert\") pod \"authorino-6d4dfc649f-gs8dv\" (UID: \"b6850a80-8bf8-4afb-b033-0ef6b1fccb00\") " pod="kuadrant-system/authorino-6d4dfc649f-gs8dv" Sep 09 23:21:08.229520 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:21:08.229478 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cqvb4\" (UniqueName: \"kubernetes.io/projected/53ff24e5-1eb5-42e2-bcb9-7074f360d405-kube-api-access-cqvb4\") pod \"authorino-557f876f69-j6pt7\" (UID: \"53ff24e5-1eb5-42e2-bcb9-7074f360d405\") " pod="kuadrant-system/authorino-557f876f69-j6pt7" Sep 09 23:21:08.239025 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:21:08.238999 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cqvb4\" (UniqueName: \"kubernetes.io/projected/53ff24e5-1eb5-42e2-bcb9-7074f360d405-kube-api-access-cqvb4\") pod \"authorino-557f876f69-j6pt7\" (UID: \"53ff24e5-1eb5-42e2-bcb9-7074f360d405\") " pod="kuadrant-system/authorino-557f876f69-j6pt7" Sep 09 23:21:08.252240 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:21:08.252220 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6d4dfc649f-gs8dv"] Sep 09 23:21:08.252452 ip-10-0-132-204 kubenswrapper[2561]: E0909 23:21:08.252434 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-ddxw5 tls-cert], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-6d4dfc649f-gs8dv" podUID="b6850a80-8bf8-4afb-b033-0ef6b1fccb00" Sep 09 23:21:08.330018 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:21:08.329955 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ddxw5\" (UniqueName: \"kubernetes.io/projected/b6850a80-8bf8-4afb-b033-0ef6b1fccb00-kube-api-access-ddxw5\") pod \"authorino-6d4dfc649f-gs8dv\" (UID: \"b6850a80-8bf8-4afb-b033-0ef6b1fccb00\") " pod="kuadrant-system/authorino-6d4dfc649f-gs8dv" Sep 09 23:21:08.330018 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:21:08.329988 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/b6850a80-8bf8-4afb-b033-0ef6b1fccb00-tls-cert\") pod \"authorino-6d4dfc649f-gs8dv\" (UID: \"b6850a80-8bf8-4afb-b033-0ef6b1fccb00\") " pod="kuadrant-system/authorino-6d4dfc649f-gs8dv" Sep 09 23:21:08.332566 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:21:08.332547 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/b6850a80-8bf8-4afb-b033-0ef6b1fccb00-tls-cert\") pod \"authorino-6d4dfc649f-gs8dv\" (UID: \"b6850a80-8bf8-4afb-b033-0ef6b1fccb00\") " pod="kuadrant-system/authorino-6d4dfc649f-gs8dv" Sep 09 23:21:08.340355 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:21:08.340335 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ddxw5\" (UniqueName: \"kubernetes.io/projected/b6850a80-8bf8-4afb-b033-0ef6b1fccb00-kube-api-access-ddxw5\") pod \"authorino-6d4dfc649f-gs8dv\" (UID: \"b6850a80-8bf8-4afb-b033-0ef6b1fccb00\") " pod="kuadrant-system/authorino-6d4dfc649f-gs8dv" Sep 09 23:21:08.595685 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:21:08.595606 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6d4dfc649f-gs8dv" Sep 09 23:21:08.595836 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:21:08.595610 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-557f876f69-j6pt7" Sep 09 23:21:08.604069 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:21:08.604050 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6d4dfc649f-gs8dv" Sep 09 23:21:08.605963 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:21:08.605947 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-557f876f69-j6pt7" Sep 09 23:21:08.733753 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:21:08.733725 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cqvb4\" (UniqueName: \"kubernetes.io/projected/53ff24e5-1eb5-42e2-bcb9-7074f360d405-kube-api-access-cqvb4\") pod \"53ff24e5-1eb5-42e2-bcb9-7074f360d405\" (UID: \"53ff24e5-1eb5-42e2-bcb9-7074f360d405\") " Sep 09 23:21:08.733912 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:21:08.733775 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/b6850a80-8bf8-4afb-b033-0ef6b1fccb00-tls-cert\") pod \"b6850a80-8bf8-4afb-b033-0ef6b1fccb00\" (UID: \"b6850a80-8bf8-4afb-b033-0ef6b1fccb00\") " Sep 09 23:21:08.733912 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:21:08.733816 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ddxw5\" (UniqueName: \"kubernetes.io/projected/b6850a80-8bf8-4afb-b033-0ef6b1fccb00-kube-api-access-ddxw5\") pod \"b6850a80-8bf8-4afb-b033-0ef6b1fccb00\" (UID: \"b6850a80-8bf8-4afb-b033-0ef6b1fccb00\") " Sep 09 23:21:08.736120 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:21:08.736088 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b6850a80-8bf8-4afb-b033-0ef6b1fccb00-kube-api-access-ddxw5" (OuterVolumeSpecName: "kube-api-access-ddxw5") pod "b6850a80-8bf8-4afb-b033-0ef6b1fccb00" (UID: "b6850a80-8bf8-4afb-b033-0ef6b1fccb00"). InnerVolumeSpecName "kube-api-access-ddxw5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 09 23:21:08.736120 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:21:08.736099 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/53ff24e5-1eb5-42e2-bcb9-7074f360d405-kube-api-access-cqvb4" (OuterVolumeSpecName: "kube-api-access-cqvb4") pod "53ff24e5-1eb5-42e2-bcb9-7074f360d405" (UID: "53ff24e5-1eb5-42e2-bcb9-7074f360d405"). InnerVolumeSpecName "kube-api-access-cqvb4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 09 23:21:08.736312 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:21:08.736132 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b6850a80-8bf8-4afb-b033-0ef6b1fccb00-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "b6850a80-8bf8-4afb-b033-0ef6b1fccb00" (UID: "b6850a80-8bf8-4afb-b033-0ef6b1fccb00"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 09 23:21:08.835057 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:21:08.835014 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ddxw5\" (UniqueName: \"kubernetes.io/projected/b6850a80-8bf8-4afb-b033-0ef6b1fccb00-kube-api-access-ddxw5\") on node \"ip-10-0-132-204.ec2.internal\" DevicePath \"\"" Sep 09 23:21:08.835057 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:21:08.835051 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cqvb4\" (UniqueName: \"kubernetes.io/projected/53ff24e5-1eb5-42e2-bcb9-7074f360d405-kube-api-access-cqvb4\") on node \"ip-10-0-132-204.ec2.internal\" DevicePath \"\"" Sep 09 23:21:08.835057 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:21:08.835062 2561 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/b6850a80-8bf8-4afb-b033-0ef6b1fccb00-tls-cert\") on node \"ip-10-0-132-204.ec2.internal\" DevicePath \"\"" Sep 09 23:21:09.601070 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:21:09.601045 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-557f876f69-j6pt7" Sep 09 23:21:09.601513 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:21:09.601045 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6d4dfc649f-gs8dv" Sep 09 23:21:09.632472 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:21:09.632444 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-557f876f69-j6pt7"] Sep 09 23:21:09.645331 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:21:09.645297 2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-557f876f69-j6pt7"] Sep 09 23:21:09.664811 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:21:09.664773 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6d4dfc649f-gs8dv"] Sep 09 23:21:09.667902 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:21:09.667880 2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-6d4dfc649f-gs8dv"] Sep 09 23:21:10.117260 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:21:10.117231 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="53ff24e5-1eb5-42e2-bcb9-7074f360d405" path="/var/lib/kubelet/pods/53ff24e5-1eb5-42e2-bcb9-7074f360d405/volumes" Sep 09 23:21:10.117509 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:21:10.117496 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b6850a80-8bf8-4afb-b033-0ef6b1fccb00" path="/var/lib/kubelet/pods/b6850a80-8bf8-4afb-b033-0ef6b1fccb00/volumes" Sep 09 23:21:53.160100 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:21:53.160062 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-257nv"] Sep 09 23:22:18.518129 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:22:18.518093 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-257nv"] Sep 09 23:22:28.203257 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:22:28.203225 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-257nv"] Sep 09 23:22:55.616555 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:22:55.616515 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-257nv"] Sep 09 23:23:09.615939 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:23:09.615860 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-257nv"] Sep 09 23:23:12.168165 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:23:12.168135 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pl5tw_6942a2c5-1a59-4ea7-b78d-d131103de85f/ovn-acl-logging/0.log" Sep 09 23:23:12.168599 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:23:12.168319 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pl5tw_6942a2c5-1a59-4ea7-b78d-d131103de85f/ovn-acl-logging/0.log" Sep 09 23:23:15.302610 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:23:15.302576 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-257nv"] Sep 09 23:23:26.915603 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:23:26.915557 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-257nv"] Sep 09 23:23:32.899537 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:23:32.899503 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5758cf6949-jzwz9"] Sep 09 23:23:32.903696 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:23:32.903671 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-jzwz9" Sep 09 23:23:32.906931 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:23:32.906907 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-n6sp2\"" Sep 09 23:23:32.907047 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:23:32.906948 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Sep 09 23:23:32.907047 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:23:32.906907 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Sep 09 23:23:32.907912 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:23:32.907897 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\"" Sep 09 23:23:32.913238 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:23:32.912781 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5758cf6949-jzwz9"] Sep 09 23:23:33.012139 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:23:33.012100 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1312f52e-a6ae-4e56-b775-7c634cf4382a-dshm\") pod \"premium-simulated-simulated-premium-kserve-5758cf6949-jzwz9\" (UID: \"1312f52e-a6ae-4e56-b775-7c634cf4382a\") " pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-jzwz9" Sep 09 23:23:33.012139 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:23:33.012142 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1312f52e-a6ae-4e56-b775-7c634cf4382a-home\") pod \"premium-simulated-simulated-premium-kserve-5758cf6949-jzwz9\" (UID: \"1312f52e-a6ae-4e56-b775-7c634cf4382a\") " pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-jzwz9" Sep 09 23:23:33.012449 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:23:33.012160 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cf886\" (UniqueName: \"kubernetes.io/projected/1312f52e-a6ae-4e56-b775-7c634cf4382a-kube-api-access-cf886\") pod \"premium-simulated-simulated-premium-kserve-5758cf6949-jzwz9\" (UID: \"1312f52e-a6ae-4e56-b775-7c634cf4382a\") " pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-jzwz9" Sep 09 23:23:33.012449 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:23:33.012192 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1312f52e-a6ae-4e56-b775-7c634cf4382a-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5758cf6949-jzwz9\" (UID: \"1312f52e-a6ae-4e56-b775-7c634cf4382a\") " pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-jzwz9" Sep 09 23:23:33.012449 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:23:33.012282 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1312f52e-a6ae-4e56-b775-7c634cf4382a-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5758cf6949-jzwz9\" (UID: \"1312f52e-a6ae-4e56-b775-7c634cf4382a\") " pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-jzwz9" Sep 09 23:23:33.012449 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:23:33.012319 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1312f52e-a6ae-4e56-b775-7c634cf4382a-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5758cf6949-jzwz9\" (UID: \"1312f52e-a6ae-4e56-b775-7c634cf4382a\") " pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-jzwz9" Sep 09 23:23:33.113112 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:23:33.113073 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1312f52e-a6ae-4e56-b775-7c634cf4382a-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5758cf6949-jzwz9\" (UID: \"1312f52e-a6ae-4e56-b775-7c634cf4382a\") " pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-jzwz9" Sep 09 23:23:33.113112 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:23:33.113110 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1312f52e-a6ae-4e56-b775-7c634cf4382a-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5758cf6949-jzwz9\" (UID: \"1312f52e-a6ae-4e56-b775-7c634cf4382a\") " pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-jzwz9" Sep 09 23:23:33.113348 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:23:33.113156 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1312f52e-a6ae-4e56-b775-7c634cf4382a-dshm\") pod \"premium-simulated-simulated-premium-kserve-5758cf6949-jzwz9\" (UID: \"1312f52e-a6ae-4e56-b775-7c634cf4382a\") " pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-jzwz9" Sep 09 23:23:33.113348 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:23:33.113176 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1312f52e-a6ae-4e56-b775-7c634cf4382a-home\") pod \"premium-simulated-simulated-premium-kserve-5758cf6949-jzwz9\" (UID: \"1312f52e-a6ae-4e56-b775-7c634cf4382a\") " pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-jzwz9" Sep 09 23:23:33.113348 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:23:33.113194 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cf886\" (UniqueName: \"kubernetes.io/projected/1312f52e-a6ae-4e56-b775-7c634cf4382a-kube-api-access-cf886\") pod \"premium-simulated-simulated-premium-kserve-5758cf6949-jzwz9\" (UID: \"1312f52e-a6ae-4e56-b775-7c634cf4382a\") " pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-jzwz9" Sep 09 23:23:33.113348 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:23:33.113221 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1312f52e-a6ae-4e56-b775-7c634cf4382a-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5758cf6949-jzwz9\" (UID: \"1312f52e-a6ae-4e56-b775-7c634cf4382a\") " pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-jzwz9" Sep 09 23:23:33.113609 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:23:33.113588 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1312f52e-a6ae-4e56-b775-7c634cf4382a-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5758cf6949-jzwz9\" (UID: \"1312f52e-a6ae-4e56-b775-7c634cf4382a\") " pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-jzwz9" Sep 09 23:23:33.113673 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:23:33.113635 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1312f52e-a6ae-4e56-b775-7c634cf4382a-home\") pod \"premium-simulated-simulated-premium-kserve-5758cf6949-jzwz9\" (UID: \"1312f52e-a6ae-4e56-b775-7c634cf4382a\") " pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-jzwz9" Sep 09 23:23:33.113673 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:23:33.113660 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1312f52e-a6ae-4e56-b775-7c634cf4382a-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5758cf6949-jzwz9\" (UID: \"1312f52e-a6ae-4e56-b775-7c634cf4382a\") " pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-jzwz9" Sep 09 23:23:33.115530 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:23:33.115509 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1312f52e-a6ae-4e56-b775-7c634cf4382a-dshm\") pod \"premium-simulated-simulated-premium-kserve-5758cf6949-jzwz9\" (UID: \"1312f52e-a6ae-4e56-b775-7c634cf4382a\") " pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-jzwz9" Sep 09 23:23:33.115701 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:23:33.115683 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1312f52e-a6ae-4e56-b775-7c634cf4382a-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5758cf6949-jzwz9\" (UID: \"1312f52e-a6ae-4e56-b775-7c634cf4382a\") " pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-jzwz9" Sep 09 23:23:33.121880 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:23:33.121855 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cf886\" (UniqueName: \"kubernetes.io/projected/1312f52e-a6ae-4e56-b775-7c634cf4382a-kube-api-access-cf886\") pod \"premium-simulated-simulated-premium-kserve-5758cf6949-jzwz9\" (UID: \"1312f52e-a6ae-4e56-b775-7c634cf4382a\") " pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-jzwz9" Sep 09 23:23:33.215647 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:23:33.215564 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-jzwz9" Sep 09 23:23:33.487074 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:23:33.487052 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5758cf6949-jzwz9"] Sep 09 23:23:33.489044 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:23:33.489016 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1312f52e_a6ae_4e56_b775_7c634cf4382a.slice/crio-0529b6820ee40be9ba2b8251b856553f8a4ab274c817f0f67b5f8ac63ff14e44 WatchSource:0}: Error finding container 0529b6820ee40be9ba2b8251b856553f8a4ab274c817f0f67b5f8ac63ff14e44: Status 404 returned error can't find the container with id 0529b6820ee40be9ba2b8251b856553f8a4ab274c817f0f67b5f8ac63ff14e44 Sep 09 23:23:33.490435 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:23:33.490416 2561 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 09 23:23:34.379225 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:23:34.379184 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-jzwz9" event={"ID":"1312f52e-a6ae-4e56-b775-7c634cf4382a","Type":"ContainerStarted","Data":"0529b6820ee40be9ba2b8251b856553f8a4ab274c817f0f67b5f8ac63ff14e44"} Sep 09 23:23:35.392541 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:23:35.392499 2561 generic.go:356] "Generic (PLEG): container finished" podID="1312f52e-a6ae-4e56-b775-7c634cf4382a" containerID="2413bbf8a8184ce246f79a287b25be33a667d0ed638549378db1ff92efe3f350" exitCode=0 Sep 09 23:23:35.392907 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:23:35.392570 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-jzwz9" event={"ID":"1312f52e-a6ae-4e56-b775-7c634cf4382a","Type":"ContainerDied","Data":"2413bbf8a8184ce246f79a287b25be33a667d0ed638549378db1ff92efe3f350"} Sep 09 23:23:35.392907 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:23:35.392770 2561 scope.go:117] "RemoveContainer" containerID="2413bbf8a8184ce246f79a287b25be33a667d0ed638549378db1ff92efe3f350" Sep 09 23:23:35.909925 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:23:35.909831 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-257nv"] Sep 09 23:23:36.399833 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:23:36.399803 2561 generic.go:356] "Generic (PLEG): container finished" podID="1312f52e-a6ae-4e56-b775-7c634cf4382a" containerID="13fecca8da1d4fff5426a9570eec9c88072775e5bc39a62b4bed501ac35693d7" exitCode=0 Sep 09 23:23:36.400312 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:23:36.399863 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-jzwz9" event={"ID":"1312f52e-a6ae-4e56-b775-7c634cf4382a","Type":"ContainerDied","Data":"13fecca8da1d4fff5426a9570eec9c88072775e5bc39a62b4bed501ac35693d7"} Sep 09 23:23:36.400312 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:23:36.399900 2561 scope.go:117] "RemoveContainer" containerID="2413bbf8a8184ce246f79a287b25be33a667d0ed638549378db1ff92efe3f350" Sep 09 23:23:36.400312 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:23:36.400165 2561 scope.go:117] "RemoveContainer" containerID="13fecca8da1d4fff5426a9570eec9c88072775e5bc39a62b4bed501ac35693d7" Sep 09 23:23:36.400516 ip-10-0-132-204 kubenswrapper[2561]: E0909 23:23:36.400415 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 10s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-jzwz9_llm(1312f52e-a6ae-4e56-b775-7c634cf4382a)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-jzwz9" podUID="1312f52e-a6ae-4e56-b775-7c634cf4382a" Sep 09 23:23:37.407419 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:23:37.407357 2561 scope.go:117] "RemoveContainer" containerID="13fecca8da1d4fff5426a9570eec9c88072775e5bc39a62b4bed501ac35693d7" Sep 09 23:23:37.407815 ip-10-0-132-204 kubenswrapper[2561]: E0909 23:23:37.407533 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 10s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-jzwz9_llm(1312f52e-a6ae-4e56-b775-7c634cf4382a)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-jzwz9" podUID="1312f52e-a6ae-4e56-b775-7c634cf4382a" Sep 09 23:23:43.216535 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:23:43.216500 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-jzwz9" Sep 09 23:23:43.216994 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:23:43.216556 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-jzwz9" Sep 09 23:23:43.216994 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:23:43.216570 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-jzwz9" Sep 09 23:23:43.216994 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:23:43.216580 2561 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-jzwz9" Sep 09 23:23:43.217175 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:23:43.217026 2561 scope.go:117] "RemoveContainer" containerID="13fecca8da1d4fff5426a9570eec9c88072775e5bc39a62b4bed501ac35693d7" Sep 09 23:23:43.217252 ip-10-0-132-204 kubenswrapper[2561]: E0909 23:23:43.217227 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 10s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-jzwz9_llm(1312f52e-a6ae-4e56-b775-7c634cf4382a)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-jzwz9" podUID="1312f52e-a6ae-4e56-b775-7c634cf4382a" Sep 09 23:23:56.111716 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:23:56.111680 2561 scope.go:117] "RemoveContainer" containerID="13fecca8da1d4fff5426a9570eec9c88072775e5bc39a62b4bed501ac35693d7" Sep 09 23:23:56.507134 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:23:56.507101 2561 generic.go:356] "Generic (PLEG): container finished" podID="1312f52e-a6ae-4e56-b775-7c634cf4382a" containerID="78e9e090b88cfaab92ecddacdd186734f2df419ef4499684785a070f87ce2ab1" exitCode=0 Sep 09 23:23:56.507285 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:23:56.507175 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-jzwz9" event={"ID":"1312f52e-a6ae-4e56-b775-7c634cf4382a","Type":"ContainerDied","Data":"78e9e090b88cfaab92ecddacdd186734f2df419ef4499684785a070f87ce2ab1"} Sep 09 23:23:56.507285 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:23:56.507230 2561 scope.go:117] "RemoveContainer" containerID="13fecca8da1d4fff5426a9570eec9c88072775e5bc39a62b4bed501ac35693d7" Sep 09 23:23:56.507653 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:23:56.507636 2561 scope.go:117] "RemoveContainer" containerID="78e9e090b88cfaab92ecddacdd186734f2df419ef4499684785a070f87ce2ab1" Sep 09 23:23:56.507864 ip-10-0-132-204 kubenswrapper[2561]: E0909 23:23:56.507844 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 20s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-jzwz9_llm(1312f52e-a6ae-4e56-b775-7c634cf4382a)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-jzwz9" podUID="1312f52e-a6ae-4e56-b775-7c634cf4382a" Sep 09 23:24:03.216505 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:24:03.216456 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-jzwz9" Sep 09 23:24:03.216505 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:24:03.216519 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-jzwz9" Sep 09 23:24:03.216974 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:24:03.216530 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-jzwz9" Sep 09 23:24:03.216974 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:24:03.216540 2561 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-jzwz9" Sep 09 23:24:03.216974 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:24:03.216869 2561 scope.go:117] "RemoveContainer" containerID="78e9e090b88cfaab92ecddacdd186734f2df419ef4499684785a070f87ce2ab1" Sep 09 23:24:03.217075 ip-10-0-132-204 kubenswrapper[2561]: E0909 23:24:03.217029 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 20s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-jzwz9_llm(1312f52e-a6ae-4e56-b775-7c634cf4382a)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-jzwz9" podUID="1312f52e-a6ae-4e56-b775-7c634cf4382a" Sep 09 23:24:18.111335 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:24:18.111297 2561 scope.go:117] "RemoveContainer" containerID="78e9e090b88cfaab92ecddacdd186734f2df419ef4499684785a070f87ce2ab1" Sep 09 23:24:18.629396 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:24:18.629288 2561 generic.go:356] "Generic (PLEG): container finished" podID="1312f52e-a6ae-4e56-b775-7c634cf4382a" containerID="1820b65feb9d4a98d441334db25ed5ff996c46e66068097c822ac15a1cb26639" exitCode=0 Sep 09 23:24:18.629396 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:24:18.629345 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-jzwz9" event={"ID":"1312f52e-a6ae-4e56-b775-7c634cf4382a","Type":"ContainerDied","Data":"1820b65feb9d4a98d441334db25ed5ff996c46e66068097c822ac15a1cb26639"} Sep 09 23:24:18.629396 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:24:18.629395 2561 scope.go:117] "RemoveContainer" containerID="78e9e090b88cfaab92ecddacdd186734f2df419ef4499684785a070f87ce2ab1" Sep 09 23:24:18.629771 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:24:18.629734 2561 scope.go:117] "RemoveContainer" containerID="1820b65feb9d4a98d441334db25ed5ff996c46e66068097c822ac15a1cb26639" Sep 09 23:24:18.629953 ip-10-0-132-204 kubenswrapper[2561]: E0909 23:24:18.629925 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 40s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-jzwz9_llm(1312f52e-a6ae-4e56-b775-7c634cf4382a)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-jzwz9" podUID="1312f52e-a6ae-4e56-b775-7c634cf4382a" Sep 09 23:24:23.216518 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:24:23.216480 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-jzwz9" Sep 09 23:24:23.216904 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:24:23.216532 2561 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-jzwz9" Sep 09 23:24:23.216904 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:24:23.216544 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-jzwz9" Sep 09 23:24:23.216904 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:24:23.216553 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-jzwz9" Sep 09 23:24:23.216904 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:24:23.216884 2561 scope.go:117] "RemoveContainer" containerID="1820b65feb9d4a98d441334db25ed5ff996c46e66068097c822ac15a1cb26639" Sep 09 23:24:23.217050 ip-10-0-132-204 kubenswrapper[2561]: E0909 23:24:23.217031 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 40s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-jzwz9_llm(1312f52e-a6ae-4e56-b775-7c634cf4382a)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-jzwz9" podUID="1312f52e-a6ae-4e56-b775-7c634cf4382a" Sep 09 23:24:35.111016 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:24:35.110974 2561 scope.go:117] "RemoveContainer" containerID="1820b65feb9d4a98d441334db25ed5ff996c46e66068097c822ac15a1cb26639" Sep 09 23:24:35.111644 ip-10-0-132-204 kubenswrapper[2561]: E0909 23:24:35.111192 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 40s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-jzwz9_llm(1312f52e-a6ae-4e56-b775-7c634cf4382a)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-jzwz9" podUID="1312f52e-a6ae-4e56-b775-7c634cf4382a" Sep 09 23:24:47.111631 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:24:47.111596 2561 scope.go:117] "RemoveContainer" containerID="1820b65feb9d4a98d441334db25ed5ff996c46e66068097c822ac15a1cb26639" Sep 09 23:24:47.111991 ip-10-0-132-204 kubenswrapper[2561]: E0909 23:24:47.111753 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 40s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-jzwz9_llm(1312f52e-a6ae-4e56-b775-7c634cf4382a)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-jzwz9" podUID="1312f52e-a6ae-4e56-b775-7c634cf4382a" Sep 09 23:25:01.110971 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:25:01.110936 2561 scope.go:117] "RemoveContainer" containerID="1820b65feb9d4a98d441334db25ed5ff996c46e66068097c822ac15a1cb26639" Sep 09 23:25:01.865002 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:25:01.864968 2561 generic.go:356] "Generic (PLEG): container finished" podID="1312f52e-a6ae-4e56-b775-7c634cf4382a" containerID="243e3f74dd340559afe8a1f1cc1ac7d7ed6aa0337266d68359509d41abb56d94" exitCode=0 Sep 09 23:25:01.865168 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:25:01.865010 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-jzwz9" event={"ID":"1312f52e-a6ae-4e56-b775-7c634cf4382a","Type":"ContainerDied","Data":"243e3f74dd340559afe8a1f1cc1ac7d7ed6aa0337266d68359509d41abb56d94"} Sep 09 23:25:01.865168 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:25:01.865047 2561 scope.go:117] "RemoveContainer" containerID="1820b65feb9d4a98d441334db25ed5ff996c46e66068097c822ac15a1cb26639" Sep 09 23:25:01.865456 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:25:01.865435 2561 scope.go:117] "RemoveContainer" containerID="243e3f74dd340559afe8a1f1cc1ac7d7ed6aa0337266d68359509d41abb56d94" Sep 09 23:25:01.865629 ip-10-0-132-204 kubenswrapper[2561]: E0909 23:25:01.865608 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-jzwz9_llm(1312f52e-a6ae-4e56-b775-7c634cf4382a)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-jzwz9" podUID="1312f52e-a6ae-4e56-b775-7c634cf4382a" Sep 09 23:25:03.215695 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:25:03.215653 2561 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-jzwz9" Sep 09 23:25:03.215695 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:25:03.215694 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-jzwz9" Sep 09 23:25:03.215695 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:25:03.215706 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-jzwz9" Sep 09 23:25:03.216143 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:25:03.215715 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-jzwz9" Sep 09 23:25:03.216143 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:25:03.216040 2561 scope.go:117] "RemoveContainer" containerID="243e3f74dd340559afe8a1f1cc1ac7d7ed6aa0337266d68359509d41abb56d94" Sep 09 23:25:03.216209 ip-10-0-132-204 kubenswrapper[2561]: E0909 23:25:03.216184 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-jzwz9_llm(1312f52e-a6ae-4e56-b775-7c634cf4382a)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-jzwz9" podUID="1312f52e-a6ae-4e56-b775-7c634cf4382a" Sep 09 23:25:14.111957 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:25:14.111928 2561 scope.go:117] "RemoveContainer" containerID="243e3f74dd340559afe8a1f1cc1ac7d7ed6aa0337266d68359509d41abb56d94" Sep 09 23:25:14.112454 ip-10-0-132-204 kubenswrapper[2561]: E0909 23:25:14.112081 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-jzwz9_llm(1312f52e-a6ae-4e56-b775-7c634cf4382a)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-jzwz9" podUID="1312f52e-a6ae-4e56-b775-7c634cf4382a" Sep 09 23:25:28.111132 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:25:28.111096 2561 scope.go:117] "RemoveContainer" containerID="243e3f74dd340559afe8a1f1cc1ac7d7ed6aa0337266d68359509d41abb56d94" Sep 09 23:25:28.111623 ip-10-0-132-204 kubenswrapper[2561]: E0909 23:25:28.111253 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-jzwz9_llm(1312f52e-a6ae-4e56-b775-7c634cf4382a)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-jzwz9" podUID="1312f52e-a6ae-4e56-b775-7c634cf4382a" Sep 09 23:25:42.113771 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:25:42.113737 2561 scope.go:117] "RemoveContainer" containerID="243e3f74dd340559afe8a1f1cc1ac7d7ed6aa0337266d68359509d41abb56d94" Sep 09 23:25:42.114231 ip-10-0-132-204 kubenswrapper[2561]: E0909 23:25:42.113958 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-jzwz9_llm(1312f52e-a6ae-4e56-b775-7c634cf4382a)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-jzwz9" podUID="1312f52e-a6ae-4e56-b775-7c634cf4382a" Sep 09 23:25:55.110805 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:25:55.110777 2561 scope.go:117] "RemoveContainer" containerID="243e3f74dd340559afe8a1f1cc1ac7d7ed6aa0337266d68359509d41abb56d94" Sep 09 23:25:55.111276 ip-10-0-132-204 kubenswrapper[2561]: E0909 23:25:55.110940 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-jzwz9_llm(1312f52e-a6ae-4e56-b775-7c634cf4382a)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-jzwz9" podUID="1312f52e-a6ae-4e56-b775-7c634cf4382a" Sep 09 23:26:09.111696 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:26:09.111625 2561 scope.go:117] "RemoveContainer" containerID="243e3f74dd340559afe8a1f1cc1ac7d7ed6aa0337266d68359509d41abb56d94" Sep 09 23:26:09.112057 ip-10-0-132-204 kubenswrapper[2561]: E0909 23:26:09.111821 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-jzwz9_llm(1312f52e-a6ae-4e56-b775-7c634cf4382a)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-jzwz9" podUID="1312f52e-a6ae-4e56-b775-7c634cf4382a" Sep 09 23:26:24.117146 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:26:24.117117 2561 scope.go:117] "RemoveContainer" containerID="243e3f74dd340559afe8a1f1cc1ac7d7ed6aa0337266d68359509d41abb56d94" Sep 09 23:26:25.310194 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:26:25.310160 2561 generic.go:356] "Generic (PLEG): container finished" podID="1312f52e-a6ae-4e56-b775-7c634cf4382a" containerID="ed1b9e0096fa3cba841ec8b7fc12952f46a176a75b3bab8b56dc3b902b7c4491" exitCode=0 Sep 09 23:26:25.310682 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:26:25.310236 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-jzwz9" event={"ID":"1312f52e-a6ae-4e56-b775-7c634cf4382a","Type":"ContainerDied","Data":"ed1b9e0096fa3cba841ec8b7fc12952f46a176a75b3bab8b56dc3b902b7c4491"} Sep 09 23:26:25.310682 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:26:25.310287 2561 scope.go:117] "RemoveContainer" containerID="243e3f74dd340559afe8a1f1cc1ac7d7ed6aa0337266d68359509d41abb56d94" Sep 09 23:26:25.310806 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:26:25.310703 2561 scope.go:117] "RemoveContainer" containerID="ed1b9e0096fa3cba841ec8b7fc12952f46a176a75b3bab8b56dc3b902b7c4491" Sep 09 23:26:25.310927 ip-10-0-132-204 kubenswrapper[2561]: E0909 23:26:25.310903 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-jzwz9_llm(1312f52e-a6ae-4e56-b775-7c634cf4382a)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-jzwz9" podUID="1312f52e-a6ae-4e56-b775-7c634cf4382a" Sep 09 23:26:33.216068 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:26:33.216032 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-jzwz9" Sep 09 23:26:33.216541 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:26:33.216086 2561 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-jzwz9" Sep 09 23:26:33.216541 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:26:33.216099 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-jzwz9" Sep 09 23:26:33.216541 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:26:33.216109 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-jzwz9" Sep 09 23:26:33.216541 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:26:33.216466 2561 scope.go:117] "RemoveContainer" containerID="ed1b9e0096fa3cba841ec8b7fc12952f46a176a75b3bab8b56dc3b902b7c4491" Sep 09 23:26:33.216682 ip-10-0-132-204 kubenswrapper[2561]: E0909 23:26:33.216655 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-jzwz9_llm(1312f52e-a6ae-4e56-b775-7c634cf4382a)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-jzwz9" podUID="1312f52e-a6ae-4e56-b775-7c634cf4382a" Sep 09 23:26:44.110898 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:26:44.110861 2561 scope.go:117] "RemoveContainer" containerID="ed1b9e0096fa3cba841ec8b7fc12952f46a176a75b3bab8b56dc3b902b7c4491" Sep 09 23:26:44.111406 ip-10-0-132-204 kubenswrapper[2561]: E0909 23:26:44.111045 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-jzwz9_llm(1312f52e-a6ae-4e56-b775-7c634cf4382a)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-jzwz9" podUID="1312f52e-a6ae-4e56-b775-7c634cf4382a" Sep 09 23:26:57.111406 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:26:57.111354 2561 scope.go:117] "RemoveContainer" containerID="ed1b9e0096fa3cba841ec8b7fc12952f46a176a75b3bab8b56dc3b902b7c4491" Sep 09 23:26:57.111783 ip-10-0-132-204 kubenswrapper[2561]: E0909 23:26:57.111531 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-jzwz9_llm(1312f52e-a6ae-4e56-b775-7c634cf4382a)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-jzwz9" podUID="1312f52e-a6ae-4e56-b775-7c634cf4382a" Sep 09 23:27:11.110803 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:27:11.110769 2561 scope.go:117] "RemoveContainer" containerID="ed1b9e0096fa3cba841ec8b7fc12952f46a176a75b3bab8b56dc3b902b7c4491" Sep 09 23:27:11.111248 ip-10-0-132-204 kubenswrapper[2561]: E0909 23:27:11.110931 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-jzwz9_llm(1312f52e-a6ae-4e56-b775-7c634cf4382a)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-jzwz9" podUID="1312f52e-a6ae-4e56-b775-7c634cf4382a" Sep 09 23:27:13.090253 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:27:13.090225 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-68fd95c47c-p6x7t_691fe9da-083d-46f8-8d63-9d6dcd34aa29/copy-manifests/0.log" Sep 09 23:27:13.096973 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:27:13.096951 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-68fd95c47c-p6x7t_691fe9da-083d-46f8-8d63-9d6dcd34aa29/manager/0.log" Sep 09 23:27:14.783233 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:27:14.783204 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-fbdd4f445-v8lg2_16c0220c-601b-4610-b516-d6a3894a9143/kuadrant-console-plugin/0.log" Sep 09 23:27:15.020272 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:27:15.020241 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-84994f7ffc-257nv_99edc6a9-42aa-40bb-a292-9649d5367b3c/limitador/0.log" Sep 09 23:27:15.733563 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:27:15.733531 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-576f68f9bc-nd249_fa8bc2b3-b8f5-401a-ab8d-d080de3ba60a/kube-auth-proxy/0.log" Sep 09 23:27:16.302542 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:27:16.302513 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-894458656-blvvg_9238fa77-06ef-4b6b-9544-ab94b7466815/router/0.log" Sep 09 23:27:17.379223 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:27:17.379192 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-5758cf6949-jzwz9_1312f52e-a6ae-4e56-b775-7c634cf4382a/main/5.log" Sep 09 23:27:23.342489 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:27:23.342456 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-h2lnk/must-gather-wjnkk"] Sep 09 23:27:23.346015 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:27:23.345997 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-h2lnk/must-gather-wjnkk" Sep 09 23:27:23.348680 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:27:23.348659 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-h2lnk\"/\"kube-root-ca.crt\"" Sep 09 23:27:23.349684 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:27:23.349669 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-h2lnk\"/\"openshift-service-ca.crt\"" Sep 09 23:27:23.349735 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:27:23.349710 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-h2lnk\"/\"default-dockercfg-2mqrr\"" Sep 09 23:27:23.355075 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:27:23.355051 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-h2lnk/must-gather-wjnkk"] Sep 09 23:27:23.529158 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:27:23.529116 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/7d901f6c-32a1-457f-8dc7-50096a6b1e1d-must-gather-output\") pod \"must-gather-wjnkk\" (UID: \"7d901f6c-32a1-457f-8dc7-50096a6b1e1d\") " pod="openshift-must-gather-h2lnk/must-gather-wjnkk" Sep 09 23:27:23.529350 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:27:23.529252 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-62fx8\" (UniqueName: \"kubernetes.io/projected/7d901f6c-32a1-457f-8dc7-50096a6b1e1d-kube-api-access-62fx8\") pod \"must-gather-wjnkk\" (UID: \"7d901f6c-32a1-457f-8dc7-50096a6b1e1d\") " pod="openshift-must-gather-h2lnk/must-gather-wjnkk" Sep 09 23:27:23.630129 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:27:23.630048 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-62fx8\" (UniqueName: \"kubernetes.io/projected/7d901f6c-32a1-457f-8dc7-50096a6b1e1d-kube-api-access-62fx8\") pod \"must-gather-wjnkk\" (UID: \"7d901f6c-32a1-457f-8dc7-50096a6b1e1d\") " pod="openshift-must-gather-h2lnk/must-gather-wjnkk" Sep 09 23:27:23.630129 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:27:23.630097 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/7d901f6c-32a1-457f-8dc7-50096a6b1e1d-must-gather-output\") pod \"must-gather-wjnkk\" (UID: \"7d901f6c-32a1-457f-8dc7-50096a6b1e1d\") " pod="openshift-must-gather-h2lnk/must-gather-wjnkk" Sep 09 23:27:23.630438 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:27:23.630395 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/7d901f6c-32a1-457f-8dc7-50096a6b1e1d-must-gather-output\") pod \"must-gather-wjnkk\" (UID: \"7d901f6c-32a1-457f-8dc7-50096a6b1e1d\") " pod="openshift-must-gather-h2lnk/must-gather-wjnkk" Sep 09 23:27:23.638190 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:27:23.638159 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-62fx8\" (UniqueName: \"kubernetes.io/projected/7d901f6c-32a1-457f-8dc7-50096a6b1e1d-kube-api-access-62fx8\") pod \"must-gather-wjnkk\" (UID: \"7d901f6c-32a1-457f-8dc7-50096a6b1e1d\") " pod="openshift-must-gather-h2lnk/must-gather-wjnkk" Sep 09 23:27:23.656168 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:27:23.656145 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-h2lnk/must-gather-wjnkk" Sep 09 23:27:23.929589 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:27:23.929566 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-h2lnk/must-gather-wjnkk"] Sep 09 23:27:23.931516 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:27:23.931486 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7d901f6c_32a1_457f_8dc7_50096a6b1e1d.slice/crio-f5a11963493e9bf0c8351287972083a94c6dcb8e62dc4dee30b7fe4d6d4b9979 WatchSource:0}: Error finding container f5a11963493e9bf0c8351287972083a94c6dcb8e62dc4dee30b7fe4d6d4b9979: Status 404 returned error can't find the container with id f5a11963493e9bf0c8351287972083a94c6dcb8e62dc4dee30b7fe4d6d4b9979 Sep 09 23:27:24.111529 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:27:24.111502 2561 scope.go:117] "RemoveContainer" containerID="ed1b9e0096fa3cba841ec8b7fc12952f46a176a75b3bab8b56dc3b902b7c4491" Sep 09 23:27:24.111683 ip-10-0-132-204 kubenswrapper[2561]: E0909 23:27:24.111647 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-jzwz9_llm(1312f52e-a6ae-4e56-b775-7c634cf4382a)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-jzwz9" podUID="1312f52e-a6ae-4e56-b775-7c634cf4382a" Sep 09 23:27:24.625001 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:27:24.624965 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-h2lnk/must-gather-wjnkk" event={"ID":"7d901f6c-32a1-457f-8dc7-50096a6b1e1d","Type":"ContainerStarted","Data":"f5a11963493e9bf0c8351287972083a94c6dcb8e62dc4dee30b7fe4d6d4b9979"} Sep 09 23:27:25.634748 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:27:25.634704 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-h2lnk/must-gather-wjnkk" event={"ID":"7d901f6c-32a1-457f-8dc7-50096a6b1e1d","Type":"ContainerStarted","Data":"432fabc9c66e19287bd024e6848972702f2d0526d786262214e17346acc967a7"} Sep 09 23:27:25.635204 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:27:25.634766 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-h2lnk/must-gather-wjnkk" event={"ID":"7d901f6c-32a1-457f-8dc7-50096a6b1e1d","Type":"ContainerStarted","Data":"2ee432ffc4069a231c2ed32193c25f0ad45dc7e720d59c257aafa0982bd51552"} Sep 09 23:27:25.654079 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:27:25.654017 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-h2lnk/must-gather-wjnkk" podStartSLOduration=1.656875812 podStartE2EDuration="2.653996717s" totalImagesPullingTime="997.120905ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:27:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:27:25.652893575 +0000 UTC m=+1154.028467638" watchObservedRunningTime="2026-09-09 23:27:25.653996717 +0000 UTC m=+1154.029570780" Sep 09 23:27:26.384451 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:27:26.384415 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-9dwkv_02b55bf2-2972-4487-b51d-9a361a0d2b13/global-pull-secret-syncer/0.log" Sep 09 23:27:26.552774 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:27:26.552741 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-szqb4_1c4a374c-66ce-4af1-b989-7dfdd5b29b61/konnectivity-agent/0.log" Sep 09 23:27:26.573811 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:27:26.573784 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-132-204.ec2.internal_0b1737cd5cce52c5c2776007824f9803/haproxy/0.log" Sep 09 23:27:30.837387 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:27:30.837344 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-fbdd4f445-v8lg2_16c0220c-601b-4610-b516-d6a3894a9143/kuadrant-console-plugin/0.log" Sep 09 23:27:30.914833 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:27:30.914806 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-84994f7ffc-257nv_99edc6a9-42aa-40bb-a292-9649d5367b3c/limitador/0.log" Sep 09 23:27:32.608317 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:27:32.608283 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_fdb2d647-9aa7-4a2a-bff9-faea1bd65032/alertmanager/0.log" Sep 09 23:27:32.631306 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:27:32.631281 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_fdb2d647-9aa7-4a2a-bff9-faea1bd65032/config-reloader/0.log" Sep 09 23:27:32.652469 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:27:32.652434 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_fdb2d647-9aa7-4a2a-bff9-faea1bd65032/kube-rbac-proxy-web/0.log" Sep 09 23:27:32.673488 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:27:32.673461 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_fdb2d647-9aa7-4a2a-bff9-faea1bd65032/kube-rbac-proxy/0.log" Sep 09 23:27:32.705963 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:27:32.705928 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_fdb2d647-9aa7-4a2a-bff9-faea1bd65032/kube-rbac-proxy-metric/0.log" Sep 09 23:27:32.726036 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:27:32.725516 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_fdb2d647-9aa7-4a2a-bff9-faea1bd65032/prom-label-proxy/0.log" Sep 09 23:27:32.746580 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:27:32.746555 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_fdb2d647-9aa7-4a2a-bff9-faea1bd65032/init-config-reloader/0.log" Sep 09 23:27:32.982534 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:27:32.982454 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-78c7c65684-56vmn_7b984e06-8e7a-44b1-b4f1-3404f0be716c/metrics-server/0.log" Sep 09 23:27:33.008912 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:27:33.008887 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-85bbbbbf4-rdcr7_4a45b8ea-3eff-465e-859b-df7b0909fbc3/monitoring-plugin/0.log" Sep 09 23:27:33.199853 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:27:33.199824 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-zltt8_8c702585-be92-4326-80b9-532cb4dfbb69/node-exporter/0.log" Sep 09 23:27:33.220680 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:27:33.220653 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-zltt8_8c702585-be92-4326-80b9-532cb4dfbb69/kube-rbac-proxy/0.log" Sep 09 23:27:33.240648 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:27:33.240579 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-zltt8_8c702585-be92-4326-80b9-532cb4dfbb69/init-textfile/0.log" Sep 09 23:27:33.586536 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:27:33.586452 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-847fc9b467-6647q_bf9c31af-0b7a-4f4a-9502-ec2267abc7dd/telemeter-client/0.log" Sep 09 23:27:33.609142 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:27:33.609117 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-847fc9b467-6647q_bf9c31af-0b7a-4f4a-9502-ec2267abc7dd/reload/0.log" Sep 09 23:27:33.638790 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:27:33.638759 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-847fc9b467-6647q_bf9c31af-0b7a-4f4a-9502-ec2267abc7dd/kube-rbac-proxy/0.log" Sep 09 23:27:33.673996 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:27:33.673963 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6dbc848f7f-ll2ll_c5d3fec8-dee1-4746-8bc9-6c0d873f9698/thanos-query/0.log" Sep 09 23:27:33.699404 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:27:33.699354 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6dbc848f7f-ll2ll_c5d3fec8-dee1-4746-8bc9-6c0d873f9698/kube-rbac-proxy-web/0.log" Sep 09 23:27:33.731638 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:27:33.731591 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6dbc848f7f-ll2ll_c5d3fec8-dee1-4746-8bc9-6c0d873f9698/kube-rbac-proxy/0.log" Sep 09 23:27:33.757399 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:27:33.757351 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6dbc848f7f-ll2ll_c5d3fec8-dee1-4746-8bc9-6c0d873f9698/prom-label-proxy/0.log" Sep 09 23:27:33.778385 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:27:33.778346 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6dbc848f7f-ll2ll_c5d3fec8-dee1-4746-8bc9-6c0d873f9698/kube-rbac-proxy-rules/0.log" Sep 09 23:27:33.800616 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:27:33.800589 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6dbc848f7f-ll2ll_c5d3fec8-dee1-4746-8bc9-6c0d873f9698/kube-rbac-proxy-metrics/0.log" Sep 09 23:27:36.110912 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:27:36.110878 2561 scope.go:117] "RemoveContainer" containerID="ed1b9e0096fa3cba841ec8b7fc12952f46a176a75b3bab8b56dc3b902b7c4491" Sep 09 23:27:36.111501 ip-10-0-132-204 kubenswrapper[2561]: E0909 23:27:36.111139 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-jzwz9_llm(1312f52e-a6ae-4e56-b775-7c634cf4382a)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-jzwz9" podUID="1312f52e-a6ae-4e56-b775-7c634cf4382a" Sep 09 23:27:36.312472 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:27:36.312434 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-h2lnk/perf-node-gather-daemonset-gsqwg"] Sep 09 23:27:36.320941 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:27:36.320908 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-h2lnk/perf-node-gather-daemonset-gsqwg" Sep 09 23:27:36.324128 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:27:36.324099 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-h2lnk/perf-node-gather-daemonset-gsqwg"] Sep 09 23:27:36.363058 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:27:36.362986 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-5f9b59867f-7b784_54d5dfe2-6f96-448d-959e-43b6dce9275b/console/0.log" Sep 09 23:27:36.371477 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:27:36.371442 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c54lf\" (UniqueName: \"kubernetes.io/projected/c0f0ade6-6f02-4c6a-ab74-be7cc1764fd1-kube-api-access-c54lf\") pod \"perf-node-gather-daemonset-gsqwg\" (UID: \"c0f0ade6-6f02-4c6a-ab74-be7cc1764fd1\") " pod="openshift-must-gather-h2lnk/perf-node-gather-daemonset-gsqwg" Sep 09 23:27:36.371636 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:27:36.371530 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/c0f0ade6-6f02-4c6a-ab74-be7cc1764fd1-proc\") pod \"perf-node-gather-daemonset-gsqwg\" (UID: \"c0f0ade6-6f02-4c6a-ab74-be7cc1764fd1\") " pod="openshift-must-gather-h2lnk/perf-node-gather-daemonset-gsqwg" Sep 09 23:27:36.371636 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:27:36.371558 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/c0f0ade6-6f02-4c6a-ab74-be7cc1764fd1-podres\") pod \"perf-node-gather-daemonset-gsqwg\" (UID: \"c0f0ade6-6f02-4c6a-ab74-be7cc1764fd1\") " pod="openshift-must-gather-h2lnk/perf-node-gather-daemonset-gsqwg" Sep 09 23:27:36.371748 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:27:36.371643 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c0f0ade6-6f02-4c6a-ab74-be7cc1764fd1-sys\") pod \"perf-node-gather-daemonset-gsqwg\" (UID: \"c0f0ade6-6f02-4c6a-ab74-be7cc1764fd1\") " pod="openshift-must-gather-h2lnk/perf-node-gather-daemonset-gsqwg" Sep 09 23:27:36.371748 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:27:36.371709 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c0f0ade6-6f02-4c6a-ab74-be7cc1764fd1-lib-modules\") pod \"perf-node-gather-daemonset-gsqwg\" (UID: \"c0f0ade6-6f02-4c6a-ab74-be7cc1764fd1\") " pod="openshift-must-gather-h2lnk/perf-node-gather-daemonset-gsqwg" Sep 09 23:27:36.390032 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:27:36.390001 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-85d98c998f-gqw8t_33187b1c-2f16-4d27-9de0-860af5debc69/download-server/0.log" Sep 09 23:27:36.473081 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:27:36.473041 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c54lf\" (UniqueName: \"kubernetes.io/projected/c0f0ade6-6f02-4c6a-ab74-be7cc1764fd1-kube-api-access-c54lf\") pod \"perf-node-gather-daemonset-gsqwg\" (UID: \"c0f0ade6-6f02-4c6a-ab74-be7cc1764fd1\") " pod="openshift-must-gather-h2lnk/perf-node-gather-daemonset-gsqwg" Sep 09 23:27:36.473396 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:27:36.473352 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/c0f0ade6-6f02-4c6a-ab74-be7cc1764fd1-proc\") pod \"perf-node-gather-daemonset-gsqwg\" (UID: \"c0f0ade6-6f02-4c6a-ab74-be7cc1764fd1\") " pod="openshift-must-gather-h2lnk/perf-node-gather-daemonset-gsqwg" Sep 09 23:27:36.473556 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:27:36.473539 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/c0f0ade6-6f02-4c6a-ab74-be7cc1764fd1-podres\") pod \"perf-node-gather-daemonset-gsqwg\" (UID: \"c0f0ade6-6f02-4c6a-ab74-be7cc1764fd1\") " pod="openshift-must-gather-h2lnk/perf-node-gather-daemonset-gsqwg" Sep 09 23:27:36.473715 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:27:36.473699 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c0f0ade6-6f02-4c6a-ab74-be7cc1764fd1-sys\") pod \"perf-node-gather-daemonset-gsqwg\" (UID: \"c0f0ade6-6f02-4c6a-ab74-be7cc1764fd1\") " pod="openshift-must-gather-h2lnk/perf-node-gather-daemonset-gsqwg" Sep 09 23:27:36.473817 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:27:36.473803 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c0f0ade6-6f02-4c6a-ab74-be7cc1764fd1-lib-modules\") pod \"perf-node-gather-daemonset-gsqwg\" (UID: \"c0f0ade6-6f02-4c6a-ab74-be7cc1764fd1\") " pod="openshift-must-gather-h2lnk/perf-node-gather-daemonset-gsqwg" Sep 09 23:27:36.474129 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:27:36.474111 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c0f0ade6-6f02-4c6a-ab74-be7cc1764fd1-lib-modules\") pod \"perf-node-gather-daemonset-gsqwg\" (UID: \"c0f0ade6-6f02-4c6a-ab74-be7cc1764fd1\") " pod="openshift-must-gather-h2lnk/perf-node-gather-daemonset-gsqwg" Sep 09 23:27:36.474606 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:27:36.474585 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/c0f0ade6-6f02-4c6a-ab74-be7cc1764fd1-proc\") pod \"perf-node-gather-daemonset-gsqwg\" (UID: \"c0f0ade6-6f02-4c6a-ab74-be7cc1764fd1\") " pod="openshift-must-gather-h2lnk/perf-node-gather-daemonset-gsqwg" Sep 09 23:27:36.474818 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:27:36.474803 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/c0f0ade6-6f02-4c6a-ab74-be7cc1764fd1-podres\") pod \"perf-node-gather-daemonset-gsqwg\" (UID: \"c0f0ade6-6f02-4c6a-ab74-be7cc1764fd1\") " pod="openshift-must-gather-h2lnk/perf-node-gather-daemonset-gsqwg" Sep 09 23:27:36.474953 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:27:36.474940 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c0f0ade6-6f02-4c6a-ab74-be7cc1764fd1-sys\") pod \"perf-node-gather-daemonset-gsqwg\" (UID: \"c0f0ade6-6f02-4c6a-ab74-be7cc1764fd1\") " pod="openshift-must-gather-h2lnk/perf-node-gather-daemonset-gsqwg" Sep 09 23:27:36.485207 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:27:36.485177 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c54lf\" (UniqueName: \"kubernetes.io/projected/c0f0ade6-6f02-4c6a-ab74-be7cc1764fd1-kube-api-access-c54lf\") pod \"perf-node-gather-daemonset-gsqwg\" (UID: \"c0f0ade6-6f02-4c6a-ab74-be7cc1764fd1\") " pod="openshift-must-gather-h2lnk/perf-node-gather-daemonset-gsqwg" Sep 09 23:27:36.637699 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:27:36.637612 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-h2lnk/perf-node-gather-daemonset-gsqwg" Sep 09 23:27:36.933702 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:27:36.933616 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-h2lnk/perf-node-gather-daemonset-gsqwg"] Sep 09 23:27:36.939016 ip-10-0-132-204 kubenswrapper[2561]: W0909 23:27:36.938990 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podc0f0ade6_6f02_4c6a_ab74_be7cc1764fd1.slice/crio-e1f85a170d7869c0a7f24518b7d4173cde1a6ba8a8435b6b34b8ee31747d676e WatchSource:0}: Error finding container e1f85a170d7869c0a7f24518b7d4173cde1a6ba8a8435b6b34b8ee31747d676e: Status 404 returned error can't find the container with id e1f85a170d7869c0a7f24518b7d4173cde1a6ba8a8435b6b34b8ee31747d676e Sep 09 23:27:37.059061 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:27:37.059034 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-695c895bd6-sl8rx_af0af713-eccd-4d71-8400-8318e56d8214/volume-data-source-validator/0.log" Sep 09 23:27:37.759519 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:27:37.759477 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-h2lnk/perf-node-gather-daemonset-gsqwg" event={"ID":"c0f0ade6-6f02-4c6a-ab74-be7cc1764fd1","Type":"ContainerStarted","Data":"030780b5b9a9d496d71466a4f1ad30ab4d51fb98c9f77c61357c04a9035eb7d6"} Sep 09 23:27:37.759995 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:27:37.759551 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-h2lnk/perf-node-gather-daemonset-gsqwg" event={"ID":"c0f0ade6-6f02-4c6a-ab74-be7cc1764fd1","Type":"ContainerStarted","Data":"e1f85a170d7869c0a7f24518b7d4173cde1a6ba8a8435b6b34b8ee31747d676e"} Sep 09 23:27:37.760429 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:27:37.760404 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-h2lnk/perf-node-gather-daemonset-gsqwg" Sep 09 23:27:37.779239 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:27:37.779182 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-h2lnk/perf-node-gather-daemonset-gsqwg" podStartSLOduration=1.77916316 podStartE2EDuration="1.77916316s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 23:27:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:27:37.776000226 +0000 UTC m=+1166.151574289" watchObservedRunningTime="2026-09-09 23:27:37.77916316 +0000 UTC m=+1166.154737224" Sep 09 23:27:38.109790 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:27:38.109726 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-cvlgc_0da6e759-847b-4f85-b775-a82a83eb8ae2/dns/0.log" Sep 09 23:27:38.129711 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:27:38.129689 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-cvlgc_0da6e759-847b-4f85-b775-a82a83eb8ae2/kube-rbac-proxy/0.log" Sep 09 23:27:38.234346 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:27:38.234316 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-2vcdm_cecbf40f-1a0a-4819-b677-6d38f3e0d3af/dns-node-resolver/0.log" Sep 09 23:27:38.788185 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:27:38.788149 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-6c744854f9-4vtjs_20c1b743-eb6e-4d7c-84f2-f4450c1a7dd9/registry/0.log" Sep 09 23:27:38.808685 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:27:38.808660 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-q2mnk_a1511acb-caeb-42b1-be06-daa47d1973e3/node-ca/0.log" Sep 09 23:27:39.812345 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:27:39.812315 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-576f68f9bc-nd249_fa8bc2b3-b8f5-401a-ab8d-d080de3ba60a/kube-auth-proxy/0.log" Sep 09 23:27:39.933138 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:27:39.933107 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-894458656-blvvg_9238fa77-06ef-4b6b-9544-ab94b7466815/router/0.log" Sep 09 23:27:40.533134 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:27:40.533100 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-v2twq_117461f6-118c-4ca7-b116-9d3aff2dfdb6/serve-healthcheck-canary/0.log" Sep 09 23:27:40.962817 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:27:40.962720 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-76bcd6ccf5-pqpnz_90ae4174-3e12-48c2-af21-cee4d17b6a79/insights-operator/1.log" Sep 09 23:27:40.970482 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:27:40.970457 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-76bcd6ccf5-pqpnz_90ae4174-3e12-48c2-af21-cee4d17b6a79/insights-operator/0.log" Sep 09 23:27:41.122286 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:27:41.122257 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-x6vdz_1198f3f5-48cb-44d8-a496-34e7de2d2d45/kube-rbac-proxy/0.log" Sep 09 23:27:41.140985 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:27:41.140957 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-x6vdz_1198f3f5-48cb-44d8-a496-34e7de2d2d45/exporter/0.log" Sep 09 23:27:41.162342 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:27:41.162310 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-x6vdz_1198f3f5-48cb-44d8-a496-34e7de2d2d45/extractor/0.log" Sep 09 23:27:43.429256 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:27:43.429225 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-68fd95c47c-p6x7t_691fe9da-083d-46f8-8d63-9d6dcd34aa29/manager/0.log" Sep 09 23:27:43.448847 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:27:43.448821 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-68fd95c47c-p6x7t_691fe9da-083d-46f8-8d63-9d6dcd34aa29/copy-manifests/0.log" Sep 09 23:27:44.627787 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:27:44.627759 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-66c6d9b8f-2bz5h_04245465-cec9-49e3-a976-60a47338b1a4/manager/0.log" Sep 09 23:27:44.678926 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:27:44.678896 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-lpn9q_0a8eaad0-5419-4762-b9ae-ef0489a2f47b/openshift-lws-operator/0.log" Sep 09 23:27:44.787907 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:27:44.787873 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-h2lnk/perf-node-gather-daemonset-gsqwg" Sep 09 23:27:46.447357 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:27:46.447323 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-576f68f9bc-nd249_fa8bc2b3-b8f5-401a-ab8d-d080de3ba60a/kube-auth-proxy/0.log" Sep 09 23:27:46.540347 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:27:46.540316 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-894458656-blvvg_9238fa77-06ef-4b6b-9544-ab94b7466815/router/0.log" Sep 09 23:27:47.838730 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:27:47.838703 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-576f68f9bc-nd249_fa8bc2b3-b8f5-401a-ab8d-d080de3ba60a/kube-auth-proxy/0.log" Sep 09 23:27:47.923616 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:27:47.923542 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-894458656-blvvg_9238fa77-06ef-4b6b-9544-ab94b7466815/router/0.log" Sep 09 23:27:49.111290 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:27:49.111253 2561 scope.go:117] "RemoveContainer" containerID="ed1b9e0096fa3cba841ec8b7fc12952f46a176a75b3bab8b56dc3b902b7c4491" Sep 09 23:27:49.111766 ip-10-0-132-204 kubenswrapper[2561]: E0909 23:27:49.111552 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-jzwz9_llm(1312f52e-a6ae-4e56-b775-7c634cf4382a)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-jzwz9" podUID="1312f52e-a6ae-4e56-b775-7c634cf4382a" Sep 09 23:27:51.401050 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:27:51.401018 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-rzmhq_505de87b-9cf1-4af8-815b-ed5f65ac6675/kube-multus-additional-cni-plugins/0.log" Sep 09 23:27:51.419510 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:27:51.419487 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-rzmhq_505de87b-9cf1-4af8-815b-ed5f65ac6675/egress-router-binary-copy/0.log" Sep 09 23:27:51.437917 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:27:51.437892 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-rzmhq_505de87b-9cf1-4af8-815b-ed5f65ac6675/cni-plugins/0.log" Sep 09 23:27:51.457792 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:27:51.457769 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-rzmhq_505de87b-9cf1-4af8-815b-ed5f65ac6675/bond-cni-plugin/0.log" Sep 09 23:27:51.476728 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:27:51.476707 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-rzmhq_505de87b-9cf1-4af8-815b-ed5f65ac6675/routeoverride-cni/0.log" Sep 09 23:27:51.497949 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:27:51.497922 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-rzmhq_505de87b-9cf1-4af8-815b-ed5f65ac6675/whereabouts-cni-bincopy/0.log" Sep 09 23:27:51.516329 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:27:51.516301 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-rzmhq_505de87b-9cf1-4af8-815b-ed5f65ac6675/whereabouts-cni/0.log" Sep 09 23:27:51.701607 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:27:51.701527 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-fnf6n_a616cd8b-8bc4-4972-91bf-11f3e7ca7d44/kube-multus/0.log" Sep 09 23:27:51.837712 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:27:51.837661 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-ktqck_77df7cc0-0e7e-468f-89d9-b055af5de0b3/network-metrics-daemon/0.log" Sep 09 23:27:51.857140 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:27:51.857111 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-ktqck_77df7cc0-0e7e-468f-89d9-b055af5de0b3/kube-rbac-proxy/0.log" Sep 09 23:27:53.304960 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:27:53.304922 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pl5tw_6942a2c5-1a59-4ea7-b78d-d131103de85f/ovn-controller/0.log" Sep 09 23:27:53.338494 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:27:53.338465 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pl5tw_6942a2c5-1a59-4ea7-b78d-d131103de85f/ovn-acl-logging/1.log" Sep 09 23:27:53.338494 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:27:53.338466 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pl5tw_6942a2c5-1a59-4ea7-b78d-d131103de85f/ovn-acl-logging/0.log" Sep 09 23:27:53.373955 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:27:53.373930 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pl5tw_6942a2c5-1a59-4ea7-b78d-d131103de85f/kube-rbac-proxy-node/0.log" Sep 09 23:27:53.410487 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:27:53.410455 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pl5tw_6942a2c5-1a59-4ea7-b78d-d131103de85f/kube-rbac-proxy-ovn-metrics/0.log" Sep 09 23:27:53.448846 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:27:53.448819 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pl5tw_6942a2c5-1a59-4ea7-b78d-d131103de85f/northd/0.log" Sep 09 23:27:53.486750 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:27:53.486726 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pl5tw_6942a2c5-1a59-4ea7-b78d-d131103de85f/nbdb/0.log" Sep 09 23:27:53.520558 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:27:53.520529 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pl5tw_6942a2c5-1a59-4ea7-b78d-d131103de85f/sbdb/0.log" Sep 09 23:27:53.579731 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:27:53.579644 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pl5tw_6942a2c5-1a59-4ea7-b78d-d131103de85f/ovnkube-controller/0.log" Sep 09 23:27:54.689277 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:27:54.689243 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-source-685456655f-9stz9_07b145f0-cdc5-40cb-b9d1-74a3af81a78a/check-endpoints/0.log" Sep 09 23:27:54.712621 ip-10-0-132-204 kubenswrapper[2561]: I0909 23:27:54.712589 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-6s7s6_61cad06e-7668-4ada-82e5-a34a71bf52fb/network-check-target-container/0.log"