Sep 10 11:12:14.303145 ip-10-0-134-73 systemd[1]: Starting Kubernetes Kubelet... Sep 10 11:12:14.716146 ip-10-0-134-73 kubenswrapper[2564]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 10 11:12:14.716146 ip-10-0-134-73 kubenswrapper[2564]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Sep 10 11:12:14.716146 ip-10-0-134-73 kubenswrapper[2564]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 10 11:12:14.716146 ip-10-0-134-73 kubenswrapper[2564]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Sep 10 11:12:14.716146 ip-10-0-134-73 kubenswrapper[2564]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 10 11:12:14.717300 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:14.717222 2564 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Sep 10 11:12:14.721419 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.721404 2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 10 11:12:14.721419 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.721419 2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 10 11:12:14.721485 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.721422 2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 10 11:12:14.721485 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.721425 2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 10 11:12:14.721485 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.721428 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 10 11:12:14.721485 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.721431 2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 10 11:12:14.721485 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.721435 2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 10 11:12:14.721485 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.721438 2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 10 11:12:14.721485 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.721441 2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 10 11:12:14.721485 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.721445 2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 10 11:12:14.721485 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.721449 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 10 11:12:14.721485 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.721452 2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 10 11:12:14.721485 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.721455 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 10 11:12:14.721485 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.721458 2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 10 11:12:14.721485 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.721461 2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 10 11:12:14.721485 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.721464 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 10 11:12:14.721485 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.721467 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 10 11:12:14.721485 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.721470 2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 10 11:12:14.721485 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.721472 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 10 11:12:14.721485 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.721485 2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 10 11:12:14.721485 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.721488 2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 10 11:12:14.721949 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.721491 2564 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 10 11:12:14.721949 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.721494 2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 10 11:12:14.721949 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.721497 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 10 11:12:14.721949 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.721500 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 10 11:12:14.721949 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.721503 2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 10 11:12:14.721949 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.721505 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 10 11:12:14.721949 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.721508 2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 10 11:12:14.721949 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.721510 2564 feature_gate.go:328] unrecognized feature gate: Example Sep 10 11:12:14.721949 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.721513 2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 10 11:12:14.721949 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.721515 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 10 11:12:14.721949 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.721518 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 10 11:12:14.721949 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.721520 2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 10 11:12:14.721949 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.721523 2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 10 11:12:14.721949 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.721525 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 10 11:12:14.721949 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.721528 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 10 11:12:14.721949 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.721530 2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 10 11:12:14.721949 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.721533 2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 10 11:12:14.721949 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.721535 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 10 11:12:14.721949 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.721538 2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 10 11:12:14.721949 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.721541 2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 10 11:12:14.722423 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.721543 2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 10 11:12:14.722423 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.721547 2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 10 11:12:14.722423 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.721549 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 10 11:12:14.722423 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.721552 2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 10 11:12:14.722423 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.721554 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 10 11:12:14.722423 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.721556 2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 10 11:12:14.722423 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.721559 2564 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 10 11:12:14.722423 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.721561 2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 10 11:12:14.722423 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.721564 2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 10 11:12:14.722423 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.721566 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 10 11:12:14.722423 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.721569 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 10 11:12:14.722423 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.721571 2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 10 11:12:14.722423 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.721575 2564 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 10 11:12:14.722423 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.721578 2564 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 10 11:12:14.722423 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.721581 2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 10 11:12:14.722423 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.721584 2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 10 11:12:14.722423 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.721586 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 10 11:12:14.722423 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.721589 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 10 11:12:14.722423 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.721592 2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 10 11:12:14.722423 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.721594 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 10 11:12:14.722913 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.721597 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 10 11:12:14.722913 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.721599 2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 10 11:12:14.722913 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.721602 2564 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 10 11:12:14.722913 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.721604 2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 10 11:12:14.722913 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.721607 2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 10 11:12:14.722913 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.721610 2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 10 11:12:14.722913 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.721613 2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 10 11:12:14.722913 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.721615 2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 10 11:12:14.722913 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.721618 2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 10 11:12:14.722913 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.721620 2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 10 11:12:14.722913 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.721623 2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 10 11:12:14.722913 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.721626 2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 10 11:12:14.722913 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.721629 2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 10 11:12:14.722913 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.721631 2564 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 10 11:12:14.722913 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.721634 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 10 11:12:14.722913 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.721636 2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 10 11:12:14.722913 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.721638 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 10 11:12:14.722913 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.721641 2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 10 11:12:14.722913 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.721643 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 10 11:12:14.722913 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.721646 2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 10 11:12:14.723396 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.721648 2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 10 11:12:14.723396 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.721651 2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 10 11:12:14.723396 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.721653 2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 10 11:12:14.723396 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.721656 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 10 11:12:14.723396 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.721660 2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 10 11:12:14.723396 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.721665 2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 10 11:12:14.723396 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.721668 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 10 11:12:14.723396 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.721671 2564 feature_gate.go:328] unrecognized feature gate: Example2 Sep 10 11:12:14.723396 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.721674 2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 10 11:12:14.723396 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.721677 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 10 11:12:14.723396 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.721679 2564 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 10 11:12:14.723396 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.721682 2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 10 11:12:14.723396 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.721685 2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 10 11:12:14.723396 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.721687 2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 10 11:12:14.723396 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.721690 2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 10 11:12:14.723396 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.721692 2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 10 11:12:14.723396 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.721696 2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 10 11:12:14.723396 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.721700 2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 10 11:12:14.723396 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.722403 2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 10 11:12:14.723904 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.722411 2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 10 11:12:14.723904 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.722414 2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 10 11:12:14.723904 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.722417 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 10 11:12:14.723904 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.722420 2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 10 11:12:14.723904 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.722423 2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 10 11:12:14.723904 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.722427 2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 10 11:12:14.723904 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.722430 2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 10 11:12:14.723904 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.722432 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 10 11:12:14.723904 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.722435 2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 10 11:12:14.723904 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.722438 2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 10 11:12:14.723904 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.722440 2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 10 11:12:14.723904 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.722443 2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 10 11:12:14.723904 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.722445 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 10 11:12:14.723904 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.722448 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 10 11:12:14.723904 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.722450 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 10 11:12:14.723904 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.722453 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 10 11:12:14.723904 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.722455 2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 10 11:12:14.723904 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.722458 2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 10 11:12:14.723904 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.722461 2564 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 10 11:12:14.724379 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.722465 2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 10 11:12:14.724379 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.722469 2564 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 10 11:12:14.724379 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.722472 2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 10 11:12:14.724379 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.722475 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 10 11:12:14.724379 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.722478 2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 10 11:12:14.724379 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.722480 2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 10 11:12:14.724379 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.722483 2564 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 10 11:12:14.724379 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.722486 2564 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 10 11:12:14.724379 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.722489 2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 10 11:12:14.724379 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.722492 2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 10 11:12:14.724379 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.722494 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 10 11:12:14.724379 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.722497 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 10 11:12:14.724379 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.722499 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 10 11:12:14.724379 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.722502 2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 10 11:12:14.724379 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.722504 2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 10 11:12:14.724379 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.722507 2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 10 11:12:14.724379 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.722509 2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 10 11:12:14.724379 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.722512 2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 10 11:12:14.724379 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.722515 2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 10 11:12:14.724379 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.722517 2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 10 11:12:14.724876 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.722520 2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 10 11:12:14.724876 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.722522 2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 10 11:12:14.724876 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.722525 2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 10 11:12:14.724876 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.722528 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 10 11:12:14.724876 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.722530 2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 10 11:12:14.724876 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.722532 2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 10 11:12:14.724876 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.722535 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 10 11:12:14.724876 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.722537 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 10 11:12:14.724876 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.722540 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 10 11:12:14.724876 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.722542 2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 10 11:12:14.724876 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.722545 2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 10 11:12:14.724876 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.722548 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 10 11:12:14.724876 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.722551 2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 10 11:12:14.724876 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.722554 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 10 11:12:14.724876 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.722557 2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 10 11:12:14.724876 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.722559 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 10 11:12:14.724876 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.722562 2564 feature_gate.go:328] unrecognized feature gate: Example2 Sep 10 11:12:14.724876 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.722564 2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 10 11:12:14.724876 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.722567 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 10 11:12:14.724876 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.722569 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 10 11:12:14.725375 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.722572 2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 10 11:12:14.725375 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.722574 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 10 11:12:14.725375 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.722577 2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 10 11:12:14.725375 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.722579 2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 10 11:12:14.725375 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.722582 2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 10 11:12:14.725375 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.722584 2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 10 11:12:14.725375 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.722587 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 10 11:12:14.725375 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.722589 2564 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 10 11:12:14.725375 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.722592 2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 10 11:12:14.725375 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.722594 2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 10 11:12:14.725375 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.722598 2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 10 11:12:14.725375 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.722602 2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 10 11:12:14.725375 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.722605 2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 10 11:12:14.725375 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.722608 2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 10 11:12:14.725375 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.722613 2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 10 11:12:14.725375 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.722617 2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 10 11:12:14.725375 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.722620 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 10 11:12:14.725375 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.722623 2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 10 11:12:14.725375 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.722625 2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 10 11:12:14.725936 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.722628 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 10 11:12:14.725936 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.722631 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 10 11:12:14.725936 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.722633 2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 10 11:12:14.725936 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.722636 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 10 11:12:14.725936 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.722639 2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 10 11:12:14.725936 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.722641 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 10 11:12:14.725936 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.722644 2564 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 10 11:12:14.725936 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.722647 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 10 11:12:14.725936 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.722649 2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 10 11:12:14.725936 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.722652 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 10 11:12:14.725936 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.722654 2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 10 11:12:14.725936 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.722657 2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 10 11:12:14.725936 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.722659 2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 10 11:12:14.725936 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.722662 2564 feature_gate.go:328] unrecognized feature gate: Example Sep 10 11:12:14.725936 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.722664 2564 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 10 11:12:14.725936 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.722667 2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 10 11:12:14.725936 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.722669 2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 10 11:12:14.725936 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.722672 2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 10 11:12:14.725936 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.722676 2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 10 11:12:14.725936 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.722678 2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 10 11:12:14.726409 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.723049 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 10 11:12:14.726409 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.723054 2564 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 10 11:12:14.726409 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.723057 2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 10 11:12:14.726409 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.723060 2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 10 11:12:14.726409 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.723063 2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 10 11:12:14.726409 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.723066 2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 10 11:12:14.726409 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.723068 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 10 11:12:14.726409 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.723071 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 10 11:12:14.726409 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.723074 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 10 11:12:14.726409 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.723076 2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 10 11:12:14.726409 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.723079 2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 10 11:12:14.726409 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.723082 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 10 11:12:14.726409 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.723085 2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 10 11:12:14.726409 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.723089 2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 10 11:12:14.726409 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.723101 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 10 11:12:14.726409 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.723105 2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 10 11:12:14.726409 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.723108 2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 10 11:12:14.726409 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.723112 2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 10 11:12:14.726409 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.723114 2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 10 11:12:14.726873 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.723117 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 10 11:12:14.726873 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.723120 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 10 11:12:14.726873 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.723123 2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 10 11:12:14.726873 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.723125 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 10 11:12:14.726873 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.723128 2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 10 11:12:14.726873 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.723130 2564 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 10 11:12:14.726873 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.723133 2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 10 11:12:14.726873 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.723136 2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 10 11:12:14.726873 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.723139 2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 10 11:12:14.726873 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.723142 2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 10 11:12:14.726873 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.723144 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 10 11:12:14.726873 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.723147 2564 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 10 11:12:14.726873 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.723150 2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 10 11:12:14.726873 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.723152 2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 10 11:12:14.726873 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.723155 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 10 11:12:14.726873 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.723157 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 10 11:12:14.726873 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.723159 2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 10 11:12:14.726873 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.723162 2564 feature_gate.go:328] unrecognized feature gate: Example Sep 10 11:12:14.726873 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.723165 2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 10 11:12:14.726873 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.723168 2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 10 11:12:14.727361 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.723170 2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 10 11:12:14.727361 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.723173 2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 10 11:12:14.727361 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.723175 2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 10 11:12:14.727361 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.723178 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 10 11:12:14.727361 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.723180 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 10 11:12:14.727361 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.723183 2564 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 10 11:12:14.727361 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.723185 2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 10 11:12:14.727361 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.723188 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 10 11:12:14.727361 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.723191 2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 10 11:12:14.727361 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.723195 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 10 11:12:14.727361 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.723198 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 10 11:12:14.727361 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.723200 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 10 11:12:14.727361 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.723203 2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 10 11:12:14.727361 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.723205 2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 10 11:12:14.727361 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.723208 2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 10 11:12:14.727361 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.723211 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 10 11:12:14.727361 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.723213 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 10 11:12:14.727361 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.723216 2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 10 11:12:14.727361 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.723218 2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 10 11:12:14.727826 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.723221 2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 10 11:12:14.727826 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.723223 2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 10 11:12:14.727826 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.723226 2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 10 11:12:14.727826 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.723229 2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 10 11:12:14.727826 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.723231 2564 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 10 11:12:14.727826 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.723233 2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 10 11:12:14.727826 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.723236 2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 10 11:12:14.727826 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.723240 2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 10 11:12:14.727826 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.723242 2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 10 11:12:14.727826 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.723245 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 10 11:12:14.727826 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.723247 2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 10 11:12:14.727826 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.723250 2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 10 11:12:14.727826 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.723253 2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 10 11:12:14.727826 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.723256 2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 10 11:12:14.727826 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.723258 2564 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 10 11:12:14.727826 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.723260 2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 10 11:12:14.727826 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.723263 2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 10 11:12:14.727826 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.723265 2564 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 10 11:12:14.727826 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.723268 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 10 11:12:14.727826 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.723271 2564 feature_gate.go:328] unrecognized feature gate: Example2 Sep 10 11:12:14.728321 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.723273 2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 10 11:12:14.728321 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.723276 2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 10 11:12:14.728321 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.723280 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 10 11:12:14.728321 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.723283 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 10 11:12:14.728321 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.723285 2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 10 11:12:14.728321 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.723289 2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 10 11:12:14.728321 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.723292 2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 10 11:12:14.728321 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.723295 2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 10 11:12:14.728321 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.723299 2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 10 11:12:14.728321 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.723301 2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 10 11:12:14.728321 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.723304 2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 10 11:12:14.728321 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.723306 2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 10 11:12:14.728321 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.723309 2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 10 11:12:14.728321 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.723311 2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 10 11:12:14.728321 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.723314 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 10 11:12:14.728321 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.723316 2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 10 11:12:14.728321 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.723319 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 10 11:12:14.728321 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.723322 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 10 11:12:14.728321 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.723325 2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 10 11:12:14.728815 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.723328 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 10 11:12:14.728815 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.723331 2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 10 11:12:14.728815 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:14.723400 2564 flags.go:64] FLAG: --address="0.0.0.0" Sep 10 11:12:14.728815 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:14.723432 2564 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Sep 10 11:12:14.728815 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:14.723449 2564 flags.go:64] FLAG: --anonymous-auth="true" Sep 10 11:12:14.728815 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:14.723454 2564 flags.go:64] FLAG: --application-metrics-count-limit="100" Sep 10 11:12:14.728815 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:14.723459 2564 flags.go:64] FLAG: --authentication-token-webhook="false" Sep 10 11:12:14.728815 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:14.723462 2564 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Sep 10 11:12:14.728815 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:14.723466 2564 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Sep 10 11:12:14.728815 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:14.723470 2564 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Sep 10 11:12:14.728815 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:14.723473 2564 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Sep 10 11:12:14.728815 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:14.723476 2564 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Sep 10 11:12:14.728815 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:14.723479 2564 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Sep 10 11:12:14.728815 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:14.723482 2564 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Sep 10 11:12:14.728815 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:14.723486 2564 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Sep 10 11:12:14.728815 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:14.723490 2564 flags.go:64] FLAG: --cgroup-root="" Sep 10 11:12:14.728815 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:14.723493 2564 flags.go:64] FLAG: --cgroups-per-qos="true" Sep 10 11:12:14.728815 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:14.723496 2564 flags.go:64] FLAG: --client-ca-file="" Sep 10 11:12:14.728815 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:14.723498 2564 flags.go:64] FLAG: --cloud-provider="external" Sep 10 11:12:14.728815 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:14.723501 2564 flags.go:64] FLAG: --cluster-dns="[]" Sep 10 11:12:14.728815 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:14.723505 2564 flags.go:64] FLAG: --cluster-domain="" Sep 10 11:12:14.728815 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:14.723508 2564 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Sep 10 11:12:14.728815 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:14.723511 2564 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Sep 10 11:12:14.729382 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:14.723514 2564 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Sep 10 11:12:14.729382 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:14.723518 2564 flags.go:64] FLAG: --container-log-max-files="5" Sep 10 11:12:14.729382 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:14.723521 2564 flags.go:64] FLAG: --container-log-max-size="10Mi" Sep 10 11:12:14.729382 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:14.723524 2564 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Sep 10 11:12:14.729382 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:14.723527 2564 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Sep 10 11:12:14.729382 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:14.723531 2564 flags.go:64] FLAG: --containerd-namespace="k8s.io" Sep 10 11:12:14.729382 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:14.723534 2564 flags.go:64] FLAG: --contention-profiling="false" Sep 10 11:12:14.729382 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:14.723538 2564 flags.go:64] FLAG: --cpu-cfs-quota="true" Sep 10 11:12:14.729382 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:14.723542 2564 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Sep 10 11:12:14.729382 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:14.723545 2564 flags.go:64] FLAG: --cpu-manager-policy="none" Sep 10 11:12:14.729382 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:14.723547 2564 flags.go:64] FLAG: --cpu-manager-policy-options="" Sep 10 11:12:14.729382 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:14.723551 2564 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Sep 10 11:12:14.729382 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:14.723554 2564 flags.go:64] FLAG: --enable-controller-attach-detach="true" Sep 10 11:12:14.729382 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:14.723557 2564 flags.go:64] FLAG: --enable-debugging-handlers="true" Sep 10 11:12:14.729382 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:14.723560 2564 flags.go:64] FLAG: --enable-load-reader="false" Sep 10 11:12:14.729382 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:14.723563 2564 flags.go:64] FLAG: --enable-server="true" Sep 10 11:12:14.729382 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:14.723567 2564 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Sep 10 11:12:14.729382 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:14.723571 2564 flags.go:64] FLAG: --event-burst="100" Sep 10 11:12:14.729382 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:14.723574 2564 flags.go:64] FLAG: --event-qps="50" Sep 10 11:12:14.729382 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:14.723576 2564 flags.go:64] FLAG: --event-storage-age-limit="default=0" Sep 10 11:12:14.729382 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:14.723579 2564 flags.go:64] FLAG: --event-storage-event-limit="default=0" Sep 10 11:12:14.729382 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:14.723582 2564 flags.go:64] FLAG: --eviction-hard="" Sep 10 11:12:14.729382 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:14.723586 2564 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Sep 10 11:12:14.729382 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:14.723588 2564 flags.go:64] FLAG: --eviction-minimum-reclaim="" Sep 10 11:12:14.729954 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:14.723593 2564 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Sep 10 11:12:14.729954 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:14.723596 2564 flags.go:64] FLAG: --eviction-soft="" Sep 10 11:12:14.729954 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:14.723599 2564 flags.go:64] FLAG: --eviction-soft-grace-period="" Sep 10 11:12:14.729954 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:14.723602 2564 flags.go:64] FLAG: --exit-on-lock-contention="false" Sep 10 11:12:14.729954 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:14.723605 2564 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Sep 10 11:12:14.729954 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:14.723608 2564 flags.go:64] FLAG: --experimental-mounter-path="" Sep 10 11:12:14.729954 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:14.723610 2564 flags.go:64] FLAG: --fail-cgroupv1="false" Sep 10 11:12:14.729954 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:14.723613 2564 flags.go:64] FLAG: --fail-swap-on="true" Sep 10 11:12:14.729954 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:14.723616 2564 flags.go:64] FLAG: --feature-gates="" Sep 10 11:12:14.729954 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:14.723620 2564 flags.go:64] FLAG: --file-check-frequency="20s" Sep 10 11:12:14.729954 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:14.723623 2564 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Sep 10 11:12:14.729954 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:14.723626 2564 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Sep 10 11:12:14.729954 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:14.723629 2564 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Sep 10 11:12:14.729954 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:14.723631 2564 flags.go:64] FLAG: --healthz-port="10248" Sep 10 11:12:14.729954 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:14.723635 2564 flags.go:64] FLAG: --help="false" Sep 10 11:12:14.729954 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:14.723639 2564 flags.go:64] FLAG: --hostname-override="ip-10-0-134-73.ec2.internal" Sep 10 11:12:14.729954 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:14.723642 2564 flags.go:64] FLAG: --housekeeping-interval="10s" Sep 10 11:12:14.729954 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:14.723645 2564 flags.go:64] FLAG: --http-check-frequency="20s" Sep 10 11:12:14.729954 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:14.723647 2564 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Sep 10 11:12:14.729954 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:14.723651 2564 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Sep 10 11:12:14.729954 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:14.723654 2564 flags.go:64] FLAG: --image-gc-high-threshold="85" Sep 10 11:12:14.729954 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:14.723657 2564 flags.go:64] FLAG: --image-gc-low-threshold="80" Sep 10 11:12:14.729954 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:14.723660 2564 flags.go:64] FLAG: --image-service-endpoint="" Sep 10 11:12:14.730538 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:14.723663 2564 flags.go:64] FLAG: --kernel-memcg-notification="false" Sep 10 11:12:14.730538 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:14.723666 2564 flags.go:64] FLAG: --kube-api-burst="100" Sep 10 11:12:14.730538 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:14.723669 2564 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Sep 10 11:12:14.730538 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:14.723673 2564 flags.go:64] FLAG: --kube-api-qps="50" Sep 10 11:12:14.730538 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:14.723676 2564 flags.go:64] FLAG: --kube-reserved="" Sep 10 11:12:14.730538 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:14.723678 2564 flags.go:64] FLAG: --kube-reserved-cgroup="" Sep 10 11:12:14.730538 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:14.723681 2564 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Sep 10 11:12:14.730538 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:14.723684 2564 flags.go:64] FLAG: --kubelet-cgroups="" Sep 10 11:12:14.730538 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:14.723687 2564 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Sep 10 11:12:14.730538 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:14.723691 2564 flags.go:64] FLAG: --lock-file="" Sep 10 11:12:14.730538 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:14.723693 2564 flags.go:64] FLAG: --log-cadvisor-usage="false" Sep 10 11:12:14.730538 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:14.723696 2564 flags.go:64] FLAG: --log-flush-frequency="5s" Sep 10 11:12:14.730538 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:14.723700 2564 flags.go:64] FLAG: --log-json-info-buffer-size="0" Sep 10 11:12:14.730538 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:14.723705 2564 flags.go:64] FLAG: --log-json-split-stream="false" Sep 10 11:12:14.730538 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:14.723708 2564 flags.go:64] FLAG: --log-text-info-buffer-size="0" Sep 10 11:12:14.730538 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:14.723710 2564 flags.go:64] FLAG: --log-text-split-stream="false" Sep 10 11:12:14.730538 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:14.723713 2564 flags.go:64] FLAG: --logging-format="text" Sep 10 11:12:14.730538 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:14.723716 2564 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Sep 10 11:12:14.730538 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:14.723719 2564 flags.go:64] FLAG: --make-iptables-util-chains="true" Sep 10 11:12:14.730538 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:14.723722 2564 flags.go:64] FLAG: --manifest-url="" Sep 10 11:12:14.730538 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:14.723725 2564 flags.go:64] FLAG: --manifest-url-header="" Sep 10 11:12:14.730538 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:14.723728 2564 flags.go:64] FLAG: --max-housekeeping-interval="15s" Sep 10 11:12:14.730538 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:14.723731 2564 flags.go:64] FLAG: --max-open-files="1000000" Sep 10 11:12:14.730538 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:14.723735 2564 flags.go:64] FLAG: --max-pods="110" Sep 10 11:12:14.730538 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:14.723740 2564 flags.go:64] FLAG: --maximum-dead-containers="-1" Sep 10 11:12:14.731184 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:14.723743 2564 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Sep 10 11:12:14.731184 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:14.723745 2564 flags.go:64] FLAG: --memory-manager-policy="None" Sep 10 11:12:14.731184 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:14.723748 2564 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Sep 10 11:12:14.731184 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:14.723751 2564 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Sep 10 11:12:14.731184 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:14.723754 2564 flags.go:64] FLAG: --node-ip="0.0.0.0" Sep 10 11:12:14.731184 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:14.723757 2564 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Sep 10 11:12:14.731184 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:14.723764 2564 flags.go:64] FLAG: --node-status-max-images="50" Sep 10 11:12:14.731184 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:14.723767 2564 flags.go:64] FLAG: --node-status-update-frequency="10s" Sep 10 11:12:14.731184 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:14.723770 2564 flags.go:64] FLAG: --oom-score-adj="-999" Sep 10 11:12:14.731184 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:14.723773 2564 flags.go:64] FLAG: --pod-cidr="" Sep 10 11:12:14.731184 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:14.723777 2564 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8ccbacc999dbf9abad8f4009240188312b683f36ced4763eed166c1500c164b1" Sep 10 11:12:14.731184 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:14.723782 2564 flags.go:64] FLAG: --pod-manifest-path="" Sep 10 11:12:14.731184 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:14.723785 2564 flags.go:64] FLAG: --pod-max-pids="-1" Sep 10 11:12:14.731184 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:14.723788 2564 flags.go:64] FLAG: --pods-per-core="0" Sep 10 11:12:14.731184 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:14.723791 2564 flags.go:64] FLAG: --port="10250" Sep 10 11:12:14.731184 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:14.723795 2564 flags.go:64] FLAG: --protect-kernel-defaults="false" Sep 10 11:12:14.731184 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:14.723798 2564 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0ff6393bb4a6094f2" Sep 10 11:12:14.731184 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:14.723802 2564 flags.go:64] FLAG: --qos-reserved="" Sep 10 11:12:14.731184 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:14.723805 2564 flags.go:64] FLAG: --read-only-port="10255" Sep 10 11:12:14.731184 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:14.723808 2564 flags.go:64] FLAG: --register-node="true" Sep 10 11:12:14.731184 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:14.723811 2564 flags.go:64] FLAG: --register-with-taints="" Sep 10 11:12:14.731184 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:14.723814 2564 flags.go:64] FLAG: --registry-burst="10" Sep 10 11:12:14.731184 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:14.723817 2564 flags.go:64] FLAG: --registry-qps="5" Sep 10 11:12:14.731184 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:14.723820 2564 flags.go:64] FLAG: --reserved-cpus="" Sep 10 11:12:14.731762 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:14.723822 2564 flags.go:64] FLAG: --reserved-memory="" Sep 10 11:12:14.731762 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:14.723826 2564 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Sep 10 11:12:14.731762 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:14.723829 2564 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Sep 10 11:12:14.731762 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:14.723832 2564 flags.go:64] FLAG: --rotate-certificates="false" Sep 10 11:12:14.731762 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:14.723835 2564 flags.go:64] FLAG: --rotate-server-certificates="false" Sep 10 11:12:14.731762 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:14.723838 2564 flags.go:64] FLAG: --runonce="false" Sep 10 11:12:14.731762 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:14.723841 2564 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Sep 10 11:12:14.731762 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:14.723845 2564 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Sep 10 11:12:14.731762 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:14.723848 2564 flags.go:64] FLAG: --seccomp-default="false" Sep 10 11:12:14.731762 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:14.723863 2564 flags.go:64] FLAG: --serialize-image-pulls="true" Sep 10 11:12:14.731762 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:14.723866 2564 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Sep 10 11:12:14.731762 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:14.723869 2564 flags.go:64] FLAG: --storage-driver-db="cadvisor" Sep 10 11:12:14.731762 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:14.723873 2564 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Sep 10 11:12:14.731762 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:14.723876 2564 flags.go:64] FLAG: --storage-driver-password="root" Sep 10 11:12:14.731762 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:14.723879 2564 flags.go:64] FLAG: --storage-driver-secure="false" Sep 10 11:12:14.731762 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:14.723882 2564 flags.go:64] FLAG: --storage-driver-table="stats" Sep 10 11:12:14.731762 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:14.723885 2564 flags.go:64] FLAG: --storage-driver-user="root" Sep 10 11:12:14.731762 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:14.723888 2564 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Sep 10 11:12:14.731762 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:14.723891 2564 flags.go:64] FLAG: --sync-frequency="1m0s" Sep 10 11:12:14.731762 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:14.723894 2564 flags.go:64] FLAG: --system-cgroups="" Sep 10 11:12:14.731762 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:14.723897 2564 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Sep 10 11:12:14.731762 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:14.723902 2564 flags.go:64] FLAG: --system-reserved-cgroup="" Sep 10 11:12:14.731762 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:14.723905 2564 flags.go:64] FLAG: --tls-cert-file="" Sep 10 11:12:14.731762 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:14.723908 2564 flags.go:64] FLAG: --tls-cipher-suites="[]" Sep 10 11:12:14.731762 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:14.723912 2564 flags.go:64] FLAG: --tls-min-version="" Sep 10 11:12:14.732403 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:14.723915 2564 flags.go:64] FLAG: --tls-private-key-file="" Sep 10 11:12:14.732403 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:14.723918 2564 flags.go:64] FLAG: --topology-manager-policy="none" Sep 10 11:12:14.732403 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:14.723921 2564 flags.go:64] FLAG: --topology-manager-policy-options="" Sep 10 11:12:14.732403 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:14.723924 2564 flags.go:64] FLAG: --topology-manager-scope="container" Sep 10 11:12:14.732403 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:14.723927 2564 flags.go:64] FLAG: --v="2" Sep 10 11:12:14.732403 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:14.723931 2564 flags.go:64] FLAG: --version="false" Sep 10 11:12:14.732403 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:14.723935 2564 flags.go:64] FLAG: --vmodule="" Sep 10 11:12:14.732403 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:14.723938 2564 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Sep 10 11:12:14.732403 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:14.723941 2564 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Sep 10 11:12:14.732403 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.724052 2564 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 10 11:12:14.732403 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.724056 2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 10 11:12:14.732403 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.724059 2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 10 11:12:14.732403 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.724062 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 10 11:12:14.732403 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.724065 2564 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 10 11:12:14.732403 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.724069 2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 10 11:12:14.732403 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.724072 2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 10 11:12:14.732403 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.724074 2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 10 11:12:14.732403 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.724077 2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 10 11:12:14.732403 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.724079 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 10 11:12:14.732403 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.724082 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 10 11:12:14.732403 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.724084 2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 10 11:12:14.732403 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.724087 2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 10 11:12:14.732949 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.724089 2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 10 11:12:14.732949 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.724091 2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 10 11:12:14.732949 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.724095 2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 10 11:12:14.732949 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.724099 2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 10 11:12:14.732949 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.724103 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 10 11:12:14.732949 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.724107 2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 10 11:12:14.732949 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.724110 2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 10 11:12:14.732949 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.724113 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 10 11:12:14.732949 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.724116 2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 10 11:12:14.732949 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.724118 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 10 11:12:14.732949 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.724121 2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 10 11:12:14.732949 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.724124 2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 10 11:12:14.732949 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.724126 2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 10 11:12:14.732949 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.724129 2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 10 11:12:14.732949 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.724132 2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 10 11:12:14.732949 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.724134 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 10 11:12:14.732949 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.724137 2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 10 11:12:14.732949 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.724139 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 10 11:12:14.732949 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.724142 2564 feature_gate.go:328] unrecognized feature gate: Example Sep 10 11:12:14.733398 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.724144 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 10 11:12:14.733398 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.724147 2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 10 11:12:14.733398 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.724149 2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 10 11:12:14.733398 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.724151 2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 10 11:12:14.733398 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.724154 2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 10 11:12:14.733398 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.724158 2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 10 11:12:14.733398 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.724160 2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 10 11:12:14.733398 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.724163 2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 10 11:12:14.733398 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.724165 2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 10 11:12:14.733398 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.724168 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 10 11:12:14.733398 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.724170 2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 10 11:12:14.733398 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.724173 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 10 11:12:14.733398 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.724175 2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 10 11:12:14.733398 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.724177 2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 10 11:12:14.733398 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.724180 2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 10 11:12:14.733398 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.724182 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 10 11:12:14.733398 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.724185 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 10 11:12:14.733398 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.724187 2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 10 11:12:14.733398 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.724190 2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 10 11:12:14.733398 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.724193 2564 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 10 11:12:14.733892 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.724195 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 10 11:12:14.733892 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.724198 2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 10 11:12:14.733892 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.724200 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 10 11:12:14.733892 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.724203 2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 10 11:12:14.733892 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.724206 2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 10 11:12:14.733892 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.724208 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 10 11:12:14.733892 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.724211 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 10 11:12:14.733892 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.724213 2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 10 11:12:14.733892 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.724216 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 10 11:12:14.733892 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.724218 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 10 11:12:14.733892 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.724221 2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 10 11:12:14.733892 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.724223 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 10 11:12:14.733892 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.724226 2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 10 11:12:14.733892 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.724228 2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 10 11:12:14.733892 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.724231 2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 10 11:12:14.733892 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.724233 2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 10 11:12:14.733892 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.724236 2564 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 10 11:12:14.733892 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.724240 2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 10 11:12:14.733892 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.724243 2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 10 11:12:14.734353 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.724245 2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 10 11:12:14.734353 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.724248 2564 feature_gate.go:328] unrecognized feature gate: Example2 Sep 10 11:12:14.734353 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.724250 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 10 11:12:14.734353 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.724253 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 10 11:12:14.734353 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.724255 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 10 11:12:14.734353 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.724258 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 10 11:12:14.734353 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.724261 2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 10 11:12:14.734353 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.724265 2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 10 11:12:14.734353 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.724269 2564 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 10 11:12:14.734353 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.724273 2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 10 11:12:14.734353 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.724276 2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 10 11:12:14.734353 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.724279 2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 10 11:12:14.734353 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.724281 2564 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 10 11:12:14.734353 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.724285 2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 10 11:12:14.734353 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.724287 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 10 11:12:14.734353 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.724290 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 10 11:12:14.734353 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.724293 2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 10 11:12:14.734353 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.724295 2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 10 11:12:14.734353 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.724297 2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 10 11:12:14.734353 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.724300 2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 10 11:12:14.734850 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.724302 2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 10 11:12:14.734850 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.724305 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 10 11:12:14.734850 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.724309 2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 10 11:12:14.734850 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.724312 2564 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 10 11:12:14.734850 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.724315 2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 10 11:12:14.734850 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.724318 2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 10 11:12:14.734850 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.724321 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 10 11:12:14.734850 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.724323 2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 10 11:12:14.734850 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:14.725079 2564 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 10 11:12:14.734850 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:14.732792 2564 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Sep 10 11:12:14.734850 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:14.732807 2564 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Sep 10 11:12:14.734850 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:14.732825 2564 watchdog_linux.go:95] "Systemd watchdog is not enabled" Sep 10 11:12:14.734850 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:14.732830 2564 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Sep 10 11:12:14.734850 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.732912 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 10 11:12:14.735345 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.732918 2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 10 11:12:14.735345 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.732923 2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 10 11:12:14.735345 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.732927 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 10 11:12:14.735345 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.732930 2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 10 11:12:14.735345 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.732933 2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 10 11:12:14.735345 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.732936 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 10 11:12:14.735345 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.732939 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 10 11:12:14.735345 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.732942 2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 10 11:12:14.735345 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.732945 2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 10 11:12:14.735345 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.732947 2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 10 11:12:14.735345 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.732950 2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 10 11:12:14.735345 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.732953 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 10 11:12:14.735345 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.732956 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 10 11:12:14.735345 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.732958 2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 10 11:12:14.735345 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.732961 2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 10 11:12:14.735345 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.732964 2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 10 11:12:14.735345 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.732966 2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 10 11:12:14.735345 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.732969 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 10 11:12:14.735345 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.732972 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 10 11:12:14.736165 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.732974 2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 10 11:12:14.736165 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.732977 2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 10 11:12:14.736165 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.732980 2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 10 11:12:14.736165 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.732982 2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 10 11:12:14.736165 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.732985 2564 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 10 11:12:14.736165 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.732987 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 10 11:12:14.736165 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.732991 2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 10 11:12:14.736165 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.732995 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 10 11:12:14.736165 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.732999 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 10 11:12:14.736165 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.733008 2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 10 11:12:14.736165 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.733011 2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 10 11:12:14.736165 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.733014 2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 10 11:12:14.736165 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.733017 2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 10 11:12:14.736165 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.733019 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 10 11:12:14.736165 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.733022 2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 10 11:12:14.736165 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.733025 2564 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 10 11:12:14.736165 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.733028 2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 10 11:12:14.736165 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.733030 2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 10 11:12:14.736165 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.733033 2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 10 11:12:14.736944 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.733035 2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 10 11:12:14.736944 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.733038 2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 10 11:12:14.736944 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.733041 2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 10 11:12:14.736944 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.733043 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 10 11:12:14.736944 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.733046 2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 10 11:12:14.736944 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.733048 2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 10 11:12:14.736944 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.733051 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 10 11:12:14.736944 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.733053 2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 10 11:12:14.736944 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.733056 2564 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 10 11:12:14.736944 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.733058 2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 10 11:12:14.736944 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.733061 2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 10 11:12:14.736944 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.733063 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 10 11:12:14.736944 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.733065 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 10 11:12:14.736944 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.733068 2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 10 11:12:14.736944 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.733071 2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 10 11:12:14.736944 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.733073 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 10 11:12:14.736944 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.733076 2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 10 11:12:14.736944 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.733079 2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 10 11:12:14.736944 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.733081 2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 10 11:12:14.736944 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.733084 2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 10 11:12:14.737429 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.733087 2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 10 11:12:14.737429 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.733090 2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 10 11:12:14.737429 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.733093 2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 10 11:12:14.737429 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.733101 2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 10 11:12:14.737429 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.733104 2564 feature_gate.go:328] unrecognized feature gate: Example2 Sep 10 11:12:14.737429 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.733107 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 10 11:12:14.737429 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.733109 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 10 11:12:14.737429 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.733112 2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 10 11:12:14.737429 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.733115 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 10 11:12:14.737429 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.733118 2564 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 10 11:12:14.737429 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.733120 2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 10 11:12:14.737429 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.733123 2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 10 11:12:14.737429 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.733125 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 10 11:12:14.737429 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.733128 2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 10 11:12:14.737429 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.733131 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 10 11:12:14.737429 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.733134 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 10 11:12:14.737429 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.733136 2564 feature_gate.go:328] unrecognized feature gate: Example Sep 10 11:12:14.737429 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.733139 2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 10 11:12:14.737429 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.733141 2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 10 11:12:14.737429 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.733144 2564 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 10 11:12:14.737967 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.733147 2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 10 11:12:14.737967 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.733149 2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 10 11:12:14.737967 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.733152 2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 10 11:12:14.737967 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.733154 2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 10 11:12:14.737967 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.733157 2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 10 11:12:14.737967 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.733160 2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 10 11:12:14.737967 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.733162 2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 10 11:12:14.737967 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.733165 2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 10 11:12:14.737967 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.733167 2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 10 11:12:14.737967 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.733170 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 10 11:12:14.737967 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.733172 2564 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 10 11:12:14.737967 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.733174 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 10 11:12:14.737967 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.733177 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 10 11:12:14.737967 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.733180 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 10 11:12:14.737967 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.733183 2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 10 11:12:14.737967 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.733186 2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 10 11:12:14.737967 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.733197 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 10 11:12:14.737967 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.733200 2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 10 11:12:14.737967 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.733204 2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 10 11:12:14.737967 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.733207 2564 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 10 11:12:14.738466 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:14.733212 2564 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 10 11:12:14.738466 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.733342 2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 10 11:12:14.738466 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.733348 2564 feature_gate.go:328] unrecognized feature gate: Example Sep 10 11:12:14.738466 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.733351 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 10 11:12:14.738466 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.733354 2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 10 11:12:14.738466 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.733357 2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 10 11:12:14.738466 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.733360 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 10 11:12:14.738466 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.733363 2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 10 11:12:14.738466 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.733366 2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 10 11:12:14.738466 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.733368 2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 10 11:12:14.738466 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.733372 2564 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 10 11:12:14.738466 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.733375 2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 10 11:12:14.738466 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.733378 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 10 11:12:14.738466 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.733380 2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 10 11:12:14.738466 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.733383 2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 10 11:12:14.738828 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.733386 2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 10 11:12:14.738828 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.733388 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 10 11:12:14.738828 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.733391 2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 10 11:12:14.738828 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.733393 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 10 11:12:14.738828 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.733396 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 10 11:12:14.738828 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.733398 2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 10 11:12:14.738828 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.733401 2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 10 11:12:14.738828 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.733404 2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 10 11:12:14.738828 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.733406 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 10 11:12:14.738828 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.733409 2564 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 10 11:12:14.738828 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.733413 2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 10 11:12:14.738828 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.733417 2564 feature_gate.go:328] unrecognized feature gate: Example2 Sep 10 11:12:14.738828 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.733420 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 10 11:12:14.738828 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.733423 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 10 11:12:14.738828 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.733431 2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 10 11:12:14.738828 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.733434 2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 10 11:12:14.738828 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.733437 2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 10 11:12:14.738828 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.733439 2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 10 11:12:14.738828 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.733442 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 10 11:12:14.738828 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.733444 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 10 11:12:14.739395 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.733447 2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 10 11:12:14.739395 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.733449 2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 10 11:12:14.739395 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.733452 2564 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 10 11:12:14.739395 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.733454 2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 10 11:12:14.739395 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.733457 2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 10 11:12:14.739395 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.733459 2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 10 11:12:14.739395 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.733462 2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 10 11:12:14.739395 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.733464 2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 10 11:12:14.739395 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.733467 2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 10 11:12:14.739395 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.733469 2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 10 11:12:14.739395 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.733472 2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 10 11:12:14.739395 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.733474 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 10 11:12:14.739395 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.733477 2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 10 11:12:14.739395 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.733479 2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 10 11:12:14.739395 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.733482 2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 10 11:12:14.739395 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.733484 2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 10 11:12:14.739395 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.733487 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 10 11:12:14.739395 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.733490 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 10 11:12:14.739395 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.733493 2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 10 11:12:14.739395 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.733497 2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 10 11:12:14.739885 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.733501 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 10 11:12:14.739885 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.733505 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 10 11:12:14.739885 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.733509 2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 10 11:12:14.739885 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.733512 2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 10 11:12:14.739885 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.733515 2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 10 11:12:14.739885 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.733518 2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 10 11:12:14.739885 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.733520 2564 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 10 11:12:14.739885 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.733529 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 10 11:12:14.739885 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.733532 2564 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 10 11:12:14.739885 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.733535 2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 10 11:12:14.739885 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.733537 2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 10 11:12:14.739885 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.733540 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 10 11:12:14.739885 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.733542 2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 10 11:12:14.739885 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.733545 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 10 11:12:14.739885 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.733547 2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 10 11:12:14.739885 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.733550 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 10 11:12:14.739885 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.733553 2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 10 11:12:14.739885 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.733555 2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 10 11:12:14.739885 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.733557 2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 10 11:12:14.740353 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.733561 2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 10 11:12:14.740353 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.733565 2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 10 11:12:14.740353 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.733568 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 10 11:12:14.740353 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.733570 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 10 11:12:14.740353 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.733573 2564 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 10 11:12:14.740353 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.733576 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 10 11:12:14.740353 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.733579 2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 10 11:12:14.740353 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.733582 2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 10 11:12:14.740353 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.733584 2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 10 11:12:14.740353 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.733587 2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 10 11:12:14.740353 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.733590 2564 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 10 11:12:14.740353 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.733593 2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 10 11:12:14.740353 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.733601 2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 10 11:12:14.740353 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.733604 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 10 11:12:14.740353 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.733606 2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 10 11:12:14.740353 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.733609 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 10 11:12:14.740353 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.733611 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 10 11:12:14.740353 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.733614 2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 10 11:12:14.740353 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.733617 2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 10 11:12:14.740809 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.733619 2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 10 11:12:14.740809 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.733621 2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 10 11:12:14.740809 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.733630 2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 10 11:12:14.740809 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.733633 2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 10 11:12:14.740809 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.733635 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 10 11:12:14.740809 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.733638 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 10 11:12:14.740809 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:14.733640 2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 10 11:12:14.740809 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:14.733645 2564 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 10 11:12:14.740809 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:14.733757 2564 server.go:962] "Client rotation is on, will bootstrap in background" Sep 10 11:12:14.740809 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:14.738041 2564 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Sep 10 11:12:14.740809 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:14.739140 2564 server.go:1019] "Starting client certificate rotation" Sep 10 11:12:14.740809 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:14.739233 2564 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Sep 10 11:12:14.740809 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:14.739269 2564 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Sep 10 11:12:14.741968 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:14.741955 2564 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Sep 10 11:12:14.745615 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:14.745599 2564 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Sep 10 11:12:14.756958 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:14.756941 2564 log.go:25] "Validated CRI v1 runtime API" Sep 10 11:12:14.760213 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:14.760197 2564 log.go:25] "Validated CRI v1 image API" Sep 10 11:12:14.761079 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:14.761060 2564 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Sep 10 11:12:14.765532 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:14.765513 2564 fs.go:135] Filesystem UUIDs: map[4e1d5b0e-0026-4143-aa19-2b308b87feb4:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 acf4468b-2c1e-44b4-8440-8514886f8e66:/dev/nvme0n1p4] Sep 10 11:12:14.765612 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:14.765530 2564 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Sep 10 11:12:14.768968 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:14.768946 2564 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Sep 10 11:12:14.770286 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:14.770178 2564 manager.go:216] Machine: {Timestamp:2026-09-10 11:12:14.769680227 +0000 UTC m=+0.366241433 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3098722 MemoryCapacity:33164476416 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec26cfe489591575bdd8bc97d977fcf2 SystemUUID:ec26cfe4-8959-1575-bdd8-bc97d977fcf2 BootID:33b998cc-a100-49e7-be35-ece633b5da15 Filesystems:[{Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582238208 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582238208 Type:vfs Inodes:4048398 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:69:0f:c4:22:bf Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:69:0f:c4:22:bf Speed:0 Mtu:9001} {Name:ovs-system MacAddress:16:a4:23:df:89:b4 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164476416 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Sep 10 11:12:14.770286 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:14.770283 2564 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Sep 10 11:12:14.770402 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:14.770357 2564 manager.go:232] Version: {KernelVersion:5.14.0-570.138.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260901-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Sep 10 11:12:14.773894 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:14.773866 2564 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Sep 10 11:12:14.774032 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:14.773899 2564 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-134-73.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Sep 10 11:12:14.774804 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:14.774794 2564 topology_manager.go:138] "Creating topology manager with none policy" Sep 10 11:12:14.774835 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:14.774807 2564 container_manager_linux.go:309] "Creating device plugin manager" Sep 10 11:12:14.774835 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:14.774814 2564 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Sep 10 11:12:14.775695 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:14.775684 2564 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Sep 10 11:12:14.776978 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:14.776969 2564 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Sep 10 11:12:14.782486 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:14.782474 2564 state_mem.go:36] "Initialized new in-memory state store" Sep 10 11:12:14.782598 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:14.782589 2564 server.go:1240] "Using root directory" path="/var/lib/kubelet" Sep 10 11:12:14.782644 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:14.782621 2564 kubelet.go:486] "Attempting to sync node with API server" Sep 10 11:12:14.782644 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:14.782638 2564 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Sep 10 11:12:14.782764 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:14.782652 2564 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Sep 10 11:12:14.782764 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:14.782661 2564 kubelet.go:398] "Adding apiserver pod source" Sep 10 11:12:14.782764 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:14.782669 2564 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Sep 10 11:12:14.783139 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:14.783123 2564 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Sep 10 11:12:14.783199 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:14.783187 2564 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Sep 10 11:12:14.785687 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:14.785670 2564 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.12-5.rhaos4.21.gitd1ec63c.el9" apiVersion="v1" Sep 10 11:12:14.787958 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:14.787941 2564 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Sep 10 11:12:14.788019 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:14.787974 2564 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Sep 10 11:12:14.788702 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:14.788690 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Sep 10 11:12:14.788746 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:14.788706 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Sep 10 11:12:14.788746 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:14.788712 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Sep 10 11:12:14.788746 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:14.788717 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Sep 10 11:12:14.788746 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:14.788724 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Sep 10 11:12:14.788868 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:14.788755 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Sep 10 11:12:14.788868 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:14.788769 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Sep 10 11:12:14.788868 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:14.788774 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Sep 10 11:12:14.788868 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:14.788780 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Sep 10 11:12:14.788868 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:14.788785 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Sep 10 11:12:14.788868 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:14.788797 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Sep 10 11:12:14.788868 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:14.788804 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Sep 10 11:12:14.788868 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:14.788826 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Sep 10 11:12:14.788868 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:14.788831 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Sep 10 11:12:14.794729 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:14.793584 2564 server.go:1268] "Started kubelet" Sep 10 11:12:14.794834 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:14.794808 2564 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-134-73.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Sep 10 11:12:14.794923 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:14.794877 2564 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Sep 10 11:12:14.794977 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:14.794943 2564 server_v1.go:49] "podresources" method="list" useActivePods=true Sep 10 11:12:14.794977 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:14.794729 2564 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Sep 10 11:12:14.795719 ip-10-0-134-73 kubenswrapper[2564]: E0910 11:12:14.795697 2564 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-134-73.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Sep 10 11:12:14.799302 ip-10-0-134-73 kubenswrapper[2564]: E0910 11:12:14.799279 2564 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Sep 10 11:12:14.799867 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:14.799822 2564 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Sep 10 11:12:14.800340 ip-10-0-134-73 systemd[1]: Started Kubernetes Kubelet. Sep 10 11:12:14.801309 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:14.800558 2564 server.go:310] "Adding debug handlers to kubelet server" Sep 10 11:12:14.804893 ip-10-0-134-73 kubenswrapper[2564]: E0910 11:12:14.804873 2564 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Sep 10 11:12:14.805803 ip-10-0-134-73 kubenswrapper[2564]: E0910 11:12:14.804671 2564 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-73.ec2.internal.18d3f14024c7020a default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-73.ec2.internal,UID:ip-10-0-134-73.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-134-73.ec2.internal,},FirstTimestamp:2026-09-10 11:12:14.793441802 +0000 UTC m=+0.390003008,LastTimestamp:2026-09-10 11:12:14.793441802 +0000 UTC m=+0.390003008,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-73.ec2.internal,}" Sep 10 11:12:14.807532 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:14.807514 2564 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Sep 10 11:12:14.808256 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:14.808239 2564 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Sep 10 11:12:14.808382 ip-10-0-134-73 kubenswrapper[2564]: E0910 11:12:14.808366 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-73.ec2.internal\" not found" Sep 10 11:12:14.808967 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:14.808953 2564 factory.go:55] Registering systemd factory Sep 10 11:12:14.809042 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:14.809001 2564 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Sep 10 11:12:14.809042 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:14.809001 2564 volume_manager.go:311] "The desired_state_of_world populator starts" Sep 10 11:12:14.809042 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:14.809029 2564 volume_manager.go:313] "Starting Kubelet Volume Manager" Sep 10 11:12:14.809137 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:14.809007 2564 factory.go:223] Registration of the systemd container factory successfully Sep 10 11:12:14.809178 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:14.809138 2564 reconstruct.go:97] "Volume reconstruction finished" Sep 10 11:12:14.809178 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:14.809147 2564 reconciler.go:29] "Reconciler: start to sync state" Sep 10 11:12:14.809300 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:14.809288 2564 factory.go:153] Registering CRI-O factory Sep 10 11:12:14.809355 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:14.809303 2564 factory.go:223] Registration of the crio container factory successfully Sep 10 11:12:14.809355 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:14.809342 2564 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Sep 10 11:12:14.809413 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:14.809358 2564 factory.go:103] Registering Raw factory Sep 10 11:12:14.809413 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:14.809373 2564 manager.go:1196] Started watching for new ooms in manager Sep 10 11:12:14.809799 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:14.809787 2564 manager.go:349] Starting recovery of all containers Sep 10 11:12:14.811265 ip-10-0-134-73 kubenswrapper[2564]: E0910 11:12:14.811236 2564 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-134-73.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Sep 10 11:12:14.811359 ip-10-0-134-73 kubenswrapper[2564]: E0910 11:12:14.811289 2564 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Sep 10 11:12:14.820559 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:14.820543 2564 manager.go:354] Recovery completed Sep 10 11:12:14.825302 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:14.825289 2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 10 11:12:14.828753 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:14.828733 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-73.ec2.internal" event="NodeHasSufficientMemory" Sep 10 11:12:14.828843 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:14.828769 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-73.ec2.internal" event="NodeHasNoDiskPressure" Sep 10 11:12:14.828843 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:14.828784 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-73.ec2.internal" event="NodeHasSufficientPID" Sep 10 11:12:14.829376 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:14.829361 2564 cpu_manager.go:222] "Starting CPU manager" policy="none" Sep 10 11:12:14.829376 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:14.829370 2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 10 11:12:14.829512 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:14.829375 2564 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Sep 10 11:12:14.829512 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:14.829437 2564 state_mem.go:36] "Initialized new in-memory state store" Sep 10 11:12:14.830093 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:14.830079 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-73.ec2.internal" event="NodeHasSufficientMemory" Sep 10 11:12:14.830158 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:14.830108 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-73.ec2.internal" event="NodeHasNoDiskPressure" Sep 10 11:12:14.830158 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:14.830123 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-73.ec2.internal" event="NodeHasSufficientPID" Sep 10 11:12:14.831698 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:14.831557 2564 policy_none.go:49] "None policy: Start" Sep 10 11:12:14.831746 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:14.831707 2564 memory_manager.go:187] "Starting memorymanager" policy="None" Sep 10 11:12:14.831746 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:14.831722 2564 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Sep 10 11:12:14.834507 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:14.834490 2564 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-wwdks" Sep 10 11:12:14.834690 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:14.834679 2564 policy_none.go:47] "Start" Sep 10 11:12:14.840764 ip-10-0-134-73 kubenswrapper[2564]: E0910 11:12:14.840683 2564 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-73.ec2.internal.18d3f14026e1cbd0 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-73.ec2.internal,UID:ip-10-0-134-73.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-134-73.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-134-73.ec2.internal,},FirstTimestamp:2026-09-10 11:12:14.828751824 +0000 UTC m=+0.425313034,LastTimestamp:2026-09-10 11:12:14.828751824 +0000 UTC m=+0.425313034,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-73.ec2.internal,}" Sep 10 11:12:14.845166 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:14.845150 2564 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-wwdks" Sep 10 11:12:14.885149 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:14.876381 2564 manager.go:337] "Starting Device Plugin manager" Sep 10 11:12:14.885149 ip-10-0-134-73 kubenswrapper[2564]: E0910 11:12:14.876421 2564 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Sep 10 11:12:14.885149 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:14.876430 2564 server.go:87] "Starting device plugin registration server" Sep 10 11:12:14.885149 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:14.876685 2564 eviction_manager.go:189] "Eviction manager: starting control loop" Sep 10 11:12:14.885149 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:14.876700 2564 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Sep 10 11:12:14.885149 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:14.876821 2564 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Sep 10 11:12:14.885149 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:14.876911 2564 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Sep 10 11:12:14.885149 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:14.876920 2564 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Sep 10 11:12:14.885149 ip-10-0-134-73 kubenswrapper[2564]: E0910 11:12:14.878948 2564 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Sep 10 11:12:14.885149 ip-10-0-134-73 kubenswrapper[2564]: E0910 11:12:14.878996 2564 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-134-73.ec2.internal\" not found" Sep 10 11:12:14.910117 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:14.910097 2564 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Sep 10 11:12:14.911287 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:14.911265 2564 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Sep 10 11:12:14.911358 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:14.911315 2564 status_manager.go:244] "Starting to sync pod status with apiserver" Sep 10 11:12:14.911358 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:14.911338 2564 kubelet.go:2448] "Starting kubelet main sync loop" Sep 10 11:12:14.911448 ip-10-0-134-73 kubenswrapper[2564]: E0910 11:12:14.911407 2564 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Sep 10 11:12:14.914099 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:14.914083 2564 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Sep 10 11:12:14.977495 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:14.977439 2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 10 11:12:14.978257 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:14.978241 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-73.ec2.internal" event="NodeHasSufficientMemory" Sep 10 11:12:14.978323 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:14.978270 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-73.ec2.internal" event="NodeHasNoDiskPressure" Sep 10 11:12:14.978323 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:14.978279 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-73.ec2.internal" event="NodeHasSufficientPID" Sep 10 11:12:14.978323 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:14.978300 2564 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-134-73.ec2.internal" Sep 10 11:12:14.990447 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:14.990430 2564 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-134-73.ec2.internal" Sep 10 11:12:14.990447 ip-10-0-134-73 kubenswrapper[2564]: E0910 11:12:14.990448 2564 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-134-73.ec2.internal\": node \"ip-10-0-134-73.ec2.internal\" not found" Sep 10 11:12:15.011485 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:15.011454 2564 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-73.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-134-73.ec2.internal"] Sep 10 11:12:15.011547 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:15.011515 2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 10 11:12:15.012274 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:15.012261 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-73.ec2.internal" event="NodeHasSufficientMemory" Sep 10 11:12:15.012349 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:15.012283 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-73.ec2.internal" event="NodeHasNoDiskPressure" Sep 10 11:12:15.012349 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:15.012293 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-73.ec2.internal" event="NodeHasSufficientPID" Sep 10 11:12:15.014628 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:15.014617 2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 10 11:12:15.014758 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:15.014745 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-73.ec2.internal" Sep 10 11:12:15.014792 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:15.014779 2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 10 11:12:15.015296 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:15.015282 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-73.ec2.internal" event="NodeHasSufficientMemory" Sep 10 11:12:15.015296 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:15.015292 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-73.ec2.internal" event="NodeHasSufficientMemory" Sep 10 11:12:15.015390 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:15.015305 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-73.ec2.internal" event="NodeHasNoDiskPressure" Sep 10 11:12:15.015390 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:15.015313 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-73.ec2.internal" event="NodeHasNoDiskPressure" Sep 10 11:12:15.015390 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:15.015315 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-73.ec2.internal" event="NodeHasSufficientPID" Sep 10 11:12:15.015390 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:15.015324 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-73.ec2.internal" event="NodeHasSufficientPID" Sep 10 11:12:15.017909 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:15.017896 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-73.ec2.internal" Sep 10 11:12:15.017956 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:15.017921 2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 10 11:12:15.018933 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:15.018912 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-73.ec2.internal" event="NodeHasSufficientMemory" Sep 10 11:12:15.019017 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:15.018937 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-73.ec2.internal" event="NodeHasNoDiskPressure" Sep 10 11:12:15.019017 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:15.018947 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-73.ec2.internal" event="NodeHasSufficientPID" Sep 10 11:12:15.042496 ip-10-0-134-73 kubenswrapper[2564]: E0910 11:12:15.042476 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-73.ec2.internal\" not found" Sep 10 11:12:15.043402 ip-10-0-134-73 kubenswrapper[2564]: E0910 11:12:15.043386 2564 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-134-73.ec2.internal\" not found" node="ip-10-0-134-73.ec2.internal" Sep 10 11:12:15.047648 ip-10-0-134-73 kubenswrapper[2564]: E0910 11:12:15.047632 2564 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-134-73.ec2.internal\" not found" node="ip-10-0-134-73.ec2.internal" Sep 10 11:12:15.110666 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:15.110643 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8d6e48b52697b16de0fdd5bfe815b959-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-73.ec2.internal\" (UID: \"8d6e48b52697b16de0fdd5bfe815b959\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-73.ec2.internal" Sep 10 11:12:15.110783 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:15.110674 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/fa04fa410118647777397f100391d4d1-config\") pod \"kube-apiserver-proxy-ip-10-0-134-73.ec2.internal\" (UID: \"fa04fa410118647777397f100391d4d1\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-73.ec2.internal" Sep 10 11:12:15.110783 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:15.110696 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/8d6e48b52697b16de0fdd5bfe815b959-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-73.ec2.internal\" (UID: \"8d6e48b52697b16de0fdd5bfe815b959\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-73.ec2.internal" Sep 10 11:12:15.143281 ip-10-0-134-73 kubenswrapper[2564]: E0910 11:12:15.143259 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-73.ec2.internal\" not found" Sep 10 11:12:15.211271 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:15.211244 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/8d6e48b52697b16de0fdd5bfe815b959-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-73.ec2.internal\" (UID: \"8d6e48b52697b16de0fdd5bfe815b959\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-73.ec2.internal" Sep 10 11:12:15.211271 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:15.211259 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/8d6e48b52697b16de0fdd5bfe815b959-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-73.ec2.internal\" (UID: \"8d6e48b52697b16de0fdd5bfe815b959\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-73.ec2.internal" Sep 10 11:12:15.211389 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:15.211280 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8d6e48b52697b16de0fdd5bfe815b959-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-73.ec2.internal\" (UID: \"8d6e48b52697b16de0fdd5bfe815b959\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-73.ec2.internal" Sep 10 11:12:15.211389 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:15.211299 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/fa04fa410118647777397f100391d4d1-config\") pod \"kube-apiserver-proxy-ip-10-0-134-73.ec2.internal\" (UID: \"fa04fa410118647777397f100391d4d1\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-73.ec2.internal" Sep 10 11:12:15.211389 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:15.211323 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8d6e48b52697b16de0fdd5bfe815b959-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-73.ec2.internal\" (UID: \"8d6e48b52697b16de0fdd5bfe815b959\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-73.ec2.internal" Sep 10 11:12:15.211389 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:15.211333 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/fa04fa410118647777397f100391d4d1-config\") pod \"kube-apiserver-proxy-ip-10-0-134-73.ec2.internal\" (UID: \"fa04fa410118647777397f100391d4d1\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-73.ec2.internal" Sep 10 11:12:15.243534 ip-10-0-134-73 kubenswrapper[2564]: E0910 11:12:15.243464 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-73.ec2.internal\" not found" Sep 10 11:12:15.344190 ip-10-0-134-73 kubenswrapper[2564]: E0910 11:12:15.344155 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-73.ec2.internal\" not found" Sep 10 11:12:15.345265 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:15.345245 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-73.ec2.internal" Sep 10 11:12:15.350288 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:15.350191 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-73.ec2.internal" Sep 10 11:12:15.444311 ip-10-0-134-73 kubenswrapper[2564]: E0910 11:12:15.444281 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-73.ec2.internal\" not found" Sep 10 11:12:15.545947 ip-10-0-134-73 kubenswrapper[2564]: E0910 11:12:15.545853 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-73.ec2.internal\" not found" Sep 10 11:12:15.646894 ip-10-0-134-73 kubenswrapper[2564]: E0910 11:12:15.646843 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-73.ec2.internal\" not found" Sep 10 11:12:15.739615 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:15.739582 2564 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Sep 10 11:12:15.740155 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:15.739747 2564 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Sep 10 11:12:15.747490 ip-10-0-134-73 kubenswrapper[2564]: E0910 11:12:15.747467 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-73.ec2.internal\" not found" Sep 10 11:12:15.848501 ip-10-0-134-73 kubenswrapper[2564]: E0910 11:12:15.848423 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-73.ec2.internal\" not found" Sep 10 11:12:15.851871 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:15.851827 2564 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-09 11:07:15 +0000 UTC" deadline="2028-06-06 18:47:35.83769524 +0000 UTC" Sep 10 11:12:15.851964 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:15.851873 2564 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15247h35m19.985841801s" Sep 10 11:12:15.911696 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:15.911674 2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 10 11:12:15.912704 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:15.912682 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-73.ec2.internal" event="NodeHasSufficientMemory" Sep 10 11:12:15.912810 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:15.912722 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-73.ec2.internal" event="NodeHasNoDiskPressure" Sep 10 11:12:15.912810 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:15.912741 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-73.ec2.internal" event="NodeHasSufficientPID" Sep 10 11:12:15.949017 ip-10-0-134-73 kubenswrapper[2564]: E0910 11:12:15.948984 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-73.ec2.internal\" not found" Sep 10 11:12:16.050174 ip-10-0-134-73 kubenswrapper[2564]: E0910 11:12:16.050143 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-73.ec2.internal\" not found" Sep 10 11:12:16.084335 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:16.084306 2564 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Sep 10 11:12:16.106718 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:16.106644 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfa04fa410118647777397f100391d4d1.slice/crio-b98c7a949af2543050a96d591950586bf8750812ba6d81046a09503030a4cf4d WatchSource:0}: Error finding container b98c7a949af2543050a96d591950586bf8750812ba6d81046a09503030a4cf4d: Status 404 returned error can't find the container with id b98c7a949af2543050a96d591950586bf8750812ba6d81046a09503030a4cf4d Sep 10 11:12:16.114248 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:16.114226 2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 10 11:12:16.118312 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:16.118291 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8d6e48b52697b16de0fdd5bfe815b959.slice/crio-ae0ab4c89bdef860780be75e8163fa09fe4c1d0b427901283c79ab8beeb907fd WatchSource:0}: Error finding container ae0ab4c89bdef860780be75e8163fa09fe4c1d0b427901283c79ab8beeb907fd: Status 404 returned error can't find the container with id ae0ab4c89bdef860780be75e8163fa09fe4c1d0b427901283c79ab8beeb907fd Sep 10 11:12:16.150629 ip-10-0-134-73 kubenswrapper[2564]: E0910 11:12:16.150595 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-73.ec2.internal\" not found" Sep 10 11:12:16.251301 ip-10-0-134-73 kubenswrapper[2564]: E0910 11:12:16.251258 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-73.ec2.internal\" not found" Sep 10 11:12:16.296048 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:16.296023 2564 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Sep 10 11:12:16.308558 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:16.308517 2564 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-73.ec2.internal" Sep 10 11:12:16.321451 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:16.321423 2564 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Sep 10 11:12:16.324160 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:16.324139 2564 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-73.ec2.internal" Sep 10 11:12:16.335730 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:16.335707 2564 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Sep 10 11:12:16.340713 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:16.340696 2564 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Sep 10 11:12:16.784421 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:16.784366 2564 apiserver.go:52] "Watching apiserver" Sep 10 11:12:16.792289 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:16.792227 2564 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Sep 10 11:12:16.792677 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:16.792647 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/multus-r6sr6","openshift-multus/network-metrics-daemon-54z9n","openshift-network-operator/iptables-alerter-z697w","openshift-ovn-kubernetes/ovnkube-node-t5n27","kube-system/global-pull-secret-syncer-kxss9","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tjcmb","openshift-dns/node-resolver-zgkgx","openshift-image-registry/node-ca-285k7","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-73.ec2.internal","openshift-multus/multus-additional-cni-plugins-dpgnj","openshift-network-diagnostics/network-check-target-bvnw9","kube-system/konnectivity-agent-pq4ct","kube-system/kube-apiserver-proxy-ip-10-0-134-73.ec2.internal","openshift-cluster-node-tuning-operator/tuned-8mbpl"] Sep 10 11:12:16.795378 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:16.795351 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-zgkgx" Sep 10 11:12:16.797907 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:16.797877 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-dpgnj" Sep 10 11:12:16.798376 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:16.798354 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Sep 10 11:12:16.798455 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:16.798399 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Sep 10 11:12:16.798455 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:16.798429 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-khdgj\"" Sep 10 11:12:16.800420 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:16.800120 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-z697w" Sep 10 11:12:16.800990 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:16.800972 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-2v2kr\"" Sep 10 11:12:16.802601 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:16.802580 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-t5n27" Sep 10 11:12:16.804088 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:16.803414 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Sep 10 11:12:16.804088 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:16.803617 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Sep 10 11:12:16.804088 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:16.803690 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Sep 10 11:12:16.804088 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:16.803765 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Sep 10 11:12:16.804088 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:16.803913 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Sep 10 11:12:16.804088 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:16.803979 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Sep 10 11:12:16.804603 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:16.804395 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Sep 10 11:12:16.804603 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:16.804571 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-jb62z\"" Sep 10 11:12:16.804914 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:16.804787 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Sep 10 11:12:16.805023 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:16.805005 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Sep 10 11:12:16.805415 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:16.805322 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-r6sr6" Sep 10 11:12:16.808928 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:16.807612 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-fd952\"" Sep 10 11:12:16.808928 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:16.807847 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Sep 10 11:12:16.808928 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:16.807942 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Sep 10 11:12:16.808928 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:16.808185 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Sep 10 11:12:16.808928 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:16.808414 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Sep 10 11:12:16.808928 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:16.808559 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tjcmb" Sep 10 11:12:16.808928 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:16.808631 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Sep 10 11:12:16.808928 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:16.808751 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-npfpd\"" Sep 10 11:12:16.808928 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:16.808904 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Sep 10 11:12:16.808928 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:16.808920 2564 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Sep 10 11:12:16.811275 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:16.811258 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-285k7" Sep 10 11:12:16.813219 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:16.813198 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Sep 10 11:12:16.813447 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:16.813415 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Sep 10 11:12:16.813676 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:16.813611 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Sep 10 11:12:16.814537 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:16.813961 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-l8cfw\"" Sep 10 11:12:16.814537 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:16.814060 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Sep 10 11:12:16.814537 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:16.814246 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Sep 10 11:12:16.814537 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:16.814468 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-f29r7\"" Sep 10 11:12:16.814792 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:16.814742 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Sep 10 11:12:16.815039 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:16.815021 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bvnw9" Sep 10 11:12:16.815122 ip-10-0-134-73 kubenswrapper[2564]: E0910 11:12:16.815105 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bvnw9" podUID="1f233d76-b986-4ec6-a096-e4bc9d53101f" Sep 10 11:12:16.817719 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:16.817698 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kxss9" Sep 10 11:12:16.819710 ip-10-0-134-73 kubenswrapper[2564]: E0910 11:12:16.819683 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kxss9" podUID="c61d89d6-ef29-42ae-aa25-e350ab385462" Sep 10 11:12:16.823715 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:16.822545 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d1b87354-8843-4e59-8a85-68c875f472e6-tmp-dir\") pod \"node-resolver-zgkgx\" (UID: \"d1b87354-8843-4e59-8a85-68c875f472e6\") " pod="openshift-dns/node-resolver-zgkgx" Sep 10 11:12:16.823715 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:16.822588 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/433a8dab-963b-403e-a78f-b3b4fbeadf8f-host-kubelet\") pod \"ovnkube-node-t5n27\" (UID: \"433a8dab-963b-403e-a78f-b3b4fbeadf8f\") " pod="openshift-ovn-kubernetes/ovnkube-node-t5n27" Sep 10 11:12:16.823715 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:16.822622 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/433a8dab-963b-403e-a78f-b3b4fbeadf8f-ovnkube-config\") pod \"ovnkube-node-t5n27\" (UID: \"433a8dab-963b-403e-a78f-b3b4fbeadf8f\") " pod="openshift-ovn-kubernetes/ovnkube-node-t5n27" Sep 10 11:12:16.823715 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:16.822653 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/1bf42e41-3da3-4bc1-8388-c0157fb5ae44-multus-daemon-config\") pod \"multus-r6sr6\" (UID: \"1bf42e41-3da3-4bc1-8388-c0157fb5ae44\") " pod="openshift-multus/multus-r6sr6" Sep 10 11:12:16.823715 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:16.822681 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j8kwf\" (UniqueName: \"kubernetes.io/projected/60a628d5-3863-4793-802f-e07a7157dcdf-kube-api-access-j8kwf\") pod \"node-ca-285k7\" (UID: \"60a628d5-3863-4793-802f-e07a7157dcdf\") " pod="openshift-image-registry/node-ca-285k7" Sep 10 11:12:16.823715 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:16.822713 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/433a8dab-963b-403e-a78f-b3b4fbeadf8f-var-lib-openvswitch\") pod \"ovnkube-node-t5n27\" (UID: \"433a8dab-963b-403e-a78f-b3b4fbeadf8f\") " pod="openshift-ovn-kubernetes/ovnkube-node-t5n27" Sep 10 11:12:16.823715 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:16.822744 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/433a8dab-963b-403e-a78f-b3b4fbeadf8f-systemd-units\") pod \"ovnkube-node-t5n27\" (UID: \"433a8dab-963b-403e-a78f-b3b4fbeadf8f\") " pod="openshift-ovn-kubernetes/ovnkube-node-t5n27" Sep 10 11:12:16.823715 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:16.822775 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1bf42e41-3da3-4bc1-8388-c0157fb5ae44-etc-kubernetes\") pod \"multus-r6sr6\" (UID: \"1bf42e41-3da3-4bc1-8388-c0157fb5ae44\") " pod="openshift-multus/multus-r6sr6" Sep 10 11:12:16.823715 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:16.822805 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d659be6f-7ae8-4309-8d20-0954a8b188ad-host-slash\") pod \"iptables-alerter-z697w\" (UID: \"d659be6f-7ae8-4309-8d20-0954a8b188ad\") " pod="openshift-network-operator/iptables-alerter-z697w" Sep 10 11:12:16.823715 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:16.822871 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/60a628d5-3863-4793-802f-e07a7157dcdf-serviceca\") pod \"node-ca-285k7\" (UID: \"60a628d5-3863-4793-802f-e07a7157dcdf\") " pod="openshift-image-registry/node-ca-285k7" Sep 10 11:12:16.823715 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:16.822994 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ctz7k\" (UniqueName: \"kubernetes.io/projected/d1b87354-8843-4e59-8a85-68c875f472e6-kube-api-access-ctz7k\") pod \"node-resolver-zgkgx\" (UID: \"d1b87354-8843-4e59-8a85-68c875f472e6\") " pod="openshift-dns/node-resolver-zgkgx" Sep 10 11:12:16.823715 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:16.823054 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/433a8dab-963b-403e-a78f-b3b4fbeadf8f-host-run-ovn-kubernetes\") pod \"ovnkube-node-t5n27\" (UID: \"433a8dab-963b-403e-a78f-b3b4fbeadf8f\") " pod="openshift-ovn-kubernetes/ovnkube-node-t5n27" Sep 10 11:12:16.823715 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:16.823191 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1bf42e41-3da3-4bc1-8388-c0157fb5ae44-host-run-netns\") pod \"multus-r6sr6\" (UID: \"1bf42e41-3da3-4bc1-8388-c0157fb5ae44\") " pod="openshift-multus/multus-r6sr6" Sep 10 11:12:16.823715 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:16.823346 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/1bf42e41-3da3-4bc1-8388-c0157fb5ae44-host-var-lib-cni-multus\") pod \"multus-r6sr6\" (UID: \"1bf42e41-3da3-4bc1-8388-c0157fb5ae44\") " pod="openshift-multus/multus-r6sr6" Sep 10 11:12:16.823715 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:16.823387 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/a938afae-5d17-4255-b89d-123cdcc6c4a3-etc-selinux\") pod \"aws-ebs-csi-driver-node-tjcmb\" (UID: \"a938afae-5d17-4255-b89d-123cdcc6c4a3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tjcmb" Sep 10 11:12:16.823715 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:16.823422 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1bf42e41-3da3-4bc1-8388-c0157fb5ae44-multus-cni-dir\") pod \"multus-r6sr6\" (UID: \"1bf42e41-3da3-4bc1-8388-c0157fb5ae44\") " pod="openshift-multus/multus-r6sr6" Sep 10 11:12:16.823715 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:16.823457 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/433a8dab-963b-403e-a78f-b3b4fbeadf8f-log-socket\") pod \"ovnkube-node-t5n27\" (UID: \"433a8dab-963b-403e-a78f-b3b4fbeadf8f\") " pod="openshift-ovn-kubernetes/ovnkube-node-t5n27" Sep 10 11:12:16.824609 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:16.823490 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1bf42e41-3da3-4bc1-8388-c0157fb5ae44-system-cni-dir\") pod \"multus-r6sr6\" (UID: \"1bf42e41-3da3-4bc1-8388-c0157fb5ae44\") " pod="openshift-multus/multus-r6sr6" Sep 10 11:12:16.824609 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:16.823517 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/a938afae-5d17-4255-b89d-123cdcc6c4a3-sys-fs\") pod \"aws-ebs-csi-driver-node-tjcmb\" (UID: \"a938afae-5d17-4255-b89d-123cdcc6c4a3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tjcmb" Sep 10 11:12:16.824609 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:16.823548 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/1bf42e41-3da3-4bc1-8388-c0157fb5ae44-hostroot\") pod \"multus-r6sr6\" (UID: \"1bf42e41-3da3-4bc1-8388-c0157fb5ae44\") " pod="openshift-multus/multus-r6sr6" Sep 10 11:12:16.824609 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:16.823581 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/a938afae-5d17-4255-b89d-123cdcc6c4a3-socket-dir\") pod \"aws-ebs-csi-driver-node-tjcmb\" (UID: \"a938afae-5d17-4255-b89d-123cdcc6c4a3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tjcmb" Sep 10 11:12:16.824609 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:16.823610 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/433a8dab-963b-403e-a78f-b3b4fbeadf8f-run-ovn\") pod \"ovnkube-node-t5n27\" (UID: \"433a8dab-963b-403e-a78f-b3b4fbeadf8f\") " pod="openshift-ovn-kubernetes/ovnkube-node-t5n27" Sep 10 11:12:16.824609 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:16.824377 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-54z9n" Sep 10 11:12:16.824609 ip-10-0-134-73 kubenswrapper[2564]: E0910 11:12:16.824462 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-54z9n" podUID="794743e8-fee9-426f-9546-161a898541e2" Sep 10 11:12:16.824975 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:16.824828 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gxnj8\" (UniqueName: \"kubernetes.io/projected/1d5ea621-658b-4058-9b1a-d4c976651be0-kube-api-access-gxnj8\") pod \"multus-additional-cni-plugins-dpgnj\" (UID: \"1d5ea621-658b-4058-9b1a-d4c976651be0\") " pod="openshift-multus/multus-additional-cni-plugins-dpgnj" Sep 10 11:12:16.824975 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:16.824875 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/1d5ea621-658b-4058-9b1a-d4c976651be0-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-dpgnj\" (UID: \"1d5ea621-658b-4058-9b1a-d4c976651be0\") " pod="openshift-multus/multus-additional-cni-plugins-dpgnj" Sep 10 11:12:16.824975 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:16.824909 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/1d5ea621-658b-4058-9b1a-d4c976651be0-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-dpgnj\" (UID: \"1d5ea621-658b-4058-9b1a-d4c976651be0\") " pod="openshift-multus/multus-additional-cni-plugins-dpgnj" Sep 10 11:12:16.825134 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:16.824986 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/1bf42e41-3da3-4bc1-8388-c0157fb5ae44-multus-socket-dir-parent\") pod \"multus-r6sr6\" (UID: \"1bf42e41-3da3-4bc1-8388-c0157fb5ae44\") " pod="openshift-multus/multus-r6sr6" Sep 10 11:12:16.825134 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:16.825041 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1d5ea621-658b-4058-9b1a-d4c976651be0-tuning-conf-dir\") pod \"multus-additional-cni-plugins-dpgnj\" (UID: \"1d5ea621-658b-4058-9b1a-d4c976651be0\") " pod="openshift-multus/multus-additional-cni-plugins-dpgnj" Sep 10 11:12:16.825134 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:16.825070 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rvmvw\" (UniqueName: \"kubernetes.io/projected/a938afae-5d17-4255-b89d-123cdcc6c4a3-kube-api-access-rvmvw\") pod \"aws-ebs-csi-driver-node-tjcmb\" (UID: \"a938afae-5d17-4255-b89d-123cdcc6c4a3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tjcmb" Sep 10 11:12:16.825290 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:16.825164 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1d5ea621-658b-4058-9b1a-d4c976651be0-cni-binary-copy\") pod \"multus-additional-cni-plugins-dpgnj\" (UID: \"1d5ea621-658b-4058-9b1a-d4c976651be0\") " pod="openshift-multus/multus-additional-cni-plugins-dpgnj" Sep 10 11:12:16.825290 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:16.825202 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/433a8dab-963b-403e-a78f-b3b4fbeadf8f-host-slash\") pod \"ovnkube-node-t5n27\" (UID: \"433a8dab-963b-403e-a78f-b3b4fbeadf8f\") " pod="openshift-ovn-kubernetes/ovnkube-node-t5n27" Sep 10 11:12:16.825290 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:16.825266 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/433a8dab-963b-403e-a78f-b3b4fbeadf8f-node-log\") pod \"ovnkube-node-t5n27\" (UID: \"433a8dab-963b-403e-a78f-b3b4fbeadf8f\") " pod="openshift-ovn-kubernetes/ovnkube-node-t5n27" Sep 10 11:12:16.825444 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:16.825325 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/433a8dab-963b-403e-a78f-b3b4fbeadf8f-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-t5n27\" (UID: \"433a8dab-963b-403e-a78f-b3b4fbeadf8f\") " pod="openshift-ovn-kubernetes/ovnkube-node-t5n27" Sep 10 11:12:16.825444 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:16.825368 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/1bf42e41-3da3-4bc1-8388-c0157fb5ae44-host-run-k8s-cni-cncf-io\") pod \"multus-r6sr6\" (UID: \"1bf42e41-3da3-4bc1-8388-c0157fb5ae44\") " pod="openshift-multus/multus-r6sr6" Sep 10 11:12:16.825444 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:16.825398 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/1bf42e41-3da3-4bc1-8388-c0157fb5ae44-host-run-multus-certs\") pod \"multus-r6sr6\" (UID: \"1bf42e41-3da3-4bc1-8388-c0157fb5ae44\") " pod="openshift-multus/multus-r6sr6" Sep 10 11:12:16.825593 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:16.825539 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/433a8dab-963b-403e-a78f-b3b4fbeadf8f-etc-openvswitch\") pod \"ovnkube-node-t5n27\" (UID: \"433a8dab-963b-403e-a78f-b3b4fbeadf8f\") " pod="openshift-ovn-kubernetes/ovnkube-node-t5n27" Sep 10 11:12:16.825593 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:16.825582 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/433a8dab-963b-403e-a78f-b3b4fbeadf8f-run-openvswitch\") pod \"ovnkube-node-t5n27\" (UID: \"433a8dab-963b-403e-a78f-b3b4fbeadf8f\") " pod="openshift-ovn-kubernetes/ovnkube-node-t5n27" Sep 10 11:12:16.825694 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:16.825617 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/433a8dab-963b-403e-a78f-b3b4fbeadf8f-host-cni-netd\") pod \"ovnkube-node-t5n27\" (UID: \"433a8dab-963b-403e-a78f-b3b4fbeadf8f\") " pod="openshift-ovn-kubernetes/ovnkube-node-t5n27" Sep 10 11:12:16.825694 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:16.825681 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/d1b87354-8843-4e59-8a85-68c875f472e6-hosts-file\") pod \"node-resolver-zgkgx\" (UID: \"d1b87354-8843-4e59-8a85-68c875f472e6\") " pod="openshift-dns/node-resolver-zgkgx" Sep 10 11:12:16.825809 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:16.825704 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/a938afae-5d17-4255-b89d-123cdcc6c4a3-registration-dir\") pod \"aws-ebs-csi-driver-node-tjcmb\" (UID: \"a938afae-5d17-4255-b89d-123cdcc6c4a3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tjcmb" Sep 10 11:12:16.825809 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:16.825725 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nl7t8\" (UniqueName: \"kubernetes.io/projected/d659be6f-7ae8-4309-8d20-0954a8b188ad-kube-api-access-nl7t8\") pod \"iptables-alerter-z697w\" (UID: \"d659be6f-7ae8-4309-8d20-0954a8b188ad\") " pod="openshift-network-operator/iptables-alerter-z697w" Sep 10 11:12:16.825809 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:16.825748 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/433a8dab-963b-403e-a78f-b3b4fbeadf8f-env-overrides\") pod \"ovnkube-node-t5n27\" (UID: \"433a8dab-963b-403e-a78f-b3b4fbeadf8f\") " pod="openshift-ovn-kubernetes/ovnkube-node-t5n27" Sep 10 11:12:16.825809 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:16.825783 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1bf42e41-3da3-4bc1-8388-c0157fb5ae44-host-var-lib-cni-bin\") pod \"multus-r6sr6\" (UID: \"1bf42e41-3da3-4bc1-8388-c0157fb5ae44\") " pod="openshift-multus/multus-r6sr6" Sep 10 11:12:16.825809 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:16.825799 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1bf42e41-3da3-4bc1-8388-c0157fb5ae44-multus-conf-dir\") pod \"multus-r6sr6\" (UID: \"1bf42e41-3da3-4bc1-8388-c0157fb5ae44\") " pod="openshift-multus/multus-r6sr6" Sep 10 11:12:16.826089 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:16.825868 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ktkjb\" (UniqueName: \"kubernetes.io/projected/433a8dab-963b-403e-a78f-b3b4fbeadf8f-kube-api-access-ktkjb\") pod \"ovnkube-node-t5n27\" (UID: \"433a8dab-963b-403e-a78f-b3b4fbeadf8f\") " pod="openshift-ovn-kubernetes/ovnkube-node-t5n27" Sep 10 11:12:16.826089 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:16.825970 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1bf42e41-3da3-4bc1-8388-c0157fb5ae44-cnibin\") pod \"multus-r6sr6\" (UID: \"1bf42e41-3da3-4bc1-8388-c0157fb5ae44\") " pod="openshift-multus/multus-r6sr6" Sep 10 11:12:16.826089 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:16.826007 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/60a628d5-3863-4793-802f-e07a7157dcdf-host\") pod \"node-ca-285k7\" (UID: \"60a628d5-3863-4793-802f-e07a7157dcdf\") " pod="openshift-image-registry/node-ca-285k7" Sep 10 11:12:16.826089 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:16.826025 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/433a8dab-963b-403e-a78f-b3b4fbeadf8f-host-run-netns\") pod \"ovnkube-node-t5n27\" (UID: \"433a8dab-963b-403e-a78f-b3b4fbeadf8f\") " pod="openshift-ovn-kubernetes/ovnkube-node-t5n27" Sep 10 11:12:16.826089 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:16.826050 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/433a8dab-963b-403e-a78f-b3b4fbeadf8f-host-cni-bin\") pod \"ovnkube-node-t5n27\" (UID: \"433a8dab-963b-403e-a78f-b3b4fbeadf8f\") " pod="openshift-ovn-kubernetes/ovnkube-node-t5n27" Sep 10 11:12:16.826089 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:16.826070 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1bf42e41-3da3-4bc1-8388-c0157fb5ae44-cni-binary-copy\") pod \"multus-r6sr6\" (UID: \"1bf42e41-3da3-4bc1-8388-c0157fb5ae44\") " pod="openshift-multus/multus-r6sr6" Sep 10 11:12:16.826440 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:16.826092 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/a938afae-5d17-4255-b89d-123cdcc6c4a3-kubelet-dir\") pod \"aws-ebs-csi-driver-node-tjcmb\" (UID: \"a938afae-5d17-4255-b89d-123cdcc6c4a3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tjcmb" Sep 10 11:12:16.826440 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:16.826128 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/d659be6f-7ae8-4309-8d20-0954a8b188ad-iptables-alerter-script\") pod \"iptables-alerter-z697w\" (UID: \"d659be6f-7ae8-4309-8d20-0954a8b188ad\") " pod="openshift-network-operator/iptables-alerter-z697w" Sep 10 11:12:16.826440 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:16.826149 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/433a8dab-963b-403e-a78f-b3b4fbeadf8f-run-systemd\") pod \"ovnkube-node-t5n27\" (UID: \"433a8dab-963b-403e-a78f-b3b4fbeadf8f\") " pod="openshift-ovn-kubernetes/ovnkube-node-t5n27" Sep 10 11:12:16.826440 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:16.826227 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1d5ea621-658b-4058-9b1a-d4c976651be0-system-cni-dir\") pod \"multus-additional-cni-plugins-dpgnj\" (UID: \"1d5ea621-658b-4058-9b1a-d4c976651be0\") " pod="openshift-multus/multus-additional-cni-plugins-dpgnj" Sep 10 11:12:16.826440 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:16.826248 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/433a8dab-963b-403e-a78f-b3b4fbeadf8f-ovn-node-metrics-cert\") pod \"ovnkube-node-t5n27\" (UID: \"433a8dab-963b-403e-a78f-b3b4fbeadf8f\") " pod="openshift-ovn-kubernetes/ovnkube-node-t5n27" Sep 10 11:12:16.826440 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:16.826266 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1bf42e41-3da3-4bc1-8388-c0157fb5ae44-host-var-lib-kubelet\") pod \"multus-r6sr6\" (UID: \"1bf42e41-3da3-4bc1-8388-c0157fb5ae44\") " pod="openshift-multus/multus-r6sr6" Sep 10 11:12:16.826440 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:16.826284 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q5x2b\" (UniqueName: \"kubernetes.io/projected/1bf42e41-3da3-4bc1-8388-c0157fb5ae44-kube-api-access-q5x2b\") pod \"multus-r6sr6\" (UID: \"1bf42e41-3da3-4bc1-8388-c0157fb5ae44\") " pod="openshift-multus/multus-r6sr6" Sep 10 11:12:16.826440 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:16.826303 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1d5ea621-658b-4058-9b1a-d4c976651be0-cnibin\") pod \"multus-additional-cni-plugins-dpgnj\" (UID: \"1d5ea621-658b-4058-9b1a-d4c976651be0\") " pod="openshift-multus/multus-additional-cni-plugins-dpgnj" Sep 10 11:12:16.826440 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:16.826329 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/433a8dab-963b-403e-a78f-b3b4fbeadf8f-ovnkube-script-lib\") pod \"ovnkube-node-t5n27\" (UID: \"433a8dab-963b-403e-a78f-b3b4fbeadf8f\") " pod="openshift-ovn-kubernetes/ovnkube-node-t5n27" Sep 10 11:12:16.826440 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:16.826430 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/a938afae-5d17-4255-b89d-123cdcc6c4a3-device-dir\") pod \"aws-ebs-csi-driver-node-tjcmb\" (UID: \"a938afae-5d17-4255-b89d-123cdcc6c4a3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tjcmb" Sep 10 11:12:16.827982 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:16.827766 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-pq4ct" Sep 10 11:12:16.830742 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:16.830365 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-8mbpl" Sep 10 11:12:16.833780 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:16.832385 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Sep 10 11:12:16.833780 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:16.832610 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-vxk57\"" Sep 10 11:12:16.833780 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:16.833526 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Sep 10 11:12:16.834214 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:16.834190 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-bdrcp\"" Sep 10 11:12:16.834492 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:16.834415 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Sep 10 11:12:16.834605 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:16.834590 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Sep 10 11:12:16.835733 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:16.835693 2564 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Sep 10 11:12:16.858584 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:16.858565 2564 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-96cxf" Sep 10 11:12:16.867958 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:16.867912 2564 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-96cxf" Sep 10 11:12:16.911092 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:16.911065 2564 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Sep 10 11:12:16.919490 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:16.919431 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-73.ec2.internal" event={"ID":"8d6e48b52697b16de0fdd5bfe815b959","Type":"ContainerStarted","Data":"ae0ab4c89bdef860780be75e8163fa09fe4c1d0b427901283c79ab8beeb907fd"} Sep 10 11:12:16.921139 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:16.921072 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-73.ec2.internal" event={"ID":"fa04fa410118647777397f100391d4d1","Type":"ContainerStarted","Data":"b98c7a949af2543050a96d591950586bf8750812ba6d81046a09503030a4cf4d"} Sep 10 11:12:16.927362 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:16.927335 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/433a8dab-963b-403e-a78f-b3b4fbeadf8f-ovn-node-metrics-cert\") pod \"ovnkube-node-t5n27\" (UID: \"433a8dab-963b-403e-a78f-b3b4fbeadf8f\") " pod="openshift-ovn-kubernetes/ovnkube-node-t5n27" Sep 10 11:12:16.927460 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:16.927379 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1bf42e41-3da3-4bc1-8388-c0157fb5ae44-host-var-lib-kubelet\") pod \"multus-r6sr6\" (UID: \"1bf42e41-3da3-4bc1-8388-c0157fb5ae44\") " pod="openshift-multus/multus-r6sr6" Sep 10 11:12:16.927460 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:16.927406 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q5x2b\" (UniqueName: \"kubernetes.io/projected/1bf42e41-3da3-4bc1-8388-c0157fb5ae44-kube-api-access-q5x2b\") pod \"multus-r6sr6\" (UID: \"1bf42e41-3da3-4bc1-8388-c0157fb5ae44\") " pod="openshift-multus/multus-r6sr6" Sep 10 11:12:16.927460 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:16.927431 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1d5ea621-658b-4058-9b1a-d4c976651be0-cnibin\") pod \"multus-additional-cni-plugins-dpgnj\" (UID: \"1d5ea621-658b-4058-9b1a-d4c976651be0\") " pod="openshift-multus/multus-additional-cni-plugins-dpgnj" Sep 10 11:12:16.927460 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:16.927453 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/433a8dab-963b-403e-a78f-b3b4fbeadf8f-ovnkube-script-lib\") pod \"ovnkube-node-t5n27\" (UID: \"433a8dab-963b-403e-a78f-b3b4fbeadf8f\") " pod="openshift-ovn-kubernetes/ovnkube-node-t5n27" Sep 10 11:12:16.927681 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:16.927477 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/a938afae-5d17-4255-b89d-123cdcc6c4a3-device-dir\") pod \"aws-ebs-csi-driver-node-tjcmb\" (UID: \"a938afae-5d17-4255-b89d-123cdcc6c4a3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tjcmb" Sep 10 11:12:16.927681 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:16.927505 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/c61d89d6-ef29-42ae-aa25-e350ab385462-dbus\") pod \"global-pull-secret-syncer-kxss9\" (UID: \"c61d89d6-ef29-42ae-aa25-e350ab385462\") " pod="kube-system/global-pull-secret-syncer-kxss9" Sep 10 11:12:16.927681 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:16.927527 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/d79e1737-1635-4c9c-8ad3-1ed1537ee844-etc-systemd\") pod \"tuned-8mbpl\" (UID: \"d79e1737-1635-4c9c-8ad3-1ed1537ee844\") " pod="openshift-cluster-node-tuning-operator/tuned-8mbpl" Sep 10 11:12:16.927681 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:16.927552 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/d79e1737-1635-4c9c-8ad3-1ed1537ee844-run\") pod \"tuned-8mbpl\" (UID: \"d79e1737-1635-4c9c-8ad3-1ed1537ee844\") " pod="openshift-cluster-node-tuning-operator/tuned-8mbpl" Sep 10 11:12:16.927681 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:16.927575 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d79e1737-1635-4c9c-8ad3-1ed1537ee844-lib-modules\") pod \"tuned-8mbpl\" (UID: \"d79e1737-1635-4c9c-8ad3-1ed1537ee844\") " pod="openshift-cluster-node-tuning-operator/tuned-8mbpl" Sep 10 11:12:16.927681 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:16.927596 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/d79e1737-1635-4c9c-8ad3-1ed1537ee844-etc-tuned\") pod \"tuned-8mbpl\" (UID: \"d79e1737-1635-4c9c-8ad3-1ed1537ee844\") " pod="openshift-cluster-node-tuning-operator/tuned-8mbpl" Sep 10 11:12:16.927681 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:16.927633 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d1b87354-8843-4e59-8a85-68c875f472e6-tmp-dir\") pod \"node-resolver-zgkgx\" (UID: \"d1b87354-8843-4e59-8a85-68c875f472e6\") " pod="openshift-dns/node-resolver-zgkgx" Sep 10 11:12:16.927681 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:16.927658 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/433a8dab-963b-403e-a78f-b3b4fbeadf8f-host-kubelet\") pod \"ovnkube-node-t5n27\" (UID: \"433a8dab-963b-403e-a78f-b3b4fbeadf8f\") " pod="openshift-ovn-kubernetes/ovnkube-node-t5n27" Sep 10 11:12:16.928090 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:16.927683 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/433a8dab-963b-403e-a78f-b3b4fbeadf8f-ovnkube-config\") pod \"ovnkube-node-t5n27\" (UID: \"433a8dab-963b-403e-a78f-b3b4fbeadf8f\") " pod="openshift-ovn-kubernetes/ovnkube-node-t5n27" Sep 10 11:12:16.928090 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:16.927723 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/1bf42e41-3da3-4bc1-8388-c0157fb5ae44-multus-daemon-config\") pod \"multus-r6sr6\" (UID: \"1bf42e41-3da3-4bc1-8388-c0157fb5ae44\") " pod="openshift-multus/multus-r6sr6" Sep 10 11:12:16.928090 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:16.927753 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j8kwf\" (UniqueName: \"kubernetes.io/projected/60a628d5-3863-4793-802f-e07a7157dcdf-kube-api-access-j8kwf\") pod \"node-ca-285k7\" (UID: \"60a628d5-3863-4793-802f-e07a7157dcdf\") " pod="openshift-image-registry/node-ca-285k7" Sep 10 11:12:16.928090 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:16.927789 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/c61d89d6-ef29-42ae-aa25-e350ab385462-kubelet-config\") pod \"global-pull-secret-syncer-kxss9\" (UID: \"c61d89d6-ef29-42ae-aa25-e350ab385462\") " pod="kube-system/global-pull-secret-syncer-kxss9" Sep 10 11:12:16.928090 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:16.927815 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/794743e8-fee9-426f-9546-161a898541e2-metrics-certs\") pod \"network-metrics-daemon-54z9n\" (UID: \"794743e8-fee9-426f-9546-161a898541e2\") " pod="openshift-multus/network-metrics-daemon-54z9n" Sep 10 11:12:16.928090 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:16.927837 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cjz66\" (UniqueName: \"kubernetes.io/projected/d79e1737-1635-4c9c-8ad3-1ed1537ee844-kube-api-access-cjz66\") pod \"tuned-8mbpl\" (UID: \"d79e1737-1635-4c9c-8ad3-1ed1537ee844\") " pod="openshift-cluster-node-tuning-operator/tuned-8mbpl" Sep 10 11:12:16.928090 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:16.927877 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/433a8dab-963b-403e-a78f-b3b4fbeadf8f-var-lib-openvswitch\") pod \"ovnkube-node-t5n27\" (UID: \"433a8dab-963b-403e-a78f-b3b4fbeadf8f\") " pod="openshift-ovn-kubernetes/ovnkube-node-t5n27" Sep 10 11:12:16.928090 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:16.927918 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/433a8dab-963b-403e-a78f-b3b4fbeadf8f-systemd-units\") pod \"ovnkube-node-t5n27\" (UID: \"433a8dab-963b-403e-a78f-b3b4fbeadf8f\") " pod="openshift-ovn-kubernetes/ovnkube-node-t5n27" Sep 10 11:12:16.928090 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:16.927916 2564 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Sep 10 11:12:16.928090 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:16.927945 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1bf42e41-3da3-4bc1-8388-c0157fb5ae44-etc-kubernetes\") pod \"multus-r6sr6\" (UID: \"1bf42e41-3da3-4bc1-8388-c0157fb5ae44\") " pod="openshift-multus/multus-r6sr6" Sep 10 11:12:16.928090 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:16.927971 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d659be6f-7ae8-4309-8d20-0954a8b188ad-host-slash\") pod \"iptables-alerter-z697w\" (UID: \"d659be6f-7ae8-4309-8d20-0954a8b188ad\") " pod="openshift-network-operator/iptables-alerter-z697w" Sep 10 11:12:16.928090 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:16.927994 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/60a628d5-3863-4793-802f-e07a7157dcdf-serviceca\") pod \"node-ca-285k7\" (UID: \"60a628d5-3863-4793-802f-e07a7157dcdf\") " pod="openshift-image-registry/node-ca-285k7" Sep 10 11:12:16.928090 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:16.928020 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-86bbn\" (UniqueName: \"kubernetes.io/projected/794743e8-fee9-426f-9546-161a898541e2-kube-api-access-86bbn\") pod \"network-metrics-daemon-54z9n\" (UID: \"794743e8-fee9-426f-9546-161a898541e2\") " pod="openshift-multus/network-metrics-daemon-54z9n" Sep 10 11:12:16.928090 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:16.928040 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d79e1737-1635-4c9c-8ad3-1ed1537ee844-tmp\") pod \"tuned-8mbpl\" (UID: \"d79e1737-1635-4c9c-8ad3-1ed1537ee844\") " pod="openshift-cluster-node-tuning-operator/tuned-8mbpl" Sep 10 11:12:16.928090 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:16.928062 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ctz7k\" (UniqueName: \"kubernetes.io/projected/d1b87354-8843-4e59-8a85-68c875f472e6-kube-api-access-ctz7k\") pod \"node-resolver-zgkgx\" (UID: \"d1b87354-8843-4e59-8a85-68c875f472e6\") " pod="openshift-dns/node-resolver-zgkgx" Sep 10 11:12:16.928090 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:16.928086 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/433a8dab-963b-403e-a78f-b3b4fbeadf8f-host-run-ovn-kubernetes\") pod \"ovnkube-node-t5n27\" (UID: \"433a8dab-963b-403e-a78f-b3b4fbeadf8f\") " pod="openshift-ovn-kubernetes/ovnkube-node-t5n27" Sep 10 11:12:16.928880 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:16.928108 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1bf42e41-3da3-4bc1-8388-c0157fb5ae44-host-run-netns\") pod \"multus-r6sr6\" (UID: \"1bf42e41-3da3-4bc1-8388-c0157fb5ae44\") " pod="openshift-multus/multus-r6sr6" Sep 10 11:12:16.928880 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:16.928128 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/1bf42e41-3da3-4bc1-8388-c0157fb5ae44-host-var-lib-cni-multus\") pod \"multus-r6sr6\" (UID: \"1bf42e41-3da3-4bc1-8388-c0157fb5ae44\") " pod="openshift-multus/multus-r6sr6" Sep 10 11:12:16.928880 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:16.928156 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/a938afae-5d17-4255-b89d-123cdcc6c4a3-etc-selinux\") pod \"aws-ebs-csi-driver-node-tjcmb\" (UID: \"a938afae-5d17-4255-b89d-123cdcc6c4a3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tjcmb" Sep 10 11:12:16.928880 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:16.928179 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1bf42e41-3da3-4bc1-8388-c0157fb5ae44-multus-cni-dir\") pod \"multus-r6sr6\" (UID: \"1bf42e41-3da3-4bc1-8388-c0157fb5ae44\") " pod="openshift-multus/multus-r6sr6" Sep 10 11:12:16.928880 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:16.928206 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c61d89d6-ef29-42ae-aa25-e350ab385462-original-pull-secret\") pod \"global-pull-secret-syncer-kxss9\" (UID: \"c61d89d6-ef29-42ae-aa25-e350ab385462\") " pod="kube-system/global-pull-secret-syncer-kxss9" Sep 10 11:12:16.928880 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:16.928232 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d79e1737-1635-4c9c-8ad3-1ed1537ee844-etc-kubernetes\") pod \"tuned-8mbpl\" (UID: \"d79e1737-1635-4c9c-8ad3-1ed1537ee844\") " pod="openshift-cluster-node-tuning-operator/tuned-8mbpl" Sep 10 11:12:16.928880 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:16.928261 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/433a8dab-963b-403e-a78f-b3b4fbeadf8f-log-socket\") pod \"ovnkube-node-t5n27\" (UID: \"433a8dab-963b-403e-a78f-b3b4fbeadf8f\") " pod="openshift-ovn-kubernetes/ovnkube-node-t5n27" Sep 10 11:12:16.928880 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:16.928287 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1bf42e41-3da3-4bc1-8388-c0157fb5ae44-system-cni-dir\") pod \"multus-r6sr6\" (UID: \"1bf42e41-3da3-4bc1-8388-c0157fb5ae44\") " pod="openshift-multus/multus-r6sr6" Sep 10 11:12:16.928880 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:16.928312 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/a938afae-5d17-4255-b89d-123cdcc6c4a3-sys-fs\") pod \"aws-ebs-csi-driver-node-tjcmb\" (UID: \"a938afae-5d17-4255-b89d-123cdcc6c4a3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tjcmb" Sep 10 11:12:16.928880 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:16.928355 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d79e1737-1635-4c9c-8ad3-1ed1537ee844-sys\") pod \"tuned-8mbpl\" (UID: \"d79e1737-1635-4c9c-8ad3-1ed1537ee844\") " pod="openshift-cluster-node-tuning-operator/tuned-8mbpl" Sep 10 11:12:16.928880 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:16.928394 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/433a8dab-963b-403e-a78f-b3b4fbeadf8f-var-lib-openvswitch\") pod \"ovnkube-node-t5n27\" (UID: \"433a8dab-963b-403e-a78f-b3b4fbeadf8f\") " pod="openshift-ovn-kubernetes/ovnkube-node-t5n27" Sep 10 11:12:16.928880 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:16.928386 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d79e1737-1635-4c9c-8ad3-1ed1537ee844-var-lib-kubelet\") pod \"tuned-8mbpl\" (UID: \"d79e1737-1635-4c9c-8ad3-1ed1537ee844\") " pod="openshift-cluster-node-tuning-operator/tuned-8mbpl" Sep 10 11:12:16.928880 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:16.928432 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/1bf42e41-3da3-4bc1-8388-c0157fb5ae44-hostroot\") pod \"multus-r6sr6\" (UID: \"1bf42e41-3da3-4bc1-8388-c0157fb5ae44\") " pod="openshift-multus/multus-r6sr6" Sep 10 11:12:16.928880 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:16.928461 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/a938afae-5d17-4255-b89d-123cdcc6c4a3-socket-dir\") pod \"aws-ebs-csi-driver-node-tjcmb\" (UID: \"a938afae-5d17-4255-b89d-123cdcc6c4a3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tjcmb" Sep 10 11:12:16.928880 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:16.928502 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1bf42e41-3da3-4bc1-8388-c0157fb5ae44-etc-kubernetes\") pod \"multus-r6sr6\" (UID: \"1bf42e41-3da3-4bc1-8388-c0157fb5ae44\") " pod="openshift-multus/multus-r6sr6" Sep 10 11:12:16.928880 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:16.928511 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/433a8dab-963b-403e-a78f-b3b4fbeadf8f-run-ovn\") pod \"ovnkube-node-t5n27\" (UID: \"433a8dab-963b-403e-a78f-b3b4fbeadf8f\") " pod="openshift-ovn-kubernetes/ovnkube-node-t5n27" Sep 10 11:12:16.928880 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:16.928541 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gxnj8\" (UniqueName: \"kubernetes.io/projected/1d5ea621-658b-4058-9b1a-d4c976651be0-kube-api-access-gxnj8\") pod \"multus-additional-cni-plugins-dpgnj\" (UID: \"1d5ea621-658b-4058-9b1a-d4c976651be0\") " pod="openshift-multus/multus-additional-cni-plugins-dpgnj" Sep 10 11:12:16.929799 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:16.928548 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d659be6f-7ae8-4309-8d20-0954a8b188ad-host-slash\") pod \"iptables-alerter-z697w\" (UID: \"d659be6f-7ae8-4309-8d20-0954a8b188ad\") " pod="openshift-network-operator/iptables-alerter-z697w" Sep 10 11:12:16.929799 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:16.928582 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/1d5ea621-658b-4058-9b1a-d4c976651be0-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-dpgnj\" (UID: \"1d5ea621-658b-4058-9b1a-d4c976651be0\") " pod="openshift-multus/multus-additional-cni-plugins-dpgnj" Sep 10 11:12:16.929799 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:16.928610 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/1d5ea621-658b-4058-9b1a-d4c976651be0-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-dpgnj\" (UID: \"1d5ea621-658b-4058-9b1a-d4c976651be0\") " pod="openshift-multus/multus-additional-cni-plugins-dpgnj" Sep 10 11:12:16.929799 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:16.928639 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/1bf42e41-3da3-4bc1-8388-c0157fb5ae44-multus-socket-dir-parent\") pod \"multus-r6sr6\" (UID: \"1bf42e41-3da3-4bc1-8388-c0157fb5ae44\") " pod="openshift-multus/multus-r6sr6" Sep 10 11:12:16.929799 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:16.928666 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/d79e1737-1635-4c9c-8ad3-1ed1537ee844-etc-sysctl-d\") pod \"tuned-8mbpl\" (UID: \"d79e1737-1635-4c9c-8ad3-1ed1537ee844\") " pod="openshift-cluster-node-tuning-operator/tuned-8mbpl" Sep 10 11:12:16.929799 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:16.928697 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1d5ea621-658b-4058-9b1a-d4c976651be0-tuning-conf-dir\") pod \"multus-additional-cni-plugins-dpgnj\" (UID: \"1d5ea621-658b-4058-9b1a-d4c976651be0\") " pod="openshift-multus/multus-additional-cni-plugins-dpgnj" Sep 10 11:12:16.929799 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:16.928728 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rvmvw\" (UniqueName: \"kubernetes.io/projected/a938afae-5d17-4255-b89d-123cdcc6c4a3-kube-api-access-rvmvw\") pod \"aws-ebs-csi-driver-node-tjcmb\" (UID: \"a938afae-5d17-4255-b89d-123cdcc6c4a3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tjcmb" Sep 10 11:12:16.929799 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:16.928755 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/d79e1737-1635-4c9c-8ad3-1ed1537ee844-etc-sysctl-conf\") pod \"tuned-8mbpl\" (UID: \"d79e1737-1635-4c9c-8ad3-1ed1537ee844\") " pod="openshift-cluster-node-tuning-operator/tuned-8mbpl" Sep 10 11:12:16.929799 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:16.928794 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1d5ea621-658b-4058-9b1a-d4c976651be0-cni-binary-copy\") pod \"multus-additional-cni-plugins-dpgnj\" (UID: \"1d5ea621-658b-4058-9b1a-d4c976651be0\") " pod="openshift-multus/multus-additional-cni-plugins-dpgnj" Sep 10 11:12:16.929799 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:16.928840 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/433a8dab-963b-403e-a78f-b3b4fbeadf8f-host-slash\") pod \"ovnkube-node-t5n27\" (UID: \"433a8dab-963b-403e-a78f-b3b4fbeadf8f\") " pod="openshift-ovn-kubernetes/ovnkube-node-t5n27" Sep 10 11:12:16.929799 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:16.928867 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/433a8dab-963b-403e-a78f-b3b4fbeadf8f-node-log\") pod \"ovnkube-node-t5n27\" (UID: \"433a8dab-963b-403e-a78f-b3b4fbeadf8f\") " pod="openshift-ovn-kubernetes/ovnkube-node-t5n27" Sep 10 11:12:16.929799 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:16.928895 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/d79e1737-1635-4c9c-8ad3-1ed1537ee844-etc-sysconfig\") pod \"tuned-8mbpl\" (UID: \"d79e1737-1635-4c9c-8ad3-1ed1537ee844\") " pod="openshift-cluster-node-tuning-operator/tuned-8mbpl" Sep 10 11:12:16.929799 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:16.928924 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/433a8dab-963b-403e-a78f-b3b4fbeadf8f-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-t5n27\" (UID: \"433a8dab-963b-403e-a78f-b3b4fbeadf8f\") " pod="openshift-ovn-kubernetes/ovnkube-node-t5n27" Sep 10 11:12:16.929799 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:16.928973 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/1bf42e41-3da3-4bc1-8388-c0157fb5ae44-host-run-k8s-cni-cncf-io\") pod \"multus-r6sr6\" (UID: \"1bf42e41-3da3-4bc1-8388-c0157fb5ae44\") " pod="openshift-multus/multus-r6sr6" Sep 10 11:12:16.929799 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:16.929006 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/1bf42e41-3da3-4bc1-8388-c0157fb5ae44-host-run-multus-certs\") pod \"multus-r6sr6\" (UID: \"1bf42e41-3da3-4bc1-8388-c0157fb5ae44\") " pod="openshift-multus/multus-r6sr6" Sep 10 11:12:16.929799 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:16.929033 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tpb4z\" (UniqueName: \"kubernetes.io/projected/1f233d76-b986-4ec6-a096-e4bc9d53101f-kube-api-access-tpb4z\") pod \"network-check-target-bvnw9\" (UID: \"1f233d76-b986-4ec6-a096-e4bc9d53101f\") " pod="openshift-network-diagnostics/network-check-target-bvnw9" Sep 10 11:12:16.930618 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:16.929035 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/60a628d5-3863-4793-802f-e07a7157dcdf-serviceca\") pod \"node-ca-285k7\" (UID: \"60a628d5-3863-4793-802f-e07a7157dcdf\") " pod="openshift-image-registry/node-ca-285k7" Sep 10 11:12:16.930618 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:16.929102 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/433a8dab-963b-403e-a78f-b3b4fbeadf8f-etc-openvswitch\") pod \"ovnkube-node-t5n27\" (UID: \"433a8dab-963b-403e-a78f-b3b4fbeadf8f\") " pod="openshift-ovn-kubernetes/ovnkube-node-t5n27" Sep 10 11:12:16.930618 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:16.929133 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/433a8dab-963b-403e-a78f-b3b4fbeadf8f-run-openvswitch\") pod \"ovnkube-node-t5n27\" (UID: \"433a8dab-963b-403e-a78f-b3b4fbeadf8f\") " pod="openshift-ovn-kubernetes/ovnkube-node-t5n27" Sep 10 11:12:16.930618 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:16.929160 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/433a8dab-963b-403e-a78f-b3b4fbeadf8f-host-cni-netd\") pod \"ovnkube-node-t5n27\" (UID: \"433a8dab-963b-403e-a78f-b3b4fbeadf8f\") " pod="openshift-ovn-kubernetes/ovnkube-node-t5n27" Sep 10 11:12:16.930618 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:16.929191 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/d1b87354-8843-4e59-8a85-68c875f472e6-hosts-file\") pod \"node-resolver-zgkgx\" (UID: \"d1b87354-8843-4e59-8a85-68c875f472e6\") " pod="openshift-dns/node-resolver-zgkgx" Sep 10 11:12:16.930618 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:16.929218 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/a938afae-5d17-4255-b89d-123cdcc6c4a3-registration-dir\") pod \"aws-ebs-csi-driver-node-tjcmb\" (UID: \"a938afae-5d17-4255-b89d-123cdcc6c4a3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tjcmb" Sep 10 11:12:16.930618 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:16.929245 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nl7t8\" (UniqueName: \"kubernetes.io/projected/d659be6f-7ae8-4309-8d20-0954a8b188ad-kube-api-access-nl7t8\") pod \"iptables-alerter-z697w\" (UID: \"d659be6f-7ae8-4309-8d20-0954a8b188ad\") " pod="openshift-network-operator/iptables-alerter-z697w" Sep 10 11:12:16.930618 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:16.929273 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/77142edb-57e1-4da1-8eba-f104366a851f-agent-certs\") pod \"konnectivity-agent-pq4ct\" (UID: \"77142edb-57e1-4da1-8eba-f104366a851f\") " pod="kube-system/konnectivity-agent-pq4ct" Sep 10 11:12:16.930618 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:16.929302 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/433a8dab-963b-403e-a78f-b3b4fbeadf8f-env-overrides\") pod \"ovnkube-node-t5n27\" (UID: \"433a8dab-963b-403e-a78f-b3b4fbeadf8f\") " pod="openshift-ovn-kubernetes/ovnkube-node-t5n27" Sep 10 11:12:16.930618 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:16.929327 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1bf42e41-3da3-4bc1-8388-c0157fb5ae44-host-var-lib-cni-bin\") pod \"multus-r6sr6\" (UID: \"1bf42e41-3da3-4bc1-8388-c0157fb5ae44\") " pod="openshift-multus/multus-r6sr6" Sep 10 11:12:16.930618 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:16.929354 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1bf42e41-3da3-4bc1-8388-c0157fb5ae44-multus-conf-dir\") pod \"multus-r6sr6\" (UID: \"1bf42e41-3da3-4bc1-8388-c0157fb5ae44\") " pod="openshift-multus/multus-r6sr6" Sep 10 11:12:16.930618 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:16.929376 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1d5ea621-658b-4058-9b1a-d4c976651be0-cnibin\") pod \"multus-additional-cni-plugins-dpgnj\" (UID: \"1d5ea621-658b-4058-9b1a-d4c976651be0\") " pod="openshift-multus/multus-additional-cni-plugins-dpgnj" Sep 10 11:12:16.930618 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:16.929382 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/77142edb-57e1-4da1-8eba-f104366a851f-konnectivity-ca\") pod \"konnectivity-agent-pq4ct\" (UID: \"77142edb-57e1-4da1-8eba-f104366a851f\") " pod="kube-system/konnectivity-agent-pq4ct" Sep 10 11:12:16.930618 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:16.929412 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/d79e1737-1635-4c9c-8ad3-1ed1537ee844-etc-modprobe-d\") pod \"tuned-8mbpl\" (UID: \"d79e1737-1635-4c9c-8ad3-1ed1537ee844\") " pod="openshift-cluster-node-tuning-operator/tuned-8mbpl" Sep 10 11:12:16.930618 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:16.929451 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d79e1737-1635-4c9c-8ad3-1ed1537ee844-host\") pod \"tuned-8mbpl\" (UID: \"d79e1737-1635-4c9c-8ad3-1ed1537ee844\") " pod="openshift-cluster-node-tuning-operator/tuned-8mbpl" Sep 10 11:12:16.930618 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:16.929481 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ktkjb\" (UniqueName: \"kubernetes.io/projected/433a8dab-963b-403e-a78f-b3b4fbeadf8f-kube-api-access-ktkjb\") pod \"ovnkube-node-t5n27\" (UID: \"433a8dab-963b-403e-a78f-b3b4fbeadf8f\") " pod="openshift-ovn-kubernetes/ovnkube-node-t5n27" Sep 10 11:12:16.930618 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:16.929507 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1bf42e41-3da3-4bc1-8388-c0157fb5ae44-cnibin\") pod \"multus-r6sr6\" (UID: \"1bf42e41-3da3-4bc1-8388-c0157fb5ae44\") " pod="openshift-multus/multus-r6sr6" Sep 10 11:12:16.931750 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:16.929534 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/60a628d5-3863-4793-802f-e07a7157dcdf-host\") pod \"node-ca-285k7\" (UID: \"60a628d5-3863-4793-802f-e07a7157dcdf\") " pod="openshift-image-registry/node-ca-285k7" Sep 10 11:12:16.931750 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:16.929565 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/433a8dab-963b-403e-a78f-b3b4fbeadf8f-host-run-netns\") pod \"ovnkube-node-t5n27\" (UID: \"433a8dab-963b-403e-a78f-b3b4fbeadf8f\") " pod="openshift-ovn-kubernetes/ovnkube-node-t5n27" Sep 10 11:12:16.931750 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:16.929613 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/433a8dab-963b-403e-a78f-b3b4fbeadf8f-host-cni-bin\") pod \"ovnkube-node-t5n27\" (UID: \"433a8dab-963b-403e-a78f-b3b4fbeadf8f\") " pod="openshift-ovn-kubernetes/ovnkube-node-t5n27" Sep 10 11:12:16.931750 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:16.929644 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1bf42e41-3da3-4bc1-8388-c0157fb5ae44-cni-binary-copy\") pod \"multus-r6sr6\" (UID: \"1bf42e41-3da3-4bc1-8388-c0157fb5ae44\") " pod="openshift-multus/multus-r6sr6" Sep 10 11:12:16.931750 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:16.929673 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/a938afae-5d17-4255-b89d-123cdcc6c4a3-kubelet-dir\") pod \"aws-ebs-csi-driver-node-tjcmb\" (UID: \"a938afae-5d17-4255-b89d-123cdcc6c4a3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tjcmb" Sep 10 11:12:16.931750 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:16.929701 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/d659be6f-7ae8-4309-8d20-0954a8b188ad-iptables-alerter-script\") pod \"iptables-alerter-z697w\" (UID: \"d659be6f-7ae8-4309-8d20-0954a8b188ad\") " pod="openshift-network-operator/iptables-alerter-z697w" Sep 10 11:12:16.931750 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:16.929732 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/433a8dab-963b-403e-a78f-b3b4fbeadf8f-run-systemd\") pod \"ovnkube-node-t5n27\" (UID: \"433a8dab-963b-403e-a78f-b3b4fbeadf8f\") " pod="openshift-ovn-kubernetes/ovnkube-node-t5n27" Sep 10 11:12:16.931750 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:16.929775 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1d5ea621-658b-4058-9b1a-d4c976651be0-system-cni-dir\") pod \"multus-additional-cni-plugins-dpgnj\" (UID: \"1d5ea621-658b-4058-9b1a-d4c976651be0\") " pod="openshift-multus/multus-additional-cni-plugins-dpgnj" Sep 10 11:12:16.931750 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:16.929871 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1d5ea621-658b-4058-9b1a-d4c976651be0-system-cni-dir\") pod \"multus-additional-cni-plugins-dpgnj\" (UID: \"1d5ea621-658b-4058-9b1a-d4c976651be0\") " pod="openshift-multus/multus-additional-cni-plugins-dpgnj" Sep 10 11:12:16.931750 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:16.929979 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/433a8dab-963b-403e-a78f-b3b4fbeadf8f-ovnkube-script-lib\") pod \"ovnkube-node-t5n27\" (UID: \"433a8dab-963b-403e-a78f-b3b4fbeadf8f\") " pod="openshift-ovn-kubernetes/ovnkube-node-t5n27" Sep 10 11:12:16.931750 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:16.930043 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/a938afae-5d17-4255-b89d-123cdcc6c4a3-device-dir\") pod \"aws-ebs-csi-driver-node-tjcmb\" (UID: \"a938afae-5d17-4255-b89d-123cdcc6c4a3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tjcmb" Sep 10 11:12:16.931750 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:16.930176 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/433a8dab-963b-403e-a78f-b3b4fbeadf8f-host-run-ovn-kubernetes\") pod \"ovnkube-node-t5n27\" (UID: \"433a8dab-963b-403e-a78f-b3b4fbeadf8f\") " pod="openshift-ovn-kubernetes/ovnkube-node-t5n27" Sep 10 11:12:16.931750 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:16.930226 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1bf42e41-3da3-4bc1-8388-c0157fb5ae44-host-run-netns\") pod \"multus-r6sr6\" (UID: \"1bf42e41-3da3-4bc1-8388-c0157fb5ae44\") " pod="openshift-multus/multus-r6sr6" Sep 10 11:12:16.931750 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:16.930289 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/1bf42e41-3da3-4bc1-8388-c0157fb5ae44-host-var-lib-cni-multus\") pod \"multus-r6sr6\" (UID: \"1bf42e41-3da3-4bc1-8388-c0157fb5ae44\") " pod="openshift-multus/multus-r6sr6" Sep 10 11:12:16.931750 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:16.930351 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/a938afae-5d17-4255-b89d-123cdcc6c4a3-etc-selinux\") pod \"aws-ebs-csi-driver-node-tjcmb\" (UID: \"a938afae-5d17-4255-b89d-123cdcc6c4a3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tjcmb" Sep 10 11:12:16.931750 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:16.930352 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d1b87354-8843-4e59-8a85-68c875f472e6-tmp-dir\") pod \"node-resolver-zgkgx\" (UID: \"d1b87354-8843-4e59-8a85-68c875f472e6\") " pod="openshift-dns/node-resolver-zgkgx" Sep 10 11:12:16.931750 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:16.930390 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/433a8dab-963b-403e-a78f-b3b4fbeadf8f-host-kubelet\") pod \"ovnkube-node-t5n27\" (UID: \"433a8dab-963b-403e-a78f-b3b4fbeadf8f\") " pod="openshift-ovn-kubernetes/ovnkube-node-t5n27" Sep 10 11:12:16.932770 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:16.930448 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1bf42e41-3da3-4bc1-8388-c0157fb5ae44-multus-cni-dir\") pod \"multus-r6sr6\" (UID: \"1bf42e41-3da3-4bc1-8388-c0157fb5ae44\") " pod="openshift-multus/multus-r6sr6" Sep 10 11:12:16.932770 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:16.930909 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/433a8dab-963b-403e-a78f-b3b4fbeadf8f-ovnkube-config\") pod \"ovnkube-node-t5n27\" (UID: \"433a8dab-963b-403e-a78f-b3b4fbeadf8f\") " pod="openshift-ovn-kubernetes/ovnkube-node-t5n27" Sep 10 11:12:16.932770 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:16.931016 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/a938afae-5d17-4255-b89d-123cdcc6c4a3-sys-fs\") pod \"aws-ebs-csi-driver-node-tjcmb\" (UID: \"a938afae-5d17-4255-b89d-123cdcc6c4a3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tjcmb" Sep 10 11:12:16.932770 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:16.931019 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/433a8dab-963b-403e-a78f-b3b4fbeadf8f-log-socket\") pod \"ovnkube-node-t5n27\" (UID: \"433a8dab-963b-403e-a78f-b3b4fbeadf8f\") " pod="openshift-ovn-kubernetes/ovnkube-node-t5n27" Sep 10 11:12:16.932770 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:16.931097 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/1bf42e41-3da3-4bc1-8388-c0157fb5ae44-hostroot\") pod \"multus-r6sr6\" (UID: \"1bf42e41-3da3-4bc1-8388-c0157fb5ae44\") " pod="openshift-multus/multus-r6sr6" Sep 10 11:12:16.932770 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:16.931132 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1bf42e41-3da3-4bc1-8388-c0157fb5ae44-system-cni-dir\") pod \"multus-r6sr6\" (UID: \"1bf42e41-3da3-4bc1-8388-c0157fb5ae44\") " pod="openshift-multus/multus-r6sr6" Sep 10 11:12:16.932770 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:16.931172 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/433a8dab-963b-403e-a78f-b3b4fbeadf8f-etc-openvswitch\") pod \"ovnkube-node-t5n27\" (UID: \"433a8dab-963b-403e-a78f-b3b4fbeadf8f\") " pod="openshift-ovn-kubernetes/ovnkube-node-t5n27" Sep 10 11:12:16.932770 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:16.929104 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1bf42e41-3da3-4bc1-8388-c0157fb5ae44-host-var-lib-kubelet\") pod \"multus-r6sr6\" (UID: \"1bf42e41-3da3-4bc1-8388-c0157fb5ae44\") " pod="openshift-multus/multus-r6sr6" Sep 10 11:12:16.932770 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:16.931211 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/a938afae-5d17-4255-b89d-123cdcc6c4a3-socket-dir\") pod \"aws-ebs-csi-driver-node-tjcmb\" (UID: \"a938afae-5d17-4255-b89d-123cdcc6c4a3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tjcmb" Sep 10 11:12:16.932770 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:16.931220 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/433a8dab-963b-403e-a78f-b3b4fbeadf8f-run-openvswitch\") pod \"ovnkube-node-t5n27\" (UID: \"433a8dab-963b-403e-a78f-b3b4fbeadf8f\") " pod="openshift-ovn-kubernetes/ovnkube-node-t5n27" Sep 10 11:12:16.932770 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:16.928449 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/433a8dab-963b-403e-a78f-b3b4fbeadf8f-systemd-units\") pod \"ovnkube-node-t5n27\" (UID: \"433a8dab-963b-403e-a78f-b3b4fbeadf8f\") " pod="openshift-ovn-kubernetes/ovnkube-node-t5n27" Sep 10 11:12:16.932770 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:16.931261 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/433a8dab-963b-403e-a78f-b3b4fbeadf8f-host-cni-netd\") pod \"ovnkube-node-t5n27\" (UID: \"433a8dab-963b-403e-a78f-b3b4fbeadf8f\") " pod="openshift-ovn-kubernetes/ovnkube-node-t5n27" Sep 10 11:12:16.932770 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:16.931267 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/433a8dab-963b-403e-a78f-b3b4fbeadf8f-run-ovn\") pod \"ovnkube-node-t5n27\" (UID: \"433a8dab-963b-403e-a78f-b3b4fbeadf8f\") " pod="openshift-ovn-kubernetes/ovnkube-node-t5n27" Sep 10 11:12:16.932770 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:16.931309 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/d1b87354-8843-4e59-8a85-68c875f472e6-hosts-file\") pod \"node-resolver-zgkgx\" (UID: \"d1b87354-8843-4e59-8a85-68c875f472e6\") " pod="openshift-dns/node-resolver-zgkgx" Sep 10 11:12:16.932770 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:16.931365 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/a938afae-5d17-4255-b89d-123cdcc6c4a3-registration-dir\") pod \"aws-ebs-csi-driver-node-tjcmb\" (UID: \"a938afae-5d17-4255-b89d-123cdcc6c4a3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tjcmb" Sep 10 11:12:16.932770 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:16.931907 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/433a8dab-963b-403e-a78f-b3b4fbeadf8f-env-overrides\") pod \"ovnkube-node-t5n27\" (UID: \"433a8dab-963b-403e-a78f-b3b4fbeadf8f\") " pod="openshift-ovn-kubernetes/ovnkube-node-t5n27" Sep 10 11:12:16.932770 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:16.932002 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1bf42e41-3da3-4bc1-8388-c0157fb5ae44-host-var-lib-cni-bin\") pod \"multus-r6sr6\" (UID: \"1bf42e41-3da3-4bc1-8388-c0157fb5ae44\") " pod="openshift-multus/multus-r6sr6" Sep 10 11:12:16.932770 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:16.932012 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/1d5ea621-658b-4058-9b1a-d4c976651be0-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-dpgnj\" (UID: \"1d5ea621-658b-4058-9b1a-d4c976651be0\") " pod="openshift-multus/multus-additional-cni-plugins-dpgnj" Sep 10 11:12:16.933968 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:16.932053 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1bf42e41-3da3-4bc1-8388-c0157fb5ae44-multus-conf-dir\") pod \"multus-r6sr6\" (UID: \"1bf42e41-3da3-4bc1-8388-c0157fb5ae44\") " pod="openshift-multus/multus-r6sr6" Sep 10 11:12:16.933968 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:16.932330 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1bf42e41-3da3-4bc1-8388-c0157fb5ae44-cnibin\") pod \"multus-r6sr6\" (UID: \"1bf42e41-3da3-4bc1-8388-c0157fb5ae44\") " pod="openshift-multus/multus-r6sr6" Sep 10 11:12:16.933968 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:16.932385 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/60a628d5-3863-4793-802f-e07a7157dcdf-host\") pod \"node-ca-285k7\" (UID: \"60a628d5-3863-4793-802f-e07a7157dcdf\") " pod="openshift-image-registry/node-ca-285k7" Sep 10 11:12:16.933968 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:16.932428 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/433a8dab-963b-403e-a78f-b3b4fbeadf8f-host-run-netns\") pod \"ovnkube-node-t5n27\" (UID: \"433a8dab-963b-403e-a78f-b3b4fbeadf8f\") " pod="openshift-ovn-kubernetes/ovnkube-node-t5n27" Sep 10 11:12:16.933968 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:16.932476 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/433a8dab-963b-403e-a78f-b3b4fbeadf8f-host-cni-bin\") pod \"ovnkube-node-t5n27\" (UID: \"433a8dab-963b-403e-a78f-b3b4fbeadf8f\") " pod="openshift-ovn-kubernetes/ovnkube-node-t5n27" Sep 10 11:12:16.933968 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:16.932486 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/1d5ea621-658b-4058-9b1a-d4c976651be0-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-dpgnj\" (UID: \"1d5ea621-658b-4058-9b1a-d4c976651be0\") " pod="openshift-multus/multus-additional-cni-plugins-dpgnj" Sep 10 11:12:16.933968 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:16.932551 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/1bf42e41-3da3-4bc1-8388-c0157fb5ae44-multus-socket-dir-parent\") pod \"multus-r6sr6\" (UID: \"1bf42e41-3da3-4bc1-8388-c0157fb5ae44\") " pod="openshift-multus/multus-r6sr6" Sep 10 11:12:16.933968 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:16.932710 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1d5ea621-658b-4058-9b1a-d4c976651be0-tuning-conf-dir\") pod \"multus-additional-cni-plugins-dpgnj\" (UID: \"1d5ea621-658b-4058-9b1a-d4c976651be0\") " pod="openshift-multus/multus-additional-cni-plugins-dpgnj" Sep 10 11:12:16.933968 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:16.932921 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1bf42e41-3da3-4bc1-8388-c0157fb5ae44-cni-binary-copy\") pod \"multus-r6sr6\" (UID: \"1bf42e41-3da3-4bc1-8388-c0157fb5ae44\") " pod="openshift-multus/multus-r6sr6" Sep 10 11:12:16.933968 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:16.933009 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/a938afae-5d17-4255-b89d-123cdcc6c4a3-kubelet-dir\") pod \"aws-ebs-csi-driver-node-tjcmb\" (UID: \"a938afae-5d17-4255-b89d-123cdcc6c4a3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tjcmb" Sep 10 11:12:16.933968 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:16.933480 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/d659be6f-7ae8-4309-8d20-0954a8b188ad-iptables-alerter-script\") pod \"iptables-alerter-z697w\" (UID: \"d659be6f-7ae8-4309-8d20-0954a8b188ad\") " pod="openshift-network-operator/iptables-alerter-z697w" Sep 10 11:12:16.933968 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:16.933533 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/433a8dab-963b-403e-a78f-b3b4fbeadf8f-node-log\") pod \"ovnkube-node-t5n27\" (UID: \"433a8dab-963b-403e-a78f-b3b4fbeadf8f\") " pod="openshift-ovn-kubernetes/ovnkube-node-t5n27" Sep 10 11:12:16.933968 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:16.933540 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/433a8dab-963b-403e-a78f-b3b4fbeadf8f-run-systemd\") pod \"ovnkube-node-t5n27\" (UID: \"433a8dab-963b-403e-a78f-b3b4fbeadf8f\") " pod="openshift-ovn-kubernetes/ovnkube-node-t5n27" Sep 10 11:12:16.933968 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:16.930909 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/1bf42e41-3da3-4bc1-8388-c0157fb5ae44-multus-daemon-config\") pod \"multus-r6sr6\" (UID: \"1bf42e41-3da3-4bc1-8388-c0157fb5ae44\") " pod="openshift-multus/multus-r6sr6" Sep 10 11:12:16.933968 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:16.933577 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/433a8dab-963b-403e-a78f-b3b4fbeadf8f-host-slash\") pod \"ovnkube-node-t5n27\" (UID: \"433a8dab-963b-403e-a78f-b3b4fbeadf8f\") " pod="openshift-ovn-kubernetes/ovnkube-node-t5n27" Sep 10 11:12:16.933968 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:16.933631 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/433a8dab-963b-403e-a78f-b3b4fbeadf8f-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-t5n27\" (UID: \"433a8dab-963b-403e-a78f-b3b4fbeadf8f\") " pod="openshift-ovn-kubernetes/ovnkube-node-t5n27" Sep 10 11:12:16.933968 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:16.933677 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/1bf42e41-3da3-4bc1-8388-c0157fb5ae44-host-run-k8s-cni-cncf-io\") pod \"multus-r6sr6\" (UID: \"1bf42e41-3da3-4bc1-8388-c0157fb5ae44\") " pod="openshift-multus/multus-r6sr6" Sep 10 11:12:16.933968 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:16.933718 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/1bf42e41-3da3-4bc1-8388-c0157fb5ae44-host-run-multus-certs\") pod \"multus-r6sr6\" (UID: \"1bf42e41-3da3-4bc1-8388-c0157fb5ae44\") " pod="openshift-multus/multus-r6sr6" Sep 10 11:12:16.935248 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:16.933480 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1d5ea621-658b-4058-9b1a-d4c976651be0-cni-binary-copy\") pod \"multus-additional-cni-plugins-dpgnj\" (UID: \"1d5ea621-658b-4058-9b1a-d4c976651be0\") " pod="openshift-multus/multus-additional-cni-plugins-dpgnj" Sep 10 11:12:16.937874 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:16.937837 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/433a8dab-963b-403e-a78f-b3b4fbeadf8f-ovn-node-metrics-cert\") pod \"ovnkube-node-t5n27\" (UID: \"433a8dab-963b-403e-a78f-b3b4fbeadf8f\") " pod="openshift-ovn-kubernetes/ovnkube-node-t5n27" Sep 10 11:12:16.940602 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:16.940575 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ctz7k\" (UniqueName: \"kubernetes.io/projected/d1b87354-8843-4e59-8a85-68c875f472e6-kube-api-access-ctz7k\") pod \"node-resolver-zgkgx\" (UID: \"d1b87354-8843-4e59-8a85-68c875f472e6\") " pod="openshift-dns/node-resolver-zgkgx" Sep 10 11:12:16.941571 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:16.941541 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q5x2b\" (UniqueName: \"kubernetes.io/projected/1bf42e41-3da3-4bc1-8388-c0157fb5ae44-kube-api-access-q5x2b\") pod \"multus-r6sr6\" (UID: \"1bf42e41-3da3-4bc1-8388-c0157fb5ae44\") " pod="openshift-multus/multus-r6sr6" Sep 10 11:12:16.942814 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:16.942788 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gxnj8\" (UniqueName: \"kubernetes.io/projected/1d5ea621-658b-4058-9b1a-d4c976651be0-kube-api-access-gxnj8\") pod \"multus-additional-cni-plugins-dpgnj\" (UID: \"1d5ea621-658b-4058-9b1a-d4c976651be0\") " pod="openshift-multus/multus-additional-cni-plugins-dpgnj" Sep 10 11:12:16.947543 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:16.947499 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nl7t8\" (UniqueName: \"kubernetes.io/projected/d659be6f-7ae8-4309-8d20-0954a8b188ad-kube-api-access-nl7t8\") pod \"iptables-alerter-z697w\" (UID: \"d659be6f-7ae8-4309-8d20-0954a8b188ad\") " pod="openshift-network-operator/iptables-alerter-z697w" Sep 10 11:12:16.948024 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:16.948002 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ktkjb\" (UniqueName: \"kubernetes.io/projected/433a8dab-963b-403e-a78f-b3b4fbeadf8f-kube-api-access-ktkjb\") pod \"ovnkube-node-t5n27\" (UID: \"433a8dab-963b-403e-a78f-b3b4fbeadf8f\") " pod="openshift-ovn-kubernetes/ovnkube-node-t5n27" Sep 10 11:12:16.948579 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:16.948556 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j8kwf\" (UniqueName: \"kubernetes.io/projected/60a628d5-3863-4793-802f-e07a7157dcdf-kube-api-access-j8kwf\") pod \"node-ca-285k7\" (UID: \"60a628d5-3863-4793-802f-e07a7157dcdf\") " pod="openshift-image-registry/node-ca-285k7" Sep 10 11:12:16.950175 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:16.950141 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rvmvw\" (UniqueName: \"kubernetes.io/projected/a938afae-5d17-4255-b89d-123cdcc6c4a3-kube-api-access-rvmvw\") pod \"aws-ebs-csi-driver-node-tjcmb\" (UID: \"a938afae-5d17-4255-b89d-123cdcc6c4a3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tjcmb" Sep 10 11:12:17.031983 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:17.030736 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/77142edb-57e1-4da1-8eba-f104366a851f-agent-certs\") pod \"konnectivity-agent-pq4ct\" (UID: \"77142edb-57e1-4da1-8eba-f104366a851f\") " pod="kube-system/konnectivity-agent-pq4ct" Sep 10 11:12:17.031983 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:17.030781 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/77142edb-57e1-4da1-8eba-f104366a851f-konnectivity-ca\") pod \"konnectivity-agent-pq4ct\" (UID: \"77142edb-57e1-4da1-8eba-f104366a851f\") " pod="kube-system/konnectivity-agent-pq4ct" Sep 10 11:12:17.031983 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:17.030807 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/d79e1737-1635-4c9c-8ad3-1ed1537ee844-etc-modprobe-d\") pod \"tuned-8mbpl\" (UID: \"d79e1737-1635-4c9c-8ad3-1ed1537ee844\") " pod="openshift-cluster-node-tuning-operator/tuned-8mbpl" Sep 10 11:12:17.031983 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:17.030832 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d79e1737-1635-4c9c-8ad3-1ed1537ee844-host\") pod \"tuned-8mbpl\" (UID: \"d79e1737-1635-4c9c-8ad3-1ed1537ee844\") " pod="openshift-cluster-node-tuning-operator/tuned-8mbpl" Sep 10 11:12:17.031983 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:17.030865 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/c61d89d6-ef29-42ae-aa25-e350ab385462-dbus\") pod \"global-pull-secret-syncer-kxss9\" (UID: \"c61d89d6-ef29-42ae-aa25-e350ab385462\") " pod="kube-system/global-pull-secret-syncer-kxss9" Sep 10 11:12:17.031983 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:17.030907 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/d79e1737-1635-4c9c-8ad3-1ed1537ee844-etc-systemd\") pod \"tuned-8mbpl\" (UID: \"d79e1737-1635-4c9c-8ad3-1ed1537ee844\") " pod="openshift-cluster-node-tuning-operator/tuned-8mbpl" Sep 10 11:12:17.031983 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:17.030930 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/d79e1737-1635-4c9c-8ad3-1ed1537ee844-run\") pod \"tuned-8mbpl\" (UID: \"d79e1737-1635-4c9c-8ad3-1ed1537ee844\") " pod="openshift-cluster-node-tuning-operator/tuned-8mbpl" Sep 10 11:12:17.031983 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:17.030954 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d79e1737-1635-4c9c-8ad3-1ed1537ee844-lib-modules\") pod \"tuned-8mbpl\" (UID: \"d79e1737-1635-4c9c-8ad3-1ed1537ee844\") " pod="openshift-cluster-node-tuning-operator/tuned-8mbpl" Sep 10 11:12:17.031983 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:17.030976 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/d79e1737-1635-4c9c-8ad3-1ed1537ee844-etc-tuned\") pod \"tuned-8mbpl\" (UID: \"d79e1737-1635-4c9c-8ad3-1ed1537ee844\") " pod="openshift-cluster-node-tuning-operator/tuned-8mbpl" Sep 10 11:12:17.031983 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:17.031004 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/c61d89d6-ef29-42ae-aa25-e350ab385462-kubelet-config\") pod \"global-pull-secret-syncer-kxss9\" (UID: \"c61d89d6-ef29-42ae-aa25-e350ab385462\") " pod="kube-system/global-pull-secret-syncer-kxss9" Sep 10 11:12:17.031983 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:17.031030 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/794743e8-fee9-426f-9546-161a898541e2-metrics-certs\") pod \"network-metrics-daemon-54z9n\" (UID: \"794743e8-fee9-426f-9546-161a898541e2\") " pod="openshift-multus/network-metrics-daemon-54z9n" Sep 10 11:12:17.031983 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:17.031055 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cjz66\" (UniqueName: \"kubernetes.io/projected/d79e1737-1635-4c9c-8ad3-1ed1537ee844-kube-api-access-cjz66\") pod \"tuned-8mbpl\" (UID: \"d79e1737-1635-4c9c-8ad3-1ed1537ee844\") " pod="openshift-cluster-node-tuning-operator/tuned-8mbpl" Sep 10 11:12:17.031983 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:17.031085 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-86bbn\" (UniqueName: \"kubernetes.io/projected/794743e8-fee9-426f-9546-161a898541e2-kube-api-access-86bbn\") pod \"network-metrics-daemon-54z9n\" (UID: \"794743e8-fee9-426f-9546-161a898541e2\") " pod="openshift-multus/network-metrics-daemon-54z9n" Sep 10 11:12:17.031983 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:17.031109 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d79e1737-1635-4c9c-8ad3-1ed1537ee844-tmp\") pod \"tuned-8mbpl\" (UID: \"d79e1737-1635-4c9c-8ad3-1ed1537ee844\") " pod="openshift-cluster-node-tuning-operator/tuned-8mbpl" Sep 10 11:12:17.031983 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:17.031138 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c61d89d6-ef29-42ae-aa25-e350ab385462-original-pull-secret\") pod \"global-pull-secret-syncer-kxss9\" (UID: \"c61d89d6-ef29-42ae-aa25-e350ab385462\") " pod="kube-system/global-pull-secret-syncer-kxss9" Sep 10 11:12:17.031983 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:17.031163 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d79e1737-1635-4c9c-8ad3-1ed1537ee844-etc-kubernetes\") pod \"tuned-8mbpl\" (UID: \"d79e1737-1635-4c9c-8ad3-1ed1537ee844\") " pod="openshift-cluster-node-tuning-operator/tuned-8mbpl" Sep 10 11:12:17.031983 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:17.031189 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d79e1737-1635-4c9c-8ad3-1ed1537ee844-sys\") pod \"tuned-8mbpl\" (UID: \"d79e1737-1635-4c9c-8ad3-1ed1537ee844\") " pod="openshift-cluster-node-tuning-operator/tuned-8mbpl" Sep 10 11:12:17.033043 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:17.031213 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d79e1737-1635-4c9c-8ad3-1ed1537ee844-var-lib-kubelet\") pod \"tuned-8mbpl\" (UID: \"d79e1737-1635-4c9c-8ad3-1ed1537ee844\") " pod="openshift-cluster-node-tuning-operator/tuned-8mbpl" Sep 10 11:12:17.033043 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:17.031246 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/d79e1737-1635-4c9c-8ad3-1ed1537ee844-etc-sysctl-d\") pod \"tuned-8mbpl\" (UID: \"d79e1737-1635-4c9c-8ad3-1ed1537ee844\") " pod="openshift-cluster-node-tuning-operator/tuned-8mbpl" Sep 10 11:12:17.033043 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:17.031273 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/d79e1737-1635-4c9c-8ad3-1ed1537ee844-etc-sysctl-conf\") pod \"tuned-8mbpl\" (UID: \"d79e1737-1635-4c9c-8ad3-1ed1537ee844\") " pod="openshift-cluster-node-tuning-operator/tuned-8mbpl" Sep 10 11:12:17.033043 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:17.031300 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/d79e1737-1635-4c9c-8ad3-1ed1537ee844-etc-sysconfig\") pod \"tuned-8mbpl\" (UID: \"d79e1737-1635-4c9c-8ad3-1ed1537ee844\") " pod="openshift-cluster-node-tuning-operator/tuned-8mbpl" Sep 10 11:12:17.033043 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:17.031328 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tpb4z\" (UniqueName: \"kubernetes.io/projected/1f233d76-b986-4ec6-a096-e4bc9d53101f-kube-api-access-tpb4z\") pod \"network-check-target-bvnw9\" (UID: \"1f233d76-b986-4ec6-a096-e4bc9d53101f\") " pod="openshift-network-diagnostics/network-check-target-bvnw9" Sep 10 11:12:17.033043 ip-10-0-134-73 kubenswrapper[2564]: E0910 11:12:17.031753 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 11:12:17.033043 ip-10-0-134-73 kubenswrapper[2564]: E0910 11:12:17.031850 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/794743e8-fee9-426f-9546-161a898541e2-metrics-certs podName:794743e8-fee9-426f-9546-161a898541e2 nodeName:}" failed. No retries permitted until 2026-09-10 11:12:17.531822551 +0000 UTC m=+3.128383754 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/794743e8-fee9-426f-9546-161a898541e2-metrics-certs") pod "network-metrics-daemon-54z9n" (UID: "794743e8-fee9-426f-9546-161a898541e2") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 11:12:17.033043 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:17.032273 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/d79e1737-1635-4c9c-8ad3-1ed1537ee844-run\") pod \"tuned-8mbpl\" (UID: \"d79e1737-1635-4c9c-8ad3-1ed1537ee844\") " pod="openshift-cluster-node-tuning-operator/tuned-8mbpl" Sep 10 11:12:17.033043 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:17.032319 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d79e1737-1635-4c9c-8ad3-1ed1537ee844-var-lib-kubelet\") pod \"tuned-8mbpl\" (UID: \"d79e1737-1635-4c9c-8ad3-1ed1537ee844\") " pod="openshift-cluster-node-tuning-operator/tuned-8mbpl" Sep 10 11:12:17.033043 ip-10-0-134-73 kubenswrapper[2564]: E0910 11:12:17.032427 2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 10 11:12:17.033043 ip-10-0-134-73 kubenswrapper[2564]: E0910 11:12:17.032491 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c61d89d6-ef29-42ae-aa25-e350ab385462-original-pull-secret podName:c61d89d6-ef29-42ae-aa25-e350ab385462 nodeName:}" failed. No retries permitted until 2026-09-10 11:12:17.532473211 +0000 UTC m=+3.129034412 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c61d89d6-ef29-42ae-aa25-e350ab385462-original-pull-secret") pod "global-pull-secret-syncer-kxss9" (UID: "c61d89d6-ef29-42ae-aa25-e350ab385462") : object "kube-system"/"original-pull-secret" not registered Sep 10 11:12:17.033043 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:17.032481 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/c61d89d6-ef29-42ae-aa25-e350ab385462-kubelet-config\") pod \"global-pull-secret-syncer-kxss9\" (UID: \"c61d89d6-ef29-42ae-aa25-e350ab385462\") " pod="kube-system/global-pull-secret-syncer-kxss9" Sep 10 11:12:17.033043 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:17.032547 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d79e1737-1635-4c9c-8ad3-1ed1537ee844-etc-kubernetes\") pod \"tuned-8mbpl\" (UID: \"d79e1737-1635-4c9c-8ad3-1ed1537ee844\") " pod="openshift-cluster-node-tuning-operator/tuned-8mbpl" Sep 10 11:12:17.033043 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:17.032603 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d79e1737-1635-4c9c-8ad3-1ed1537ee844-lib-modules\") pod \"tuned-8mbpl\" (UID: \"d79e1737-1635-4c9c-8ad3-1ed1537ee844\") " pod="openshift-cluster-node-tuning-operator/tuned-8mbpl" Sep 10 11:12:17.033043 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:17.032641 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d79e1737-1635-4c9c-8ad3-1ed1537ee844-host\") pod \"tuned-8mbpl\" (UID: \"d79e1737-1635-4c9c-8ad3-1ed1537ee844\") " pod="openshift-cluster-node-tuning-operator/tuned-8mbpl" Sep 10 11:12:17.033043 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:17.032663 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d79e1737-1635-4c9c-8ad3-1ed1537ee844-sys\") pod \"tuned-8mbpl\" (UID: \"d79e1737-1635-4c9c-8ad3-1ed1537ee844\") " pod="openshift-cluster-node-tuning-operator/tuned-8mbpl" Sep 10 11:12:17.033043 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:17.032734 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/d79e1737-1635-4c9c-8ad3-1ed1537ee844-etc-modprobe-d\") pod \"tuned-8mbpl\" (UID: \"d79e1737-1635-4c9c-8ad3-1ed1537ee844\") " pod="openshift-cluster-node-tuning-operator/tuned-8mbpl" Sep 10 11:12:17.033924 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:17.032797 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/d79e1737-1635-4c9c-8ad3-1ed1537ee844-etc-sysctl-conf\") pod \"tuned-8mbpl\" (UID: \"d79e1737-1635-4c9c-8ad3-1ed1537ee844\") " pod="openshift-cluster-node-tuning-operator/tuned-8mbpl" Sep 10 11:12:17.033924 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:17.032828 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/77142edb-57e1-4da1-8eba-f104366a851f-konnectivity-ca\") pod \"konnectivity-agent-pq4ct\" (UID: \"77142edb-57e1-4da1-8eba-f104366a851f\") " pod="kube-system/konnectivity-agent-pq4ct" Sep 10 11:12:17.033924 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:17.032839 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/d79e1737-1635-4c9c-8ad3-1ed1537ee844-etc-sysctl-d\") pod \"tuned-8mbpl\" (UID: \"d79e1737-1635-4c9c-8ad3-1ed1537ee844\") " pod="openshift-cluster-node-tuning-operator/tuned-8mbpl" Sep 10 11:12:17.033924 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:17.032850 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/d79e1737-1635-4c9c-8ad3-1ed1537ee844-etc-sysconfig\") pod \"tuned-8mbpl\" (UID: \"d79e1737-1635-4c9c-8ad3-1ed1537ee844\") " pod="openshift-cluster-node-tuning-operator/tuned-8mbpl" Sep 10 11:12:17.033924 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:17.032911 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/c61d89d6-ef29-42ae-aa25-e350ab385462-dbus\") pod \"global-pull-secret-syncer-kxss9\" (UID: \"c61d89d6-ef29-42ae-aa25-e350ab385462\") " pod="kube-system/global-pull-secret-syncer-kxss9" Sep 10 11:12:17.033924 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:17.032919 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/d79e1737-1635-4c9c-8ad3-1ed1537ee844-etc-systemd\") pod \"tuned-8mbpl\" (UID: \"d79e1737-1635-4c9c-8ad3-1ed1537ee844\") " pod="openshift-cluster-node-tuning-operator/tuned-8mbpl" Sep 10 11:12:17.035357 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:17.035294 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/d79e1737-1635-4c9c-8ad3-1ed1537ee844-etc-tuned\") pod \"tuned-8mbpl\" (UID: \"d79e1737-1635-4c9c-8ad3-1ed1537ee844\") " pod="openshift-cluster-node-tuning-operator/tuned-8mbpl" Sep 10 11:12:17.035732 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:17.035709 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/77142edb-57e1-4da1-8eba-f104366a851f-agent-certs\") pod \"konnectivity-agent-pq4ct\" (UID: \"77142edb-57e1-4da1-8eba-f104366a851f\") " pod="kube-system/konnectivity-agent-pq4ct" Sep 10 11:12:17.036680 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:17.035989 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d79e1737-1635-4c9c-8ad3-1ed1537ee844-tmp\") pod \"tuned-8mbpl\" (UID: \"d79e1737-1635-4c9c-8ad3-1ed1537ee844\") " pod="openshift-cluster-node-tuning-operator/tuned-8mbpl" Sep 10 11:12:17.049899 ip-10-0-134-73 kubenswrapper[2564]: E0910 11:12:17.049650 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 10 11:12:17.049899 ip-10-0-134-73 kubenswrapper[2564]: E0910 11:12:17.049675 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 10 11:12:17.049899 ip-10-0-134-73 kubenswrapper[2564]: E0910 11:12:17.049689 2564 projected.go:196] Error preparing data for projected volume kube-api-access-tpb4z for pod openshift-network-diagnostics/network-check-target-bvnw9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 11:12:17.049899 ip-10-0-134-73 kubenswrapper[2564]: E0910 11:12:17.049748 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1f233d76-b986-4ec6-a096-e4bc9d53101f-kube-api-access-tpb4z podName:1f233d76-b986-4ec6-a096-e4bc9d53101f nodeName:}" failed. No retries permitted until 2026-09-10 11:12:17.549734577 +0000 UTC m=+3.146295776 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-tpb4z" (UniqueName: "kubernetes.io/projected/1f233d76-b986-4ec6-a096-e4bc9d53101f-kube-api-access-tpb4z") pod "network-check-target-bvnw9" (UID: "1f233d76-b986-4ec6-a096-e4bc9d53101f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 11:12:17.052363 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:17.052335 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-86bbn\" (UniqueName: \"kubernetes.io/projected/794743e8-fee9-426f-9546-161a898541e2-kube-api-access-86bbn\") pod \"network-metrics-daemon-54z9n\" (UID: \"794743e8-fee9-426f-9546-161a898541e2\") " pod="openshift-multus/network-metrics-daemon-54z9n" Sep 10 11:12:17.054094 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:17.054048 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cjz66\" (UniqueName: \"kubernetes.io/projected/d79e1737-1635-4c9c-8ad3-1ed1537ee844-kube-api-access-cjz66\") pod \"tuned-8mbpl\" (UID: \"d79e1737-1635-4c9c-8ad3-1ed1537ee844\") " pod="openshift-cluster-node-tuning-operator/tuned-8mbpl" Sep 10 11:12:17.109137 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:17.109108 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-zgkgx" Sep 10 11:12:17.122621 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:17.122548 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd1b87354_8843_4e59_8a85_68c875f472e6.slice/crio-3e9ac6afaf2c309bb909db71f76025fcd6908feb91ed55c0b2f6100496dff08f WatchSource:0}: Error finding container 3e9ac6afaf2c309bb909db71f76025fcd6908feb91ed55c0b2f6100496dff08f: Status 404 returned error can't find the container with id 3e9ac6afaf2c309bb909db71f76025fcd6908feb91ed55c0b2f6100496dff08f Sep 10 11:12:17.124306 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:17.124100 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-dpgnj" Sep 10 11:12:17.134818 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:17.134791 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1d5ea621_658b_4058_9b1a_d4c976651be0.slice/crio-0603db3fa8e20c30b78bb8a64e7a2cce3096bbee250815ca2a5ef0e4b20c11c2 WatchSource:0}: Error finding container 0603db3fa8e20c30b78bb8a64e7a2cce3096bbee250815ca2a5ef0e4b20c11c2: Status 404 returned error can't find the container with id 0603db3fa8e20c30b78bb8a64e7a2cce3096bbee250815ca2a5ef0e4b20c11c2 Sep 10 11:12:17.137748 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:17.137726 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-z697w" Sep 10 11:12:17.145344 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:17.145310 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-t5n27" Sep 10 11:12:17.148102 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:17.148077 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd659be6f_7ae8_4309_8d20_0954a8b188ad.slice/crio-e4fddffc82d93f52a4f2a1ec3259971c12832b5e80addbe0127e86321578b926 WatchSource:0}: Error finding container e4fddffc82d93f52a4f2a1ec3259971c12832b5e80addbe0127e86321578b926: Status 404 returned error can't find the container with id e4fddffc82d93f52a4f2a1ec3259971c12832b5e80addbe0127e86321578b926 Sep 10 11:12:17.155817 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:17.155791 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-r6sr6" Sep 10 11:12:17.157431 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:17.157406 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod433a8dab_963b_403e_a78f_b3b4fbeadf8f.slice/crio-d41c89b792ab3469ff84f813cda35624b19ae7a1139323270fa3eab4f5072cdc WatchSource:0}: Error finding container d41c89b792ab3469ff84f813cda35624b19ae7a1139323270fa3eab4f5072cdc: Status 404 returned error can't find the container with id d41c89b792ab3469ff84f813cda35624b19ae7a1139323270fa3eab4f5072cdc Sep 10 11:12:17.162271 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:17.162246 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tjcmb" Sep 10 11:12:17.171344 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:17.171326 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-285k7" Sep 10 11:12:17.180525 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:17.180504 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-pq4ct" Sep 10 11:12:17.188487 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:17.188464 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-8mbpl" Sep 10 11:12:17.262188 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:17.262156 2564 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Sep 10 11:12:17.534548 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:17.534472 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/794743e8-fee9-426f-9546-161a898541e2-metrics-certs\") pod \"network-metrics-daemon-54z9n\" (UID: \"794743e8-fee9-426f-9546-161a898541e2\") " pod="openshift-multus/network-metrics-daemon-54z9n" Sep 10 11:12:17.534548 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:17.534515 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c61d89d6-ef29-42ae-aa25-e350ab385462-original-pull-secret\") pod \"global-pull-secret-syncer-kxss9\" (UID: \"c61d89d6-ef29-42ae-aa25-e350ab385462\") " pod="kube-system/global-pull-secret-syncer-kxss9" Sep 10 11:12:17.534718 ip-10-0-134-73 kubenswrapper[2564]: E0910 11:12:17.534636 2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 10 11:12:17.534718 ip-10-0-134-73 kubenswrapper[2564]: E0910 11:12:17.534638 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 11:12:17.534718 ip-10-0-134-73 kubenswrapper[2564]: E0910 11:12:17.534691 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c61d89d6-ef29-42ae-aa25-e350ab385462-original-pull-secret podName:c61d89d6-ef29-42ae-aa25-e350ab385462 nodeName:}" failed. No retries permitted until 2026-09-10 11:12:18.534677769 +0000 UTC m=+4.131238963 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c61d89d6-ef29-42ae-aa25-e350ab385462-original-pull-secret") pod "global-pull-secret-syncer-kxss9" (UID: "c61d89d6-ef29-42ae-aa25-e350ab385462") : object "kube-system"/"original-pull-secret" not registered Sep 10 11:12:17.534718 ip-10-0-134-73 kubenswrapper[2564]: E0910 11:12:17.534711 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/794743e8-fee9-426f-9546-161a898541e2-metrics-certs podName:794743e8-fee9-426f-9546-161a898541e2 nodeName:}" failed. No retries permitted until 2026-09-10 11:12:18.534700947 +0000 UTC m=+4.131262143 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/794743e8-fee9-426f-9546-161a898541e2-metrics-certs") pod "network-metrics-daemon-54z9n" (UID: "794743e8-fee9-426f-9546-161a898541e2") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 11:12:17.537606 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:17.537581 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1bf42e41_3da3_4bc1_8388_c0157fb5ae44.slice/crio-7ce1717d35025646367d7d8c9a8feacd564c98027836e30b676d7b3beff8ed01 WatchSource:0}: Error finding container 7ce1717d35025646367d7d8c9a8feacd564c98027836e30b676d7b3beff8ed01: Status 404 returned error can't find the container with id 7ce1717d35025646367d7d8c9a8feacd564c98027836e30b676d7b3beff8ed01 Sep 10 11:12:17.635006 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:17.634968 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tpb4z\" (UniqueName: \"kubernetes.io/projected/1f233d76-b986-4ec6-a096-e4bc9d53101f-kube-api-access-tpb4z\") pod \"network-check-target-bvnw9\" (UID: \"1f233d76-b986-4ec6-a096-e4bc9d53101f\") " pod="openshift-network-diagnostics/network-check-target-bvnw9" Sep 10 11:12:17.635196 ip-10-0-134-73 kubenswrapper[2564]: E0910 11:12:17.635113 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 10 11:12:17.635196 ip-10-0-134-73 kubenswrapper[2564]: E0910 11:12:17.635132 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 10 11:12:17.635196 ip-10-0-134-73 kubenswrapper[2564]: E0910 11:12:17.635142 2564 projected.go:196] Error preparing data for projected volume kube-api-access-tpb4z for pod openshift-network-diagnostics/network-check-target-bvnw9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 11:12:17.635353 ip-10-0-134-73 kubenswrapper[2564]: E0910 11:12:17.635224 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1f233d76-b986-4ec6-a096-e4bc9d53101f-kube-api-access-tpb4z podName:1f233d76-b986-4ec6-a096-e4bc9d53101f nodeName:}" failed. No retries permitted until 2026-09-10 11:12:18.635204517 +0000 UTC m=+4.231765712 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-tpb4z" (UniqueName: "kubernetes.io/projected/1f233d76-b986-4ec6-a096-e4bc9d53101f-kube-api-access-tpb4z") pod "network-check-target-bvnw9" (UID: "1f233d76-b986-4ec6-a096-e4bc9d53101f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 11:12:17.872428 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:17.872266 2564 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-09 11:07:17 +0000 UTC" deadline="2028-06-14 16:18:53.119910814 +0000 UTC" Sep 10 11:12:17.872428 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:17.872326 2564 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15437h6m35.247591319s" Sep 10 11:12:17.924777 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:17.924736 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-r6sr6" event={"ID":"1bf42e41-3da3-4bc1-8388-c0157fb5ae44","Type":"ContainerStarted","Data":"7ce1717d35025646367d7d8c9a8feacd564c98027836e30b676d7b3beff8ed01"} Sep 10 11:12:17.926334 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:17.926300 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-t5n27" event={"ID":"433a8dab-963b-403e-a78f-b3b4fbeadf8f","Type":"ContainerStarted","Data":"d41c89b792ab3469ff84f813cda35624b19ae7a1139323270fa3eab4f5072cdc"} Sep 10 11:12:17.927744 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:17.927719 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-z697w" event={"ID":"d659be6f-7ae8-4309-8d20-0954a8b188ad","Type":"ContainerStarted","Data":"e4fddffc82d93f52a4f2a1ec3259971c12832b5e80addbe0127e86321578b926"} Sep 10 11:12:17.929099 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:17.929066 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dpgnj" event={"ID":"1d5ea621-658b-4058-9b1a-d4c976651be0","Type":"ContainerStarted","Data":"0603db3fa8e20c30b78bb8a64e7a2cce3096bbee250815ca2a5ef0e4b20c11c2"} Sep 10 11:12:17.930351 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:17.930322 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-zgkgx" event={"ID":"d1b87354-8843-4e59-8a85-68c875f472e6","Type":"ContainerStarted","Data":"3e9ac6afaf2c309bb909db71f76025fcd6908feb91ed55c0b2f6100496dff08f"} Sep 10 11:12:18.437789 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:18.437750 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd79e1737_1635_4c9c_8ad3_1ed1537ee844.slice/crio-5e1366b262d83b06a49bab3f8c69bf6b9ebee6e91512a095ee7854aa4e5aef60 WatchSource:0}: Error finding container 5e1366b262d83b06a49bab3f8c69bf6b9ebee6e91512a095ee7854aa4e5aef60: Status 404 returned error can't find the container with id 5e1366b262d83b06a49bab3f8c69bf6b9ebee6e91512a095ee7854aa4e5aef60 Sep 10 11:12:18.438406 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:18.438383 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod60a628d5_3863_4793_802f_e07a7157dcdf.slice/crio-e7339cf747c4eda7dda2ee5faa9517ae3867bfaa38153c7f3e4aec704f675295 WatchSource:0}: Error finding container e7339cf747c4eda7dda2ee5faa9517ae3867bfaa38153c7f3e4aec704f675295: Status 404 returned error can't find the container with id e7339cf747c4eda7dda2ee5faa9517ae3867bfaa38153c7f3e4aec704f675295 Sep 10 11:12:18.443193 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:18.442447 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda938afae_5d17_4255_b89d_123cdcc6c4a3.slice/crio-e716aa2756cdb74d6dcb373e058915199995e36e2cea6d30940e0a4fd91519be WatchSource:0}: Error finding container e716aa2756cdb74d6dcb373e058915199995e36e2cea6d30940e0a4fd91519be: Status 404 returned error can't find the container with id e716aa2756cdb74d6dcb373e058915199995e36e2cea6d30940e0a4fd91519be Sep 10 11:12:18.447547 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:18.447405 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod77142edb_57e1_4da1_8eba_f104366a851f.slice/crio-b6096001296e48d115a6a03a1ea9088372fe62bb4deb9b68501f169fabeff98c WatchSource:0}: Error finding container b6096001296e48d115a6a03a1ea9088372fe62bb4deb9b68501f169fabeff98c: Status 404 returned error can't find the container with id b6096001296e48d115a6a03a1ea9088372fe62bb4deb9b68501f169fabeff98c Sep 10 11:12:18.543459 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:18.543119 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/794743e8-fee9-426f-9546-161a898541e2-metrics-certs\") pod \"network-metrics-daemon-54z9n\" (UID: \"794743e8-fee9-426f-9546-161a898541e2\") " pod="openshift-multus/network-metrics-daemon-54z9n" Sep 10 11:12:18.543459 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:18.543287 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c61d89d6-ef29-42ae-aa25-e350ab385462-original-pull-secret\") pod \"global-pull-secret-syncer-kxss9\" (UID: \"c61d89d6-ef29-42ae-aa25-e350ab385462\") " pod="kube-system/global-pull-secret-syncer-kxss9" Sep 10 11:12:18.543459 ip-10-0-134-73 kubenswrapper[2564]: E0910 11:12:18.543319 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 11:12:18.543459 ip-10-0-134-73 kubenswrapper[2564]: E0910 11:12:18.543384 2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 10 11:12:18.543459 ip-10-0-134-73 kubenswrapper[2564]: E0910 11:12:18.543401 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/794743e8-fee9-426f-9546-161a898541e2-metrics-certs podName:794743e8-fee9-426f-9546-161a898541e2 nodeName:}" failed. No retries permitted until 2026-09-10 11:12:20.543379296 +0000 UTC m=+6.139940506 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/794743e8-fee9-426f-9546-161a898541e2-metrics-certs") pod "network-metrics-daemon-54z9n" (UID: "794743e8-fee9-426f-9546-161a898541e2") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 11:12:18.543459 ip-10-0-134-73 kubenswrapper[2564]: E0910 11:12:18.543426 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c61d89d6-ef29-42ae-aa25-e350ab385462-original-pull-secret podName:c61d89d6-ef29-42ae-aa25-e350ab385462 nodeName:}" failed. No retries permitted until 2026-09-10 11:12:20.543413387 +0000 UTC m=+6.139974583 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c61d89d6-ef29-42ae-aa25-e350ab385462-original-pull-secret") pod "global-pull-secret-syncer-kxss9" (UID: "c61d89d6-ef29-42ae-aa25-e350ab385462") : object "kube-system"/"original-pull-secret" not registered Sep 10 11:12:18.644313 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:18.644222 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tpb4z\" (UniqueName: \"kubernetes.io/projected/1f233d76-b986-4ec6-a096-e4bc9d53101f-kube-api-access-tpb4z\") pod \"network-check-target-bvnw9\" (UID: \"1f233d76-b986-4ec6-a096-e4bc9d53101f\") " pod="openshift-network-diagnostics/network-check-target-bvnw9" Sep 10 11:12:18.644477 ip-10-0-134-73 kubenswrapper[2564]: E0910 11:12:18.644407 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 10 11:12:18.644477 ip-10-0-134-73 kubenswrapper[2564]: E0910 11:12:18.644438 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 10 11:12:18.644477 ip-10-0-134-73 kubenswrapper[2564]: E0910 11:12:18.644454 2564 projected.go:196] Error preparing data for projected volume kube-api-access-tpb4z for pod openshift-network-diagnostics/network-check-target-bvnw9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 11:12:18.644646 ip-10-0-134-73 kubenswrapper[2564]: E0910 11:12:18.644518 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1f233d76-b986-4ec6-a096-e4bc9d53101f-kube-api-access-tpb4z podName:1f233d76-b986-4ec6-a096-e4bc9d53101f nodeName:}" failed. No retries permitted until 2026-09-10 11:12:20.644499407 +0000 UTC m=+6.241060615 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-tpb4z" (UniqueName: "kubernetes.io/projected/1f233d76-b986-4ec6-a096-e4bc9d53101f-kube-api-access-tpb4z") pod "network-check-target-bvnw9" (UID: "1f233d76-b986-4ec6-a096-e4bc9d53101f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 11:12:18.873542 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:18.873470 2564 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-09 11:07:17 +0000 UTC" deadline="2028-02-17 18:14:05.814828083 +0000 UTC" Sep 10 11:12:18.873542 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:18.873536 2564 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12607h1m46.941295653s" Sep 10 11:12:18.912792 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:18.912060 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kxss9" Sep 10 11:12:18.912792 ip-10-0-134-73 kubenswrapper[2564]: E0910 11:12:18.912198 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kxss9" podUID="c61d89d6-ef29-42ae-aa25-e350ab385462" Sep 10 11:12:18.912792 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:18.912626 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-54z9n" Sep 10 11:12:18.912792 ip-10-0-134-73 kubenswrapper[2564]: E0910 11:12:18.912734 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-54z9n" podUID="794743e8-fee9-426f-9546-161a898541e2" Sep 10 11:12:18.913381 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:18.913254 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bvnw9" Sep 10 11:12:18.913381 ip-10-0-134-73 kubenswrapper[2564]: E0910 11:12:18.913345 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bvnw9" podUID="1f233d76-b986-4ec6-a096-e4bc9d53101f" Sep 10 11:12:18.934600 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:18.934564 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-pq4ct" event={"ID":"77142edb-57e1-4da1-8eba-f104366a851f","Type":"ContainerStarted","Data":"b6096001296e48d115a6a03a1ea9088372fe62bb4deb9b68501f169fabeff98c"} Sep 10 11:12:18.936601 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:18.936527 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-285k7" event={"ID":"60a628d5-3863-4793-802f-e07a7157dcdf","Type":"ContainerStarted","Data":"e7339cf747c4eda7dda2ee5faa9517ae3867bfaa38153c7f3e4aec704f675295"} Sep 10 11:12:18.938424 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:18.938331 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-8mbpl" event={"ID":"d79e1737-1635-4c9c-8ad3-1ed1537ee844","Type":"ContainerStarted","Data":"5e1366b262d83b06a49bab3f8c69bf6b9ebee6e91512a095ee7854aa4e5aef60"} Sep 10 11:12:18.950567 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:18.944504 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-73.ec2.internal" event={"ID":"fa04fa410118647777397f100391d4d1","Type":"ContainerStarted","Data":"77afacc11bfefe1b4939d01a64664abeae0f915abcaad598dc7d73f5a09e63bb"} Sep 10 11:12:18.950567 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:18.948148 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tjcmb" event={"ID":"a938afae-5d17-4255-b89d-123cdcc6c4a3","Type":"ContainerStarted","Data":"e716aa2756cdb74d6dcb373e058915199995e36e2cea6d30940e0a4fd91519be"} Sep 10 11:12:18.952274 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:18.951022 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-73.ec2.internal" event={"ID":"8d6e48b52697b16de0fdd5bfe815b959","Type":"ContainerStarted","Data":"9607f40ba0a704e56e8e1940a09c1a212ed3d1f805ac96694f71d7c995d213e0"} Sep 10 11:12:18.985827 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:18.984719 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-73.ec2.internal" podStartSLOduration=2.984695344 podStartE2EDuration="2.984695344s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 11:12:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 11:12:18.964541057 +0000 UTC m=+4.561102277" watchObservedRunningTime="2026-09-10 11:12:18.984695344 +0000 UTC m=+4.581256564" Sep 10 11:12:19.959332 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:19.959232 2564 generic.go:356] "Generic (PLEG): container finished" podID="8d6e48b52697b16de0fdd5bfe815b959" containerID="9607f40ba0a704e56e8e1940a09c1a212ed3d1f805ac96694f71d7c995d213e0" exitCode=0 Sep 10 11:12:19.960239 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:19.960212 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-73.ec2.internal" event={"ID":"8d6e48b52697b16de0fdd5bfe815b959","Type":"ContainerDied","Data":"9607f40ba0a704e56e8e1940a09c1a212ed3d1f805ac96694f71d7c995d213e0"} Sep 10 11:12:20.560448 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:20.560404 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c61d89d6-ef29-42ae-aa25-e350ab385462-original-pull-secret\") pod \"global-pull-secret-syncer-kxss9\" (UID: \"c61d89d6-ef29-42ae-aa25-e350ab385462\") " pod="kube-system/global-pull-secret-syncer-kxss9" Sep 10 11:12:20.560721 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:20.560526 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/794743e8-fee9-426f-9546-161a898541e2-metrics-certs\") pod \"network-metrics-daemon-54z9n\" (UID: \"794743e8-fee9-426f-9546-161a898541e2\") " pod="openshift-multus/network-metrics-daemon-54z9n" Sep 10 11:12:20.560721 ip-10-0-134-73 kubenswrapper[2564]: E0910 11:12:20.560691 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 11:12:20.560868 ip-10-0-134-73 kubenswrapper[2564]: E0910 11:12:20.560754 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/794743e8-fee9-426f-9546-161a898541e2-metrics-certs podName:794743e8-fee9-426f-9546-161a898541e2 nodeName:}" failed. No retries permitted until 2026-09-10 11:12:24.560734133 +0000 UTC m=+10.157295347 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/794743e8-fee9-426f-9546-161a898541e2-metrics-certs") pod "network-metrics-daemon-54z9n" (UID: "794743e8-fee9-426f-9546-161a898541e2") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 11:12:20.561208 ip-10-0-134-73 kubenswrapper[2564]: E0910 11:12:20.561187 2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 10 11:12:20.561307 ip-10-0-134-73 kubenswrapper[2564]: E0910 11:12:20.561248 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c61d89d6-ef29-42ae-aa25-e350ab385462-original-pull-secret podName:c61d89d6-ef29-42ae-aa25-e350ab385462 nodeName:}" failed. No retries permitted until 2026-09-10 11:12:24.561230959 +0000 UTC m=+10.157792156 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c61d89d6-ef29-42ae-aa25-e350ab385462-original-pull-secret") pod "global-pull-secret-syncer-kxss9" (UID: "c61d89d6-ef29-42ae-aa25-e350ab385462") : object "kube-system"/"original-pull-secret" not registered Sep 10 11:12:20.662077 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:20.661436 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tpb4z\" (UniqueName: \"kubernetes.io/projected/1f233d76-b986-4ec6-a096-e4bc9d53101f-kube-api-access-tpb4z\") pod \"network-check-target-bvnw9\" (UID: \"1f233d76-b986-4ec6-a096-e4bc9d53101f\") " pod="openshift-network-diagnostics/network-check-target-bvnw9" Sep 10 11:12:20.662077 ip-10-0-134-73 kubenswrapper[2564]: E0910 11:12:20.661606 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 10 11:12:20.662077 ip-10-0-134-73 kubenswrapper[2564]: E0910 11:12:20.661627 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 10 11:12:20.662077 ip-10-0-134-73 kubenswrapper[2564]: E0910 11:12:20.661640 2564 projected.go:196] Error preparing data for projected volume kube-api-access-tpb4z for pod openshift-network-diagnostics/network-check-target-bvnw9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 11:12:20.662077 ip-10-0-134-73 kubenswrapper[2564]: E0910 11:12:20.661700 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1f233d76-b986-4ec6-a096-e4bc9d53101f-kube-api-access-tpb4z podName:1f233d76-b986-4ec6-a096-e4bc9d53101f nodeName:}" failed. No retries permitted until 2026-09-10 11:12:24.661681433 +0000 UTC m=+10.258242632 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-tpb4z" (UniqueName: "kubernetes.io/projected/1f233d76-b986-4ec6-a096-e4bc9d53101f-kube-api-access-tpb4z") pod "network-check-target-bvnw9" (UID: "1f233d76-b986-4ec6-a096-e4bc9d53101f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 11:12:20.914965 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:20.914094 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kxss9" Sep 10 11:12:20.914965 ip-10-0-134-73 kubenswrapper[2564]: E0910 11:12:20.914231 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kxss9" podUID="c61d89d6-ef29-42ae-aa25-e350ab385462" Sep 10 11:12:20.914965 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:20.914614 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-54z9n" Sep 10 11:12:20.914965 ip-10-0-134-73 kubenswrapper[2564]: E0910 11:12:20.914725 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-54z9n" podUID="794743e8-fee9-426f-9546-161a898541e2" Sep 10 11:12:20.914965 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:20.914772 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bvnw9" Sep 10 11:12:20.914965 ip-10-0-134-73 kubenswrapper[2564]: E0910 11:12:20.914844 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bvnw9" podUID="1f233d76-b986-4ec6-a096-e4bc9d53101f" Sep 10 11:12:22.912849 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:22.912647 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kxss9" Sep 10 11:12:22.912849 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:22.912662 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-54z9n" Sep 10 11:12:22.912849 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:22.912814 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bvnw9" Sep 10 11:12:22.912849 ip-10-0-134-73 kubenswrapper[2564]: E0910 11:12:22.912808 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kxss9" podUID="c61d89d6-ef29-42ae-aa25-e350ab385462" Sep 10 11:12:22.913677 ip-10-0-134-73 kubenswrapper[2564]: E0910 11:12:22.912953 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-54z9n" podUID="794743e8-fee9-426f-9546-161a898541e2" Sep 10 11:12:22.913677 ip-10-0-134-73 kubenswrapper[2564]: E0910 11:12:22.913044 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bvnw9" podUID="1f233d76-b986-4ec6-a096-e4bc9d53101f" Sep 10 11:12:24.595000 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:24.594965 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/794743e8-fee9-426f-9546-161a898541e2-metrics-certs\") pod \"network-metrics-daemon-54z9n\" (UID: \"794743e8-fee9-426f-9546-161a898541e2\") " pod="openshift-multus/network-metrics-daemon-54z9n" Sep 10 11:12:24.595459 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:24.595015 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c61d89d6-ef29-42ae-aa25-e350ab385462-original-pull-secret\") pod \"global-pull-secret-syncer-kxss9\" (UID: \"c61d89d6-ef29-42ae-aa25-e350ab385462\") " pod="kube-system/global-pull-secret-syncer-kxss9" Sep 10 11:12:24.595459 ip-10-0-134-73 kubenswrapper[2564]: E0910 11:12:24.595119 2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 10 11:12:24.595459 ip-10-0-134-73 kubenswrapper[2564]: E0910 11:12:24.595133 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 11:12:24.595459 ip-10-0-134-73 kubenswrapper[2564]: E0910 11:12:24.595177 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c61d89d6-ef29-42ae-aa25-e350ab385462-original-pull-secret podName:c61d89d6-ef29-42ae-aa25-e350ab385462 nodeName:}" failed. No retries permitted until 2026-09-10 11:12:32.595163039 +0000 UTC m=+18.191724231 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c61d89d6-ef29-42ae-aa25-e350ab385462-original-pull-secret") pod "global-pull-secret-syncer-kxss9" (UID: "c61d89d6-ef29-42ae-aa25-e350ab385462") : object "kube-system"/"original-pull-secret" not registered Sep 10 11:12:24.595459 ip-10-0-134-73 kubenswrapper[2564]: E0910 11:12:24.595196 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/794743e8-fee9-426f-9546-161a898541e2-metrics-certs podName:794743e8-fee9-426f-9546-161a898541e2 nodeName:}" failed. No retries permitted until 2026-09-10 11:12:32.59518624 +0000 UTC m=+18.191747437 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/794743e8-fee9-426f-9546-161a898541e2-metrics-certs") pod "network-metrics-daemon-54z9n" (UID: "794743e8-fee9-426f-9546-161a898541e2") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 11:12:24.696033 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:24.695901 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tpb4z\" (UniqueName: \"kubernetes.io/projected/1f233d76-b986-4ec6-a096-e4bc9d53101f-kube-api-access-tpb4z\") pod \"network-check-target-bvnw9\" (UID: \"1f233d76-b986-4ec6-a096-e4bc9d53101f\") " pod="openshift-network-diagnostics/network-check-target-bvnw9" Sep 10 11:12:24.696215 ip-10-0-134-73 kubenswrapper[2564]: E0910 11:12:24.696070 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 10 11:12:24.696215 ip-10-0-134-73 kubenswrapper[2564]: E0910 11:12:24.696089 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 10 11:12:24.696215 ip-10-0-134-73 kubenswrapper[2564]: E0910 11:12:24.696100 2564 projected.go:196] Error preparing data for projected volume kube-api-access-tpb4z for pod openshift-network-diagnostics/network-check-target-bvnw9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 11:12:24.696215 ip-10-0-134-73 kubenswrapper[2564]: E0910 11:12:24.696160 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1f233d76-b986-4ec6-a096-e4bc9d53101f-kube-api-access-tpb4z podName:1f233d76-b986-4ec6-a096-e4bc9d53101f nodeName:}" failed. No retries permitted until 2026-09-10 11:12:32.69614234 +0000 UTC m=+18.292703548 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-tpb4z" (UniqueName: "kubernetes.io/projected/1f233d76-b986-4ec6-a096-e4bc9d53101f-kube-api-access-tpb4z") pod "network-check-target-bvnw9" (UID: "1f233d76-b986-4ec6-a096-e4bc9d53101f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 11:12:24.912768 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:24.912668 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kxss9" Sep 10 11:12:24.912928 ip-10-0-134-73 kubenswrapper[2564]: E0910 11:12:24.912802 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kxss9" podUID="c61d89d6-ef29-42ae-aa25-e350ab385462" Sep 10 11:12:24.912928 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:24.912877 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-54z9n" Sep 10 11:12:24.913020 ip-10-0-134-73 kubenswrapper[2564]: E0910 11:12:24.912967 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-54z9n" podUID="794743e8-fee9-426f-9546-161a898541e2" Sep 10 11:12:24.913318 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:24.913297 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bvnw9" Sep 10 11:12:24.913404 ip-10-0-134-73 kubenswrapper[2564]: E0910 11:12:24.913384 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bvnw9" podUID="1f233d76-b986-4ec6-a096-e4bc9d53101f" Sep 10 11:12:26.912414 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:26.912378 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kxss9" Sep 10 11:12:26.913015 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:26.912378 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-54z9n" Sep 10 11:12:26.913015 ip-10-0-134-73 kubenswrapper[2564]: E0910 11:12:26.912514 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kxss9" podUID="c61d89d6-ef29-42ae-aa25-e350ab385462" Sep 10 11:12:26.913015 ip-10-0-134-73 kubenswrapper[2564]: E0910 11:12:26.912643 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-54z9n" podUID="794743e8-fee9-426f-9546-161a898541e2" Sep 10 11:12:26.913015 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:26.912675 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bvnw9" Sep 10 11:12:26.913015 ip-10-0-134-73 kubenswrapper[2564]: E0910 11:12:26.912760 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bvnw9" podUID="1f233d76-b986-4ec6-a096-e4bc9d53101f" Sep 10 11:12:28.912502 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:28.912455 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-54z9n" Sep 10 11:12:28.912998 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:28.912517 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bvnw9" Sep 10 11:12:28.912998 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:28.912455 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kxss9" Sep 10 11:12:28.912998 ip-10-0-134-73 kubenswrapper[2564]: E0910 11:12:28.912602 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-54z9n" podUID="794743e8-fee9-426f-9546-161a898541e2" Sep 10 11:12:28.912998 ip-10-0-134-73 kubenswrapper[2564]: E0910 11:12:28.912688 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kxss9" podUID="c61d89d6-ef29-42ae-aa25-e350ab385462" Sep 10 11:12:28.912998 ip-10-0-134-73 kubenswrapper[2564]: E0910 11:12:28.912774 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bvnw9" podUID="1f233d76-b986-4ec6-a096-e4bc9d53101f" Sep 10 11:12:30.911623 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:30.911573 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-54z9n" Sep 10 11:12:30.911623 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:30.911599 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kxss9" Sep 10 11:12:30.912082 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:30.911699 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bvnw9" Sep 10 11:12:30.912082 ip-10-0-134-73 kubenswrapper[2564]: E0910 11:12:30.911707 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-54z9n" podUID="794743e8-fee9-426f-9546-161a898541e2" Sep 10 11:12:30.912082 ip-10-0-134-73 kubenswrapper[2564]: E0910 11:12:30.911789 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kxss9" podUID="c61d89d6-ef29-42ae-aa25-e350ab385462" Sep 10 11:12:30.912231 ip-10-0-134-73 kubenswrapper[2564]: E0910 11:12:30.912199 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bvnw9" podUID="1f233d76-b986-4ec6-a096-e4bc9d53101f" Sep 10 11:12:32.652313 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:32.652278 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/794743e8-fee9-426f-9546-161a898541e2-metrics-certs\") pod \"network-metrics-daemon-54z9n\" (UID: \"794743e8-fee9-426f-9546-161a898541e2\") " pod="openshift-multus/network-metrics-daemon-54z9n" Sep 10 11:12:32.652829 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:32.652323 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c61d89d6-ef29-42ae-aa25-e350ab385462-original-pull-secret\") pod \"global-pull-secret-syncer-kxss9\" (UID: \"c61d89d6-ef29-42ae-aa25-e350ab385462\") " pod="kube-system/global-pull-secret-syncer-kxss9" Sep 10 11:12:32.652829 ip-10-0-134-73 kubenswrapper[2564]: E0910 11:12:32.652429 2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 10 11:12:32.652829 ip-10-0-134-73 kubenswrapper[2564]: E0910 11:12:32.652434 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 11:12:32.652829 ip-10-0-134-73 kubenswrapper[2564]: E0910 11:12:32.652498 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c61d89d6-ef29-42ae-aa25-e350ab385462-original-pull-secret podName:c61d89d6-ef29-42ae-aa25-e350ab385462 nodeName:}" failed. No retries permitted until 2026-09-10 11:12:48.652479903 +0000 UTC m=+34.249041118 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c61d89d6-ef29-42ae-aa25-e350ab385462-original-pull-secret") pod "global-pull-secret-syncer-kxss9" (UID: "c61d89d6-ef29-42ae-aa25-e350ab385462") : object "kube-system"/"original-pull-secret" not registered Sep 10 11:12:32.652829 ip-10-0-134-73 kubenswrapper[2564]: E0910 11:12:32.652512 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/794743e8-fee9-426f-9546-161a898541e2-metrics-certs podName:794743e8-fee9-426f-9546-161a898541e2 nodeName:}" failed. No retries permitted until 2026-09-10 11:12:48.652505754 +0000 UTC m=+34.249066947 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/794743e8-fee9-426f-9546-161a898541e2-metrics-certs") pod "network-metrics-daemon-54z9n" (UID: "794743e8-fee9-426f-9546-161a898541e2") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 11:12:32.753492 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:32.753457 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tpb4z\" (UniqueName: \"kubernetes.io/projected/1f233d76-b986-4ec6-a096-e4bc9d53101f-kube-api-access-tpb4z\") pod \"network-check-target-bvnw9\" (UID: \"1f233d76-b986-4ec6-a096-e4bc9d53101f\") " pod="openshift-network-diagnostics/network-check-target-bvnw9" Sep 10 11:12:32.753642 ip-10-0-134-73 kubenswrapper[2564]: E0910 11:12:32.753622 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 10 11:12:32.753697 ip-10-0-134-73 kubenswrapper[2564]: E0910 11:12:32.753647 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 10 11:12:32.753697 ip-10-0-134-73 kubenswrapper[2564]: E0910 11:12:32.753658 2564 projected.go:196] Error preparing data for projected volume kube-api-access-tpb4z for pod openshift-network-diagnostics/network-check-target-bvnw9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 11:12:32.753767 ip-10-0-134-73 kubenswrapper[2564]: E0910 11:12:32.753711 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1f233d76-b986-4ec6-a096-e4bc9d53101f-kube-api-access-tpb4z podName:1f233d76-b986-4ec6-a096-e4bc9d53101f nodeName:}" failed. No retries permitted until 2026-09-10 11:12:48.753691753 +0000 UTC m=+34.350252945 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-tpb4z" (UniqueName: "kubernetes.io/projected/1f233d76-b986-4ec6-a096-e4bc9d53101f-kube-api-access-tpb4z") pod "network-check-target-bvnw9" (UID: "1f233d76-b986-4ec6-a096-e4bc9d53101f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 11:12:32.912701 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:32.912606 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bvnw9" Sep 10 11:12:32.912892 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:32.912631 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-54z9n" Sep 10 11:12:32.912892 ip-10-0-134-73 kubenswrapper[2564]: E0910 11:12:32.912770 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bvnw9" podUID="1f233d76-b986-4ec6-a096-e4bc9d53101f" Sep 10 11:12:32.912892 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:32.912631 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kxss9" Sep 10 11:12:32.912892 ip-10-0-134-73 kubenswrapper[2564]: E0910 11:12:32.912828 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-54z9n" podUID="794743e8-fee9-426f-9546-161a898541e2" Sep 10 11:12:32.913063 ip-10-0-134-73 kubenswrapper[2564]: E0910 11:12:32.912917 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kxss9" podUID="c61d89d6-ef29-42ae-aa25-e350ab385462" Sep 10 11:12:34.913955 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:34.913271 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kxss9" Sep 10 11:12:34.913955 ip-10-0-134-73 kubenswrapper[2564]: E0910 11:12:34.913594 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kxss9" podUID="c61d89d6-ef29-42ae-aa25-e350ab385462" Sep 10 11:12:34.913955 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:34.913372 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-54z9n" Sep 10 11:12:34.913955 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:34.913335 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bvnw9" Sep 10 11:12:34.913955 ip-10-0-134-73 kubenswrapper[2564]: E0910 11:12:34.913698 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-54z9n" podUID="794743e8-fee9-426f-9546-161a898541e2" Sep 10 11:12:34.913955 ip-10-0-134-73 kubenswrapper[2564]: E0910 11:12:34.913769 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bvnw9" podUID="1f233d76-b986-4ec6-a096-e4bc9d53101f" Sep 10 11:12:34.995868 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:34.995785 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-73.ec2.internal" event={"ID":"8d6e48b52697b16de0fdd5bfe815b959","Type":"ContainerStarted","Data":"55a06f92049afc18ac17c147b868e2a04851d2e15138d448ba26d5d1b656f10d"} Sep 10 11:12:35.001122 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:34.999765 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-zgkgx" event={"ID":"d1b87354-8843-4e59-8a85-68c875f472e6","Type":"ContainerStarted","Data":"9322fa5276b59da923035b95342ad2979629f18e498a2f5f4bfa42e20e4cfdf5"} Sep 10 11:12:35.003878 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:35.003794 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-8mbpl" event={"ID":"d79e1737-1635-4c9c-8ad3-1ed1537ee844","Type":"ContainerStarted","Data":"7bb9089e0ab99785c7a5b416b5580b5b6702f42366530fdb33c32812664e2658"} Sep 10 11:12:35.018979 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:35.018924 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-73.ec2.internal" podStartSLOduration=19.01849695 podStartE2EDuration="19.01849695s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 11:12:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 11:12:35.017525703 +0000 UTC m=+20.614086918" watchObservedRunningTime="2026-09-10 11:12:35.01849695 +0000 UTC m=+20.615058167" Sep 10 11:12:35.040204 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:35.040161 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-8mbpl" podStartSLOduration=2.710099589 podStartE2EDuration="19.040144179s" totalImagesPullingTime="16.33004459s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 11:12:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 11:12:35.040109883 +0000 UTC m=+20.636671097" watchObservedRunningTime="2026-09-10 11:12:35.040144179 +0000 UTC m=+20.636705390" Sep 10 11:12:35.062611 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:35.062559 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-zgkgx" podStartSLOduration=2.769841808 podStartE2EDuration="20.062535379s" totalImagesPullingTime="17.292693571s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 11:12:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 11:12:35.061886773 +0000 UTC m=+20.658447987" watchObservedRunningTime="2026-09-10 11:12:35.062535379 +0000 UTC m=+20.659096596" Sep 10 11:12:36.007258 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:36.007055 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-pq4ct" event={"ID":"77142edb-57e1-4da1-8eba-f104366a851f","Type":"ContainerStarted","Data":"c578c988cf9ecba6c1f5b9419677e017eec571c83ed91072b6d3cd9da1121ca9"} Sep 10 11:12:36.008555 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:36.008530 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-285k7" event={"ID":"60a628d5-3863-4793-802f-e07a7157dcdf","Type":"ContainerStarted","Data":"dfcc8cc89640ee9d2d6bc66ff1be1c251a3915082924dc9e94ae98eddb514d9d"} Sep 10 11:12:36.009972 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:36.009949 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-r6sr6" event={"ID":"1bf42e41-3da3-4bc1-8388-c0157fb5ae44","Type":"ContainerStarted","Data":"4caa3f4bf67d3571b0317b107b24039287a431d80ff14db85e113c1aace7bb3b"} Sep 10 11:12:36.011327 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:36.011307 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tjcmb" event={"ID":"a938afae-5d17-4255-b89d-123cdcc6c4a3","Type":"ContainerStarted","Data":"4c310563466f2f598acfd9299bdd108890a99d8b07779e1a5ffc3108f21f82e6"} Sep 10 11:12:36.014151 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:36.014132 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-t5n27" event={"ID":"433a8dab-963b-403e-a78f-b3b4fbeadf8f","Type":"ContainerStarted","Data":"22cfb4911979fbf8951046899062e268a4eb8cbea71cfd8913c5f21dcab8479a"} Sep 10 11:12:36.014255 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:36.014194 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-t5n27" event={"ID":"433a8dab-963b-403e-a78f-b3b4fbeadf8f","Type":"ContainerStarted","Data":"9ba7c69357c7b1891bdfcdd44c2f82bf8d3e73d7809acc6659b5e8bd0a3cb67e"} Sep 10 11:12:36.014255 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:36.014225 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-t5n27" event={"ID":"433a8dab-963b-403e-a78f-b3b4fbeadf8f","Type":"ContainerStarted","Data":"18d93cde278686540180637d09cbf4e7a0edba4a1f87ef0c72dad0568cc34dcf"} Sep 10 11:12:36.014368 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:36.014265 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-t5n27" event={"ID":"433a8dab-963b-403e-a78f-b3b4fbeadf8f","Type":"ContainerStarted","Data":"a1e287aa64f6fd54159e6aa92a378f5e1c5c24b61b8d21164439a0ad299f23f7"} Sep 10 11:12:36.014368 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:36.014297 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-t5n27" event={"ID":"433a8dab-963b-403e-a78f-b3b4fbeadf8f","Type":"ContainerStarted","Data":"2444c9988b0b7ccd3dc706dde66f8ea8ea0c4098586bec29a5b07ec8b0614293"} Sep 10 11:12:36.014368 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:36.014329 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-t5n27" event={"ID":"433a8dab-963b-403e-a78f-b3b4fbeadf8f","Type":"ContainerStarted","Data":"2e81a8c78253a6d380be73fc49a81033375c6e936ea896d60cab8b3d08de04d7"} Sep 10 11:12:36.015536 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:36.015518 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-z697w" event={"ID":"d659be6f-7ae8-4309-8d20-0954a8b188ad","Type":"ContainerStarted","Data":"e4c3b4a94ca4ca49155462072d15640c05d79e6968703a3aad5a1e30dfd99eef"} Sep 10 11:12:36.016936 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:36.016914 2564 generic.go:356] "Generic (PLEG): container finished" podID="1d5ea621-658b-4058-9b1a-d4c976651be0" containerID="aa47ce8adb70da64b147dc002c71c19afefde7f51745c134615f175aa43ea606" exitCode=0 Sep 10 11:12:36.017004 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:36.016989 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dpgnj" event={"ID":"1d5ea621-658b-4058-9b1a-d4c976651be0","Type":"ContainerDied","Data":"aa47ce8adb70da64b147dc002c71c19afefde7f51745c134615f175aa43ea606"} Sep 10 11:12:36.024277 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:36.024242 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-pq4ct" podStartSLOduration=3.704767444 podStartE2EDuration="20.02423034s" totalImagesPullingTime="16.319462896s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 11:12:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 11:12:36.023927198 +0000 UTC m=+21.620488412" watchObservedRunningTime="2026-09-10 11:12:36.02423034 +0000 UTC m=+21.620791579" Sep 10 11:12:36.044047 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:36.044004 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-285k7" podStartSLOduration=4.715805614 podStartE2EDuration="21.043992191s" totalImagesPullingTime="16.328186577s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 11:12:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 11:12:36.043724175 +0000 UTC m=+21.640285390" watchObservedRunningTime="2026-09-10 11:12:36.043992191 +0000 UTC m=+21.640553406" Sep 10 11:12:36.092372 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:36.092320 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-z697w" podStartSLOduration=3.473059787 podStartE2EDuration="21.092305495s" totalImagesPullingTime="17.619245708s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 11:12:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 11:12:36.091785785 +0000 UTC m=+21.688346999" watchObservedRunningTime="2026-09-10 11:12:36.092305495 +0000 UTC m=+21.688866710" Sep 10 11:12:36.114886 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:36.114824 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-r6sr6" podStartSLOduration=3.807683571 podStartE2EDuration="21.114808353s" totalImagesPullingTime="17.307124782s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 11:12:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 11:12:36.114668666 +0000 UTC m=+21.711229882" watchObservedRunningTime="2026-09-10 11:12:36.114808353 +0000 UTC m=+21.711369568" Sep 10 11:12:36.912168 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:36.912136 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kxss9" Sep 10 11:12:36.912168 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:36.912153 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bvnw9" Sep 10 11:12:36.912407 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:36.912134 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-54z9n" Sep 10 11:12:36.912407 ip-10-0-134-73 kubenswrapper[2564]: E0910 11:12:36.912257 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kxss9" podUID="c61d89d6-ef29-42ae-aa25-e350ab385462" Sep 10 11:12:36.912407 ip-10-0-134-73 kubenswrapper[2564]: E0910 11:12:36.912312 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bvnw9" podUID="1f233d76-b986-4ec6-a096-e4bc9d53101f" Sep 10 11:12:36.912543 ip-10-0-134-73 kubenswrapper[2564]: E0910 11:12:36.912437 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-54z9n" podUID="794743e8-fee9-426f-9546-161a898541e2" Sep 10 11:12:37.069689 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:37.069667 2564 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Sep 10 11:12:37.891867 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:37.891631 2564 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-10T11:12:37.069685553Z","UUID":"2ef991e5-39bb-4762-9b28-3db08635303d","Handler":null,"Name":"","Endpoint":""} Sep 10 11:12:37.893227 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:37.893204 2564 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Sep 10 11:12:37.893227 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:37.893232 2564 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Sep 10 11:12:38.025896 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:38.025771 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-t5n27" event={"ID":"433a8dab-963b-403e-a78f-b3b4fbeadf8f","Type":"ContainerStarted","Data":"21c506770563bb0d94b191844ad5c56c8057818d4a66162e94fda4195567c907"} Sep 10 11:12:38.027679 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:38.027656 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tjcmb" event={"ID":"a938afae-5d17-4255-b89d-123cdcc6c4a3","Type":"ContainerStarted","Data":"6ecbc5eef333ab56569a299d4ee0aebfe276df30d73efa371e5289972a091714"} Sep 10 11:12:38.904952 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:38.904912 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-pq4ct" Sep 10 11:12:38.905495 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:38.905418 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-pq4ct" Sep 10 11:12:38.912568 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:38.912515 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kxss9" Sep 10 11:12:38.912568 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:38.912538 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bvnw9" Sep 10 11:12:38.912568 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:38.912574 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-54z9n" Sep 10 11:12:38.912792 ip-10-0-134-73 kubenswrapper[2564]: E0910 11:12:38.912669 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bvnw9" podUID="1f233d76-b986-4ec6-a096-e4bc9d53101f" Sep 10 11:12:38.913085 ip-10-0-134-73 kubenswrapper[2564]: E0910 11:12:38.913060 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-54z9n" podUID="794743e8-fee9-426f-9546-161a898541e2" Sep 10 11:12:38.913159 ip-10-0-134-73 kubenswrapper[2564]: E0910 11:12:38.913146 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kxss9" podUID="c61d89d6-ef29-42ae-aa25-e350ab385462" Sep 10 11:12:39.030143 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:39.030083 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-pq4ct" Sep 10 11:12:39.030430 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:39.030411 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-pq4ct" Sep 10 11:12:40.036309 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:40.036236 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tjcmb" event={"ID":"a938afae-5d17-4255-b89d-123cdcc6c4a3","Type":"ContainerStarted","Data":"6fd8515ac4ea6349995a48fcdd96d7a202a7843f15f2259cd743b9c1e08c5c48"} Sep 10 11:12:40.040108 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:40.040077 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-t5n27" event={"ID":"433a8dab-963b-403e-a78f-b3b4fbeadf8f","Type":"ContainerStarted","Data":"3a0311fb1b4283e2724c1219fadf3a04e045fdc9d985e5ed780c666584f70f08"} Sep 10 11:12:40.040316 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:40.040294 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-t5n27" Sep 10 11:12:40.040402 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:40.040375 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-t5n27" Sep 10 11:12:40.040457 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:40.040426 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-t5n27" Sep 10 11:12:40.055615 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:40.055587 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-t5n27" Sep 10 11:12:40.056125 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:40.056107 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-t5n27" Sep 10 11:12:40.061383 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:40.061343 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tjcmb" podStartSLOduration=5.244850869 podStartE2EDuration="25.061330466s" totalImagesPullingTime="19.816479597s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 11:12:15 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 11:12:40.061304003 +0000 UTC m=+25.657865219" watchObservedRunningTime="2026-09-10 11:12:40.061330466 +0000 UTC m=+25.657891684" Sep 10 11:12:40.911775 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:40.911565 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kxss9" Sep 10 11:12:40.911998 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:40.911574 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-54z9n" Sep 10 11:12:40.911998 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:40.911618 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bvnw9" Sep 10 11:12:40.911998 ip-10-0-134-73 kubenswrapper[2564]: E0910 11:12:40.911884 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kxss9" podUID="c61d89d6-ef29-42ae-aa25-e350ab385462" Sep 10 11:12:40.911998 ip-10-0-134-73 kubenswrapper[2564]: E0910 11:12:40.911948 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-54z9n" podUID="794743e8-fee9-426f-9546-161a898541e2" Sep 10 11:12:40.912196 ip-10-0-134-73 kubenswrapper[2564]: E0910 11:12:40.912004 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bvnw9" podUID="1f233d76-b986-4ec6-a096-e4bc9d53101f" Sep 10 11:12:41.764625 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:41.764570 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-t5n27" podStartSLOduration=8.702376509 podStartE2EDuration="26.764531862s" totalImagesPullingTime="18.062155353s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 11:12:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 11:12:40.096678809 +0000 UTC m=+25.693240024" watchObservedRunningTime="2026-09-10 11:12:41.764531862 +0000 UTC m=+27.361093077" Sep 10 11:12:41.765421 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:41.765401 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-54z9n"] Sep 10 11:12:41.765510 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:41.765487 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-54z9n" Sep 10 11:12:41.765580 ip-10-0-134-73 kubenswrapper[2564]: E0910 11:12:41.765565 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-54z9n" podUID="794743e8-fee9-426f-9546-161a898541e2" Sep 10 11:12:41.772111 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:41.772088 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-kxss9"] Sep 10 11:12:41.772242 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:41.772168 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kxss9" Sep 10 11:12:41.772294 ip-10-0-134-73 kubenswrapper[2564]: E0910 11:12:41.772260 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kxss9" podUID="c61d89d6-ef29-42ae-aa25-e350ab385462" Sep 10 11:12:41.772730 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:41.772706 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-bvnw9"] Sep 10 11:12:41.772826 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:41.772783 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bvnw9" Sep 10 11:12:41.772885 ip-10-0-134-73 kubenswrapper[2564]: E0910 11:12:41.772871 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bvnw9" podUID="1f233d76-b986-4ec6-a096-e4bc9d53101f" Sep 10 11:12:42.911941 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:42.911903 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-54z9n" Sep 10 11:12:42.911941 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:42.911924 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bvnw9" Sep 10 11:12:42.912660 ip-10-0-134-73 kubenswrapper[2564]: E0910 11:12:42.912028 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-54z9n" podUID="794743e8-fee9-426f-9546-161a898541e2" Sep 10 11:12:42.912660 ip-10-0-134-73 kubenswrapper[2564]: E0910 11:12:42.912127 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bvnw9" podUID="1f233d76-b986-4ec6-a096-e4bc9d53101f" Sep 10 11:12:43.048691 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:43.048657 2564 generic.go:356] "Generic (PLEG): container finished" podID="1d5ea621-658b-4058-9b1a-d4c976651be0" containerID="7d22e66f2ad59dd7e5e79a5fea25ece4cc8ea7bd6537f1283dd096038c1e440a" exitCode=0 Sep 10 11:12:43.048843 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:43.048705 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dpgnj" event={"ID":"1d5ea621-658b-4058-9b1a-d4c976651be0","Type":"ContainerDied","Data":"7d22e66f2ad59dd7e5e79a5fea25ece4cc8ea7bd6537f1283dd096038c1e440a"} Sep 10 11:12:43.911785 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:43.911758 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kxss9" Sep 10 11:12:43.911935 ip-10-0-134-73 kubenswrapper[2564]: E0910 11:12:43.911900 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kxss9" podUID="c61d89d6-ef29-42ae-aa25-e350ab385462" Sep 10 11:12:44.912584 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:44.912425 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-54z9n" Sep 10 11:12:44.913127 ip-10-0-134-73 kubenswrapper[2564]: E0910 11:12:44.912646 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-54z9n" podUID="794743e8-fee9-426f-9546-161a898541e2" Sep 10 11:12:44.913127 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:44.912493 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bvnw9" Sep 10 11:12:44.913127 ip-10-0-134-73 kubenswrapper[2564]: E0910 11:12:44.912779 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bvnw9" podUID="1f233d76-b986-4ec6-a096-e4bc9d53101f" Sep 10 11:12:45.057381 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:45.057350 2564 generic.go:356] "Generic (PLEG): container finished" podID="1d5ea621-658b-4058-9b1a-d4c976651be0" containerID="c2750e85fa73643e37dcceecd8713cc02ecbb92199f80903b991ff5b7ac0f5cb" exitCode=0 Sep 10 11:12:45.057505 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:45.057397 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dpgnj" event={"ID":"1d5ea621-658b-4058-9b1a-d4c976651be0","Type":"ContainerDied","Data":"c2750e85fa73643e37dcceecd8713cc02ecbb92199f80903b991ff5b7ac0f5cb"} Sep 10 11:12:45.912255 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:45.912226 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kxss9" Sep 10 11:12:45.912425 ip-10-0-134-73 kubenswrapper[2564]: E0910 11:12:45.912361 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kxss9" podUID="c61d89d6-ef29-42ae-aa25-e350ab385462" Sep 10 11:12:46.061898 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:46.061792 2564 generic.go:356] "Generic (PLEG): container finished" podID="1d5ea621-658b-4058-9b1a-d4c976651be0" containerID="3ebd64295c03b6fffb4c32d84a6948b66a86794733cd8e92fe5b7bd33108f489" exitCode=0 Sep 10 11:12:46.061898 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:46.061840 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dpgnj" event={"ID":"1d5ea621-658b-4058-9b1a-d4c976651be0","Type":"ContainerDied","Data":"3ebd64295c03b6fffb4c32d84a6948b66a86794733cd8e92fe5b7bd33108f489"} Sep 10 11:12:46.912132 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:46.912034 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bvnw9" Sep 10 11:12:46.912293 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:46.912060 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-54z9n" Sep 10 11:12:46.912293 ip-10-0-134-73 kubenswrapper[2564]: E0910 11:12:46.912174 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bvnw9" podUID="1f233d76-b986-4ec6-a096-e4bc9d53101f" Sep 10 11:12:46.912293 ip-10-0-134-73 kubenswrapper[2564]: E0910 11:12:46.912246 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-54z9n" podUID="794743e8-fee9-426f-9546-161a898541e2" Sep 10 11:12:47.912016 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:47.911980 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kxss9" Sep 10 11:12:47.912364 ip-10-0-134-73 kubenswrapper[2564]: E0910 11:12:47.912084 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kxss9" podUID="c61d89d6-ef29-42ae-aa25-e350ab385462" Sep 10 11:12:48.671213 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:48.671128 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c61d89d6-ef29-42ae-aa25-e350ab385462-original-pull-secret\") pod \"global-pull-secret-syncer-kxss9\" (UID: \"c61d89d6-ef29-42ae-aa25-e350ab385462\") " pod="kube-system/global-pull-secret-syncer-kxss9" Sep 10 11:12:48.671370 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:48.671233 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/794743e8-fee9-426f-9546-161a898541e2-metrics-certs\") pod \"network-metrics-daemon-54z9n\" (UID: \"794743e8-fee9-426f-9546-161a898541e2\") " pod="openshift-multus/network-metrics-daemon-54z9n" Sep 10 11:12:48.671370 ip-10-0-134-73 kubenswrapper[2564]: E0910 11:12:48.671286 2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 10 11:12:48.671370 ip-10-0-134-73 kubenswrapper[2564]: E0910 11:12:48.671343 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 11:12:48.671370 ip-10-0-134-73 kubenswrapper[2564]: E0910 11:12:48.671365 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c61d89d6-ef29-42ae-aa25-e350ab385462-original-pull-secret podName:c61d89d6-ef29-42ae-aa25-e350ab385462 nodeName:}" failed. No retries permitted until 2026-09-10 11:13:20.671343668 +0000 UTC m=+66.267904860 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c61d89d6-ef29-42ae-aa25-e350ab385462-original-pull-secret") pod "global-pull-secret-syncer-kxss9" (UID: "c61d89d6-ef29-42ae-aa25-e350ab385462") : object "kube-system"/"original-pull-secret" not registered Sep 10 11:12:48.671516 ip-10-0-134-73 kubenswrapper[2564]: E0910 11:12:48.671392 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/794743e8-fee9-426f-9546-161a898541e2-metrics-certs podName:794743e8-fee9-426f-9546-161a898541e2 nodeName:}" failed. No retries permitted until 2026-09-10 11:13:20.671375888 +0000 UTC m=+66.267937104 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/794743e8-fee9-426f-9546-161a898541e2-metrics-certs") pod "network-metrics-daemon-54z9n" (UID: "794743e8-fee9-426f-9546-161a898541e2") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 11:12:48.726359 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:48.726332 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-73.ec2.internal" event="NodeReady" Sep 10 11:12:48.726528 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:48.726493 2564 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Sep 10 11:12:48.772651 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:48.772609 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tpb4z\" (UniqueName: \"kubernetes.io/projected/1f233d76-b986-4ec6-a096-e4bc9d53101f-kube-api-access-tpb4z\") pod \"network-check-target-bvnw9\" (UID: \"1f233d76-b986-4ec6-a096-e4bc9d53101f\") " pod="openshift-network-diagnostics/network-check-target-bvnw9" Sep 10 11:12:48.772820 ip-10-0-134-73 kubenswrapper[2564]: E0910 11:12:48.772803 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 10 11:12:48.772899 ip-10-0-134-73 kubenswrapper[2564]: E0910 11:12:48.772825 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 10 11:12:48.772899 ip-10-0-134-73 kubenswrapper[2564]: E0910 11:12:48.772835 2564 projected.go:196] Error preparing data for projected volume kube-api-access-tpb4z for pod openshift-network-diagnostics/network-check-target-bvnw9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 11:12:48.773016 ip-10-0-134-73 kubenswrapper[2564]: E0910 11:12:48.772909 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1f233d76-b986-4ec6-a096-e4bc9d53101f-kube-api-access-tpb4z podName:1f233d76-b986-4ec6-a096-e4bc9d53101f nodeName:}" failed. No retries permitted until 2026-09-10 11:13:20.772892572 +0000 UTC m=+66.369453785 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-tpb4z" (UniqueName: "kubernetes.io/projected/1f233d76-b986-4ec6-a096-e4bc9d53101f-kube-api-access-tpb4z") pod "network-check-target-bvnw9" (UID: "1f233d76-b986-4ec6-a096-e4bc9d53101f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 11:12:48.784699 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:48.784208 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-7864689cc9-sw6sb"] Sep 10 11:12:48.787223 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:48.786227 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-879b8884d-8tjr9"] Sep 10 11:12:48.787223 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:48.786457 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7864689cc9-sw6sb" Sep 10 11:12:48.789289 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:48.789268 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-t55dh"] Sep 10 11:12:48.789408 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:48.789386 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-879b8884d-8tjr9" Sep 10 11:12:48.791114 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:48.791093 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-ppgz5"] Sep 10 11:12:48.791217 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:48.791206 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-t55dh" Sep 10 11:12:48.793159 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:48.793141 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-sckxh"] Sep 10 11:12:48.793286 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:48.793254 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-ppgz5" Sep 10 11:12:48.795117 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:48.795080 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-76bcd6ccf5-2srs4"] Sep 10 11:12:48.795328 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:48.795309 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-sckxh" Sep 10 11:12:48.797243 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:48.797226 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-85b454874b-l2hf2"] Sep 10 11:12:48.797593 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:48.797353 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-76bcd6ccf5-2srs4" Sep 10 11:12:48.799727 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:48.799707 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-859f94c4b-2kgcg"] Sep 10 11:12:48.799832 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:48.799783 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-85b454874b-l2hf2" Sep 10 11:12:48.801812 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:48.801789 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Sep 10 11:12:48.801996 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:48.801946 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Sep 10 11:12:48.802064 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:48.802018 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Sep 10 11:12:48.802064 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:48.802037 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Sep 10 11:12:48.802064 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:48.802049 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Sep 10 11:12:48.802181 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:48.802162 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Sep 10 11:12:48.802547 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:48.802293 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Sep 10 11:12:48.802547 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:48.802307 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Sep 10 11:12:48.802547 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:48.802323 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6cdcc96965-cw9qc"] Sep 10 11:12:48.802547 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:48.802335 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Sep 10 11:12:48.802547 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:48.802360 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Sep 10 11:12:48.802547 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:48.802451 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Sep 10 11:12:48.802547 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:48.802481 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Sep 10 11:12:48.802930 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:48.802590 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-2kgcg" Sep 10 11:12:48.802930 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:48.802660 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Sep 10 11:12:48.802930 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:48.802786 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Sep 10 11:12:48.803079 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:48.803033 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Sep 10 11:12:48.803899 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:48.803142 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Sep 10 11:12:48.803899 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:48.803216 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-msk79\"" Sep 10 11:12:48.803899 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:48.803232 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Sep 10 11:12:48.803899 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:48.803255 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Sep 10 11:12:48.803899 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:48.803295 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Sep 10 11:12:48.803899 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:48.803383 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Sep 10 11:12:48.803899 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:48.803406 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Sep 10 11:12:48.803899 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:48.803414 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Sep 10 11:12:48.803899 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:48.803519 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-z48vt\"" Sep 10 11:12:48.803899 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:48.803541 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Sep 10 11:12:48.803899 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:48.803569 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Sep 10 11:12:48.803899 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:48.803684 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-kr9rd\"" Sep 10 11:12:48.803899 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:48.803709 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-wbrcw\"" Sep 10 11:12:48.803899 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:48.803743 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Sep 10 11:12:48.803899 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:48.803804 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Sep 10 11:12:48.803899 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:48.803909 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-dgphp\"" Sep 10 11:12:48.804714 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:48.803936 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-b5m99\"" Sep 10 11:12:48.804714 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:48.804693 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-cw9qc" Sep 10 11:12:48.804964 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:48.804947 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-g2q8b\"" Sep 10 11:12:48.813428 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:48.813313 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-79977f9844-bz6mz"] Sep 10 11:12:48.821102 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:48.821074 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Sep 10 11:12:48.821543 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:48.821074 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Sep 10 11:12:48.821822 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:48.821564 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Sep 10 11:12:48.821822 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:48.821576 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Sep 10 11:12:48.821822 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:48.821644 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-srqvl\"" Sep 10 11:12:48.821822 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:48.821180 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Sep 10 11:12:48.821822 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:48.821516 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-96vm5\"" Sep 10 11:12:48.821822 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:48.821520 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Sep 10 11:12:48.821822 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:48.821130 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Sep 10 11:12:48.823968 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:48.823940 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-4bkc6"] Sep 10 11:12:48.824699 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:48.824681 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-79977f9844-bz6mz" Sep 10 11:12:48.826011 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:48.824918 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Sep 10 11:12:48.826011 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:48.825246 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Sep 10 11:12:48.827316 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:48.827294 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-wqmx7\"" Sep 10 11:12:48.827578 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:48.827425 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Sep 10 11:12:48.827578 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:48.827566 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Sep 10 11:12:48.828293 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:48.828218 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Sep 10 11:12:48.830013 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:48.829993 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-685456655f-z7mhl"] Sep 10 11:12:48.830610 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:48.830358 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Sep 10 11:12:48.830610 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:48.830569 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-4bkc6" Sep 10 11:12:48.833614 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:48.833592 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Sep 10 11:12:48.833836 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:48.833671 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-cs5mx\"" Sep 10 11:12:48.834155 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:48.834133 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Sep 10 11:12:48.834155 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:48.834145 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Sep 10 11:12:48.834541 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:48.834507 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-crh79"] Sep 10 11:12:48.835037 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:48.835019 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-685456655f-z7mhl" Sep 10 11:12:48.838993 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:48.838790 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Sep 10 11:12:48.839258 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:48.839237 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Sep 10 11:12:48.839550 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:48.839530 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-76bcd6ccf5-2srs4"] Sep 10 11:12:48.839550 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:48.839546 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-qg2bz\"" Sep 10 11:12:48.839701 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:48.839570 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-859f94c4b-2kgcg"] Sep 10 11:12:48.839701 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:48.839594 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-ppgz5"] Sep 10 11:12:48.839701 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:48.839615 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-879b8884d-8tjr9"] Sep 10 11:12:48.839701 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:48.839635 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-79977f9844-bz6mz"] Sep 10 11:12:48.839701 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:48.839653 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-685456655f-z7mhl"] Sep 10 11:12:48.839701 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:48.839672 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7864689cc9-sw6sb"] Sep 10 11:12:48.839992 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:48.839739 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-crh79" Sep 10 11:12:48.842575 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:48.842543 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-crh79"] Sep 10 11:12:48.843514 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:48.843496 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6cdcc96965-cw9qc"] Sep 10 11:12:48.843820 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:48.843801 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Sep 10 11:12:48.844767 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:48.844375 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-sckxh"] Sep 10 11:12:48.844767 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:48.844468 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-rpwp6\"" Sep 10 11:12:48.844767 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:48.844470 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Sep 10 11:12:48.853735 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:48.853707 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-t55dh"] Sep 10 11:12:48.854640 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:48.854616 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-85b454874b-l2hf2"] Sep 10 11:12:48.857958 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:48.857938 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-4bkc6"] Sep 10 11:12:48.873038 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:48.873014 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/9e565424-7eca-4f29-8582-664fac065238-serving-cert\") pod \"kube-storage-version-migrator-operator-8d7dd4675-t55dh\" (UID: \"9e565424-7eca-4f29-8582-664fac065238\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-t55dh" Sep 10 11:12:48.873191 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:48.873059 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8q7bw\" (UniqueName: \"kubernetes.io/projected/7a9cb7ef-ebb9-48cc-8a51-f83540a85612-kube-api-access-8q7bw\") pod \"router-default-879b8884d-8tjr9\" (UID: \"7a9cb7ef-ebb9-48cc-8a51-f83540a85612\") " pod="openshift-ingress/router-default-879b8884d-8tjr9" Sep 10 11:12:48.873191 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:48.873132 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2aeac0f7-3e8b-4d33-abcc-ae757048a5cf-trusted-ca-bundle\") pod \"insights-operator-76bcd6ccf5-2srs4\" (UID: \"2aeac0f7-3e8b-4d33-abcc-ae757048a5cf\") " pod="openshift-insights/insights-operator-76bcd6ccf5-2srs4" Sep 10 11:12:48.873191 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:48.873167 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m7n54\" (UniqueName: \"kubernetes.io/projected/35dc51d7-6cf7-42d2-8e35-1a31a3a1ac8f-kube-api-access-m7n54\") pod \"service-ca-operator-859f94c4b-2kgcg\" (UID: \"35dc51d7-6cf7-42d2-8e35-1a31a3a1ac8f\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-2kgcg" Sep 10 11:12:48.873339 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:48.873202 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/07ed66ee-327a-4767-a989-0cc7574b0c0f-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-cw9qc\" (UID: \"07ed66ee-327a-4767-a989-0cc7574b0c0f\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-cw9qc" Sep 10 11:12:48.873339 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:48.873229 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/74f68888-4cfe-416f-bce6-e0b42f46aef5-trusted-ca\") pod \"image-registry-7864689cc9-sw6sb\" (UID: \"74f68888-4cfe-416f-bce6-e0b42f46aef5\") " pod="openshift-image-registry/image-registry-7864689cc9-sw6sb" Sep 10 11:12:48.873447 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:48.873258 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2aeac0f7-3e8b-4d33-abcc-ae757048a5cf-tmp\") pod \"insights-operator-76bcd6ccf5-2srs4\" (UID: \"2aeac0f7-3e8b-4d33-abcc-ae757048a5cf\") " pod="openshift-insights/insights-operator-76bcd6ccf5-2srs4" Sep 10 11:12:48.874276 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:48.873737 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2aeac0f7-3e8b-4d33-abcc-ae757048a5cf-service-ca-bundle\") pod \"insights-operator-76bcd6ccf5-2srs4\" (UID: \"2aeac0f7-3e8b-4d33-abcc-ae757048a5cf\") " pod="openshift-insights/insights-operator-76bcd6ccf5-2srs4" Sep 10 11:12:48.874276 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:48.873875 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/74f68888-4cfe-416f-bce6-e0b42f46aef5-installation-pull-secrets\") pod \"image-registry-7864689cc9-sw6sb\" (UID: \"74f68888-4cfe-416f-bce6-e0b42f46aef5\") " pod="openshift-image-registry/image-registry-7864689cc9-sw6sb" Sep 10 11:12:48.874276 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:48.873940 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7f298f77-06d2-4ea6-b4fc-cb2c5e9080de-trusted-ca\") pod \"console-operator-85b454874b-l2hf2\" (UID: \"7f298f77-06d2-4ea6-b4fc-cb2c5e9080de\") " pod="openshift-console-operator/console-operator-85b454874b-l2hf2" Sep 10 11:12:48.874276 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:48.873978 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/74f68888-4cfe-416f-bce6-e0b42f46aef5-image-registry-private-configuration\") pod \"image-registry-7864689cc9-sw6sb\" (UID: \"74f68888-4cfe-416f-bce6-e0b42f46aef5\") " pod="openshift-image-registry/image-registry-7864689cc9-sw6sb" Sep 10 11:12:48.874276 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:48.874012 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/35dc51d7-6cf7-42d2-8e35-1a31a3a1ac8f-config\") pod \"service-ca-operator-859f94c4b-2kgcg\" (UID: \"35dc51d7-6cf7-42d2-8e35-1a31a3a1ac8f\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-2kgcg" Sep 10 11:12:48.874276 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:48.874041 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/07ed66ee-327a-4767-a989-0cc7574b0c0f-telemetry-config\") pod \"cluster-monitoring-operator-6cdcc96965-cw9qc\" (UID: \"07ed66ee-327a-4767-a989-0cc7574b0c0f\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-cw9qc" Sep 10 11:12:48.874276 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:48.874074 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/3e0bbd18-8afb-43e7-8e61-04d516f482f0-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-sckxh\" (UID: \"3e0bbd18-8afb-43e7-8e61-04d516f482f0\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-sckxh" Sep 10 11:12:48.874276 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:48.874101 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/7a9cb7ef-ebb9-48cc-8a51-f83540a85612-stats-auth\") pod \"router-default-879b8884d-8tjr9\" (UID: \"7a9cb7ef-ebb9-48cc-8a51-f83540a85612\") " pod="openshift-ingress/router-default-879b8884d-8tjr9" Sep 10 11:12:48.874276 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:48.874125 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7a9cb7ef-ebb9-48cc-8a51-f83540a85612-service-ca-bundle\") pod \"router-default-879b8884d-8tjr9\" (UID: \"7a9cb7ef-ebb9-48cc-8a51-f83540a85612\") " pod="openshift-ingress/router-default-879b8884d-8tjr9" Sep 10 11:12:48.874276 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:48.874146 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7a9cb7ef-ebb9-48cc-8a51-f83540a85612-metrics-certs\") pod \"router-default-879b8884d-8tjr9\" (UID: \"7a9cb7ef-ebb9-48cc-8a51-f83540a85612\") " pod="openshift-ingress/router-default-879b8884d-8tjr9" Sep 10 11:12:48.874276 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:48.874165 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gjjp5\" (UniqueName: \"kubernetes.io/projected/3e0bbd18-8afb-43e7-8e61-04d516f482f0-kube-api-access-gjjp5\") pod \"cluster-samples-operator-7cdcfcf76c-sckxh\" (UID: \"3e0bbd18-8afb-43e7-8e61-04d516f482f0\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-sckxh" Sep 10 11:12:48.874823 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:48.874197 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2nv4j\" (UniqueName: \"kubernetes.io/projected/9e565424-7eca-4f29-8582-664fac065238-kube-api-access-2nv4j\") pod \"kube-storage-version-migrator-operator-8d7dd4675-t55dh\" (UID: \"9e565424-7eca-4f29-8582-664fac065238\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-t55dh" Sep 10 11:12:48.874823 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:48.874456 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vsc45\" (UniqueName: \"kubernetes.io/projected/7f298f77-06d2-4ea6-b4fc-cb2c5e9080de-kube-api-access-vsc45\") pod \"console-operator-85b454874b-l2hf2\" (UID: \"7f298f77-06d2-4ea6-b4fc-cb2c5e9080de\") " pod="openshift-console-operator/console-operator-85b454874b-l2hf2" Sep 10 11:12:48.874823 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:48.874496 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/9e565424-7eca-4f29-8582-664fac065238-config\") pod \"kube-storage-version-migrator-operator-8d7dd4675-t55dh\" (UID: \"9e565424-7eca-4f29-8582-664fac065238\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-t55dh" Sep 10 11:12:48.874823 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:48.874532 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mfnr9\" (UniqueName: \"kubernetes.io/projected/eea0842b-55ea-4845-8e5f-61bb84d918eb-kube-api-access-mfnr9\") pod \"volume-data-source-validator-695c895bd6-ppgz5\" (UID: \"eea0842b-55ea-4845-8e5f-61bb84d918eb\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-ppgz5" Sep 10 11:12:48.874823 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:48.874564 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/7a9cb7ef-ebb9-48cc-8a51-f83540a85612-default-certificate\") pod \"router-default-879b8884d-8tjr9\" (UID: \"7a9cb7ef-ebb9-48cc-8a51-f83540a85612\") " pod="openshift-ingress/router-default-879b8884d-8tjr9" Sep 10 11:12:48.874823 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:48.874601 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n2cjt\" (UniqueName: \"kubernetes.io/projected/07ed66ee-327a-4767-a989-0cc7574b0c0f-kube-api-access-n2cjt\") pod \"cluster-monitoring-operator-6cdcc96965-cw9qc\" (UID: \"07ed66ee-327a-4767-a989-0cc7574b0c0f\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-cw9qc" Sep 10 11:12:48.874823 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:48.874640 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/74f68888-4cfe-416f-bce6-e0b42f46aef5-registry-tls\") pod \"image-registry-7864689cc9-sw6sb\" (UID: \"74f68888-4cfe-416f-bce6-e0b42f46aef5\") " pod="openshift-image-registry/image-registry-7864689cc9-sw6sb" Sep 10 11:12:48.874823 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:48.874675 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/74f68888-4cfe-416f-bce6-e0b42f46aef5-ca-trust-extracted\") pod \"image-registry-7864689cc9-sw6sb\" (UID: \"74f68888-4cfe-416f-bce6-e0b42f46aef5\") " pod="openshift-image-registry/image-registry-7864689cc9-sw6sb" Sep 10 11:12:48.874823 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:48.874714 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7f298f77-06d2-4ea6-b4fc-cb2c5e9080de-serving-cert\") pod \"console-operator-85b454874b-l2hf2\" (UID: \"7f298f77-06d2-4ea6-b4fc-cb2c5e9080de\") " pod="openshift-console-operator/console-operator-85b454874b-l2hf2" Sep 10 11:12:48.874823 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:48.874769 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/2aeac0f7-3e8b-4d33-abcc-ae757048a5cf-snapshots\") pod \"insights-operator-76bcd6ccf5-2srs4\" (UID: \"2aeac0f7-3e8b-4d33-abcc-ae757048a5cf\") " pod="openshift-insights/insights-operator-76bcd6ccf5-2srs4" Sep 10 11:12:48.874823 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:48.874800 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/2aeac0f7-3e8b-4d33-abcc-ae757048a5cf-serving-cert\") pod \"insights-operator-76bcd6ccf5-2srs4\" (UID: \"2aeac0f7-3e8b-4d33-abcc-ae757048a5cf\") " pod="openshift-insights/insights-operator-76bcd6ccf5-2srs4" Sep 10 11:12:48.874823 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:48.874824 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/7f298f77-06d2-4ea6-b4fc-cb2c5e9080de-config\") pod \"console-operator-85b454874b-l2hf2\" (UID: \"7f298f77-06d2-4ea6-b4fc-cb2c5e9080de\") " pod="openshift-console-operator/console-operator-85b454874b-l2hf2" Sep 10 11:12:48.875439 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:48.874877 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/74f68888-4cfe-416f-bce6-e0b42f46aef5-registry-certificates\") pod \"image-registry-7864689cc9-sw6sb\" (UID: \"74f68888-4cfe-416f-bce6-e0b42f46aef5\") " pod="openshift-image-registry/image-registry-7864689cc9-sw6sb" Sep 10 11:12:48.875439 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:48.874940 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/74f68888-4cfe-416f-bce6-e0b42f46aef5-bound-sa-token\") pod \"image-registry-7864689cc9-sw6sb\" (UID: \"74f68888-4cfe-416f-bce6-e0b42f46aef5\") " pod="openshift-image-registry/image-registry-7864689cc9-sw6sb" Sep 10 11:12:48.875439 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:48.874989 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/35dc51d7-6cf7-42d2-8e35-1a31a3a1ac8f-serving-cert\") pod \"service-ca-operator-859f94c4b-2kgcg\" (UID: \"35dc51d7-6cf7-42d2-8e35-1a31a3a1ac8f\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-2kgcg" Sep 10 11:12:48.875439 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:48.875029 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cx46n\" (UniqueName: \"kubernetes.io/projected/2aeac0f7-3e8b-4d33-abcc-ae757048a5cf-kube-api-access-cx46n\") pod \"insights-operator-76bcd6ccf5-2srs4\" (UID: \"2aeac0f7-3e8b-4d33-abcc-ae757048a5cf\") " pod="openshift-insights/insights-operator-76bcd6ccf5-2srs4" Sep 10 11:12:48.875439 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:48.875060 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hqr9w\" (UniqueName: \"kubernetes.io/projected/74f68888-4cfe-416f-bce6-e0b42f46aef5-kube-api-access-hqr9w\") pod \"image-registry-7864689cc9-sw6sb\" (UID: \"74f68888-4cfe-416f-bce6-e0b42f46aef5\") " pod="openshift-image-registry/image-registry-7864689cc9-sw6sb" Sep 10 11:12:48.911837 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:48.911813 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bvnw9" Sep 10 11:12:48.911979 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:48.911906 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-54z9n" Sep 10 11:12:48.915552 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:48.915531 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-qdxwv\"" Sep 10 11:12:48.915929 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:48.915591 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Sep 10 11:12:48.915980 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:48.915957 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-t7cdh\"" Sep 10 11:12:48.976082 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:48.976049 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/74f68888-4cfe-416f-bce6-e0b42f46aef5-installation-pull-secrets\") pod \"image-registry-7864689cc9-sw6sb\" (UID: \"74f68888-4cfe-416f-bce6-e0b42f46aef5\") " pod="openshift-image-registry/image-registry-7864689cc9-sw6sb" Sep 10 11:12:48.976082 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:48.976088 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1e1b3fbc-ac27-424e-85be-c2dc53c62d3e-cert\") pod \"ingress-canary-4bkc6\" (UID: \"1e1b3fbc-ac27-424e-85be-c2dc53c62d3e\") " pod="openshift-ingress-canary/ingress-canary-4bkc6" Sep 10 11:12:48.976323 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:48.976109 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7f298f77-06d2-4ea6-b4fc-cb2c5e9080de-trusted-ca\") pod \"console-operator-85b454874b-l2hf2\" (UID: \"7f298f77-06d2-4ea6-b4fc-cb2c5e9080de\") " pod="openshift-console-operator/console-operator-85b454874b-l2hf2" Sep 10 11:12:48.976323 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:48.976134 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/74f68888-4cfe-416f-bce6-e0b42f46aef5-image-registry-private-configuration\") pod \"image-registry-7864689cc9-sw6sb\" (UID: \"74f68888-4cfe-416f-bce6-e0b42f46aef5\") " pod="openshift-image-registry/image-registry-7864689cc9-sw6sb" Sep 10 11:12:48.976323 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:48.976168 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/35dc51d7-6cf7-42d2-8e35-1a31a3a1ac8f-config\") pod \"service-ca-operator-859f94c4b-2kgcg\" (UID: \"35dc51d7-6cf7-42d2-8e35-1a31a3a1ac8f\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-2kgcg" Sep 10 11:12:48.976323 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:48.976199 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/07ed66ee-327a-4767-a989-0cc7574b0c0f-telemetry-config\") pod \"cluster-monitoring-operator-6cdcc96965-cw9qc\" (UID: \"07ed66ee-327a-4767-a989-0cc7574b0c0f\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-cw9qc" Sep 10 11:12:48.976323 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:48.976226 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/3e0bbd18-8afb-43e7-8e61-04d516f482f0-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-sckxh\" (UID: \"3e0bbd18-8afb-43e7-8e61-04d516f482f0\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-sckxh" Sep 10 11:12:48.976323 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:48.976251 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/7a9cb7ef-ebb9-48cc-8a51-f83540a85612-stats-auth\") pod \"router-default-879b8884d-8tjr9\" (UID: \"7a9cb7ef-ebb9-48cc-8a51-f83540a85612\") " pod="openshift-ingress/router-default-879b8884d-8tjr9" Sep 10 11:12:48.976821 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:48.976792 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/35dc51d7-6cf7-42d2-8e35-1a31a3a1ac8f-config\") pod \"service-ca-operator-859f94c4b-2kgcg\" (UID: \"35dc51d7-6cf7-42d2-8e35-1a31a3a1ac8f\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-2kgcg" Sep 10 11:12:48.976939 ip-10-0-134-73 kubenswrapper[2564]: E0910 11:12:48.976913 2564 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Sep 10 11:12:48.976998 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:48.976934 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/68178850-698c-4ff6-82b8-b345e52851b8-config-volume\") pod \"dns-default-crh79\" (UID: \"68178850-698c-4ff6-82b8-b345e52851b8\") " pod="openshift-dns/dns-default-crh79" Sep 10 11:12:48.976998 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:48.976980 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7a9cb7ef-ebb9-48cc-8a51-f83540a85612-service-ca-bundle\") pod \"router-default-879b8884d-8tjr9\" (UID: \"7a9cb7ef-ebb9-48cc-8a51-f83540a85612\") " pod="openshift-ingress/router-default-879b8884d-8tjr9" Sep 10 11:12:48.976998 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:48.976981 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/07ed66ee-327a-4767-a989-0cc7574b0c0f-telemetry-config\") pod \"cluster-monitoring-operator-6cdcc96965-cw9qc\" (UID: \"07ed66ee-327a-4767-a989-0cc7574b0c0f\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-cw9qc" Sep 10 11:12:48.977145 ip-10-0-134-73 kubenswrapper[2564]: E0910 11:12:48.976991 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3e0bbd18-8afb-43e7-8e61-04d516f482f0-samples-operator-tls podName:3e0bbd18-8afb-43e7-8e61-04d516f482f0 nodeName:}" failed. No retries permitted until 2026-09-10 11:12:49.476975936 +0000 UTC m=+35.073537144 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/3e0bbd18-8afb-43e7-8e61-04d516f482f0-samples-operator-tls") pod "cluster-samples-operator-7cdcfcf76c-sckxh" (UID: "3e0bbd18-8afb-43e7-8e61-04d516f482f0") : secret "samples-operator-tls" not found Sep 10 11:12:48.977145 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:48.977127 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7a9cb7ef-ebb9-48cc-8a51-f83540a85612-metrics-certs\") pod \"router-default-879b8884d-8tjr9\" (UID: \"7a9cb7ef-ebb9-48cc-8a51-f83540a85612\") " pod="openshift-ingress/router-default-879b8884d-8tjr9" Sep 10 11:12:48.977261 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:48.977157 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/68178850-698c-4ff6-82b8-b345e52851b8-metrics-tls\") pod \"dns-default-crh79\" (UID: \"68178850-698c-4ff6-82b8-b345e52851b8\") " pod="openshift-dns/dns-default-crh79" Sep 10 11:12:48.977261 ip-10-0-134-73 kubenswrapper[2564]: E0910 11:12:48.977182 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7a9cb7ef-ebb9-48cc-8a51-f83540a85612-service-ca-bundle podName:7a9cb7ef-ebb9-48cc-8a51-f83540a85612 nodeName:}" failed. No retries permitted until 2026-09-10 11:12:49.477167016 +0000 UTC m=+35.073728233 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/7a9cb7ef-ebb9-48cc-8a51-f83540a85612-service-ca-bundle") pod "router-default-879b8884d-8tjr9" (UID: "7a9cb7ef-ebb9-48cc-8a51-f83540a85612") : configmap references non-existent config key: service-ca.crt Sep 10 11:12:48.977261 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:48.977227 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gjjp5\" (UniqueName: \"kubernetes.io/projected/3e0bbd18-8afb-43e7-8e61-04d516f482f0-kube-api-access-gjjp5\") pod \"cluster-samples-operator-7cdcfcf76c-sckxh\" (UID: \"3e0bbd18-8afb-43e7-8e61-04d516f482f0\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-sckxh" Sep 10 11:12:48.977261 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:48.977256 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/68178850-698c-4ff6-82b8-b345e52851b8-tmp-dir\") pod \"dns-default-crh79\" (UID: \"68178850-698c-4ff6-82b8-b345e52851b8\") " pod="openshift-dns/dns-default-crh79" Sep 10 11:12:48.977453 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:48.977291 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2nv4j\" (UniqueName: \"kubernetes.io/projected/9e565424-7eca-4f29-8582-664fac065238-kube-api-access-2nv4j\") pod \"kube-storage-version-migrator-operator-8d7dd4675-t55dh\" (UID: \"9e565424-7eca-4f29-8582-664fac065238\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-t55dh" Sep 10 11:12:48.977453 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:48.977316 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vsc45\" (UniqueName: \"kubernetes.io/projected/7f298f77-06d2-4ea6-b4fc-cb2c5e9080de-kube-api-access-vsc45\") pod \"console-operator-85b454874b-l2hf2\" (UID: \"7f298f77-06d2-4ea6-b4fc-cb2c5e9080de\") " pod="openshift-console-operator/console-operator-85b454874b-l2hf2" Sep 10 11:12:48.977453 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:48.977340 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/9e565424-7eca-4f29-8582-664fac065238-config\") pod \"kube-storage-version-migrator-operator-8d7dd4675-t55dh\" (UID: \"9e565424-7eca-4f29-8582-664fac065238\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-t55dh" Sep 10 11:12:48.977453 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:48.977368 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-94vdd\" (UniqueName: \"kubernetes.io/projected/1e1b3fbc-ac27-424e-85be-c2dc53c62d3e-kube-api-access-94vdd\") pod \"ingress-canary-4bkc6\" (UID: \"1e1b3fbc-ac27-424e-85be-c2dc53c62d3e\") " pod="openshift-ingress-canary/ingress-canary-4bkc6" Sep 10 11:12:48.977453 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:48.977394 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mfnr9\" (UniqueName: \"kubernetes.io/projected/eea0842b-55ea-4845-8e5f-61bb84d918eb-kube-api-access-mfnr9\") pod \"volume-data-source-validator-695c895bd6-ppgz5\" (UID: \"eea0842b-55ea-4845-8e5f-61bb84d918eb\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-ppgz5" Sep 10 11:12:48.977453 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:48.977424 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/7a9cb7ef-ebb9-48cc-8a51-f83540a85612-default-certificate\") pod \"router-default-879b8884d-8tjr9\" (UID: \"7a9cb7ef-ebb9-48cc-8a51-f83540a85612\") " pod="openshift-ingress/router-default-879b8884d-8tjr9" Sep 10 11:12:48.977453 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:48.977454 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n2cjt\" (UniqueName: \"kubernetes.io/projected/07ed66ee-327a-4767-a989-0cc7574b0c0f-kube-api-access-n2cjt\") pod \"cluster-monitoring-operator-6cdcc96965-cw9qc\" (UID: \"07ed66ee-327a-4767-a989-0cc7574b0c0f\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-cw9qc" Sep 10 11:12:48.977792 ip-10-0-134-73 kubenswrapper[2564]: E0910 11:12:48.977232 2564 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Sep 10 11:12:48.977792 ip-10-0-134-73 kubenswrapper[2564]: E0910 11:12:48.977539 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7a9cb7ef-ebb9-48cc-8a51-f83540a85612-metrics-certs podName:7a9cb7ef-ebb9-48cc-8a51-f83540a85612 nodeName:}" failed. No retries permitted until 2026-09-10 11:12:49.47752362 +0000 UTC m=+35.074084825 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7a9cb7ef-ebb9-48cc-8a51-f83540a85612-metrics-certs") pod "router-default-879b8884d-8tjr9" (UID: "7a9cb7ef-ebb9-48cc-8a51-f83540a85612") : secret "router-metrics-certs-default" not found Sep 10 11:12:48.977792 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:48.977482 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/74f68888-4cfe-416f-bce6-e0b42f46aef5-registry-tls\") pod \"image-registry-7864689cc9-sw6sb\" (UID: \"74f68888-4cfe-416f-bce6-e0b42f46aef5\") " pod="openshift-image-registry/image-registry-7864689cc9-sw6sb" Sep 10 11:12:48.977792 ip-10-0-134-73 kubenswrapper[2564]: E0910 11:12:48.977554 2564 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 10 11:12:48.977792 ip-10-0-134-73 kubenswrapper[2564]: E0910 11:12:48.977565 2564 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7864689cc9-sw6sb: secret "image-registry-tls" not found Sep 10 11:12:48.977792 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:48.977578 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/74f68888-4cfe-416f-bce6-e0b42f46aef5-ca-trust-extracted\") pod \"image-registry-7864689cc9-sw6sb\" (UID: \"74f68888-4cfe-416f-bce6-e0b42f46aef5\") " pod="openshift-image-registry/image-registry-7864689cc9-sw6sb" Sep 10 11:12:48.977792 ip-10-0-134-73 kubenswrapper[2564]: E0910 11:12:48.977601 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/74f68888-4cfe-416f-bce6-e0b42f46aef5-registry-tls podName:74f68888-4cfe-416f-bce6-e0b42f46aef5 nodeName:}" failed. No retries permitted until 2026-09-10 11:12:49.477588925 +0000 UTC m=+35.074150123 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/74f68888-4cfe-416f-bce6-e0b42f46aef5-registry-tls") pod "image-registry-7864689cc9-sw6sb" (UID: "74f68888-4cfe-416f-bce6-e0b42f46aef5") : secret "image-registry-tls" not found Sep 10 11:12:48.977792 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:48.977628 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7f298f77-06d2-4ea6-b4fc-cb2c5e9080de-serving-cert\") pod \"console-operator-85b454874b-l2hf2\" (UID: \"7f298f77-06d2-4ea6-b4fc-cb2c5e9080de\") " pod="openshift-console-operator/console-operator-85b454874b-l2hf2" Sep 10 11:12:48.977792 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:48.977665 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/2aeac0f7-3e8b-4d33-abcc-ae757048a5cf-snapshots\") pod \"insights-operator-76bcd6ccf5-2srs4\" (UID: \"2aeac0f7-3e8b-4d33-abcc-ae757048a5cf\") " pod="openshift-insights/insights-operator-76bcd6ccf5-2srs4" Sep 10 11:12:48.977792 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:48.977685 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/2aeac0f7-3e8b-4d33-abcc-ae757048a5cf-serving-cert\") pod \"insights-operator-76bcd6ccf5-2srs4\" (UID: \"2aeac0f7-3e8b-4d33-abcc-ae757048a5cf\") " pod="openshift-insights/insights-operator-76bcd6ccf5-2srs4" Sep 10 11:12:48.977792 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:48.977711 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/c062102c-aa53-4355-9921-4d46efdf94c9-nginx-conf\") pod \"networking-console-plugin-79977f9844-bz6mz\" (UID: \"c062102c-aa53-4355-9921-4d46efdf94c9\") " pod="openshift-network-console/networking-console-plugin-79977f9844-bz6mz" Sep 10 11:12:48.977792 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:48.977787 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/7f298f77-06d2-4ea6-b4fc-cb2c5e9080de-config\") pod \"console-operator-85b454874b-l2hf2\" (UID: \"7f298f77-06d2-4ea6-b4fc-cb2c5e9080de\") " pod="openshift-console-operator/console-operator-85b454874b-l2hf2" Sep 10 11:12:48.978339 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:48.977849 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7f298f77-06d2-4ea6-b4fc-cb2c5e9080de-trusted-ca\") pod \"console-operator-85b454874b-l2hf2\" (UID: \"7f298f77-06d2-4ea6-b4fc-cb2c5e9080de\") " pod="openshift-console-operator/console-operator-85b454874b-l2hf2" Sep 10 11:12:48.978339 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:48.977913 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/74f68888-4cfe-416f-bce6-e0b42f46aef5-ca-trust-extracted\") pod \"image-registry-7864689cc9-sw6sb\" (UID: \"74f68888-4cfe-416f-bce6-e0b42f46aef5\") " pod="openshift-image-registry/image-registry-7864689cc9-sw6sb" Sep 10 11:12:48.978339 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:48.978264 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/9e565424-7eca-4f29-8582-664fac065238-config\") pod \"kube-storage-version-migrator-operator-8d7dd4675-t55dh\" (UID: \"9e565424-7eca-4f29-8582-664fac065238\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-t55dh" Sep 10 11:12:48.978339 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:48.978322 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/7f298f77-06d2-4ea6-b4fc-cb2c5e9080de-config\") pod \"console-operator-85b454874b-l2hf2\" (UID: \"7f298f77-06d2-4ea6-b4fc-cb2c5e9080de\") " pod="openshift-console-operator/console-operator-85b454874b-l2hf2" Sep 10 11:12:48.978519 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:48.978359 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/2aeac0f7-3e8b-4d33-abcc-ae757048a5cf-snapshots\") pod \"insights-operator-76bcd6ccf5-2srs4\" (UID: \"2aeac0f7-3e8b-4d33-abcc-ae757048a5cf\") " pod="openshift-insights/insights-operator-76bcd6ccf5-2srs4" Sep 10 11:12:48.978519 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:48.978501 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/74f68888-4cfe-416f-bce6-e0b42f46aef5-registry-certificates\") pod \"image-registry-7864689cc9-sw6sb\" (UID: \"74f68888-4cfe-416f-bce6-e0b42f46aef5\") " pod="openshift-image-registry/image-registry-7864689cc9-sw6sb" Sep 10 11:12:48.979444 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:48.978777 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/74f68888-4cfe-416f-bce6-e0b42f46aef5-bound-sa-token\") pod \"image-registry-7864689cc9-sw6sb\" (UID: \"74f68888-4cfe-416f-bce6-e0b42f46aef5\") " pod="openshift-image-registry/image-registry-7864689cc9-sw6sb" Sep 10 11:12:48.979444 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:48.978815 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/35dc51d7-6cf7-42d2-8e35-1a31a3a1ac8f-serving-cert\") pod \"service-ca-operator-859f94c4b-2kgcg\" (UID: \"35dc51d7-6cf7-42d2-8e35-1a31a3a1ac8f\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-2kgcg" Sep 10 11:12:48.979444 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:48.978846 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cx46n\" (UniqueName: \"kubernetes.io/projected/2aeac0f7-3e8b-4d33-abcc-ae757048a5cf-kube-api-access-cx46n\") pod \"insights-operator-76bcd6ccf5-2srs4\" (UID: \"2aeac0f7-3e8b-4d33-abcc-ae757048a5cf\") " pod="openshift-insights/insights-operator-76bcd6ccf5-2srs4" Sep 10 11:12:48.979444 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:48.978897 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9sgz5\" (UniqueName: \"kubernetes.io/projected/68178850-698c-4ff6-82b8-b345e52851b8-kube-api-access-9sgz5\") pod \"dns-default-crh79\" (UID: \"68178850-698c-4ff6-82b8-b345e52851b8\") " pod="openshift-dns/dns-default-crh79" Sep 10 11:12:48.979444 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:48.978923 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hqr9w\" (UniqueName: \"kubernetes.io/projected/74f68888-4cfe-416f-bce6-e0b42f46aef5-kube-api-access-hqr9w\") pod \"image-registry-7864689cc9-sw6sb\" (UID: \"74f68888-4cfe-416f-bce6-e0b42f46aef5\") " pod="openshift-image-registry/image-registry-7864689cc9-sw6sb" Sep 10 11:12:48.979444 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:48.978948 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c062102c-aa53-4355-9921-4d46efdf94c9-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-bz6mz\" (UID: \"c062102c-aa53-4355-9921-4d46efdf94c9\") " pod="openshift-network-console/networking-console-plugin-79977f9844-bz6mz" Sep 10 11:12:48.979444 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:48.978985 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/9e565424-7eca-4f29-8582-664fac065238-serving-cert\") pod \"kube-storage-version-migrator-operator-8d7dd4675-t55dh\" (UID: \"9e565424-7eca-4f29-8582-664fac065238\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-t55dh" Sep 10 11:12:48.979444 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:48.979019 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8q7bw\" (UniqueName: \"kubernetes.io/projected/7a9cb7ef-ebb9-48cc-8a51-f83540a85612-kube-api-access-8q7bw\") pod \"router-default-879b8884d-8tjr9\" (UID: \"7a9cb7ef-ebb9-48cc-8a51-f83540a85612\") " pod="openshift-ingress/router-default-879b8884d-8tjr9" Sep 10 11:12:48.979444 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:48.979019 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/74f68888-4cfe-416f-bce6-e0b42f46aef5-registry-certificates\") pod \"image-registry-7864689cc9-sw6sb\" (UID: \"74f68888-4cfe-416f-bce6-e0b42f46aef5\") " pod="openshift-image-registry/image-registry-7864689cc9-sw6sb" Sep 10 11:12:48.979444 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:48.979047 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2aeac0f7-3e8b-4d33-abcc-ae757048a5cf-trusted-ca-bundle\") pod \"insights-operator-76bcd6ccf5-2srs4\" (UID: \"2aeac0f7-3e8b-4d33-abcc-ae757048a5cf\") " pod="openshift-insights/insights-operator-76bcd6ccf5-2srs4" Sep 10 11:12:48.979444 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:48.979111 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m7n54\" (UniqueName: \"kubernetes.io/projected/35dc51d7-6cf7-42d2-8e35-1a31a3a1ac8f-kube-api-access-m7n54\") pod \"service-ca-operator-859f94c4b-2kgcg\" (UID: \"35dc51d7-6cf7-42d2-8e35-1a31a3a1ac8f\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-2kgcg" Sep 10 11:12:48.979444 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:48.979164 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/07ed66ee-327a-4767-a989-0cc7574b0c0f-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-cw9qc\" (UID: \"07ed66ee-327a-4767-a989-0cc7574b0c0f\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-cw9qc" Sep 10 11:12:48.979444 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:48.979210 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/74f68888-4cfe-416f-bce6-e0b42f46aef5-trusted-ca\") pod \"image-registry-7864689cc9-sw6sb\" (UID: \"74f68888-4cfe-416f-bce6-e0b42f46aef5\") " pod="openshift-image-registry/image-registry-7864689cc9-sw6sb" Sep 10 11:12:48.979444 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:48.979236 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2aeac0f7-3e8b-4d33-abcc-ae757048a5cf-tmp\") pod \"insights-operator-76bcd6ccf5-2srs4\" (UID: \"2aeac0f7-3e8b-4d33-abcc-ae757048a5cf\") " pod="openshift-insights/insights-operator-76bcd6ccf5-2srs4" Sep 10 11:12:48.979444 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:48.979266 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2aeac0f7-3e8b-4d33-abcc-ae757048a5cf-service-ca-bundle\") pod \"insights-operator-76bcd6ccf5-2srs4\" (UID: \"2aeac0f7-3e8b-4d33-abcc-ae757048a5cf\") " pod="openshift-insights/insights-operator-76bcd6ccf5-2srs4" Sep 10 11:12:48.980306 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:48.979313 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qt8pw\" (UniqueName: \"kubernetes.io/projected/341ed071-292a-4066-b98a-3cf04a4cbf93-kube-api-access-qt8pw\") pod \"network-check-source-685456655f-z7mhl\" (UID: \"341ed071-292a-4066-b98a-3cf04a4cbf93\") " pod="openshift-network-diagnostics/network-check-source-685456655f-z7mhl" Sep 10 11:12:48.981913 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:48.980544 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2aeac0f7-3e8b-4d33-abcc-ae757048a5cf-service-ca-bundle\") pod \"insights-operator-76bcd6ccf5-2srs4\" (UID: \"2aeac0f7-3e8b-4d33-abcc-ae757048a5cf\") " pod="openshift-insights/insights-operator-76bcd6ccf5-2srs4" Sep 10 11:12:48.981913 ip-10-0-134-73 kubenswrapper[2564]: E0910 11:12:48.980625 2564 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Sep 10 11:12:48.981913 ip-10-0-134-73 kubenswrapper[2564]: E0910 11:12:48.980679 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/07ed66ee-327a-4767-a989-0cc7574b0c0f-cluster-monitoring-operator-tls podName:07ed66ee-327a-4767-a989-0cc7574b0c0f nodeName:}" failed. No retries permitted until 2026-09-10 11:12:49.48066507 +0000 UTC m=+35.077226263 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/07ed66ee-327a-4767-a989-0cc7574b0c0f-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cdcc96965-cw9qc" (UID: "07ed66ee-327a-4767-a989-0cc7574b0c0f") : secret "cluster-monitoring-operator-tls" not found Sep 10 11:12:48.981913 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:48.980945 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2aeac0f7-3e8b-4d33-abcc-ae757048a5cf-tmp\") pod \"insights-operator-76bcd6ccf5-2srs4\" (UID: \"2aeac0f7-3e8b-4d33-abcc-ae757048a5cf\") " pod="openshift-insights/insights-operator-76bcd6ccf5-2srs4" Sep 10 11:12:48.981913 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:48.981786 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2aeac0f7-3e8b-4d33-abcc-ae757048a5cf-trusted-ca-bundle\") pod \"insights-operator-76bcd6ccf5-2srs4\" (UID: \"2aeac0f7-3e8b-4d33-abcc-ae757048a5cf\") " pod="openshift-insights/insights-operator-76bcd6ccf5-2srs4" Sep 10 11:12:48.981913 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:48.981826 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/74f68888-4cfe-416f-bce6-e0b42f46aef5-trusted-ca\") pod \"image-registry-7864689cc9-sw6sb\" (UID: \"74f68888-4cfe-416f-bce6-e0b42f46aef5\") " pod="openshift-image-registry/image-registry-7864689cc9-sw6sb" Sep 10 11:12:48.982249 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:48.981920 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/74f68888-4cfe-416f-bce6-e0b42f46aef5-image-registry-private-configuration\") pod \"image-registry-7864689cc9-sw6sb\" (UID: \"74f68888-4cfe-416f-bce6-e0b42f46aef5\") " pod="openshift-image-registry/image-registry-7864689cc9-sw6sb" Sep 10 11:12:48.982249 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:48.982169 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/7a9cb7ef-ebb9-48cc-8a51-f83540a85612-stats-auth\") pod \"router-default-879b8884d-8tjr9\" (UID: \"7a9cb7ef-ebb9-48cc-8a51-f83540a85612\") " pod="openshift-ingress/router-default-879b8884d-8tjr9" Sep 10 11:12:48.982249 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:48.982230 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/74f68888-4cfe-416f-bce6-e0b42f46aef5-installation-pull-secrets\") pod \"image-registry-7864689cc9-sw6sb\" (UID: \"74f68888-4cfe-416f-bce6-e0b42f46aef5\") " pod="openshift-image-registry/image-registry-7864689cc9-sw6sb" Sep 10 11:12:48.982383 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:48.982286 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/7a9cb7ef-ebb9-48cc-8a51-f83540a85612-default-certificate\") pod \"router-default-879b8884d-8tjr9\" (UID: \"7a9cb7ef-ebb9-48cc-8a51-f83540a85612\") " pod="openshift-ingress/router-default-879b8884d-8tjr9" Sep 10 11:12:48.982436 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:48.982395 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/9e565424-7eca-4f29-8582-664fac065238-serving-cert\") pod \"kube-storage-version-migrator-operator-8d7dd4675-t55dh\" (UID: \"9e565424-7eca-4f29-8582-664fac065238\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-t55dh" Sep 10 11:12:48.982554 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:48.982533 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/2aeac0f7-3e8b-4d33-abcc-ae757048a5cf-serving-cert\") pod \"insights-operator-76bcd6ccf5-2srs4\" (UID: \"2aeac0f7-3e8b-4d33-abcc-ae757048a5cf\") " pod="openshift-insights/insights-operator-76bcd6ccf5-2srs4" Sep 10 11:12:48.983161 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:48.983137 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7f298f77-06d2-4ea6-b4fc-cb2c5e9080de-serving-cert\") pod \"console-operator-85b454874b-l2hf2\" (UID: \"7f298f77-06d2-4ea6-b4fc-cb2c5e9080de\") " pod="openshift-console-operator/console-operator-85b454874b-l2hf2" Sep 10 11:12:48.984344 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:48.984324 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/35dc51d7-6cf7-42d2-8e35-1a31a3a1ac8f-serving-cert\") pod \"service-ca-operator-859f94c4b-2kgcg\" (UID: \"35dc51d7-6cf7-42d2-8e35-1a31a3a1ac8f\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-2kgcg" Sep 10 11:12:48.991115 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:48.991095 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gjjp5\" (UniqueName: \"kubernetes.io/projected/3e0bbd18-8afb-43e7-8e61-04d516f482f0-kube-api-access-gjjp5\") pod \"cluster-samples-operator-7cdcfcf76c-sckxh\" (UID: \"3e0bbd18-8afb-43e7-8e61-04d516f482f0\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-sckxh" Sep 10 11:12:48.999667 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:48.999621 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m7n54\" (UniqueName: \"kubernetes.io/projected/35dc51d7-6cf7-42d2-8e35-1a31a3a1ac8f-kube-api-access-m7n54\") pod \"service-ca-operator-859f94c4b-2kgcg\" (UID: \"35dc51d7-6cf7-42d2-8e35-1a31a3a1ac8f\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-2kgcg" Sep 10 11:12:49.000754 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:49.000737 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hqr9w\" (UniqueName: \"kubernetes.io/projected/74f68888-4cfe-416f-bce6-e0b42f46aef5-kube-api-access-hqr9w\") pod \"image-registry-7864689cc9-sw6sb\" (UID: \"74f68888-4cfe-416f-bce6-e0b42f46aef5\") " pod="openshift-image-registry/image-registry-7864689cc9-sw6sb" Sep 10 11:12:49.001450 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:49.001430 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8q7bw\" (UniqueName: \"kubernetes.io/projected/7a9cb7ef-ebb9-48cc-8a51-f83540a85612-kube-api-access-8q7bw\") pod \"router-default-879b8884d-8tjr9\" (UID: \"7a9cb7ef-ebb9-48cc-8a51-f83540a85612\") " pod="openshift-ingress/router-default-879b8884d-8tjr9" Sep 10 11:12:49.002280 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:49.002219 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/74f68888-4cfe-416f-bce6-e0b42f46aef5-bound-sa-token\") pod \"image-registry-7864689cc9-sw6sb\" (UID: \"74f68888-4cfe-416f-bce6-e0b42f46aef5\") " pod="openshift-image-registry/image-registry-7864689cc9-sw6sb" Sep 10 11:12:49.002493 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:49.002471 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n2cjt\" (UniqueName: \"kubernetes.io/projected/07ed66ee-327a-4767-a989-0cc7574b0c0f-kube-api-access-n2cjt\") pod \"cluster-monitoring-operator-6cdcc96965-cw9qc\" (UID: \"07ed66ee-327a-4767-a989-0cc7574b0c0f\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-cw9qc" Sep 10 11:12:49.004264 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:49.004239 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mfnr9\" (UniqueName: \"kubernetes.io/projected/eea0842b-55ea-4845-8e5f-61bb84d918eb-kube-api-access-mfnr9\") pod \"volume-data-source-validator-695c895bd6-ppgz5\" (UID: \"eea0842b-55ea-4845-8e5f-61bb84d918eb\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-ppgz5" Sep 10 11:12:49.004483 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:49.004465 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cx46n\" (UniqueName: \"kubernetes.io/projected/2aeac0f7-3e8b-4d33-abcc-ae757048a5cf-kube-api-access-cx46n\") pod \"insights-operator-76bcd6ccf5-2srs4\" (UID: \"2aeac0f7-3e8b-4d33-abcc-ae757048a5cf\") " pod="openshift-insights/insights-operator-76bcd6ccf5-2srs4" Sep 10 11:12:49.011591 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:49.011569 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vsc45\" (UniqueName: \"kubernetes.io/projected/7f298f77-06d2-4ea6-b4fc-cb2c5e9080de-kube-api-access-vsc45\") pod \"console-operator-85b454874b-l2hf2\" (UID: \"7f298f77-06d2-4ea6-b4fc-cb2c5e9080de\") " pod="openshift-console-operator/console-operator-85b454874b-l2hf2" Sep 10 11:12:49.012072 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:49.012054 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2nv4j\" (UniqueName: \"kubernetes.io/projected/9e565424-7eca-4f29-8582-664fac065238-kube-api-access-2nv4j\") pod \"kube-storage-version-migrator-operator-8d7dd4675-t55dh\" (UID: \"9e565424-7eca-4f29-8582-664fac065238\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-t55dh" Sep 10 11:12:49.080115 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:49.080078 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/c062102c-aa53-4355-9921-4d46efdf94c9-nginx-conf\") pod \"networking-console-plugin-79977f9844-bz6mz\" (UID: \"c062102c-aa53-4355-9921-4d46efdf94c9\") " pod="openshift-network-console/networking-console-plugin-79977f9844-bz6mz" Sep 10 11:12:49.080115 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:49.080124 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9sgz5\" (UniqueName: \"kubernetes.io/projected/68178850-698c-4ff6-82b8-b345e52851b8-kube-api-access-9sgz5\") pod \"dns-default-crh79\" (UID: \"68178850-698c-4ff6-82b8-b345e52851b8\") " pod="openshift-dns/dns-default-crh79" Sep 10 11:12:49.080352 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:49.080145 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c062102c-aa53-4355-9921-4d46efdf94c9-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-bz6mz\" (UID: \"c062102c-aa53-4355-9921-4d46efdf94c9\") " pod="openshift-network-console/networking-console-plugin-79977f9844-bz6mz" Sep 10 11:12:49.080352 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:49.080211 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qt8pw\" (UniqueName: \"kubernetes.io/projected/341ed071-292a-4066-b98a-3cf04a4cbf93-kube-api-access-qt8pw\") pod \"network-check-source-685456655f-z7mhl\" (UID: \"341ed071-292a-4066-b98a-3cf04a4cbf93\") " pod="openshift-network-diagnostics/network-check-source-685456655f-z7mhl" Sep 10 11:12:49.080352 ip-10-0-134-73 kubenswrapper[2564]: E0910 11:12:49.080305 2564 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Sep 10 11:12:49.080499 ip-10-0-134-73 kubenswrapper[2564]: E0910 11:12:49.080373 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c062102c-aa53-4355-9921-4d46efdf94c9-networking-console-plugin-cert podName:c062102c-aa53-4355-9921-4d46efdf94c9 nodeName:}" failed. No retries permitted until 2026-09-10 11:12:49.580353591 +0000 UTC m=+35.176914798 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/c062102c-aa53-4355-9921-4d46efdf94c9-networking-console-plugin-cert") pod "networking-console-plugin-79977f9844-bz6mz" (UID: "c062102c-aa53-4355-9921-4d46efdf94c9") : secret "networking-console-plugin-cert" not found Sep 10 11:12:49.080499 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:49.080411 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1e1b3fbc-ac27-424e-85be-c2dc53c62d3e-cert\") pod \"ingress-canary-4bkc6\" (UID: \"1e1b3fbc-ac27-424e-85be-c2dc53c62d3e\") " pod="openshift-ingress-canary/ingress-canary-4bkc6" Sep 10 11:12:49.080499 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:49.080463 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/68178850-698c-4ff6-82b8-b345e52851b8-config-volume\") pod \"dns-default-crh79\" (UID: \"68178850-698c-4ff6-82b8-b345e52851b8\") " pod="openshift-dns/dns-default-crh79" Sep 10 11:12:49.080672 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:49.080512 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/68178850-698c-4ff6-82b8-b345e52851b8-metrics-tls\") pod \"dns-default-crh79\" (UID: \"68178850-698c-4ff6-82b8-b345e52851b8\") " pod="openshift-dns/dns-default-crh79" Sep 10 11:12:49.080672 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:49.080536 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/68178850-698c-4ff6-82b8-b345e52851b8-tmp-dir\") pod \"dns-default-crh79\" (UID: \"68178850-698c-4ff6-82b8-b345e52851b8\") " pod="openshift-dns/dns-default-crh79" Sep 10 11:12:49.080672 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:49.080586 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-94vdd\" (UniqueName: \"kubernetes.io/projected/1e1b3fbc-ac27-424e-85be-c2dc53c62d3e-kube-api-access-94vdd\") pod \"ingress-canary-4bkc6\" (UID: \"1e1b3fbc-ac27-424e-85be-c2dc53c62d3e\") " pod="openshift-ingress-canary/ingress-canary-4bkc6" Sep 10 11:12:49.080834 ip-10-0-134-73 kubenswrapper[2564]: E0910 11:12:49.080792 2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 10 11:12:49.080915 ip-10-0-134-73 kubenswrapper[2564]: E0910 11:12:49.080839 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/68178850-698c-4ff6-82b8-b345e52851b8-metrics-tls podName:68178850-698c-4ff6-82b8-b345e52851b8 nodeName:}" failed. No retries permitted until 2026-09-10 11:12:49.580827619 +0000 UTC m=+35.177388813 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/68178850-698c-4ff6-82b8-b345e52851b8-metrics-tls") pod "dns-default-crh79" (UID: "68178850-698c-4ff6-82b8-b345e52851b8") : secret "dns-default-metrics-tls" not found Sep 10 11:12:49.081007 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:49.080980 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/c062102c-aa53-4355-9921-4d46efdf94c9-nginx-conf\") pod \"networking-console-plugin-79977f9844-bz6mz\" (UID: \"c062102c-aa53-4355-9921-4d46efdf94c9\") " pod="openshift-network-console/networking-console-plugin-79977f9844-bz6mz" Sep 10 11:12:49.081139 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:49.081016 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/68178850-698c-4ff6-82b8-b345e52851b8-tmp-dir\") pod \"dns-default-crh79\" (UID: \"68178850-698c-4ff6-82b8-b345e52851b8\") " pod="openshift-dns/dns-default-crh79" Sep 10 11:12:49.081216 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:49.081196 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/68178850-698c-4ff6-82b8-b345e52851b8-config-volume\") pod \"dns-default-crh79\" (UID: \"68178850-698c-4ff6-82b8-b345e52851b8\") " pod="openshift-dns/dns-default-crh79" Sep 10 11:12:49.083076 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:49.083056 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1e1b3fbc-ac27-424e-85be-c2dc53c62d3e-cert\") pod \"ingress-canary-4bkc6\" (UID: \"1e1b3fbc-ac27-424e-85be-c2dc53c62d3e\") " pod="openshift-ingress-canary/ingress-canary-4bkc6" Sep 10 11:12:49.089715 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:49.089693 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qt8pw\" (UniqueName: \"kubernetes.io/projected/341ed071-292a-4066-b98a-3cf04a4cbf93-kube-api-access-qt8pw\") pod \"network-check-source-685456655f-z7mhl\" (UID: \"341ed071-292a-4066-b98a-3cf04a4cbf93\") " pod="openshift-network-diagnostics/network-check-source-685456655f-z7mhl" Sep 10 11:12:49.094681 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:49.094652 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-94vdd\" (UniqueName: \"kubernetes.io/projected/1e1b3fbc-ac27-424e-85be-c2dc53c62d3e-kube-api-access-94vdd\") pod \"ingress-canary-4bkc6\" (UID: \"1e1b3fbc-ac27-424e-85be-c2dc53c62d3e\") " pod="openshift-ingress-canary/ingress-canary-4bkc6" Sep 10 11:12:49.094753 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:49.094723 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9sgz5\" (UniqueName: \"kubernetes.io/projected/68178850-698c-4ff6-82b8-b345e52851b8-kube-api-access-9sgz5\") pod \"dns-default-crh79\" (UID: \"68178850-698c-4ff6-82b8-b345e52851b8\") " pod="openshift-dns/dns-default-crh79" Sep 10 11:12:49.118863 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:49.118827 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-t55dh" Sep 10 11:12:49.130334 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:49.130312 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-ppgz5" Sep 10 11:12:49.151642 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:49.151622 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-76bcd6ccf5-2srs4" Sep 10 11:12:49.160256 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:49.160237 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-85b454874b-l2hf2" Sep 10 11:12:49.168993 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:49.168971 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-2kgcg" Sep 10 11:12:49.185655 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:49.185629 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pq4ct_77142edb-57e1-4da1-8eba-f104366a851f/konnectivity-agent/0.log" limit=1024 Sep 10 11:12:49.193257 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:49.193234 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-4bkc6" Sep 10 11:12:49.200992 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:49.200970 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-685456655f-z7mhl" Sep 10 11:12:49.293725 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:49.293691 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pq4ct_77142edb-57e1-4da1-8eba-f104366a851f/konnectivity-agent/0.log" limit=1024 Sep 10 11:12:49.484226 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:49.484142 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/74f68888-4cfe-416f-bce6-e0b42f46aef5-registry-tls\") pod \"image-registry-7864689cc9-sw6sb\" (UID: \"74f68888-4cfe-416f-bce6-e0b42f46aef5\") " pod="openshift-image-registry/image-registry-7864689cc9-sw6sb" Sep 10 11:12:49.484385 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:49.484320 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/07ed66ee-327a-4767-a989-0cc7574b0c0f-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-cw9qc\" (UID: \"07ed66ee-327a-4767-a989-0cc7574b0c0f\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-cw9qc" Sep 10 11:12:49.484385 ip-10-0-134-73 kubenswrapper[2564]: E0910 11:12:49.484330 2564 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 10 11:12:49.484385 ip-10-0-134-73 kubenswrapper[2564]: E0910 11:12:49.484354 2564 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7864689cc9-sw6sb: secret "image-registry-tls" not found Sep 10 11:12:49.484385 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:49.484380 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/3e0bbd18-8afb-43e7-8e61-04d516f482f0-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-sckxh\" (UID: \"3e0bbd18-8afb-43e7-8e61-04d516f482f0\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-sckxh" Sep 10 11:12:49.484573 ip-10-0-134-73 kubenswrapper[2564]: E0910 11:12:49.484419 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/74f68888-4cfe-416f-bce6-e0b42f46aef5-registry-tls podName:74f68888-4cfe-416f-bce6-e0b42f46aef5 nodeName:}" failed. No retries permitted until 2026-09-10 11:12:50.484398405 +0000 UTC m=+36.080959599 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/74f68888-4cfe-416f-bce6-e0b42f46aef5-registry-tls") pod "image-registry-7864689cc9-sw6sb" (UID: "74f68888-4cfe-416f-bce6-e0b42f46aef5") : secret "image-registry-tls" not found Sep 10 11:12:49.484573 ip-10-0-134-73 kubenswrapper[2564]: E0910 11:12:49.484449 2564 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Sep 10 11:12:49.484573 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:49.484445 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7a9cb7ef-ebb9-48cc-8a51-f83540a85612-service-ca-bundle\") pod \"router-default-879b8884d-8tjr9\" (UID: \"7a9cb7ef-ebb9-48cc-8a51-f83540a85612\") " pod="openshift-ingress/router-default-879b8884d-8tjr9" Sep 10 11:12:49.484573 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:49.484486 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7a9cb7ef-ebb9-48cc-8a51-f83540a85612-metrics-certs\") pod \"router-default-879b8884d-8tjr9\" (UID: \"7a9cb7ef-ebb9-48cc-8a51-f83540a85612\") " pod="openshift-ingress/router-default-879b8884d-8tjr9" Sep 10 11:12:49.484573 ip-10-0-134-73 kubenswrapper[2564]: E0910 11:12:49.484506 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/07ed66ee-327a-4767-a989-0cc7574b0c0f-cluster-monitoring-operator-tls podName:07ed66ee-327a-4767-a989-0cc7574b0c0f nodeName:}" failed. No retries permitted until 2026-09-10 11:12:50.484489671 +0000 UTC m=+36.081050876 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/07ed66ee-327a-4767-a989-0cc7574b0c0f-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cdcc96965-cw9qc" (UID: "07ed66ee-327a-4767-a989-0cc7574b0c0f") : secret "cluster-monitoring-operator-tls" not found Sep 10 11:12:49.484573 ip-10-0-134-73 kubenswrapper[2564]: E0910 11:12:49.484455 2564 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Sep 10 11:12:49.484573 ip-10-0-134-73 kubenswrapper[2564]: E0910 11:12:49.484542 2564 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Sep 10 11:12:49.484922 ip-10-0-134-73 kubenswrapper[2564]: E0910 11:12:49.484591 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7a9cb7ef-ebb9-48cc-8a51-f83540a85612-service-ca-bundle podName:7a9cb7ef-ebb9-48cc-8a51-f83540a85612 nodeName:}" failed. No retries permitted until 2026-09-10 11:12:50.484570372 +0000 UTC m=+36.081131571 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/7a9cb7ef-ebb9-48cc-8a51-f83540a85612-service-ca-bundle") pod "router-default-879b8884d-8tjr9" (UID: "7a9cb7ef-ebb9-48cc-8a51-f83540a85612") : configmap references non-existent config key: service-ca.crt Sep 10 11:12:49.484922 ip-10-0-134-73 kubenswrapper[2564]: E0910 11:12:49.484617 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3e0bbd18-8afb-43e7-8e61-04d516f482f0-samples-operator-tls podName:3e0bbd18-8afb-43e7-8e61-04d516f482f0 nodeName:}" failed. No retries permitted until 2026-09-10 11:12:50.48460703 +0000 UTC m=+36.081168227 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/3e0bbd18-8afb-43e7-8e61-04d516f482f0-samples-operator-tls") pod "cluster-samples-operator-7cdcfcf76c-sckxh" (UID: "3e0bbd18-8afb-43e7-8e61-04d516f482f0") : secret "samples-operator-tls" not found Sep 10 11:12:49.484922 ip-10-0-134-73 kubenswrapper[2564]: E0910 11:12:49.484636 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7a9cb7ef-ebb9-48cc-8a51-f83540a85612-metrics-certs podName:7a9cb7ef-ebb9-48cc-8a51-f83540a85612 nodeName:}" failed. No retries permitted until 2026-09-10 11:12:50.484627588 +0000 UTC m=+36.081188781 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7a9cb7ef-ebb9-48cc-8a51-f83540a85612-metrics-certs") pod "router-default-879b8884d-8tjr9" (UID: "7a9cb7ef-ebb9-48cc-8a51-f83540a85612") : secret "router-metrics-certs-default" not found Sep 10 11:12:49.585394 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:49.585354 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/68178850-698c-4ff6-82b8-b345e52851b8-metrics-tls\") pod \"dns-default-crh79\" (UID: \"68178850-698c-4ff6-82b8-b345e52851b8\") " pod="openshift-dns/dns-default-crh79" Sep 10 11:12:49.585568 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:49.585474 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c062102c-aa53-4355-9921-4d46efdf94c9-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-bz6mz\" (UID: \"c062102c-aa53-4355-9921-4d46efdf94c9\") " pod="openshift-network-console/networking-console-plugin-79977f9844-bz6mz" Sep 10 11:12:49.585568 ip-10-0-134-73 kubenswrapper[2564]: E0910 11:12:49.585527 2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 10 11:12:49.585695 ip-10-0-134-73 kubenswrapper[2564]: E0910 11:12:49.585608 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/68178850-698c-4ff6-82b8-b345e52851b8-metrics-tls podName:68178850-698c-4ff6-82b8-b345e52851b8 nodeName:}" failed. No retries permitted until 2026-09-10 11:12:50.585586535 +0000 UTC m=+36.182147751 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/68178850-698c-4ff6-82b8-b345e52851b8-metrics-tls") pod "dns-default-crh79" (UID: "68178850-698c-4ff6-82b8-b345e52851b8") : secret "dns-default-metrics-tls" not found Sep 10 11:12:49.585695 ip-10-0-134-73 kubenswrapper[2564]: E0910 11:12:49.585611 2564 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Sep 10 11:12:49.585695 ip-10-0-134-73 kubenswrapper[2564]: E0910 11:12:49.585666 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c062102c-aa53-4355-9921-4d46efdf94c9-networking-console-plugin-cert podName:c062102c-aa53-4355-9921-4d46efdf94c9 nodeName:}" failed. No retries permitted until 2026-09-10 11:12:50.585653855 +0000 UTC m=+36.182215049 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/c062102c-aa53-4355-9921-4d46efdf94c9-networking-console-plugin-cert") pod "networking-console-plugin-79977f9844-bz6mz" (UID: "c062102c-aa53-4355-9921-4d46efdf94c9") : secret "networking-console-plugin-cert" not found Sep 10 11:12:49.912600 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:49.912516 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kxss9" Sep 10 11:12:49.915324 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:49.915298 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Sep 10 11:12:50.493744 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:50.493710 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/74f68888-4cfe-416f-bce6-e0b42f46aef5-registry-tls\") pod \"image-registry-7864689cc9-sw6sb\" (UID: \"74f68888-4cfe-416f-bce6-e0b42f46aef5\") " pod="openshift-image-registry/image-registry-7864689cc9-sw6sb" Sep 10 11:12:50.494192 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:50.493781 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/07ed66ee-327a-4767-a989-0cc7574b0c0f-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-cw9qc\" (UID: \"07ed66ee-327a-4767-a989-0cc7574b0c0f\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-cw9qc" Sep 10 11:12:50.494192 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:50.493836 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/3e0bbd18-8afb-43e7-8e61-04d516f482f0-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-sckxh\" (UID: \"3e0bbd18-8afb-43e7-8e61-04d516f482f0\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-sckxh" Sep 10 11:12:50.494192 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:50.493879 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7a9cb7ef-ebb9-48cc-8a51-f83540a85612-service-ca-bundle\") pod \"router-default-879b8884d-8tjr9\" (UID: \"7a9cb7ef-ebb9-48cc-8a51-f83540a85612\") " pod="openshift-ingress/router-default-879b8884d-8tjr9" Sep 10 11:12:50.494192 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:50.493905 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7a9cb7ef-ebb9-48cc-8a51-f83540a85612-metrics-certs\") pod \"router-default-879b8884d-8tjr9\" (UID: \"7a9cb7ef-ebb9-48cc-8a51-f83540a85612\") " pod="openshift-ingress/router-default-879b8884d-8tjr9" Sep 10 11:12:50.494192 ip-10-0-134-73 kubenswrapper[2564]: E0910 11:12:50.493926 2564 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 10 11:12:50.494192 ip-10-0-134-73 kubenswrapper[2564]: E0910 11:12:50.493950 2564 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7864689cc9-sw6sb: secret "image-registry-tls" not found Sep 10 11:12:50.494192 ip-10-0-134-73 kubenswrapper[2564]: E0910 11:12:50.493963 2564 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Sep 10 11:12:50.494192 ip-10-0-134-73 kubenswrapper[2564]: E0910 11:12:50.493963 2564 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Sep 10 11:12:50.494192 ip-10-0-134-73 kubenswrapper[2564]: E0910 11:12:50.494010 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/74f68888-4cfe-416f-bce6-e0b42f46aef5-registry-tls podName:74f68888-4cfe-416f-bce6-e0b42f46aef5 nodeName:}" failed. No retries permitted until 2026-09-10 11:12:52.49399096 +0000 UTC m=+38.090552171 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/74f68888-4cfe-416f-bce6-e0b42f46aef5-registry-tls") pod "image-registry-7864689cc9-sw6sb" (UID: "74f68888-4cfe-416f-bce6-e0b42f46aef5") : secret "image-registry-tls" not found Sep 10 11:12:50.494192 ip-10-0-134-73 kubenswrapper[2564]: E0910 11:12:50.494020 2564 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Sep 10 11:12:50.494192 ip-10-0-134-73 kubenswrapper[2564]: E0910 11:12:50.494032 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7a9cb7ef-ebb9-48cc-8a51-f83540a85612-service-ca-bundle podName:7a9cb7ef-ebb9-48cc-8a51-f83540a85612 nodeName:}" failed. No retries permitted until 2026-09-10 11:12:52.49401857 +0000 UTC m=+38.090579780 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/7a9cb7ef-ebb9-48cc-8a51-f83540a85612-service-ca-bundle") pod "router-default-879b8884d-8tjr9" (UID: "7a9cb7ef-ebb9-48cc-8a51-f83540a85612") : configmap references non-existent config key: service-ca.crt Sep 10 11:12:50.494192 ip-10-0-134-73 kubenswrapper[2564]: E0910 11:12:50.494055 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3e0bbd18-8afb-43e7-8e61-04d516f482f0-samples-operator-tls podName:3e0bbd18-8afb-43e7-8e61-04d516f482f0 nodeName:}" failed. No retries permitted until 2026-09-10 11:12:52.494042671 +0000 UTC m=+38.090603878 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/3e0bbd18-8afb-43e7-8e61-04d516f482f0-samples-operator-tls") pod "cluster-samples-operator-7cdcfcf76c-sckxh" (UID: "3e0bbd18-8afb-43e7-8e61-04d516f482f0") : secret "samples-operator-tls" not found Sep 10 11:12:50.494192 ip-10-0-134-73 kubenswrapper[2564]: E0910 11:12:50.494077 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7a9cb7ef-ebb9-48cc-8a51-f83540a85612-metrics-certs podName:7a9cb7ef-ebb9-48cc-8a51-f83540a85612 nodeName:}" failed. No retries permitted until 2026-09-10 11:12:52.49406217 +0000 UTC m=+38.090623385 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7a9cb7ef-ebb9-48cc-8a51-f83540a85612-metrics-certs") pod "router-default-879b8884d-8tjr9" (UID: "7a9cb7ef-ebb9-48cc-8a51-f83540a85612") : secret "router-metrics-certs-default" not found Sep 10 11:12:50.494192 ip-10-0-134-73 kubenswrapper[2564]: E0910 11:12:50.494097 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/07ed66ee-327a-4767-a989-0cc7574b0c0f-cluster-monitoring-operator-tls podName:07ed66ee-327a-4767-a989-0cc7574b0c0f nodeName:}" failed. No retries permitted until 2026-09-10 11:12:52.494086887 +0000 UTC m=+38.090648080 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/07ed66ee-327a-4767-a989-0cc7574b0c0f-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cdcc96965-cw9qc" (UID: "07ed66ee-327a-4767-a989-0cc7574b0c0f") : secret "cluster-monitoring-operator-tls" not found Sep 10 11:12:50.595246 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:50.594889 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/68178850-698c-4ff6-82b8-b345e52851b8-metrics-tls\") pod \"dns-default-crh79\" (UID: \"68178850-698c-4ff6-82b8-b345e52851b8\") " pod="openshift-dns/dns-default-crh79" Sep 10 11:12:50.595425 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:50.595330 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c062102c-aa53-4355-9921-4d46efdf94c9-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-bz6mz\" (UID: \"c062102c-aa53-4355-9921-4d46efdf94c9\") " pod="openshift-network-console/networking-console-plugin-79977f9844-bz6mz" Sep 10 11:12:50.595504 ip-10-0-134-73 kubenswrapper[2564]: E0910 11:12:50.595479 2564 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Sep 10 11:12:50.595556 ip-10-0-134-73 kubenswrapper[2564]: E0910 11:12:50.595545 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c062102c-aa53-4355-9921-4d46efdf94c9-networking-console-plugin-cert podName:c062102c-aa53-4355-9921-4d46efdf94c9 nodeName:}" failed. No retries permitted until 2026-09-10 11:12:52.595526293 +0000 UTC m=+38.192087489 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/c062102c-aa53-4355-9921-4d46efdf94c9-networking-console-plugin-cert") pod "networking-console-plugin-79977f9844-bz6mz" (UID: "c062102c-aa53-4355-9921-4d46efdf94c9") : secret "networking-console-plugin-cert" not found Sep 10 11:12:50.596067 ip-10-0-134-73 kubenswrapper[2564]: E0910 11:12:50.596027 2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 10 11:12:50.596169 ip-10-0-134-73 kubenswrapper[2564]: E0910 11:12:50.596090 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/68178850-698c-4ff6-82b8-b345e52851b8-metrics-tls podName:68178850-698c-4ff6-82b8-b345e52851b8 nodeName:}" failed. No retries permitted until 2026-09-10 11:12:52.596072767 +0000 UTC m=+38.192633978 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/68178850-698c-4ff6-82b8-b345e52851b8-metrics-tls") pod "dns-default-crh79" (UID: "68178850-698c-4ff6-82b8-b345e52851b8") : secret "dns-default-metrics-tls" not found Sep 10 11:12:50.909542 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:50.909474 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-76bcd6ccf5-2srs4"] Sep 10 11:12:50.910080 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:50.910055 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2aeac0f7_3e8b_4d33_abcc_ae757048a5cf.slice/crio-b82ae398a79a89913aa71b44144d49fb5e029a43f99b3c1b6170937bf532f1e3 WatchSource:0}: Error finding container b82ae398a79a89913aa71b44144d49fb5e029a43f99b3c1b6170937bf532f1e3: Status 404 returned error can't find the container with id b82ae398a79a89913aa71b44144d49fb5e029a43f99b3c1b6170937bf532f1e3 Sep 10 11:12:50.910287 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:50.910258 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7f298f77_06d2_4ea6_b4fc_cb2c5e9080de.slice/crio-23be3f7a63a929b223ad18cd2f3c70f93b50f93d90a6eda662b5240242f0d067 WatchSource:0}: Error finding container 23be3f7a63a929b223ad18cd2f3c70f93b50f93d90a6eda662b5240242f0d067: Status 404 returned error can't find the container with id 23be3f7a63a929b223ad18cd2f3c70f93b50f93d90a6eda662b5240242f0d067 Sep 10 11:12:50.910562 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:50.910550 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-85b454874b-l2hf2"] Sep 10 11:12:50.918902 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:50.918871 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-4bkc6"] Sep 10 11:12:50.919896 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:50.919875 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-ppgz5"] Sep 10 11:12:50.920688 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:50.920655 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-t55dh"] Sep 10 11:12:50.922709 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:50.922685 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9e565424_7eca_4f29_8582_664fac065238.slice/crio-d16638b67f725193beb64020d11261fad7f88b9da9f52eb72ded9d634d0bc1b9 WatchSource:0}: Error finding container d16638b67f725193beb64020d11261fad7f88b9da9f52eb72ded9d634d0bc1b9: Status 404 returned error can't find the container with id d16638b67f725193beb64020d11261fad7f88b9da9f52eb72ded9d634d0bc1b9 Sep 10 11:12:50.923461 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:50.923441 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1e1b3fbc_ac27_424e_85be_c2dc53c62d3e.slice/crio-ef3aec3798e3c4de01f504ac2dd031ce6d5e45fe43078b900324145555b12443 WatchSource:0}: Error finding container ef3aec3798e3c4de01f504ac2dd031ce6d5e45fe43078b900324145555b12443: Status 404 returned error can't find the container with id ef3aec3798e3c4de01f504ac2dd031ce6d5e45fe43078b900324145555b12443 Sep 10 11:12:50.924446 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:50.924418 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeea0842b_55ea_4845_8e5f_61bb84d918eb.slice/crio-87e33db3435f71c243467ebaa777a1678e25d9656639d527d11c3f6c7237e290 WatchSource:0}: Error finding container 87e33db3435f71c243467ebaa777a1678e25d9656639d527d11c3f6c7237e290: Status 404 returned error can't find the container with id 87e33db3435f71c243467ebaa777a1678e25d9656639d527d11c3f6c7237e290 Sep 10 11:12:50.934914 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:50.934890 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-859f94c4b-2kgcg"] Sep 10 11:12:50.937639 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:50.937620 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod35dc51d7_6cf7_42d2_8e35_1a31a3a1ac8f.slice/crio-f7e12ee4ef7638d54267ed9c2b0face57e79289e31c47fb65d1643d5a595ed62 WatchSource:0}: Error finding container f7e12ee4ef7638d54267ed9c2b0face57e79289e31c47fb65d1643d5a595ed62: Status 404 returned error can't find the container with id f7e12ee4ef7638d54267ed9c2b0face57e79289e31c47fb65d1643d5a595ed62 Sep 10 11:12:50.938436 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:50.938386 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-685456655f-z7mhl"] Sep 10 11:12:50.942167 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:12:50.942136 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod341ed071_292a_4066_b98a_3cf04a4cbf93.slice/crio-1082c24e48ebc85d8088bbd72616b9d96e0ded36a05472be01ba67c302615243 WatchSource:0}: Error finding container 1082c24e48ebc85d8088bbd72616b9d96e0ded36a05472be01ba67c302615243: Status 404 returned error can't find the container with id 1082c24e48ebc85d8088bbd72616b9d96e0ded36a05472be01ba67c302615243 Sep 10 11:12:51.074631 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:51.074603 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-685456655f-z7mhl" event={"ID":"341ed071-292a-4066-b98a-3cf04a4cbf93","Type":"ContainerStarted","Data":"1082c24e48ebc85d8088bbd72616b9d96e0ded36a05472be01ba67c302615243"} Sep 10 11:12:51.075681 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:51.075605 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-4bkc6" event={"ID":"1e1b3fbc-ac27-424e-85be-c2dc53c62d3e","Type":"ContainerStarted","Data":"ef3aec3798e3c4de01f504ac2dd031ce6d5e45fe43078b900324145555b12443"} Sep 10 11:12:51.076664 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:51.076644 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-2kgcg" event={"ID":"35dc51d7-6cf7-42d2-8e35-1a31a3a1ac8f","Type":"ContainerStarted","Data":"f7e12ee4ef7638d54267ed9c2b0face57e79289e31c47fb65d1643d5a595ed62"} Sep 10 11:12:51.077715 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:51.077695 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-t55dh" event={"ID":"9e565424-7eca-4f29-8582-664fac065238","Type":"ContainerStarted","Data":"d16638b67f725193beb64020d11261fad7f88b9da9f52eb72ded9d634d0bc1b9"} Sep 10 11:12:51.078747 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:51.078723 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-ppgz5" event={"ID":"eea0842b-55ea-4845-8e5f-61bb84d918eb","Type":"ContainerStarted","Data":"87e33db3435f71c243467ebaa777a1678e25d9656639d527d11c3f6c7237e290"} Sep 10 11:12:51.079776 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:51.079756 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-76bcd6ccf5-2srs4" event={"ID":"2aeac0f7-3e8b-4d33-abcc-ae757048a5cf","Type":"ContainerStarted","Data":"b82ae398a79a89913aa71b44144d49fb5e029a43f99b3c1b6170937bf532f1e3"} Sep 10 11:12:51.082298 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:51.082271 2564 generic.go:356] "Generic (PLEG): container finished" podID="1d5ea621-658b-4058-9b1a-d4c976651be0" containerID="14dc7e5edb1da6be7582f3f663bfddb6063342d6d9abadb606659d2421d0949d" exitCode=0 Sep 10 11:12:51.082385 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:51.082336 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dpgnj" event={"ID":"1d5ea621-658b-4058-9b1a-d4c976651be0","Type":"ContainerDied","Data":"14dc7e5edb1da6be7582f3f663bfddb6063342d6d9abadb606659d2421d0949d"} Sep 10 11:12:51.083512 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:51.083494 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-85b454874b-l2hf2" event={"ID":"7f298f77-06d2-4ea6-b4fc-cb2c5e9080de","Type":"ContainerStarted","Data":"23be3f7a63a929b223ad18cd2f3c70f93b50f93d90a6eda662b5240242f0d067"} Sep 10 11:12:52.094129 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:52.094081 2564 generic.go:356] "Generic (PLEG): container finished" podID="1d5ea621-658b-4058-9b1a-d4c976651be0" containerID="df4242c23a72030d4e1a639ec1d5dbca4be36b4a0e45c68ca5863e4c68ff9e99" exitCode=0 Sep 10 11:12:52.094800 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:52.094140 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dpgnj" event={"ID":"1d5ea621-658b-4058-9b1a-d4c976651be0","Type":"ContainerDied","Data":"df4242c23a72030d4e1a639ec1d5dbca4be36b4a0e45c68ca5863e4c68ff9e99"} Sep 10 11:12:52.195997 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:52.195868 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pq4ct_77142edb-57e1-4da1-8eba-f104366a851f/konnectivity-agent/0.log" limit=1024 Sep 10 11:12:52.516110 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:52.515784 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/07ed66ee-327a-4767-a989-0cc7574b0c0f-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-cw9qc\" (UID: \"07ed66ee-327a-4767-a989-0cc7574b0c0f\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-cw9qc" Sep 10 11:12:52.516322 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:52.516115 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/3e0bbd18-8afb-43e7-8e61-04d516f482f0-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-sckxh\" (UID: \"3e0bbd18-8afb-43e7-8e61-04d516f482f0\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-sckxh" Sep 10 11:12:52.516322 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:52.516152 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7a9cb7ef-ebb9-48cc-8a51-f83540a85612-service-ca-bundle\") pod \"router-default-879b8884d-8tjr9\" (UID: \"7a9cb7ef-ebb9-48cc-8a51-f83540a85612\") " pod="openshift-ingress/router-default-879b8884d-8tjr9" Sep 10 11:12:52.516322 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:52.516179 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7a9cb7ef-ebb9-48cc-8a51-f83540a85612-metrics-certs\") pod \"router-default-879b8884d-8tjr9\" (UID: \"7a9cb7ef-ebb9-48cc-8a51-f83540a85612\") " pod="openshift-ingress/router-default-879b8884d-8tjr9" Sep 10 11:12:52.516322 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:52.516246 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/74f68888-4cfe-416f-bce6-e0b42f46aef5-registry-tls\") pod \"image-registry-7864689cc9-sw6sb\" (UID: \"74f68888-4cfe-416f-bce6-e0b42f46aef5\") " pod="openshift-image-registry/image-registry-7864689cc9-sw6sb" Sep 10 11:12:52.516547 ip-10-0-134-73 kubenswrapper[2564]: E0910 11:12:52.516392 2564 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 10 11:12:52.516547 ip-10-0-134-73 kubenswrapper[2564]: E0910 11:12:52.516406 2564 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7864689cc9-sw6sb: secret "image-registry-tls" not found Sep 10 11:12:52.516547 ip-10-0-134-73 kubenswrapper[2564]: E0910 11:12:52.516461 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/74f68888-4cfe-416f-bce6-e0b42f46aef5-registry-tls podName:74f68888-4cfe-416f-bce6-e0b42f46aef5 nodeName:}" failed. No retries permitted until 2026-09-10 11:12:56.516443493 +0000 UTC m=+42.113004690 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/74f68888-4cfe-416f-bce6-e0b42f46aef5-registry-tls") pod "image-registry-7864689cc9-sw6sb" (UID: "74f68888-4cfe-416f-bce6-e0b42f46aef5") : secret "image-registry-tls" not found Sep 10 11:12:52.517013 ip-10-0-134-73 kubenswrapper[2564]: E0910 11:12:52.516993 2564 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Sep 10 11:12:52.517101 ip-10-0-134-73 kubenswrapper[2564]: E0910 11:12:52.517052 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/07ed66ee-327a-4767-a989-0cc7574b0c0f-cluster-monitoring-operator-tls podName:07ed66ee-327a-4767-a989-0cc7574b0c0f nodeName:}" failed. No retries permitted until 2026-09-10 11:12:56.517036659 +0000 UTC m=+42.113597856 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/07ed66ee-327a-4767-a989-0cc7574b0c0f-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cdcc96965-cw9qc" (UID: "07ed66ee-327a-4767-a989-0cc7574b0c0f") : secret "cluster-monitoring-operator-tls" not found Sep 10 11:12:52.517171 ip-10-0-134-73 kubenswrapper[2564]: E0910 11:12:52.517115 2564 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Sep 10 11:12:52.517171 ip-10-0-134-73 kubenswrapper[2564]: E0910 11:12:52.517151 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3e0bbd18-8afb-43e7-8e61-04d516f482f0-samples-operator-tls podName:3e0bbd18-8afb-43e7-8e61-04d516f482f0 nodeName:}" failed. No retries permitted until 2026-09-10 11:12:56.517139488 +0000 UTC m=+42.113700683 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/3e0bbd18-8afb-43e7-8e61-04d516f482f0-samples-operator-tls") pod "cluster-samples-operator-7cdcfcf76c-sckxh" (UID: "3e0bbd18-8afb-43e7-8e61-04d516f482f0") : secret "samples-operator-tls" not found Sep 10 11:12:52.517284 ip-10-0-134-73 kubenswrapper[2564]: E0910 11:12:52.517218 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7a9cb7ef-ebb9-48cc-8a51-f83540a85612-service-ca-bundle podName:7a9cb7ef-ebb9-48cc-8a51-f83540a85612 nodeName:}" failed. No retries permitted until 2026-09-10 11:12:56.517207227 +0000 UTC m=+42.113768425 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/7a9cb7ef-ebb9-48cc-8a51-f83540a85612-service-ca-bundle") pod "router-default-879b8884d-8tjr9" (UID: "7a9cb7ef-ebb9-48cc-8a51-f83540a85612") : configmap references non-existent config key: service-ca.crt Sep 10 11:12:52.517284 ip-10-0-134-73 kubenswrapper[2564]: E0910 11:12:52.517275 2564 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Sep 10 11:12:52.517388 ip-10-0-134-73 kubenswrapper[2564]: E0910 11:12:52.517304 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7a9cb7ef-ebb9-48cc-8a51-f83540a85612-metrics-certs podName:7a9cb7ef-ebb9-48cc-8a51-f83540a85612 nodeName:}" failed. No retries permitted until 2026-09-10 11:12:56.517292853 +0000 UTC m=+42.113854048 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7a9cb7ef-ebb9-48cc-8a51-f83540a85612-metrics-certs") pod "router-default-879b8884d-8tjr9" (UID: "7a9cb7ef-ebb9-48cc-8a51-f83540a85612") : secret "router-metrics-certs-default" not found Sep 10 11:12:52.616845 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:52.616807 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/68178850-698c-4ff6-82b8-b345e52851b8-metrics-tls\") pod \"dns-default-crh79\" (UID: \"68178850-698c-4ff6-82b8-b345e52851b8\") " pod="openshift-dns/dns-default-crh79" Sep 10 11:12:52.617047 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:52.616958 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c062102c-aa53-4355-9921-4d46efdf94c9-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-bz6mz\" (UID: \"c062102c-aa53-4355-9921-4d46efdf94c9\") " pod="openshift-network-console/networking-console-plugin-79977f9844-bz6mz" Sep 10 11:12:52.617176 ip-10-0-134-73 kubenswrapper[2564]: E0910 11:12:52.617158 2564 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Sep 10 11:12:52.617256 ip-10-0-134-73 kubenswrapper[2564]: E0910 11:12:52.617222 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c062102c-aa53-4355-9921-4d46efdf94c9-networking-console-plugin-cert podName:c062102c-aa53-4355-9921-4d46efdf94c9 nodeName:}" failed. No retries permitted until 2026-09-10 11:12:56.617201583 +0000 UTC m=+42.213762792 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/c062102c-aa53-4355-9921-4d46efdf94c9-networking-console-plugin-cert") pod "networking-console-plugin-79977f9844-bz6mz" (UID: "c062102c-aa53-4355-9921-4d46efdf94c9") : secret "networking-console-plugin-cert" not found Sep 10 11:12:52.617630 ip-10-0-134-73 kubenswrapper[2564]: E0910 11:12:52.617613 2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 10 11:12:52.617713 ip-10-0-134-73 kubenswrapper[2564]: E0910 11:12:52.617661 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/68178850-698c-4ff6-82b8-b345e52851b8-metrics-tls podName:68178850-698c-4ff6-82b8-b345e52851b8 nodeName:}" failed. No retries permitted until 2026-09-10 11:12:56.617647675 +0000 UTC m=+42.214208882 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/68178850-698c-4ff6-82b8-b345e52851b8-metrics-tls") pod "dns-default-crh79" (UID: "68178850-698c-4ff6-82b8-b345e52851b8") : secret "dns-default-metrics-tls" not found Sep 10 11:12:53.113351 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:53.113313 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dpgnj" event={"ID":"1d5ea621-658b-4058-9b1a-d4c976651be0","Type":"ContainerStarted","Data":"a529162803ca2f87eb32b1f6c458741a3c0ee8442c91a23d46136445175f3972"} Sep 10 11:12:53.284738 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:53.284671 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pq4ct_77142edb-57e1-4da1-8eba-f104366a851f/konnectivity-agent/0.log" limit=1024 Sep 10 11:12:53.376832 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:53.376742 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pq4ct_77142edb-57e1-4da1-8eba-f104366a851f/konnectivity-agent/0.log" limit=1024 Sep 10 11:12:56.556972 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:56.556930 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/07ed66ee-327a-4767-a989-0cc7574b0c0f-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-cw9qc\" (UID: \"07ed66ee-327a-4767-a989-0cc7574b0c0f\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-cw9qc" Sep 10 11:12:56.557397 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:56.556987 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/3e0bbd18-8afb-43e7-8e61-04d516f482f0-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-sckxh\" (UID: \"3e0bbd18-8afb-43e7-8e61-04d516f482f0\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-sckxh" Sep 10 11:12:56.557397 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:56.557087 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7a9cb7ef-ebb9-48cc-8a51-f83540a85612-service-ca-bundle\") pod \"router-default-879b8884d-8tjr9\" (UID: \"7a9cb7ef-ebb9-48cc-8a51-f83540a85612\") " pod="openshift-ingress/router-default-879b8884d-8tjr9" Sep 10 11:12:56.557397 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:56.557104 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7a9cb7ef-ebb9-48cc-8a51-f83540a85612-metrics-certs\") pod \"router-default-879b8884d-8tjr9\" (UID: \"7a9cb7ef-ebb9-48cc-8a51-f83540a85612\") " pod="openshift-ingress/router-default-879b8884d-8tjr9" Sep 10 11:12:56.557397 ip-10-0-134-73 kubenswrapper[2564]: E0910 11:12:56.557109 2564 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Sep 10 11:12:56.557397 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:56.557144 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/74f68888-4cfe-416f-bce6-e0b42f46aef5-registry-tls\") pod \"image-registry-7864689cc9-sw6sb\" (UID: \"74f68888-4cfe-416f-bce6-e0b42f46aef5\") " pod="openshift-image-registry/image-registry-7864689cc9-sw6sb" Sep 10 11:12:56.557397 ip-10-0-134-73 kubenswrapper[2564]: E0910 11:12:56.557193 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/07ed66ee-327a-4767-a989-0cc7574b0c0f-cluster-monitoring-operator-tls podName:07ed66ee-327a-4767-a989-0cc7574b0c0f nodeName:}" failed. No retries permitted until 2026-09-10 11:13:04.557169304 +0000 UTC m=+50.153730514 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/07ed66ee-327a-4767-a989-0cc7574b0c0f-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cdcc96965-cw9qc" (UID: "07ed66ee-327a-4767-a989-0cc7574b0c0f") : secret "cluster-monitoring-operator-tls" not found Sep 10 11:12:56.557397 ip-10-0-134-73 kubenswrapper[2564]: E0910 11:12:56.557223 2564 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Sep 10 11:12:56.557397 ip-10-0-134-73 kubenswrapper[2564]: E0910 11:12:56.557262 2564 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Sep 10 11:12:56.557397 ip-10-0-134-73 kubenswrapper[2564]: E0910 11:12:56.557283 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7a9cb7ef-ebb9-48cc-8a51-f83540a85612-service-ca-bundle podName:7a9cb7ef-ebb9-48cc-8a51-f83540a85612 nodeName:}" failed. No retries permitted until 2026-09-10 11:13:04.557271712 +0000 UTC m=+50.153832906 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/7a9cb7ef-ebb9-48cc-8a51-f83540a85612-service-ca-bundle") pod "router-default-879b8884d-8tjr9" (UID: "7a9cb7ef-ebb9-48cc-8a51-f83540a85612") : configmap references non-existent config key: service-ca.crt Sep 10 11:12:56.557397 ip-10-0-134-73 kubenswrapper[2564]: E0910 11:12:56.557231 2564 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 10 11:12:56.557397 ip-10-0-134-73 kubenswrapper[2564]: E0910 11:12:56.557301 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3e0bbd18-8afb-43e7-8e61-04d516f482f0-samples-operator-tls podName:3e0bbd18-8afb-43e7-8e61-04d516f482f0 nodeName:}" failed. No retries permitted until 2026-09-10 11:13:04.557292717 +0000 UTC m=+50.153853910 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/3e0bbd18-8afb-43e7-8e61-04d516f482f0-samples-operator-tls") pod "cluster-samples-operator-7cdcfcf76c-sckxh" (UID: "3e0bbd18-8afb-43e7-8e61-04d516f482f0") : secret "samples-operator-tls" not found Sep 10 11:12:56.557397 ip-10-0-134-73 kubenswrapper[2564]: E0910 11:12:56.557307 2564 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7864689cc9-sw6sb: secret "image-registry-tls" not found Sep 10 11:12:56.557397 ip-10-0-134-73 kubenswrapper[2564]: E0910 11:12:56.557316 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7a9cb7ef-ebb9-48cc-8a51-f83540a85612-metrics-certs podName:7a9cb7ef-ebb9-48cc-8a51-f83540a85612 nodeName:}" failed. No retries permitted until 2026-09-10 11:13:04.55730817 +0000 UTC m=+50.153869363 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7a9cb7ef-ebb9-48cc-8a51-f83540a85612-metrics-certs") pod "router-default-879b8884d-8tjr9" (UID: "7a9cb7ef-ebb9-48cc-8a51-f83540a85612") : secret "router-metrics-certs-default" not found Sep 10 11:12:56.557397 ip-10-0-134-73 kubenswrapper[2564]: E0910 11:12:56.557340 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/74f68888-4cfe-416f-bce6-e0b42f46aef5-registry-tls podName:74f68888-4cfe-416f-bce6-e0b42f46aef5 nodeName:}" failed. No retries permitted until 2026-09-10 11:13:04.557328075 +0000 UTC m=+50.153889269 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/74f68888-4cfe-416f-bce6-e0b42f46aef5-registry-tls") pod "image-registry-7864689cc9-sw6sb" (UID: "74f68888-4cfe-416f-bce6-e0b42f46aef5") : secret "image-registry-tls" not found Sep 10 11:12:56.658108 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:56.658082 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/68178850-698c-4ff6-82b8-b345e52851b8-metrics-tls\") pod \"dns-default-crh79\" (UID: \"68178850-698c-4ff6-82b8-b345e52851b8\") " pod="openshift-dns/dns-default-crh79" Sep 10 11:12:56.658242 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:56.658153 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c062102c-aa53-4355-9921-4d46efdf94c9-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-bz6mz\" (UID: \"c062102c-aa53-4355-9921-4d46efdf94c9\") " pod="openshift-network-console/networking-console-plugin-79977f9844-bz6mz" Sep 10 11:12:56.658242 ip-10-0-134-73 kubenswrapper[2564]: E0910 11:12:56.658222 2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 10 11:12:56.658317 ip-10-0-134-73 kubenswrapper[2564]: E0910 11:12:56.658247 2564 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Sep 10 11:12:56.658317 ip-10-0-134-73 kubenswrapper[2564]: E0910 11:12:56.658279 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/68178850-698c-4ff6-82b8-b345e52851b8-metrics-tls podName:68178850-698c-4ff6-82b8-b345e52851b8 nodeName:}" failed. No retries permitted until 2026-09-10 11:13:04.658264254 +0000 UTC m=+50.254825461 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/68178850-698c-4ff6-82b8-b345e52851b8-metrics-tls") pod "dns-default-crh79" (UID: "68178850-698c-4ff6-82b8-b345e52851b8") : secret "dns-default-metrics-tls" not found Sep 10 11:12:56.658317 ip-10-0-134-73 kubenswrapper[2564]: E0910 11:12:56.658312 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c062102c-aa53-4355-9921-4d46efdf94c9-networking-console-plugin-cert podName:c062102c-aa53-4355-9921-4d46efdf94c9 nodeName:}" failed. No retries permitted until 2026-09-10 11:13:04.658300902 +0000 UTC m=+50.254862131 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/c062102c-aa53-4355-9921-4d46efdf94c9-networking-console-plugin-cert") pod "networking-console-plugin-79977f9844-bz6mz" (UID: "c062102c-aa53-4355-9921-4d46efdf94c9") : secret "networking-console-plugin-cert" not found Sep 10 11:12:57.868266 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:57.868162 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pq4ct_77142edb-57e1-4da1-8eba-f104366a851f/konnectivity-agent/0.log" limit=1024 Sep 10 11:12:57.969789 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:57.969723 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pq4ct_77142edb-57e1-4da1-8eba-f104366a851f/konnectivity-agent/0.log" limit=1024 Sep 10 11:12:59.130812 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:59.130777 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-ppgz5" event={"ID":"eea0842b-55ea-4845-8e5f-61bb84d918eb","Type":"ContainerStarted","Data":"84110acabb632df8d7b3d101b024f4179a7e11f46f3f246c559b767a87ccc805"} Sep 10 11:12:59.150910 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:59.150828 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-dpgnj" podStartSLOduration=13.848164088 podStartE2EDuration="44.150805119s" totalImagesPullingTime="30.302641031s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 11:12:15 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 11:12:53.148748233 +0000 UTC m=+38.745309451" watchObservedRunningTime="2026-09-10 11:12:59.150805119 +0000 UTC m=+44.747366338" Sep 10 11:12:59.151509 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:59.151467 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-ppgz5" podStartSLOduration=19.357495285 podStartE2EDuration="27.151453591s" totalImagesPullingTime="7.793958306s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 11:12:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 11:12:59.149421964 +0000 UTC m=+44.745983180" watchObservedRunningTime="2026-09-10 11:12:59.151453591 +0000 UTC m=+44.748014808" Sep 10 11:12:59.258380 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:59.258245 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pq4ct_77142edb-57e1-4da1-8eba-f104366a851f/konnectivity-agent/0.log" limit=1024 Sep 10 11:12:59.326780 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:59.326696 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pq4ct_77142edb-57e1-4da1-8eba-f104366a851f/konnectivity-agent/0.log" limit=1024 Sep 10 11:12:59.950166 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:12:59.950124 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pq4ct_77142edb-57e1-4da1-8eba-f104366a851f/konnectivity-agent/0.log" limit=1024 Sep 10 11:13:00.051873 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:13:00.051762 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pq4ct_77142edb-57e1-4da1-8eba-f104366a851f/konnectivity-agent/0.log" limit=1024 Sep 10 11:13:00.137083 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:13:00.136990 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-4bkc6" event={"ID":"1e1b3fbc-ac27-424e-85be-c2dc53c62d3e","Type":"ContainerStarted","Data":"b0121297c2957a72602185f96179495d3163251c4056a2638a106d6c77b16aa6"} Sep 10 11:13:00.139251 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:13:00.139210 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-2kgcg" event={"ID":"35dc51d7-6cf7-42d2-8e35-1a31a3a1ac8f","Type":"ContainerStarted","Data":"2d1ff9cd3b726ced09a7f382f8889d17889d7d3e26bfc852fd7295e26a0ad43c"} Sep 10 11:13:00.141000 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:13:00.140964 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-t55dh" event={"ID":"9e565424-7eca-4f29-8582-664fac065238","Type":"ContainerStarted","Data":"0bcfe804329f50766981c32f478dfb2c86d97b7e6d8f137c9850f1d3acf19025"} Sep 10 11:13:00.142614 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:13:00.142591 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-76bcd6ccf5-2srs4" event={"ID":"2aeac0f7-3e8b-4d33-abcc-ae757048a5cf","Type":"ContainerStarted","Data":"aac8a00b2354f1cfedd0dfb01b4e87b91136026ec55673e19506576d01776131"} Sep 10 11:13:00.144443 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:13:00.144424 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-l2hf2_7f298f77-06d2-4ea6-b4fc-cb2c5e9080de/console-operator/0.log" Sep 10 11:13:00.144539 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:13:00.144462 2564 generic.go:356] "Generic (PLEG): container finished" podID="7f298f77-06d2-4ea6-b4fc-cb2c5e9080de" containerID="1094c56391af0272a8c719a3575bf1ea313210a981f96038e33233b9ad2131cb" exitCode=255 Sep 10 11:13:00.144539 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:13:00.144530 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-85b454874b-l2hf2" event={"ID":"7f298f77-06d2-4ea6-b4fc-cb2c5e9080de","Type":"ContainerDied","Data":"1094c56391af0272a8c719a3575bf1ea313210a981f96038e33233b9ad2131cb"} Sep 10 11:13:00.144725 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:13:00.144711 2564 scope.go:117] "RemoveContainer" containerID="1094c56391af0272a8c719a3575bf1ea313210a981f96038e33233b9ad2131cb" Sep 10 11:13:00.146424 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:13:00.146263 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-685456655f-z7mhl" event={"ID":"341ed071-292a-4066-b98a-3cf04a4cbf93","Type":"ContainerStarted","Data":"77bceaeb4f8c5320f950116a887b8c35b30751d4a58c34c87efec5832839aa6e"} Sep 10 11:13:00.157323 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:13:00.157280 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-4bkc6" podStartSLOduration=4.321303217 podStartE2EDuration="12.157266145s" totalImagesPullingTime="7.835962928s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 11:12:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 11:13:00.156074622 +0000 UTC m=+45.752635838" watchObservedRunningTime="2026-09-10 11:13:00.157266145 +0000 UTC m=+45.753827360" Sep 10 11:13:00.212263 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:13:00.211085 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-2kgcg" podStartSLOduration=20.383524278 podStartE2EDuration="28.211054827s" totalImagesPullingTime="7.827530549s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 11:12:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 11:13:00.210261522 +0000 UTC m=+45.806822739" watchObservedRunningTime="2026-09-10 11:13:00.211054827 +0000 UTC m=+45.807616043" Sep 10 11:13:00.212263 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:13:00.211344 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-76bcd6ccf5-2srs4" podStartSLOduration=20.362706351 podStartE2EDuration="28.211336795s" totalImagesPullingTime="7.848630444s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 11:12:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 11:13:00.184402332 +0000 UTC m=+45.780963547" watchObservedRunningTime="2026-09-10 11:13:00.211336795 +0000 UTC m=+45.807898006" Sep 10 11:13:00.237176 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:13:00.237128 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-t55dh" podStartSLOduration=20.401313821 podStartE2EDuration="28.237110888s" totalImagesPullingTime="7.835797067s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 11:12:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 11:13:00.236384069 +0000 UTC m=+45.832945285" watchObservedRunningTime="2026-09-10 11:13:00.237110888 +0000 UTC m=+45.833672103" Sep 10 11:13:00.894809 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:13:00.894774 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pq4ct_77142edb-57e1-4da1-8eba-f104366a851f/konnectivity-agent/0.log" limit=1024 Sep 10 11:13:00.998254 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:13:00.998210 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pq4ct_77142edb-57e1-4da1-8eba-f104366a851f/konnectivity-agent/0.log" limit=1024 Sep 10 11:13:01.151279 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:13:01.151193 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pq4ct_77142edb-57e1-4da1-8eba-f104366a851f/konnectivity-agent/0.log" limit=1024 Sep 10 11:13:01.151975 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:13:01.151768 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-l2hf2_7f298f77-06d2-4ea6-b4fc-cb2c5e9080de/console-operator/1.log" Sep 10 11:13:01.152205 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:13:01.152188 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-l2hf2_7f298f77-06d2-4ea6-b4fc-cb2c5e9080de/console-operator/0.log" Sep 10 11:13:01.152277 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:13:01.152229 2564 generic.go:356] "Generic (PLEG): container finished" podID="7f298f77-06d2-4ea6-b4fc-cb2c5e9080de" containerID="abd8be5a6737402e162520052096fa15b57c0c04387159047c9af11647625047" exitCode=255 Sep 10 11:13:01.152355 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:13:01.152331 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-85b454874b-l2hf2" event={"ID":"7f298f77-06d2-4ea6-b4fc-cb2c5e9080de","Type":"ContainerDied","Data":"abd8be5a6737402e162520052096fa15b57c0c04387159047c9af11647625047"} Sep 10 11:13:01.152418 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:13:01.152404 2564 scope.go:117] "RemoveContainer" containerID="1094c56391af0272a8c719a3575bf1ea313210a981f96038e33233b9ad2131cb" Sep 10 11:13:01.152750 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:13:01.152710 2564 scope.go:117] "RemoveContainer" containerID="abd8be5a6737402e162520052096fa15b57c0c04387159047c9af11647625047" Sep 10 11:13:01.152973 ip-10-0-134-73 kubenswrapper[2564]: E0910 11:13:01.152939 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-85b454874b-l2hf2_openshift-console-operator(7f298f77-06d2-4ea6-b4fc-cb2c5e9080de)\"" pod="openshift-console-operator/console-operator-85b454874b-l2hf2" podUID="7f298f77-06d2-4ea6-b4fc-cb2c5e9080de" Sep 10 11:13:01.154467 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:13:01.154432 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-685456655f-z7mhl" podStartSLOduration=21.070660519 podStartE2EDuration="29.154419181s" totalImagesPullingTime="8.083758662s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 11:12:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 11:13:00.285791271 +0000 UTC m=+45.882352487" watchObservedRunningTime="2026-09-10 11:13:01.154419181 +0000 UTC m=+46.750980423" Sep 10 11:13:01.154584 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:13:01.154573 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-7sfr4"] Sep 10 11:13:01.172618 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:13:01.172591 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-7sfr4" Sep 10 11:13:01.183818 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:13:01.183795 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Sep 10 11:13:01.184337 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:13:01.184290 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Sep 10 11:13:01.184584 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:13:01.184565 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-d5csz\"" Sep 10 11:13:01.200246 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:13:01.200221 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-7sfr4"] Sep 10 11:13:01.283349 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:13:01.283307 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pq4ct_77142edb-57e1-4da1-8eba-f104366a851f/konnectivity-agent/0.log" limit=1024 Sep 10 11:13:01.299896 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:13:01.299836 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zx5zk\" (UniqueName: \"kubernetes.io/projected/63846292-2743-4e69-adfc-178618b942f1-kube-api-access-zx5zk\") pod \"insights-runtime-extractor-7sfr4\" (UID: \"63846292-2743-4e69-adfc-178618b942f1\") " pod="openshift-insights/insights-runtime-extractor-7sfr4" Sep 10 11:13:01.300098 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:13:01.299952 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/63846292-2743-4e69-adfc-178618b942f1-data-volume\") pod \"insights-runtime-extractor-7sfr4\" (UID: \"63846292-2743-4e69-adfc-178618b942f1\") " pod="openshift-insights/insights-runtime-extractor-7sfr4" Sep 10 11:13:01.300098 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:13:01.300003 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/63846292-2743-4e69-adfc-178618b942f1-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-7sfr4\" (UID: \"63846292-2743-4e69-adfc-178618b942f1\") " pod="openshift-insights/insights-runtime-extractor-7sfr4" Sep 10 11:13:01.300195 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:13:01.300131 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/63846292-2743-4e69-adfc-178618b942f1-crio-socket\") pod \"insights-runtime-extractor-7sfr4\" (UID: \"63846292-2743-4e69-adfc-178618b942f1\") " pod="openshift-insights/insights-runtime-extractor-7sfr4" Sep 10 11:13:01.300195 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:13:01.300187 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/63846292-2743-4e69-adfc-178618b942f1-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-7sfr4\" (UID: \"63846292-2743-4e69-adfc-178618b942f1\") " pod="openshift-insights/insights-runtime-extractor-7sfr4" Sep 10 11:13:01.401030 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:13:01.400988 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zx5zk\" (UniqueName: \"kubernetes.io/projected/63846292-2743-4e69-adfc-178618b942f1-kube-api-access-zx5zk\") pod \"insights-runtime-extractor-7sfr4\" (UID: \"63846292-2743-4e69-adfc-178618b942f1\") " pod="openshift-insights/insights-runtime-extractor-7sfr4" Sep 10 11:13:01.401030 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:13:01.401033 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/63846292-2743-4e69-adfc-178618b942f1-data-volume\") pod \"insights-runtime-extractor-7sfr4\" (UID: \"63846292-2743-4e69-adfc-178618b942f1\") " pod="openshift-insights/insights-runtime-extractor-7sfr4" Sep 10 11:13:01.401272 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:13:01.401068 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/63846292-2743-4e69-adfc-178618b942f1-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-7sfr4\" (UID: \"63846292-2743-4e69-adfc-178618b942f1\") " pod="openshift-insights/insights-runtime-extractor-7sfr4" Sep 10 11:13:01.401272 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:13:01.401131 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/63846292-2743-4e69-adfc-178618b942f1-crio-socket\") pod \"insights-runtime-extractor-7sfr4\" (UID: \"63846292-2743-4e69-adfc-178618b942f1\") " pod="openshift-insights/insights-runtime-extractor-7sfr4" Sep 10 11:13:01.401272 ip-10-0-134-73 kubenswrapper[2564]: E0910 11:13:01.401179 2564 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 10 11:13:01.401272 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:13:01.401255 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/63846292-2743-4e69-adfc-178618b942f1-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-7sfr4\" (UID: \"63846292-2743-4e69-adfc-178618b942f1\") " pod="openshift-insights/insights-runtime-extractor-7sfr4" Sep 10 11:13:01.401499 ip-10-0-134-73 kubenswrapper[2564]: E0910 11:13:01.401289 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/63846292-2743-4e69-adfc-178618b942f1-kube-rbac-proxy-cm podName:63846292-2743-4e69-adfc-178618b942f1 nodeName:}" failed. No retries permitted until 2026-09-10 11:13:01.901245569 +0000 UTC m=+47.497806761 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/63846292-2743-4e69-adfc-178618b942f1-kube-rbac-proxy-cm") pod "insights-runtime-extractor-7sfr4" (UID: "63846292-2743-4e69-adfc-178618b942f1") : configmap "kube-rbac-proxy" not found Sep 10 11:13:01.401499 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:13:01.401325 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/63846292-2743-4e69-adfc-178618b942f1-crio-socket\") pod \"insights-runtime-extractor-7sfr4\" (UID: \"63846292-2743-4e69-adfc-178618b942f1\") " pod="openshift-insights/insights-runtime-extractor-7sfr4" Sep 10 11:13:01.401499 ip-10-0-134-73 kubenswrapper[2564]: E0910 11:13:01.401347 2564 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 10 11:13:01.401499 ip-10-0-134-73 kubenswrapper[2564]: E0910 11:13:01.401405 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/63846292-2743-4e69-adfc-178618b942f1-insights-runtime-extractor-tls podName:63846292-2743-4e69-adfc-178618b942f1 nodeName:}" failed. No retries permitted until 2026-09-10 11:13:01.901388369 +0000 UTC m=+47.497949584 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/63846292-2743-4e69-adfc-178618b942f1-insights-runtime-extractor-tls") pod "insights-runtime-extractor-7sfr4" (UID: "63846292-2743-4e69-adfc-178618b942f1") : secret "insights-runtime-extractor-tls" not found Sep 10 11:13:01.401499 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:13:01.401469 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/63846292-2743-4e69-adfc-178618b942f1-data-volume\") pod \"insights-runtime-extractor-7sfr4\" (UID: \"63846292-2743-4e69-adfc-178618b942f1\") " pod="openshift-insights/insights-runtime-extractor-7sfr4" Sep 10 11:13:01.413477 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:13:01.413449 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zx5zk\" (UniqueName: \"kubernetes.io/projected/63846292-2743-4e69-adfc-178618b942f1-kube-api-access-zx5zk\") pod \"insights-runtime-extractor-7sfr4\" (UID: \"63846292-2743-4e69-adfc-178618b942f1\") " pod="openshift-insights/insights-runtime-extractor-7sfr4" Sep 10 11:13:01.593592 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:13:01.593563 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pq4ct_77142edb-57e1-4da1-8eba-f104366a851f/konnectivity-agent/0.log" limit=1024 Sep 10 11:13:01.691298 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:13:01.691218 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pq4ct_77142edb-57e1-4da1-8eba-f104366a851f/konnectivity-agent/0.log" limit=1024 Sep 10 11:13:01.906032 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:13:01.905997 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/63846292-2743-4e69-adfc-178618b942f1-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-7sfr4\" (UID: \"63846292-2743-4e69-adfc-178618b942f1\") " pod="openshift-insights/insights-runtime-extractor-7sfr4" Sep 10 11:13:01.906175 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:13:01.906069 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/63846292-2743-4e69-adfc-178618b942f1-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-7sfr4\" (UID: \"63846292-2743-4e69-adfc-178618b942f1\") " pod="openshift-insights/insights-runtime-extractor-7sfr4" Sep 10 11:13:01.906175 ip-10-0-134-73 kubenswrapper[2564]: E0910 11:13:01.906112 2564 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 10 11:13:01.906259 ip-10-0-134-73 kubenswrapper[2564]: E0910 11:13:01.906189 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/63846292-2743-4e69-adfc-178618b942f1-kube-rbac-proxy-cm podName:63846292-2743-4e69-adfc-178618b942f1 nodeName:}" failed. No retries permitted until 2026-09-10 11:13:02.906174208 +0000 UTC m=+48.502735400 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/63846292-2743-4e69-adfc-178618b942f1-kube-rbac-proxy-cm") pod "insights-runtime-extractor-7sfr4" (UID: "63846292-2743-4e69-adfc-178618b942f1") : configmap "kube-rbac-proxy" not found Sep 10 11:13:01.906259 ip-10-0-134-73 kubenswrapper[2564]: E0910 11:13:01.906209 2564 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 10 11:13:01.906259 ip-10-0-134-73 kubenswrapper[2564]: E0910 11:13:01.906257 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/63846292-2743-4e69-adfc-178618b942f1-insights-runtime-extractor-tls podName:63846292-2743-4e69-adfc-178618b942f1 nodeName:}" failed. No retries permitted until 2026-09-10 11:13:02.906245294 +0000 UTC m=+48.502806487 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/63846292-2743-4e69-adfc-178618b942f1-insights-runtime-extractor-tls") pod "insights-runtime-extractor-7sfr4" (UID: "63846292-2743-4e69-adfc-178618b942f1") : secret "insights-runtime-extractor-tls" not found Sep 10 11:13:02.157298 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:13:02.157267 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-l2hf2_7f298f77-06d2-4ea6-b4fc-cb2c5e9080de/console-operator/1.log" Sep 10 11:13:02.157656 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:13:02.157615 2564 scope.go:117] "RemoveContainer" containerID="abd8be5a6737402e162520052096fa15b57c0c04387159047c9af11647625047" Sep 10 11:13:02.157779 ip-10-0-134-73 kubenswrapper[2564]: E0910 11:13:02.157761 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-85b454874b-l2hf2_openshift-console-operator(7f298f77-06d2-4ea6-b4fc-cb2c5e9080de)\"" pod="openshift-console-operator/console-operator-85b454874b-l2hf2" podUID="7f298f77-06d2-4ea6-b4fc-cb2c5e9080de" Sep 10 11:13:02.915004 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:13:02.914972 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/63846292-2743-4e69-adfc-178618b942f1-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-7sfr4\" (UID: \"63846292-2743-4e69-adfc-178618b942f1\") " pod="openshift-insights/insights-runtime-extractor-7sfr4" Sep 10 11:13:02.915182 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:13:02.915096 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/63846292-2743-4e69-adfc-178618b942f1-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-7sfr4\" (UID: \"63846292-2743-4e69-adfc-178618b942f1\") " pod="openshift-insights/insights-runtime-extractor-7sfr4" Sep 10 11:13:02.915182 ip-10-0-134-73 kubenswrapper[2564]: E0910 11:13:02.915129 2564 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 10 11:13:02.915297 ip-10-0-134-73 kubenswrapper[2564]: E0910 11:13:02.915188 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/63846292-2743-4e69-adfc-178618b942f1-insights-runtime-extractor-tls podName:63846292-2743-4e69-adfc-178618b942f1 nodeName:}" failed. No retries permitted until 2026-09-10 11:13:04.915171251 +0000 UTC m=+50.511732445 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/63846292-2743-4e69-adfc-178618b942f1-insights-runtime-extractor-tls") pod "insights-runtime-extractor-7sfr4" (UID: "63846292-2743-4e69-adfc-178618b942f1") : secret "insights-runtime-extractor-tls" not found Sep 10 11:13:02.915297 ip-10-0-134-73 kubenswrapper[2564]: E0910 11:13:02.915213 2564 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 10 11:13:02.915297 ip-10-0-134-73 kubenswrapper[2564]: E0910 11:13:02.915289 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/63846292-2743-4e69-adfc-178618b942f1-kube-rbac-proxy-cm podName:63846292-2743-4e69-adfc-178618b942f1 nodeName:}" failed. No retries permitted until 2026-09-10 11:13:04.915270335 +0000 UTC m=+50.511831532 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/63846292-2743-4e69-adfc-178618b942f1-kube-rbac-proxy-cm") pod "insights-runtime-extractor-7sfr4" (UID: "63846292-2743-4e69-adfc-178618b942f1") : configmap "kube-rbac-proxy" not found Sep 10 11:13:03.241428 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:13:03.241343 2564 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-pq4ct_77142edb-57e1-4da1-8eba-f104366a851f/konnectivity-agent/0.log" limit=1024 Sep 10 11:13:03.654925 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:13:03.654900 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-zgkgx_d1b87354-8843-4e59-8a85-68c875f472e6/dns-node-resolver/0.log" Sep 10 11:13:04.259656 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:13:04.259630 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-285k7_60a628d5-3863-4793-802f-e07a7157dcdf/node-ca/0.log" Sep 10 11:13:04.629050 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:13:04.629023 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/07ed66ee-327a-4767-a989-0cc7574b0c0f-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-cw9qc\" (UID: \"07ed66ee-327a-4767-a989-0cc7574b0c0f\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-cw9qc" Sep 10 11:13:04.629182 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:13:04.629071 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/3e0bbd18-8afb-43e7-8e61-04d516f482f0-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-sckxh\" (UID: \"3e0bbd18-8afb-43e7-8e61-04d516f482f0\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-sckxh" Sep 10 11:13:04.629182 ip-10-0-134-73 kubenswrapper[2564]: E0910 11:13:04.629169 2564 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Sep 10 11:13:04.629254 ip-10-0-134-73 kubenswrapper[2564]: E0910 11:13:04.629214 2564 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Sep 10 11:13:04.629254 ip-10-0-134-73 kubenswrapper[2564]: E0910 11:13:04.629221 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/07ed66ee-327a-4767-a989-0cc7574b0c0f-cluster-monitoring-operator-tls podName:07ed66ee-327a-4767-a989-0cc7574b0c0f nodeName:}" failed. No retries permitted until 2026-09-10 11:13:20.629206613 +0000 UTC m=+66.225767832 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/07ed66ee-327a-4767-a989-0cc7574b0c0f-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cdcc96965-cw9qc" (UID: "07ed66ee-327a-4767-a989-0cc7574b0c0f") : secret "cluster-monitoring-operator-tls" not found Sep 10 11:13:04.629254 ip-10-0-134-73 kubenswrapper[2564]: E0910 11:13:04.629254 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3e0bbd18-8afb-43e7-8e61-04d516f482f0-samples-operator-tls podName:3e0bbd18-8afb-43e7-8e61-04d516f482f0 nodeName:}" failed. No retries permitted until 2026-09-10 11:13:20.629243206 +0000 UTC m=+66.225804423 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/3e0bbd18-8afb-43e7-8e61-04d516f482f0-samples-operator-tls") pod "cluster-samples-operator-7cdcfcf76c-sckxh" (UID: "3e0bbd18-8afb-43e7-8e61-04d516f482f0") : secret "samples-operator-tls" not found Sep 10 11:13:04.629354 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:13:04.629269 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7a9cb7ef-ebb9-48cc-8a51-f83540a85612-service-ca-bundle\") pod \"router-default-879b8884d-8tjr9\" (UID: \"7a9cb7ef-ebb9-48cc-8a51-f83540a85612\") " pod="openshift-ingress/router-default-879b8884d-8tjr9" Sep 10 11:13:04.629354 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:13:04.629286 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7a9cb7ef-ebb9-48cc-8a51-f83540a85612-metrics-certs\") pod \"router-default-879b8884d-8tjr9\" (UID: \"7a9cb7ef-ebb9-48cc-8a51-f83540a85612\") " pod="openshift-ingress/router-default-879b8884d-8tjr9" Sep 10 11:13:04.629354 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:13:04.629332 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/74f68888-4cfe-416f-bce6-e0b42f46aef5-registry-tls\") pod \"image-registry-7864689cc9-sw6sb\" (UID: \"74f68888-4cfe-416f-bce6-e0b42f46aef5\") " pod="openshift-image-registry/image-registry-7864689cc9-sw6sb" Sep 10 11:13:04.629444 ip-10-0-134-73 kubenswrapper[2564]: E0910 11:13:04.629374 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7a9cb7ef-ebb9-48cc-8a51-f83540a85612-service-ca-bundle podName:7a9cb7ef-ebb9-48cc-8a51-f83540a85612 nodeName:}" failed. No retries permitted until 2026-09-10 11:13:20.629364754 +0000 UTC m=+66.225925946 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/7a9cb7ef-ebb9-48cc-8a51-f83540a85612-service-ca-bundle") pod "router-default-879b8884d-8tjr9" (UID: "7a9cb7ef-ebb9-48cc-8a51-f83540a85612") : configmap references non-existent config key: service-ca.crt Sep 10 11:13:04.629444 ip-10-0-134-73 kubenswrapper[2564]: E0910 11:13:04.629418 2564 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Sep 10 11:13:04.629507 ip-10-0-134-73 kubenswrapper[2564]: E0910 11:13:04.629423 2564 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 10 11:13:04.629507 ip-10-0-134-73 kubenswrapper[2564]: E0910 11:13:04.629461 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7a9cb7ef-ebb9-48cc-8a51-f83540a85612-metrics-certs podName:7a9cb7ef-ebb9-48cc-8a51-f83540a85612 nodeName:}" failed. No retries permitted until 2026-09-10 11:13:20.629447688 +0000 UTC m=+66.226008881 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7a9cb7ef-ebb9-48cc-8a51-f83540a85612-metrics-certs") pod "router-default-879b8884d-8tjr9" (UID: "7a9cb7ef-ebb9-48cc-8a51-f83540a85612") : secret "router-metrics-certs-default" not found Sep 10 11:13:04.629507 ip-10-0-134-73 kubenswrapper[2564]: E0910 11:13:04.629466 2564 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7864689cc9-sw6sb: secret "image-registry-tls" not found Sep 10 11:13:04.629599 ip-10-0-134-73 kubenswrapper[2564]: E0910 11:13:04.629509 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/74f68888-4cfe-416f-bce6-e0b42f46aef5-registry-tls podName:74f68888-4cfe-416f-bce6-e0b42f46aef5 nodeName:}" failed. No retries permitted until 2026-09-10 11:13:20.629497166 +0000 UTC m=+66.226058372 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/74f68888-4cfe-416f-bce6-e0b42f46aef5-registry-tls") pod "image-registry-7864689cc9-sw6sb" (UID: "74f68888-4cfe-416f-bce6-e0b42f46aef5") : secret "image-registry-tls" not found Sep 10 11:13:04.729849 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:13:04.729820 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/68178850-698c-4ff6-82b8-b345e52851b8-metrics-tls\") pod \"dns-default-crh79\" (UID: \"68178850-698c-4ff6-82b8-b345e52851b8\") " pod="openshift-dns/dns-default-crh79" Sep 10 11:13:04.729991 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:13:04.729931 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c062102c-aa53-4355-9921-4d46efdf94c9-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-bz6mz\" (UID: \"c062102c-aa53-4355-9921-4d46efdf94c9\") " pod="openshift-network-console/networking-console-plugin-79977f9844-bz6mz" Sep 10 11:13:04.729991 ip-10-0-134-73 kubenswrapper[2564]: E0910 11:13:04.729956 2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 10 11:13:04.730061 ip-10-0-134-73 kubenswrapper[2564]: E0910 11:13:04.730004 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/68178850-698c-4ff6-82b8-b345e52851b8-metrics-tls podName:68178850-698c-4ff6-82b8-b345e52851b8 nodeName:}" failed. No retries permitted until 2026-09-10 11:13:20.729987098 +0000 UTC m=+66.326548293 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/68178850-698c-4ff6-82b8-b345e52851b8-metrics-tls") pod "dns-default-crh79" (UID: "68178850-698c-4ff6-82b8-b345e52851b8") : secret "dns-default-metrics-tls" not found Sep 10 11:13:04.730061 ip-10-0-134-73 kubenswrapper[2564]: E0910 11:13:04.730042 2564 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Sep 10 11:13:04.730128 ip-10-0-134-73 kubenswrapper[2564]: E0910 11:13:04.730079 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c062102c-aa53-4355-9921-4d46efdf94c9-networking-console-plugin-cert podName:c062102c-aa53-4355-9921-4d46efdf94c9 nodeName:}" failed. No retries permitted until 2026-09-10 11:13:20.730066673 +0000 UTC m=+66.326627884 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/c062102c-aa53-4355-9921-4d46efdf94c9-networking-console-plugin-cert") pod "networking-console-plugin-79977f9844-bz6mz" (UID: "c062102c-aa53-4355-9921-4d46efdf94c9") : secret "networking-console-plugin-cert" not found Sep 10 11:13:04.932570 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:13:04.932503 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/63846292-2743-4e69-adfc-178618b942f1-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-7sfr4\" (UID: \"63846292-2743-4e69-adfc-178618b942f1\") " pod="openshift-insights/insights-runtime-extractor-7sfr4" Sep 10 11:13:04.932693 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:13:04.932571 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/63846292-2743-4e69-adfc-178618b942f1-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-7sfr4\" (UID: \"63846292-2743-4e69-adfc-178618b942f1\") " pod="openshift-insights/insights-runtime-extractor-7sfr4" Sep 10 11:13:04.932693 ip-10-0-134-73 kubenswrapper[2564]: E0910 11:13:04.932665 2564 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 10 11:13:04.932766 ip-10-0-134-73 kubenswrapper[2564]: E0910 11:13:04.932718 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/63846292-2743-4e69-adfc-178618b942f1-insights-runtime-extractor-tls podName:63846292-2743-4e69-adfc-178618b942f1 nodeName:}" failed. No retries permitted until 2026-09-10 11:13:08.932703915 +0000 UTC m=+54.529265117 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/63846292-2743-4e69-adfc-178618b942f1-insights-runtime-extractor-tls") pod "insights-runtime-extractor-7sfr4" (UID: "63846292-2743-4e69-adfc-178618b942f1") : secret "insights-runtime-extractor-tls" not found Sep 10 11:13:04.936404 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:13:04.933523 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/63846292-2743-4e69-adfc-178618b942f1-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-7sfr4\" (UID: \"63846292-2743-4e69-adfc-178618b942f1\") " pod="openshift-insights/insights-runtime-extractor-7sfr4" Sep 10 11:13:05.056019 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:13:05.055982 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-4bkc6_1e1b3fbc-ac27-424e-85be-c2dc53c62d3e/serve-healthcheck-canary/0.log" Sep 10 11:13:05.857167 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:13:05.857130 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-8d7dd4675-t55dh_9e565424-7eca-4f29-8582-664fac065238/kube-storage-version-migrator-operator/0.log" Sep 10 11:13:08.963440 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:13:08.963400 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/63846292-2743-4e69-adfc-178618b942f1-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-7sfr4\" (UID: \"63846292-2743-4e69-adfc-178618b942f1\") " pod="openshift-insights/insights-runtime-extractor-7sfr4" Sep 10 11:13:08.963968 ip-10-0-134-73 kubenswrapper[2564]: E0910 11:13:08.963567 2564 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 10 11:13:08.963968 ip-10-0-134-73 kubenswrapper[2564]: E0910 11:13:08.963638 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/63846292-2743-4e69-adfc-178618b942f1-insights-runtime-extractor-tls podName:63846292-2743-4e69-adfc-178618b942f1 nodeName:}" failed. No retries permitted until 2026-09-10 11:13:16.96361943 +0000 UTC m=+62.560180648 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/63846292-2743-4e69-adfc-178618b942f1-insights-runtime-extractor-tls") pod "insights-runtime-extractor-7sfr4" (UID: "63846292-2743-4e69-adfc-178618b942f1") : secret "insights-runtime-extractor-tls" not found Sep 10 11:13:09.160766 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:13:09.160733 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-85b454874b-l2hf2" Sep 10 11:13:09.160965 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:13:09.160796 2564 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-85b454874b-l2hf2" Sep 10 11:13:09.161180 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:13:09.161162 2564 scope.go:117] "RemoveContainer" containerID="abd8be5a6737402e162520052096fa15b57c0c04387159047c9af11647625047" Sep 10 11:13:09.161353 ip-10-0-134-73 kubenswrapper[2564]: E0910 11:13:09.161330 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-85b454874b-l2hf2_openshift-console-operator(7f298f77-06d2-4ea6-b4fc-cb2c5e9080de)\"" pod="openshift-console-operator/console-operator-85b454874b-l2hf2" podUID="7f298f77-06d2-4ea6-b4fc-cb2c5e9080de" Sep 10 11:13:12.063190 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:13:12.063163 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-t5n27" Sep 10 11:13:17.025470 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:13:17.025434 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/63846292-2743-4e69-adfc-178618b942f1-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-7sfr4\" (UID: \"63846292-2743-4e69-adfc-178618b942f1\") " pod="openshift-insights/insights-runtime-extractor-7sfr4" Sep 10 11:13:17.027692 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:13:17.027665 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/63846292-2743-4e69-adfc-178618b942f1-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-7sfr4\" (UID: \"63846292-2743-4e69-adfc-178618b942f1\") " pod="openshift-insights/insights-runtime-extractor-7sfr4" Sep 10 11:13:17.084627 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:13:17.084599 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-d5csz\"" Sep 10 11:13:17.092321 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:13:17.092303 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-7sfr4" Sep 10 11:13:17.365656 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:13:17.365600 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-7sfr4"] Sep 10 11:13:17.367535 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:13:17.367509 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod63846292_2743_4e69_adfc_178618b942f1.slice/crio-8db7e4bc0530838839fadaa0b6ef9ecc301ce5e5b538672638d56dade2aafb5c WatchSource:0}: Error finding container 8db7e4bc0530838839fadaa0b6ef9ecc301ce5e5b538672638d56dade2aafb5c: Status 404 returned error can't find the container with id 8db7e4bc0530838839fadaa0b6ef9ecc301ce5e5b538672638d56dade2aafb5c Sep 10 11:13:18.208004 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:13:18.207970 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-7sfr4" event={"ID":"63846292-2743-4e69-adfc-178618b942f1","Type":"ContainerStarted","Data":"959d0df5263487c8986f3a14b1185f5339fefd4576be68ff8dc4163835a15d40"} Sep 10 11:13:18.208351 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:13:18.208027 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-7sfr4" event={"ID":"63846292-2743-4e69-adfc-178618b942f1","Type":"ContainerStarted","Data":"8db7e4bc0530838839fadaa0b6ef9ecc301ce5e5b538672638d56dade2aafb5c"} Sep 10 11:13:19.212521 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:13:19.212489 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-7sfr4" event={"ID":"63846292-2743-4e69-adfc-178618b942f1","Type":"ContainerStarted","Data":"d4c45f6ce82b85553a42fedf765d767802ee2dfdd44007d6a830968a831ab4f8"} Sep 10 11:13:20.656017 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:13:20.655991 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/74f68888-4cfe-416f-bce6-e0b42f46aef5-registry-tls\") pod \"image-registry-7864689cc9-sw6sb\" (UID: \"74f68888-4cfe-416f-bce6-e0b42f46aef5\") " pod="openshift-image-registry/image-registry-7864689cc9-sw6sb" Sep 10 11:13:20.656342 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:13:20.656055 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/07ed66ee-327a-4767-a989-0cc7574b0c0f-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-cw9qc\" (UID: \"07ed66ee-327a-4767-a989-0cc7574b0c0f\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-cw9qc" Sep 10 11:13:20.656342 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:13:20.656088 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/3e0bbd18-8afb-43e7-8e61-04d516f482f0-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-sckxh\" (UID: \"3e0bbd18-8afb-43e7-8e61-04d516f482f0\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-sckxh" Sep 10 11:13:20.656342 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:13:20.656107 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7a9cb7ef-ebb9-48cc-8a51-f83540a85612-service-ca-bundle\") pod \"router-default-879b8884d-8tjr9\" (UID: \"7a9cb7ef-ebb9-48cc-8a51-f83540a85612\") " pod="openshift-ingress/router-default-879b8884d-8tjr9" Sep 10 11:13:20.656342 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:13:20.656122 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7a9cb7ef-ebb9-48cc-8a51-f83540a85612-metrics-certs\") pod \"router-default-879b8884d-8tjr9\" (UID: \"7a9cb7ef-ebb9-48cc-8a51-f83540a85612\") " pod="openshift-ingress/router-default-879b8884d-8tjr9" Sep 10 11:13:20.656760 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:13:20.656741 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7a9cb7ef-ebb9-48cc-8a51-f83540a85612-service-ca-bundle\") pod \"router-default-879b8884d-8tjr9\" (UID: \"7a9cb7ef-ebb9-48cc-8a51-f83540a85612\") " pod="openshift-ingress/router-default-879b8884d-8tjr9" Sep 10 11:13:20.658395 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:13:20.658366 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/74f68888-4cfe-416f-bce6-e0b42f46aef5-registry-tls\") pod \"image-registry-7864689cc9-sw6sb\" (UID: \"74f68888-4cfe-416f-bce6-e0b42f46aef5\") " pod="openshift-image-registry/image-registry-7864689cc9-sw6sb" Sep 10 11:13:20.658476 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:13:20.658399 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7a9cb7ef-ebb9-48cc-8a51-f83540a85612-metrics-certs\") pod \"router-default-879b8884d-8tjr9\" (UID: \"7a9cb7ef-ebb9-48cc-8a51-f83540a85612\") " pod="openshift-ingress/router-default-879b8884d-8tjr9" Sep 10 11:13:20.658696 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:13:20.658678 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/07ed66ee-327a-4767-a989-0cc7574b0c0f-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-cw9qc\" (UID: \"07ed66ee-327a-4767-a989-0cc7574b0c0f\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-cw9qc" Sep 10 11:13:20.658736 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:13:20.658685 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/3e0bbd18-8afb-43e7-8e61-04d516f482f0-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-sckxh\" (UID: \"3e0bbd18-8afb-43e7-8e61-04d516f482f0\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-sckxh" Sep 10 11:13:20.680255 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:13:20.680236 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-srqvl\"" Sep 10 11:13:20.687659 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:13:20.687637 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-cw9qc" Sep 10 11:13:20.757358 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:13:20.757332 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c61d89d6-ef29-42ae-aa25-e350ab385462-original-pull-secret\") pod \"global-pull-secret-syncer-kxss9\" (UID: \"c61d89d6-ef29-42ae-aa25-e350ab385462\") " pod="kube-system/global-pull-secret-syncer-kxss9" Sep 10 11:13:20.757537 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:13:20.757380 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c062102c-aa53-4355-9921-4d46efdf94c9-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-bz6mz\" (UID: \"c062102c-aa53-4355-9921-4d46efdf94c9\") " pod="openshift-network-console/networking-console-plugin-79977f9844-bz6mz" Sep 10 11:13:20.757537 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:13:20.757431 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/794743e8-fee9-426f-9546-161a898541e2-metrics-certs\") pod \"network-metrics-daemon-54z9n\" (UID: \"794743e8-fee9-426f-9546-161a898541e2\") " pod="openshift-multus/network-metrics-daemon-54z9n" Sep 10 11:13:20.757537 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:13:20.757471 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/68178850-698c-4ff6-82b8-b345e52851b8-metrics-tls\") pod \"dns-default-crh79\" (UID: \"68178850-698c-4ff6-82b8-b345e52851b8\") " pod="openshift-dns/dns-default-crh79" Sep 10 11:13:20.759552 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:13:20.759531 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/68178850-698c-4ff6-82b8-b345e52851b8-metrics-tls\") pod \"dns-default-crh79\" (UID: \"68178850-698c-4ff6-82b8-b345e52851b8\") " pod="openshift-dns/dns-default-crh79" Sep 10 11:13:20.759649 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:13:20.759531 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c062102c-aa53-4355-9921-4d46efdf94c9-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-bz6mz\" (UID: \"c062102c-aa53-4355-9921-4d46efdf94c9\") " pod="openshift-network-console/networking-console-plugin-79977f9844-bz6mz" Sep 10 11:13:20.760155 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:13:20.760139 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Sep 10 11:13:20.760213 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:13:20.760141 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Sep 10 11:13:20.770059 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:13:20.770042 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c61d89d6-ef29-42ae-aa25-e350ab385462-original-pull-secret\") pod \"global-pull-secret-syncer-kxss9\" (UID: \"c61d89d6-ef29-42ae-aa25-e350ab385462\") " pod="kube-system/global-pull-secret-syncer-kxss9" Sep 10 11:13:20.770133 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:13:20.770087 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/794743e8-fee9-426f-9546-161a898541e2-metrics-certs\") pod \"network-metrics-daemon-54z9n\" (UID: \"794743e8-fee9-426f-9546-161a898541e2\") " pod="openshift-multus/network-metrics-daemon-54z9n" Sep 10 11:13:20.822289 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:13:20.822266 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kxss9" Sep 10 11:13:20.858566 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:13:20.858540 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tpb4z\" (UniqueName: \"kubernetes.io/projected/1f233d76-b986-4ec6-a096-e4bc9d53101f-kube-api-access-tpb4z\") pod \"network-check-target-bvnw9\" (UID: \"1f233d76-b986-4ec6-a096-e4bc9d53101f\") " pod="openshift-network-diagnostics/network-check-target-bvnw9" Sep 10 11:13:20.860706 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:13:20.860688 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tpb4z\" (UniqueName: \"kubernetes.io/projected/1f233d76-b986-4ec6-a096-e4bc9d53101f-kube-api-access-tpb4z\") pod \"network-check-target-bvnw9\" (UID: \"1f233d76-b986-4ec6-a096-e4bc9d53101f\") " pod="openshift-network-diagnostics/network-check-target-bvnw9" Sep 10 11:13:20.901995 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:13:20.901946 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-b5m99\"" Sep 10 11:13:20.909334 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:13:20.909318 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7864689cc9-sw6sb" Sep 10 11:13:20.910782 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:13:20.910765 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-msk79\"" Sep 10 11:13:20.918780 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:13:20.918763 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-879b8884d-8tjr9" Sep 10 11:13:20.942688 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:13:20.942654 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-z48vt\"" Sep 10 11:13:20.950324 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:13:20.950301 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-sckxh" Sep 10 11:13:20.962433 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:13:20.961223 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6cdcc96965-cw9qc"] Sep 10 11:13:20.988394 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:13:20.988138 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-wqmx7\"" Sep 10 11:13:20.996449 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:13:20.996430 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-79977f9844-bz6mz" Sep 10 11:13:21.010391 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:13:21.010368 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-rpwp6\"" Sep 10 11:13:21.017168 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:13:21.017070 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-crh79" Sep 10 11:13:21.027804 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:13:21.027778 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-qdxwv\"" Sep 10 11:13:21.032697 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:13:21.032634 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-t7cdh\"" Sep 10 11:13:21.036095 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:13:21.036063 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bvnw9" Sep 10 11:13:21.040335 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:13:21.040319 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-54z9n" Sep 10 11:13:21.091133 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:13:21.091002 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-kxss9"] Sep 10 11:13:21.096038 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:13:21.095986 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc61d89d6_ef29_42ae_aa25_e350ab385462.slice/crio-a4aa973d3b4e6e7db276f1cad4ab3b2bca0ac5f27cff68ca3e8d830c55f7d463 WatchSource:0}: Error finding container a4aa973d3b4e6e7db276f1cad4ab3b2bca0ac5f27cff68ca3e8d830c55f7d463: Status 404 returned error can't find the container with id a4aa973d3b4e6e7db276f1cad4ab3b2bca0ac5f27cff68ca3e8d830c55f7d463 Sep 10 11:13:21.188226 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:13:21.188166 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7864689cc9-sw6sb"] Sep 10 11:13:21.190808 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:13:21.190785 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod74f68888_4cfe_416f_bce6_e0b42f46aef5.slice/crio-f3c14af1769df4a4b6cb191d11dac9abe6a887fa8b9ee8a77a16b05bd426cec5 WatchSource:0}: Error finding container f3c14af1769df4a4b6cb191d11dac9abe6a887fa8b9ee8a77a16b05bd426cec5: Status 404 returned error can't find the container with id f3c14af1769df4a4b6cb191d11dac9abe6a887fa8b9ee8a77a16b05bd426cec5 Sep 10 11:13:21.192589 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:13:21.192567 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-879b8884d-8tjr9"] Sep 10 11:13:21.195146 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:13:21.195122 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7a9cb7ef_ebb9_48cc_8a51_f83540a85612.slice/crio-cb1ce1ef9c36d21d1fc4383268dc31544f90d5295911930761a86f7ff5c2169a WatchSource:0}: Error finding container cb1ce1ef9c36d21d1fc4383268dc31544f90d5295911930761a86f7ff5c2169a: Status 404 returned error can't find the container with id cb1ce1ef9c36d21d1fc4383268dc31544f90d5295911930761a86f7ff5c2169a Sep 10 11:13:21.220823 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:13:21.220793 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-879b8884d-8tjr9" event={"ID":"7a9cb7ef-ebb9-48cc-8a51-f83540a85612","Type":"ContainerStarted","Data":"cb1ce1ef9c36d21d1fc4383268dc31544f90d5295911930761a86f7ff5c2169a"} Sep 10 11:13:21.223481 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:13:21.223453 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-7sfr4" event={"ID":"63846292-2743-4e69-adfc-178618b942f1","Type":"ContainerStarted","Data":"de9f87090e1510028525c352cfc2127e2d602467942639dfece4295857f946d3"} Sep 10 11:13:21.225493 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:13:21.225429 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-kxss9" event={"ID":"c61d89d6-ef29-42ae-aa25-e350ab385462","Type":"ContainerStarted","Data":"a4aa973d3b4e6e7db276f1cad4ab3b2bca0ac5f27cff68ca3e8d830c55f7d463"} Sep 10 11:13:21.227471 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:13:21.227443 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-cw9qc" event={"ID":"07ed66ee-327a-4767-a989-0cc7574b0c0f","Type":"ContainerStarted","Data":"cc9cfa257d1625564588a85639b2f41385f4168442d070ed4d142862e41fb8f0"} Sep 10 11:13:21.229185 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:13:21.229165 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7864689cc9-sw6sb" event={"ID":"74f68888-4cfe-416f-bce6-e0b42f46aef5","Type":"ContainerStarted","Data":"f3c14af1769df4a4b6cb191d11dac9abe6a887fa8b9ee8a77a16b05bd426cec5"} Sep 10 11:13:21.233254 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:13:21.233231 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-sckxh"] Sep 10 11:13:21.243285 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:13:21.243246 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-7sfr4" podStartSLOduration=17.098819604 podStartE2EDuration="20.243232718s" totalImagesPullingTime="3.144413114s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 11:13:01 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 11:13:21.242668496 +0000 UTC m=+66.839229723" watchObservedRunningTime="2026-09-10 11:13:21.243232718 +0000 UTC m=+66.839793933" Sep 10 11:13:21.281587 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:13:21.281558 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-79977f9844-bz6mz"] Sep 10 11:13:21.286928 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:13:21.286898 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc062102c_aa53_4355_9921_4d46efdf94c9.slice/crio-c60601326295696963aaca33c7a2de071de026f50d652cc6642f6fb2ee7a7467 WatchSource:0}: Error finding container c60601326295696963aaca33c7a2de071de026f50d652cc6642f6fb2ee7a7467: Status 404 returned error can't find the container with id c60601326295696963aaca33c7a2de071de026f50d652cc6642f6fb2ee7a7467 Sep 10 11:13:21.304988 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:13:21.304966 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-crh79"] Sep 10 11:13:21.308143 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:13:21.308120 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod68178850_698c_4ff6_82b8_b345e52851b8.slice/crio-c90448d29d0ff318a5715b09274655de23a98d5ecc34c82f380dd766c95f080e WatchSource:0}: Error finding container c90448d29d0ff318a5715b09274655de23a98d5ecc34c82f380dd766c95f080e: Status 404 returned error can't find the container with id c90448d29d0ff318a5715b09274655de23a98d5ecc34c82f380dd766c95f080e Sep 10 11:13:21.331829 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:13:21.331808 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-bvnw9"] Sep 10 11:13:21.334587 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:13:21.334538 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-54z9n"] Sep 10 11:13:21.335715 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:13:21.335695 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1f233d76_b986_4ec6_a096_e4bc9d53101f.slice/crio-18ab3266c99c59e70a8e3e4f7622a5755e4cdf6878019522330d4de279b5b504 WatchSource:0}: Error finding container 18ab3266c99c59e70a8e3e4f7622a5755e4cdf6878019522330d4de279b5b504: Status 404 returned error can't find the container with id 18ab3266c99c59e70a8e3e4f7622a5755e4cdf6878019522330d4de279b5b504 Sep 10 11:13:21.337063 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:13:21.337040 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod794743e8_fee9_426f_9546_161a898541e2.slice/crio-9e2f6bf6c2059bf176f2615094977586530508a9e8635c4c1201aee56baf14c1 WatchSource:0}: Error finding container 9e2f6bf6c2059bf176f2615094977586530508a9e8635c4c1201aee56baf14c1: Status 404 returned error can't find the container with id 9e2f6bf6c2059bf176f2615094977586530508a9e8635c4c1201aee56baf14c1 Sep 10 11:13:21.912041 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:13:21.912013 2564 scope.go:117] "RemoveContainer" containerID="abd8be5a6737402e162520052096fa15b57c0c04387159047c9af11647625047" Sep 10 11:13:22.255535 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:13:22.254676 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-879b8884d-8tjr9" event={"ID":"7a9cb7ef-ebb9-48cc-8a51-f83540a85612","Type":"ContainerStarted","Data":"3fc17e7d15b30985ee3585228ec0d00ddb33e4584ce7f177560a75870b2990b9"} Sep 10 11:13:22.259809 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:13:22.258489 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-bvnw9" event={"ID":"1f233d76-b986-4ec6-a096-e4bc9d53101f","Type":"ContainerStarted","Data":"99041a5dfcbdb729bb7edd70f79c9ae1898171f94ab83883b72cddc3f7a59fca"} Sep 10 11:13:22.259809 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:13:22.258536 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-bvnw9" event={"ID":"1f233d76-b986-4ec6-a096-e4bc9d53101f","Type":"ContainerStarted","Data":"18ab3266c99c59e70a8e3e4f7622a5755e4cdf6878019522330d4de279b5b504"} Sep 10 11:13:22.259809 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:13:22.259068 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-bvnw9" Sep 10 11:13:22.262939 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:13:22.262866 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-crh79" event={"ID":"68178850-698c-4ff6-82b8-b345e52851b8","Type":"ContainerStarted","Data":"c90448d29d0ff318a5715b09274655de23a98d5ecc34c82f380dd766c95f080e"} Sep 10 11:13:22.264655 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:13:22.264588 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-79977f9844-bz6mz" event={"ID":"c062102c-aa53-4355-9921-4d46efdf94c9","Type":"ContainerStarted","Data":"c60601326295696963aaca33c7a2de071de026f50d652cc6642f6fb2ee7a7467"} Sep 10 11:13:22.267938 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:13:22.267836 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-sckxh" event={"ID":"3e0bbd18-8afb-43e7-8e61-04d516f482f0","Type":"ContainerStarted","Data":"f5a2fb948f44900aafa36cc835d7359a7c782572074a9dc383183aabd6c45c2d"} Sep 10 11:13:22.275632 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:13:22.273138 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-l2hf2_7f298f77-06d2-4ea6-b4fc-cb2c5e9080de/console-operator/1.log" Sep 10 11:13:22.275632 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:13:22.273232 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-85b454874b-l2hf2" event={"ID":"7f298f77-06d2-4ea6-b4fc-cb2c5e9080de","Type":"ContainerStarted","Data":"0cfbd514e336d580609decd82d18dd8ec1c7936d26c859e06b334b76e7316458"} Sep 10 11:13:22.275632 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:13:22.275152 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-85b454874b-l2hf2" Sep 10 11:13:22.279168 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:13:22.279129 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-879b8884d-8tjr9" podStartSLOduration=50.279112494 podStartE2EDuration="50.279112494s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 11:12:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 11:13:22.277779769 +0000 UTC m=+67.874340986" watchObservedRunningTime="2026-09-10 11:13:22.279112494 +0000 UTC m=+67.875673800" Sep 10 11:13:22.281602 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:13:22.281090 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7864689cc9-sw6sb" event={"ID":"74f68888-4cfe-416f-bce6-e0b42f46aef5","Type":"ContainerStarted","Data":"44bb3e8c4a4027507188adce4bcad6ff5f2d5f5d100eda0c1c0ea0ee071ab0c6"} Sep 10 11:13:22.281602 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:13:22.281556 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-7864689cc9-sw6sb" Sep 10 11:13:22.285436 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:13:22.285415 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-54z9n" event={"ID":"794743e8-fee9-426f-9546-161a898541e2","Type":"ContainerStarted","Data":"9e2f6bf6c2059bf176f2615094977586530508a9e8635c4c1201aee56baf14c1"} Sep 10 11:13:22.322500 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:13:22.322195 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-bvnw9" podStartSLOduration=67.322175055 podStartE2EDuration="1m7.322175055s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 11:12:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 11:13:22.299770929 +0000 UTC m=+67.896332145" watchObservedRunningTime="2026-09-10 11:13:22.322175055 +0000 UTC m=+67.918736271" Sep 10 11:13:22.322500 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:13:22.322360 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-85b454874b-l2hf2" podStartSLOduration=42.473367797 podStartE2EDuration="50.322349378s" totalImagesPullingTime="7.848981581s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 11:12:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 11:13:22.32047839 +0000 UTC m=+67.917039606" watchObservedRunningTime="2026-09-10 11:13:22.322349378 +0000 UTC m=+67.918910594" Sep 10 11:13:22.345881 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:13:22.345425 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-7864689cc9-sw6sb" podStartSLOduration=66.345405018 podStartE2EDuration="1m6.345405018s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 11:12:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 11:13:22.343623587 +0000 UTC m=+67.940184804" watchObservedRunningTime="2026-09-10 11:13:22.345405018 +0000 UTC m=+67.941966235" Sep 10 11:13:22.790083 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:13:22.790049 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-59f6d749cd-2mjkk"] Sep 10 11:13:22.796417 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:13:22.796387 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-59f6d749cd-2mjkk" Sep 10 11:13:22.801365 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:13:22.801340 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\"" Sep 10 11:13:22.802555 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:13:22.801999 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Sep 10 11:13:22.802555 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:13:22.802219 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Sep 10 11:13:22.802555 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:13:22.802424 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Sep 10 11:13:22.819060 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:13:22.818782 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-59f6d749cd-2mjkk"] Sep 10 11:13:22.877538 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:13:22.877340 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-smwq2\" (UniqueName: \"kubernetes.io/projected/e1e03ca2-4ee6-4ec3-a5bd-0817fb765900-kube-api-access-smwq2\") pod \"klusterlet-addon-workmgr-59f6d749cd-2mjkk\" (UID: \"e1e03ca2-4ee6-4ec3-a5bd-0817fb765900\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-59f6d749cd-2mjkk" Sep 10 11:13:22.877538 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:13:22.877398 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/e1e03ca2-4ee6-4ec3-a5bd-0817fb765900-klusterlet-config\") pod \"klusterlet-addon-workmgr-59f6d749cd-2mjkk\" (UID: \"e1e03ca2-4ee6-4ec3-a5bd-0817fb765900\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-59f6d749cd-2mjkk" Sep 10 11:13:22.877538 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:13:22.877443 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e1e03ca2-4ee6-4ec3-a5bd-0817fb765900-tmp\") pod \"klusterlet-addon-workmgr-59f6d749cd-2mjkk\" (UID: \"e1e03ca2-4ee6-4ec3-a5bd-0817fb765900\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-59f6d749cd-2mjkk" Sep 10 11:13:22.919836 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:13:22.919774 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-879b8884d-8tjr9" Sep 10 11:13:22.922061 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:13:22.921928 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-879b8884d-8tjr9" Sep 10 11:13:22.979576 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:13:22.979106 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-smwq2\" (UniqueName: \"kubernetes.io/projected/e1e03ca2-4ee6-4ec3-a5bd-0817fb765900-kube-api-access-smwq2\") pod \"klusterlet-addon-workmgr-59f6d749cd-2mjkk\" (UID: \"e1e03ca2-4ee6-4ec3-a5bd-0817fb765900\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-59f6d749cd-2mjkk" Sep 10 11:13:22.979576 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:13:22.979165 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/e1e03ca2-4ee6-4ec3-a5bd-0817fb765900-klusterlet-config\") pod \"klusterlet-addon-workmgr-59f6d749cd-2mjkk\" (UID: \"e1e03ca2-4ee6-4ec3-a5bd-0817fb765900\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-59f6d749cd-2mjkk" Sep 10 11:13:22.979576 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:13:22.979211 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e1e03ca2-4ee6-4ec3-a5bd-0817fb765900-tmp\") pod \"klusterlet-addon-workmgr-59f6d749cd-2mjkk\" (UID: \"e1e03ca2-4ee6-4ec3-a5bd-0817fb765900\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-59f6d749cd-2mjkk" Sep 10 11:13:22.979966 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:13:22.979662 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e1e03ca2-4ee6-4ec3-a5bd-0817fb765900-tmp\") pod \"klusterlet-addon-workmgr-59f6d749cd-2mjkk\" (UID: \"e1e03ca2-4ee6-4ec3-a5bd-0817fb765900\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-59f6d749cd-2mjkk" Sep 10 11:13:22.985809 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:13:22.985762 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/e1e03ca2-4ee6-4ec3-a5bd-0817fb765900-klusterlet-config\") pod \"klusterlet-addon-workmgr-59f6d749cd-2mjkk\" (UID: \"e1e03ca2-4ee6-4ec3-a5bd-0817fb765900\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-59f6d749cd-2mjkk" Sep 10 11:13:23.006644 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:13:22.999170 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-smwq2\" (UniqueName: \"kubernetes.io/projected/e1e03ca2-4ee6-4ec3-a5bd-0817fb765900-kube-api-access-smwq2\") pod \"klusterlet-addon-workmgr-59f6d749cd-2mjkk\" (UID: \"e1e03ca2-4ee6-4ec3-a5bd-0817fb765900\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-59f6d749cd-2mjkk" Sep 10 11:13:23.031556 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:13:23.031354 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-85b454874b-l2hf2" Sep 10 11:13:23.112618 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:13:23.112123 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-59f6d749cd-2mjkk" Sep 10 11:13:23.260469 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:13:23.260431 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-85d98c998f-xd4wd"] Sep 10 11:13:23.263986 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:13:23.263957 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-85d98c998f-xd4wd" Sep 10 11:13:23.268549 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:13:23.267544 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-6d5fb\"" Sep 10 11:13:23.268549 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:13:23.267817 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Sep 10 11:13:23.268549 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:13:23.268017 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Sep 10 11:13:23.279168 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:13:23.279109 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-85d98c998f-xd4wd"] Sep 10 11:13:23.293379 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:13:23.293170 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-879b8884d-8tjr9" Sep 10 11:13:23.294550 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:13:23.294528 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-879b8884d-8tjr9" Sep 10 11:13:23.388088 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:13:23.388021 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bcnnl\" (UniqueName: \"kubernetes.io/projected/83b0361a-4ac0-46ce-9542-e92483e72b82-kube-api-access-bcnnl\") pod \"downloads-85d98c998f-xd4wd\" (UID: \"83b0361a-4ac0-46ce-9542-e92483e72b82\") " pod="openshift-console/downloads-85d98c998f-xd4wd" Sep 10 11:13:23.489482 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:13:23.489447 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bcnnl\" (UniqueName: \"kubernetes.io/projected/83b0361a-4ac0-46ce-9542-e92483e72b82-kube-api-access-bcnnl\") pod \"downloads-85d98c998f-xd4wd\" (UID: \"83b0361a-4ac0-46ce-9542-e92483e72b82\") " pod="openshift-console/downloads-85d98c998f-xd4wd" Sep 10 11:13:23.508248 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:13:23.508196 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bcnnl\" (UniqueName: \"kubernetes.io/projected/83b0361a-4ac0-46ce-9542-e92483e72b82-kube-api-access-bcnnl\") pod \"downloads-85d98c998f-xd4wd\" (UID: \"83b0361a-4ac0-46ce-9542-e92483e72b82\") " pod="openshift-console/downloads-85d98c998f-xd4wd" Sep 10 11:13:23.580916 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:13:23.580886 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-85d98c998f-xd4wd" Sep 10 11:13:27.527060 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:13:27.526953 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-59f6d749cd-2mjkk"] Sep 10 11:13:27.535462 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:13:27.535434 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-85d98c998f-xd4wd"] Sep 10 11:13:27.623005 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:13:27.622964 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode1e03ca2_4ee6_4ec3_a5bd_0817fb765900.slice/crio-64fa1952efdcb92ee865bc9751de9bd27521dcb8b327856bdd6dd60fc58fe392 WatchSource:0}: Error finding container 64fa1952efdcb92ee865bc9751de9bd27521dcb8b327856bdd6dd60fc58fe392: Status 404 returned error can't find the container with id 64fa1952efdcb92ee865bc9751de9bd27521dcb8b327856bdd6dd60fc58fe392 Sep 10 11:13:27.624002 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:13:27.623960 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod83b0361a_4ac0_46ce_9542_e92483e72b82.slice/crio-6ddbbf05824fdff1a20f9cfd460bd9bf39cb94b4cc0d38f7577ac6b906422119 WatchSource:0}: Error finding container 6ddbbf05824fdff1a20f9cfd460bd9bf39cb94b4cc0d38f7577ac6b906422119: Status 404 returned error can't find the container with id 6ddbbf05824fdff1a20f9cfd460bd9bf39cb94b4cc0d38f7577ac6b906422119 Sep 10 11:13:27.956392 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:13:27.956354 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-wg57c"] Sep 10 11:13:27.981443 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:13:27.981378 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-wg57c"] Sep 10 11:13:27.981569 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:13:27.981470 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-wg57c" Sep 10 11:13:27.984258 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:13:27.984232 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Sep 10 11:13:27.984374 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:13:27.984275 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-hgvnh\"" Sep 10 11:13:28.127942 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:13:28.127920 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/e9183ea6-bdca-47c6-b0b9-f3e8e3f51783-tls-certificates\") pod \"prometheus-operator-admission-webhook-78f599db79-wg57c\" (UID: \"e9183ea6-bdca-47c6-b0b9-f3e8e3f51783\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-wg57c" Sep 10 11:13:28.228826 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:13:28.228798 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/e9183ea6-bdca-47c6-b0b9-f3e8e3f51783-tls-certificates\") pod \"prometheus-operator-admission-webhook-78f599db79-wg57c\" (UID: \"e9183ea6-bdca-47c6-b0b9-f3e8e3f51783\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-wg57c" Sep 10 11:13:28.232266 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:13:28.232189 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/e9183ea6-bdca-47c6-b0b9-f3e8e3f51783-tls-certificates\") pod \"prometheus-operator-admission-webhook-78f599db79-wg57c\" (UID: \"e9183ea6-bdca-47c6-b0b9-f3e8e3f51783\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-wg57c" Sep 10 11:13:28.290543 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:13:28.290354 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-wg57c" Sep 10 11:13:28.320545 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:13:28.320481 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-crh79" event={"ID":"68178850-698c-4ff6-82b8-b345e52851b8","Type":"ContainerStarted","Data":"1a1f21c2cd1499fba324fc5b4e42e8665de1d1bc74b543c05973578f6311e34e"} Sep 10 11:13:28.320545 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:13:28.320538 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-crh79" event={"ID":"68178850-698c-4ff6-82b8-b345e52851b8","Type":"ContainerStarted","Data":"c653e18f08c2aef8a4b8e9f59c9aa170accccd3cb7f77839e61f509c6d60ab3c"} Sep 10 11:13:28.320721 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:13:28.320583 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-crh79" Sep 10 11:13:28.323285 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:13:28.323204 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-cw9qc" event={"ID":"07ed66ee-327a-4767-a989-0cc7574b0c0f","Type":"ContainerStarted","Data":"e2facbb515699e78766ace56a08648b1e1cccf3d529ee6c2da25d1e54e1fe3fe"} Sep 10 11:13:28.325587 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:13:28.325564 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-79977f9844-bz6mz" event={"ID":"c062102c-aa53-4355-9921-4d46efdf94c9","Type":"ContainerStarted","Data":"63f7884439dcad55405994f22adcbda447ca96a5b47c882f8fd58137f069577b"} Sep 10 11:13:28.329074 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:13:28.328632 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-sckxh" event={"ID":"3e0bbd18-8afb-43e7-8e61-04d516f482f0","Type":"ContainerStarted","Data":"926241e0f3ce69b2b155a9436d0e3ac2edef26236cc11d23c34c581f2402329f"} Sep 10 11:13:28.329074 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:13:28.328683 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-sckxh" event={"ID":"3e0bbd18-8afb-43e7-8e61-04d516f482f0","Type":"ContainerStarted","Data":"cfc547d26ef851a4ec17880763ab07b3a45eb1b886bd8063e380c393979d6d34"} Sep 10 11:13:28.330383 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:13:28.330351 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-85d98c998f-xd4wd" event={"ID":"83b0361a-4ac0-46ce-9542-e92483e72b82","Type":"ContainerStarted","Data":"6ddbbf05824fdff1a20f9cfd460bd9bf39cb94b4cc0d38f7577ac6b906422119"} Sep 10 11:13:28.332798 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:13:28.332769 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-59f6d749cd-2mjkk" event={"ID":"e1e03ca2-4ee6-4ec3-a5bd-0817fb765900","Type":"ContainerStarted","Data":"64fa1952efdcb92ee865bc9751de9bd27521dcb8b327856bdd6dd60fc58fe392"} Sep 10 11:13:28.335024 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:13:28.335001 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-kxss9" event={"ID":"c61d89d6-ef29-42ae-aa25-e350ab385462","Type":"ContainerStarted","Data":"dce13d1448944552e75eda865eada993301d511c3ae8b2aad0f42c1f44ec6d9e"} Sep 10 11:13:28.340206 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:13:28.340173 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-54z9n" event={"ID":"794743e8-fee9-426f-9546-161a898541e2","Type":"ContainerStarted","Data":"0a6ca07b628d4bd78e68c0f48acbaafec0fced0282f084f401b3c2f2cb980e05"} Sep 10 11:13:28.340345 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:13:28.340266 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-54z9n" event={"ID":"794743e8-fee9-426f-9546-161a898541e2","Type":"ContainerStarted","Data":"80f8bb630bb51bab872cbc6494c74d0177fdb6e430a76a76fd91ddcf51d51bd6"} Sep 10 11:13:28.355991 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:13:28.355943 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-crh79" podStartSLOduration=34.406720961 podStartE2EDuration="40.355924301s" totalImagesPullingTime="5.94920334s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 11:12:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 11:13:28.353782655 +0000 UTC m=+73.950343871" watchObservedRunningTime="2026-09-10 11:13:28.355924301 +0000 UTC m=+73.952485516" Sep 10 11:13:28.395965 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:13:28.394720 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-54z9n" podStartSLOduration=66.480319551 podStartE2EDuration="1m12.394700123s" totalImagesPullingTime="5.914380572s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 11:12:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 11:13:28.393654591 +0000 UTC m=+73.990215806" watchObservedRunningTime="2026-09-10 11:13:28.394700123 +0000 UTC m=+73.991261338" Sep 10 11:13:28.426241 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:13:28.426179 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-sckxh" podStartSLOduration=50.433052439 podStartE2EDuration="56.426159685s" totalImagesPullingTime="5.993107246s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 11:12:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 11:13:28.423967641 +0000 UTC m=+74.020528857" watchObservedRunningTime="2026-09-10 11:13:28.426159685 +0000 UTC m=+74.022720901" Sep 10 11:13:28.445672 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:13:28.445619 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-79977f9844-bz6mz" podStartSLOduration=50.535860826 podStartE2EDuration="56.44560076s" totalImagesPullingTime="5.909739934s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 11:12:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 11:13:28.444472499 +0000 UTC m=+74.041033743" watchObservedRunningTime="2026-09-10 11:13:28.44560076 +0000 UTC m=+74.042161976" Sep 10 11:13:28.489368 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:13:28.489218 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-kxss9" podStartSLOduration=65.934158002 podStartE2EDuration="1m12.489199927s" totalImagesPullingTime="6.555041925s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 11:12:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 11:13:28.469658838 +0000 UTC m=+74.066220054" watchObservedRunningTime="2026-09-10 11:13:28.489199927 +0000 UTC m=+74.085761144" Sep 10 11:13:28.609686 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:13:28.609623 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-cw9qc" podStartSLOduration=50.327240326 podStartE2EDuration="56.609598996s" totalImagesPullingTime="6.28235867s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 11:12:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 11:13:28.489512663 +0000 UTC m=+74.086073880" watchObservedRunningTime="2026-09-10 11:13:28.609598996 +0000 UTC m=+74.206160212" Sep 10 11:13:28.610990 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:13:28.610928 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-wg57c"] Sep 10 11:13:28.614028 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:13:28.614002 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode9183ea6_bdca_47c6_b0b9_f3e8e3f51783.slice/crio-10bb11a4fc1196b05b36da0c58a738d2ddccb95429750b6333e5aa42b5676d50 WatchSource:0}: Error finding container 10bb11a4fc1196b05b36da0c58a738d2ddccb95429750b6333e5aa42b5676d50: Status 404 returned error can't find the container with id 10bb11a4fc1196b05b36da0c58a738d2ddccb95429750b6333e5aa42b5676d50 Sep 10 11:13:29.347077 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:13:29.347034 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-wg57c" event={"ID":"e9183ea6-bdca-47c6-b0b9-f3e8e3f51783","Type":"ContainerStarted","Data":"10bb11a4fc1196b05b36da0c58a738d2ddccb95429750b6333e5aa42b5676d50"} Sep 10 11:13:33.369308 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:13:33.369245 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-59f6d749cd-2mjkk" event={"ID":"e1e03ca2-4ee6-4ec3-a5bd-0817fb765900","Type":"ContainerStarted","Data":"62d82d630af432910bd7346b98941b89686c3904c9f34ab5a7c36f698ecbd14f"} Sep 10 11:13:33.369810 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:13:33.369344 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-59f6d749cd-2mjkk" Sep 10 11:13:33.371398 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:13:33.371375 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-59f6d749cd-2mjkk" Sep 10 11:13:33.371528 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:13:33.371420 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-wg57c" event={"ID":"e9183ea6-bdca-47c6-b0b9-f3e8e3f51783","Type":"ContainerStarted","Data":"d42169adf2c82fa4b4aac96a780cf10fea834d339acf2f6cbfa2e7eff72d4a59"} Sep 10 11:13:33.371607 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:13:33.371526 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-wg57c" Sep 10 11:13:33.376510 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:13:33.376482 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-wg57c" Sep 10 11:13:33.394295 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:13:33.394216 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-59f6d749cd-2mjkk" podStartSLOduration=6.486281453 podStartE2EDuration="11.394199015s" totalImagesPullingTime="4.907917562s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 11:13:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 11:13:33.391197151 +0000 UTC m=+78.987758367" watchObservedRunningTime="2026-09-10 11:13:33.394199015 +0000 UTC m=+78.990760231" Sep 10 11:13:33.408622 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:13:33.408583 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-wg57c" podStartSLOduration=2.19001724 podStartE2EDuration="6.408575228s" totalImagesPullingTime="4.218557988s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 11:13:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 11:13:33.407333365 +0000 UTC m=+79.003894581" watchObservedRunningTime="2026-09-10 11:13:33.408575228 +0000 UTC m=+79.005136448" Sep 10 11:13:38.350319 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:13:38.349958 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-crh79" Sep 10 11:13:40.505683 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:13:40.505646 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-pvpkj"] Sep 10 11:13:40.510685 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:13:40.510662 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-pvpkj" Sep 10 11:13:40.513306 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:13:40.513282 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Sep 10 11:13:40.513455 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:13:40.513432 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Sep 10 11:13:40.513455 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:13:40.513448 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Sep 10 11:13:40.513602 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:13:40.513519 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Sep 10 11:13:40.514077 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:13:40.514058 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-x7xds\"" Sep 10 11:13:40.634461 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:13:40.634429 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5f6f3d44-cc80-4965-a007-7a53e9790f9f-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-pvpkj\" (UID: \"5f6f3d44-cc80-4965-a007-7a53e9790f9f\") " pod="openshift-monitoring/node-exporter-pvpkj" Sep 10 11:13:40.634627 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:13:40.634471 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/5f6f3d44-cc80-4965-a007-7a53e9790f9f-root\") pod \"node-exporter-pvpkj\" (UID: \"5f6f3d44-cc80-4965-a007-7a53e9790f9f\") " pod="openshift-monitoring/node-exporter-pvpkj" Sep 10 11:13:40.634627 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:13:40.634499 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xgcd5\" (UniqueName: \"kubernetes.io/projected/5f6f3d44-cc80-4965-a007-7a53e9790f9f-kube-api-access-xgcd5\") pod \"node-exporter-pvpkj\" (UID: \"5f6f3d44-cc80-4965-a007-7a53e9790f9f\") " pod="openshift-monitoring/node-exporter-pvpkj" Sep 10 11:13:40.634627 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:13:40.634592 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/5f6f3d44-cc80-4965-a007-7a53e9790f9f-node-exporter-textfile\") pod \"node-exporter-pvpkj\" (UID: \"5f6f3d44-cc80-4965-a007-7a53e9790f9f\") " pod="openshift-monitoring/node-exporter-pvpkj" Sep 10 11:13:40.634627 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:13:40.634621 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/5f6f3d44-cc80-4965-a007-7a53e9790f9f-node-exporter-tls\") pod \"node-exporter-pvpkj\" (UID: \"5f6f3d44-cc80-4965-a007-7a53e9790f9f\") " pod="openshift-monitoring/node-exporter-pvpkj" Sep 10 11:13:40.634825 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:13:40.634659 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/5f6f3d44-cc80-4965-a007-7a53e9790f9f-node-exporter-wtmp\") pod \"node-exporter-pvpkj\" (UID: \"5f6f3d44-cc80-4965-a007-7a53e9790f9f\") " pod="openshift-monitoring/node-exporter-pvpkj" Sep 10 11:13:40.634825 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:13:40.634699 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5f6f3d44-cc80-4965-a007-7a53e9790f9f-metrics-client-ca\") pod \"node-exporter-pvpkj\" (UID: \"5f6f3d44-cc80-4965-a007-7a53e9790f9f\") " pod="openshift-monitoring/node-exporter-pvpkj" Sep 10 11:13:40.634825 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:13:40.634736 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/5f6f3d44-cc80-4965-a007-7a53e9790f9f-node-exporter-accelerators-collector-config\") pod \"node-exporter-pvpkj\" (UID: \"5f6f3d44-cc80-4965-a007-7a53e9790f9f\") " pod="openshift-monitoring/node-exporter-pvpkj" Sep 10 11:13:40.634825 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:13:40.634768 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5f6f3d44-cc80-4965-a007-7a53e9790f9f-sys\") pod \"node-exporter-pvpkj\" (UID: \"5f6f3d44-cc80-4965-a007-7a53e9790f9f\") " pod="openshift-monitoring/node-exporter-pvpkj" Sep 10 11:13:40.736159 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:13:40.736122 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/5f6f3d44-cc80-4965-a007-7a53e9790f9f-node-exporter-textfile\") pod \"node-exporter-pvpkj\" (UID: \"5f6f3d44-cc80-4965-a007-7a53e9790f9f\") " pod="openshift-monitoring/node-exporter-pvpkj" Sep 10 11:13:40.736316 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:13:40.736166 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/5f6f3d44-cc80-4965-a007-7a53e9790f9f-node-exporter-tls\") pod \"node-exporter-pvpkj\" (UID: \"5f6f3d44-cc80-4965-a007-7a53e9790f9f\") " pod="openshift-monitoring/node-exporter-pvpkj" Sep 10 11:13:40.736316 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:13:40.736203 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/5f6f3d44-cc80-4965-a007-7a53e9790f9f-node-exporter-wtmp\") pod \"node-exporter-pvpkj\" (UID: \"5f6f3d44-cc80-4965-a007-7a53e9790f9f\") " pod="openshift-monitoring/node-exporter-pvpkj" Sep 10 11:13:40.736316 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:13:40.736250 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5f6f3d44-cc80-4965-a007-7a53e9790f9f-metrics-client-ca\") pod \"node-exporter-pvpkj\" (UID: \"5f6f3d44-cc80-4965-a007-7a53e9790f9f\") " pod="openshift-monitoring/node-exporter-pvpkj" Sep 10 11:13:40.736316 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:13:40.736278 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/5f6f3d44-cc80-4965-a007-7a53e9790f9f-node-exporter-accelerators-collector-config\") pod \"node-exporter-pvpkj\" (UID: \"5f6f3d44-cc80-4965-a007-7a53e9790f9f\") " pod="openshift-monitoring/node-exporter-pvpkj" Sep 10 11:13:40.736316 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:13:40.736309 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5f6f3d44-cc80-4965-a007-7a53e9790f9f-sys\") pod \"node-exporter-pvpkj\" (UID: \"5f6f3d44-cc80-4965-a007-7a53e9790f9f\") " pod="openshift-monitoring/node-exporter-pvpkj" Sep 10 11:13:40.736585 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:13:40.736341 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5f6f3d44-cc80-4965-a007-7a53e9790f9f-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-pvpkj\" (UID: \"5f6f3d44-cc80-4965-a007-7a53e9790f9f\") " pod="openshift-monitoring/node-exporter-pvpkj" Sep 10 11:13:40.736585 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:13:40.736364 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/5f6f3d44-cc80-4965-a007-7a53e9790f9f-root\") pod \"node-exporter-pvpkj\" (UID: \"5f6f3d44-cc80-4965-a007-7a53e9790f9f\") " pod="openshift-monitoring/node-exporter-pvpkj" Sep 10 11:13:40.736585 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:13:40.736390 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xgcd5\" (UniqueName: \"kubernetes.io/projected/5f6f3d44-cc80-4965-a007-7a53e9790f9f-kube-api-access-xgcd5\") pod \"node-exporter-pvpkj\" (UID: \"5f6f3d44-cc80-4965-a007-7a53e9790f9f\") " pod="openshift-monitoring/node-exporter-pvpkj" Sep 10 11:13:40.736585 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:13:40.736415 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5f6f3d44-cc80-4965-a007-7a53e9790f9f-sys\") pod \"node-exporter-pvpkj\" (UID: \"5f6f3d44-cc80-4965-a007-7a53e9790f9f\") " pod="openshift-monitoring/node-exporter-pvpkj" Sep 10 11:13:40.736585 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:13:40.736495 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/5f6f3d44-cc80-4965-a007-7a53e9790f9f-node-exporter-textfile\") pod \"node-exporter-pvpkj\" (UID: \"5f6f3d44-cc80-4965-a007-7a53e9790f9f\") " pod="openshift-monitoring/node-exporter-pvpkj" Sep 10 11:13:40.736585 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:13:40.736497 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/5f6f3d44-cc80-4965-a007-7a53e9790f9f-node-exporter-wtmp\") pod \"node-exporter-pvpkj\" (UID: \"5f6f3d44-cc80-4965-a007-7a53e9790f9f\") " pod="openshift-monitoring/node-exporter-pvpkj" Sep 10 11:13:40.736585 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:13:40.736538 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/5f6f3d44-cc80-4965-a007-7a53e9790f9f-root\") pod \"node-exporter-pvpkj\" (UID: \"5f6f3d44-cc80-4965-a007-7a53e9790f9f\") " pod="openshift-monitoring/node-exporter-pvpkj" Sep 10 11:13:40.736967 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:13:40.736951 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5f6f3d44-cc80-4965-a007-7a53e9790f9f-metrics-client-ca\") pod \"node-exporter-pvpkj\" (UID: \"5f6f3d44-cc80-4965-a007-7a53e9790f9f\") " pod="openshift-monitoring/node-exporter-pvpkj" Sep 10 11:13:40.737113 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:13:40.737085 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/5f6f3d44-cc80-4965-a007-7a53e9790f9f-node-exporter-accelerators-collector-config\") pod \"node-exporter-pvpkj\" (UID: \"5f6f3d44-cc80-4965-a007-7a53e9790f9f\") " pod="openshift-monitoring/node-exporter-pvpkj" Sep 10 11:13:40.738747 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:13:40.738709 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5f6f3d44-cc80-4965-a007-7a53e9790f9f-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-pvpkj\" (UID: \"5f6f3d44-cc80-4965-a007-7a53e9790f9f\") " pod="openshift-monitoring/node-exporter-pvpkj" Sep 10 11:13:40.738906 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:13:40.738888 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/5f6f3d44-cc80-4965-a007-7a53e9790f9f-node-exporter-tls\") pod \"node-exporter-pvpkj\" (UID: \"5f6f3d44-cc80-4965-a007-7a53e9790f9f\") " pod="openshift-monitoring/node-exporter-pvpkj" Sep 10 11:13:40.747896 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:13:40.747825 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xgcd5\" (UniqueName: \"kubernetes.io/projected/5f6f3d44-cc80-4965-a007-7a53e9790f9f-kube-api-access-xgcd5\") pod \"node-exporter-pvpkj\" (UID: \"5f6f3d44-cc80-4965-a007-7a53e9790f9f\") " pod="openshift-monitoring/node-exporter-pvpkj" Sep 10 11:13:40.821601 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:13:40.821531 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-pvpkj" Sep 10 11:13:44.301870 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:13:44.301832 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-7864689cc9-sw6sb" Sep 10 11:13:45.315134 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:13:45.315100 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7864689cc9-sw6sb"] Sep 10 11:13:46.140545 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:13:46.140500 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5f6f3d44_cc80_4965_a007_7a53e9790f9f.slice/crio-d3c9c1cc68d9da643ab6e6460b5c371eea44c8aed8aebcfae9ef5b127eb4353d WatchSource:0}: Error finding container d3c9c1cc68d9da643ab6e6460b5c371eea44c8aed8aebcfae9ef5b127eb4353d: Status 404 returned error can't find the container with id d3c9c1cc68d9da643ab6e6460b5c371eea44c8aed8aebcfae9ef5b127eb4353d Sep 10 11:13:46.429959 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:13:46.429890 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-pvpkj" event={"ID":"5f6f3d44-cc80-4965-a007-7a53e9790f9f","Type":"ContainerStarted","Data":"d3c9c1cc68d9da643ab6e6460b5c371eea44c8aed8aebcfae9ef5b127eb4353d"} Sep 10 11:13:47.436988 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:13:47.436802 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-85d98c998f-xd4wd" event={"ID":"83b0361a-4ac0-46ce-9542-e92483e72b82","Type":"ContainerStarted","Data":"33e3b1b7d07f79fa2d62a562ec4a8dbd18a14d476f548b3e9f916c23d8144a3f"} Sep 10 11:13:47.436988 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:13:47.436937 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-85d98c998f-xd4wd" Sep 10 11:13:47.439362 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:13:47.439331 2564 generic.go:356] "Generic (PLEG): container finished" podID="5f6f3d44-cc80-4965-a007-7a53e9790f9f" containerID="3f25dbff327627b5cec5b969093369391a269f7fd1feeccbccec75b1ba9f660f" exitCode=0 Sep 10 11:13:47.439474 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:13:47.439383 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-pvpkj" event={"ID":"5f6f3d44-cc80-4965-a007-7a53e9790f9f","Type":"ContainerDied","Data":"3f25dbff327627b5cec5b969093369391a269f7fd1feeccbccec75b1ba9f660f"} Sep 10 11:13:47.443300 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:13:47.443276 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-85d98c998f-xd4wd" Sep 10 11:13:47.482339 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:13:47.482296 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-85d98c998f-xd4wd" podStartSLOduration=5.587957656 podStartE2EDuration="24.482276827s" totalImagesPullingTime="18.894319171s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 11:13:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 11:13:47.460554359 +0000 UTC m=+93.057115585" watchObservedRunningTime="2026-09-10 11:13:47.482276827 +0000 UTC m=+93.078838081" Sep 10 11:13:48.446943 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:13:48.446903 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-pvpkj" event={"ID":"5f6f3d44-cc80-4965-a007-7a53e9790f9f","Type":"ContainerStarted","Data":"1f3e20ce149be43f7569cb655c6bbca52a5b7838a9d54d541ccb6104fea26d86"} Sep 10 11:13:48.447510 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:13:48.447480 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-pvpkj" event={"ID":"5f6f3d44-cc80-4965-a007-7a53e9790f9f","Type":"ContainerStarted","Data":"f7abdfc81789bf1e21a957abc6d7b36bc6b9c2d93a1023b56234c7587da87e17"} Sep 10 11:13:48.470368 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:13:48.470317 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-pvpkj" podStartSLOduration=7.327760524 podStartE2EDuration="8.470298667s" totalImagesPullingTime="1.06041973s" totalInitContainerRuntime="82.118413ms" isStatefulPod=true podCreationTimestamp="2026-09-10 11:13:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 11:13:48.469164578 +0000 UTC m=+94.065725793" watchObservedRunningTime="2026-09-10 11:13:48.470298667 +0000 UTC m=+94.066859919" Sep 10 11:13:54.299191 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:13:54.299150 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-bvnw9" Sep 10 11:14:10.337158 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:14:10.337117 2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-7864689cc9-sw6sb" podUID="74f68888-4cfe-416f-bce6-e0b42f46aef5" containerName="registry" containerID="cri-o://44bb3e8c4a4027507188adce4bcad6ff5f2d5f5d100eda0c1c0ea0ee071ab0c6" gracePeriod=30 Sep 10 11:14:10.532349 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:14:10.532312 2564 generic.go:356] "Generic (PLEG): container finished" podID="74f68888-4cfe-416f-bce6-e0b42f46aef5" containerID="44bb3e8c4a4027507188adce4bcad6ff5f2d5f5d100eda0c1c0ea0ee071ab0c6" exitCode=0 Sep 10 11:14:10.532349 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:14:10.532335 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7864689cc9-sw6sb" event={"ID":"74f68888-4cfe-416f-bce6-e0b42f46aef5","Type":"ContainerDied","Data":"44bb3e8c4a4027507188adce4bcad6ff5f2d5f5d100eda0c1c0ea0ee071ab0c6"} Sep 10 11:14:10.604029 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:14:10.604006 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7864689cc9-sw6sb" Sep 10 11:14:10.672841 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:14:10.672819 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/74f68888-4cfe-416f-bce6-e0b42f46aef5-registry-tls\") pod \"74f68888-4cfe-416f-bce6-e0b42f46aef5\" (UID: \"74f68888-4cfe-416f-bce6-e0b42f46aef5\") " Sep 10 11:14:10.672994 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:14:10.672934 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/74f68888-4cfe-416f-bce6-e0b42f46aef5-ca-trust-extracted\") pod \"74f68888-4cfe-416f-bce6-e0b42f46aef5\" (UID: \"74f68888-4cfe-416f-bce6-e0b42f46aef5\") " Sep 10 11:14:10.672994 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:14:10.672974 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/74f68888-4cfe-416f-bce6-e0b42f46aef5-registry-certificates\") pod \"74f68888-4cfe-416f-bce6-e0b42f46aef5\" (UID: \"74f68888-4cfe-416f-bce6-e0b42f46aef5\") " Sep 10 11:14:10.673064 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:14:10.673001 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/74f68888-4cfe-416f-bce6-e0b42f46aef5-bound-sa-token\") pod \"74f68888-4cfe-416f-bce6-e0b42f46aef5\" (UID: \"74f68888-4cfe-416f-bce6-e0b42f46aef5\") " Sep 10 11:14:10.673064 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:14:10.673045 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/74f68888-4cfe-416f-bce6-e0b42f46aef5-trusted-ca\") pod \"74f68888-4cfe-416f-bce6-e0b42f46aef5\" (UID: \"74f68888-4cfe-416f-bce6-e0b42f46aef5\") " Sep 10 11:14:10.673146 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:14:10.673070 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hqr9w\" (UniqueName: \"kubernetes.io/projected/74f68888-4cfe-416f-bce6-e0b42f46aef5-kube-api-access-hqr9w\") pod \"74f68888-4cfe-416f-bce6-e0b42f46aef5\" (UID: \"74f68888-4cfe-416f-bce6-e0b42f46aef5\") " Sep 10 11:14:10.673146 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:14:10.673103 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/74f68888-4cfe-416f-bce6-e0b42f46aef5-installation-pull-secrets\") pod \"74f68888-4cfe-416f-bce6-e0b42f46aef5\" (UID: \"74f68888-4cfe-416f-bce6-e0b42f46aef5\") " Sep 10 11:14:10.673268 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:14:10.673243 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/74f68888-4cfe-416f-bce6-e0b42f46aef5-image-registry-private-configuration\") pod \"74f68888-4cfe-416f-bce6-e0b42f46aef5\" (UID: \"74f68888-4cfe-416f-bce6-e0b42f46aef5\") " Sep 10 11:14:10.673526 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:14:10.673491 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/74f68888-4cfe-416f-bce6-e0b42f46aef5-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "74f68888-4cfe-416f-bce6-e0b42f46aef5" (UID: "74f68888-4cfe-416f-bce6-e0b42f46aef5"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 10 11:14:10.674057 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:14:10.674018 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/74f68888-4cfe-416f-bce6-e0b42f46aef5-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "74f68888-4cfe-416f-bce6-e0b42f46aef5" (UID: "74f68888-4cfe-416f-bce6-e0b42f46aef5"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 10 11:14:10.675514 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:14:10.675469 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/74f68888-4cfe-416f-bce6-e0b42f46aef5-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "74f68888-4cfe-416f-bce6-e0b42f46aef5" (UID: "74f68888-4cfe-416f-bce6-e0b42f46aef5"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 10 11:14:10.675619 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:14:10.675508 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/74f68888-4cfe-416f-bce6-e0b42f46aef5-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "74f68888-4cfe-416f-bce6-e0b42f46aef5" (UID: "74f68888-4cfe-416f-bce6-e0b42f46aef5"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 11:14:10.675619 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:14:10.675574 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/74f68888-4cfe-416f-bce6-e0b42f46aef5-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "74f68888-4cfe-416f-bce6-e0b42f46aef5" (UID: "74f68888-4cfe-416f-bce6-e0b42f46aef5"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 11:14:10.675735 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:14:10.675666 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/74f68888-4cfe-416f-bce6-e0b42f46aef5-kube-api-access-hqr9w" (OuterVolumeSpecName: "kube-api-access-hqr9w") pod "74f68888-4cfe-416f-bce6-e0b42f46aef5" (UID: "74f68888-4cfe-416f-bce6-e0b42f46aef5"). InnerVolumeSpecName "kube-api-access-hqr9w". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 11:14:10.675735 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:14:10.675723 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/74f68888-4cfe-416f-bce6-e0b42f46aef5-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "74f68888-4cfe-416f-bce6-e0b42f46aef5" (UID: "74f68888-4cfe-416f-bce6-e0b42f46aef5"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 10 11:14:10.681274 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:14:10.681249 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/74f68888-4cfe-416f-bce6-e0b42f46aef5-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "74f68888-4cfe-416f-bce6-e0b42f46aef5" (UID: "74f68888-4cfe-416f-bce6-e0b42f46aef5"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 10 11:14:10.774280 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:14:10.774260 2564 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/74f68888-4cfe-416f-bce6-e0b42f46aef5-ca-trust-extracted\") on node \"ip-10-0-134-73.ec2.internal\" DevicePath \"\"" Sep 10 11:14:10.774280 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:14:10.774280 2564 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/74f68888-4cfe-416f-bce6-e0b42f46aef5-registry-certificates\") on node \"ip-10-0-134-73.ec2.internal\" DevicePath \"\"" Sep 10 11:14:10.774395 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:14:10.774292 2564 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/74f68888-4cfe-416f-bce6-e0b42f46aef5-bound-sa-token\") on node \"ip-10-0-134-73.ec2.internal\" DevicePath \"\"" Sep 10 11:14:10.774395 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:14:10.774301 2564 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/74f68888-4cfe-416f-bce6-e0b42f46aef5-trusted-ca\") on node \"ip-10-0-134-73.ec2.internal\" DevicePath \"\"" Sep 10 11:14:10.774395 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:14:10.774309 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hqr9w\" (UniqueName: \"kubernetes.io/projected/74f68888-4cfe-416f-bce6-e0b42f46aef5-kube-api-access-hqr9w\") on node \"ip-10-0-134-73.ec2.internal\" DevicePath \"\"" Sep 10 11:14:10.774395 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:14:10.774317 2564 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/74f68888-4cfe-416f-bce6-e0b42f46aef5-installation-pull-secrets\") on node \"ip-10-0-134-73.ec2.internal\" DevicePath \"\"" Sep 10 11:14:10.774395 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:14:10.774326 2564 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/74f68888-4cfe-416f-bce6-e0b42f46aef5-image-registry-private-configuration\") on node \"ip-10-0-134-73.ec2.internal\" DevicePath \"\"" Sep 10 11:14:10.774395 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:14:10.774335 2564 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/74f68888-4cfe-416f-bce6-e0b42f46aef5-registry-tls\") on node \"ip-10-0-134-73.ec2.internal\" DevicePath \"\"" Sep 10 11:14:11.537361 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:14:11.537336 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7864689cc9-sw6sb" Sep 10 11:14:11.537830 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:14:11.537359 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7864689cc9-sw6sb" event={"ID":"74f68888-4cfe-416f-bce6-e0b42f46aef5","Type":"ContainerDied","Data":"f3c14af1769df4a4b6cb191d11dac9abe6a887fa8b9ee8a77a16b05bd426cec5"} Sep 10 11:14:11.537830 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:14:11.537411 2564 scope.go:117] "RemoveContainer" containerID="44bb3e8c4a4027507188adce4bcad6ff5f2d5f5d100eda0c1c0ea0ee071ab0c6" Sep 10 11:14:11.558050 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:14:11.558026 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7864689cc9-sw6sb"] Sep 10 11:14:11.560193 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:14:11.560172 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-7864689cc9-sw6sb"] Sep 10 11:14:12.916406 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:14:12.916372 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="74f68888-4cfe-416f-bce6-e0b42f46aef5" path="/var/lib/kubelet/pods/74f68888-4cfe-416f-bce6-e0b42f46aef5/volumes" Sep 10 11:14:30.606371 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:14:30.606338 2564 generic.go:356] "Generic (PLEG): container finished" podID="35dc51d7-6cf7-42d2-8e35-1a31a3a1ac8f" containerID="2d1ff9cd3b726ced09a7f382f8889d17889d7d3e26bfc852fd7295e26a0ad43c" exitCode=0 Sep 10 11:14:30.606747 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:14:30.606390 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-2kgcg" event={"ID":"35dc51d7-6cf7-42d2-8e35-1a31a3a1ac8f","Type":"ContainerDied","Data":"2d1ff9cd3b726ced09a7f382f8889d17889d7d3e26bfc852fd7295e26a0ad43c"} Sep 10 11:14:30.606747 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:14:30.606701 2564 scope.go:117] "RemoveContainer" containerID="2d1ff9cd3b726ced09a7f382f8889d17889d7d3e26bfc852fd7295e26a0ad43c" Sep 10 11:14:31.611332 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:14:31.611297 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-2kgcg" event={"ID":"35dc51d7-6cf7-42d2-8e35-1a31a3a1ac8f","Type":"ContainerStarted","Data":"9f90164c7c6f07c2e1690c69931b8b318b707837956dcb178cd2d500cb5efd6d"} Sep 10 11:14:31.612641 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:14:31.612615 2564 generic.go:356] "Generic (PLEG): container finished" podID="2aeac0f7-3e8b-4d33-abcc-ae757048a5cf" containerID="aac8a00b2354f1cfedd0dfb01b4e87b91136026ec55673e19506576d01776131" exitCode=0 Sep 10 11:14:31.612773 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:14:31.612660 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-76bcd6ccf5-2srs4" event={"ID":"2aeac0f7-3e8b-4d33-abcc-ae757048a5cf","Type":"ContainerDied","Data":"aac8a00b2354f1cfedd0dfb01b4e87b91136026ec55673e19506576d01776131"} Sep 10 11:14:31.612945 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:14:31.612931 2564 scope.go:117] "RemoveContainer" containerID="aac8a00b2354f1cfedd0dfb01b4e87b91136026ec55673e19506576d01776131" Sep 10 11:14:32.617865 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:14:32.617818 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-76bcd6ccf5-2srs4" event={"ID":"2aeac0f7-3e8b-4d33-abcc-ae757048a5cf","Type":"ContainerStarted","Data":"dcb0b445bd37fac56f28d66e07fe8eb28634b571957df469929aec3114ca69a5"} Sep 10 11:14:35.629529 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:14:35.629495 2564 generic.go:356] "Generic (PLEG): container finished" podID="9e565424-7eca-4f29-8582-664fac065238" containerID="0bcfe804329f50766981c32f478dfb2c86d97b7e6d8f137c9850f1d3acf19025" exitCode=0 Sep 10 11:14:35.630073 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:14:35.629568 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-t55dh" event={"ID":"9e565424-7eca-4f29-8582-664fac065238","Type":"ContainerDied","Data":"0bcfe804329f50766981c32f478dfb2c86d97b7e6d8f137c9850f1d3acf19025"} Sep 10 11:14:35.630073 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:14:35.629952 2564 scope.go:117] "RemoveContainer" containerID="0bcfe804329f50766981c32f478dfb2c86d97b7e6d8f137c9850f1d3acf19025" Sep 10 11:14:36.634731 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:14:36.634697 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-t55dh" event={"ID":"9e565424-7eca-4f29-8582-664fac065238","Type":"ContainerStarted","Data":"8ec7b0b6253dc20cbab994f2c0f2d6b9c849b48d911d9396c29b2aa5fadf23b6"} Sep 10 11:17:14.817680 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:17:14.817644 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-l2hf2_7f298f77-06d2-4ea6-b4fc-cb2c5e9080de/console-operator/1.log" Sep 10 11:17:14.820353 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:17:14.820329 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-l2hf2_7f298f77-06d2-4ea6-b4fc-cb2c5e9080de/console-operator/1.log" Sep 10 11:17:14.829607 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:17:14.829586 2564 kubelet.go:1648] "Image garbage collection succeeded" Sep 10 11:17:21.393810 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:17:21.393775 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["feast-operator-system/feast-operator-controller-manager-588dd546db-njz8z"] Sep 10 11:17:21.394999 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:17:21.394070 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="74f68888-4cfe-416f-bce6-e0b42f46aef5" containerName="registry" Sep 10 11:17:21.394999 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:17:21.394081 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="74f68888-4cfe-416f-bce6-e0b42f46aef5" containerName="registry" Sep 10 11:17:21.394999 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:17:21.394127 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="74f68888-4cfe-416f-bce6-e0b42f46aef5" containerName="registry" Sep 10 11:17:21.395635 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:17:21.395620 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-588dd546db-njz8z" Sep 10 11:17:21.398671 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:17:21.398648 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"feast-operator-system\"/\"feast-operator-controller-manager-dockercfg-m7sfv\"" Sep 10 11:17:21.398953 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:17:21.398937 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"feast-operator-system\"/\"openshift-service-ca.crt\"" Sep 10 11:17:21.399428 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:17:21.399413 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"feast-operator-system\"/\"kube-root-ca.crt\"" Sep 10 11:17:21.413520 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:17:21.413495 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-588dd546db-njz8z"] Sep 10 11:17:21.511192 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:17:21.511167 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2rtvk\" (UniqueName: \"kubernetes.io/projected/5a8e836f-0e99-49e5-be42-68431d7c0aff-kube-api-access-2rtvk\") pod \"feast-operator-controller-manager-588dd546db-njz8z\" (UID: \"5a8e836f-0e99-49e5-be42-68431d7c0aff\") " pod="feast-operator-system/feast-operator-controller-manager-588dd546db-njz8z" Sep 10 11:17:21.612153 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:17:21.612128 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2rtvk\" (UniqueName: \"kubernetes.io/projected/5a8e836f-0e99-49e5-be42-68431d7c0aff-kube-api-access-2rtvk\") pod \"feast-operator-controller-manager-588dd546db-njz8z\" (UID: \"5a8e836f-0e99-49e5-be42-68431d7c0aff\") " pod="feast-operator-system/feast-operator-controller-manager-588dd546db-njz8z" Sep 10 11:17:21.621571 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:17:21.621545 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2rtvk\" (UniqueName: \"kubernetes.io/projected/5a8e836f-0e99-49e5-be42-68431d7c0aff-kube-api-access-2rtvk\") pod \"feast-operator-controller-manager-588dd546db-njz8z\" (UID: \"5a8e836f-0e99-49e5-be42-68431d7c0aff\") " pod="feast-operator-system/feast-operator-controller-manager-588dd546db-njz8z" Sep 10 11:17:21.705484 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:17:21.705426 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-588dd546db-njz8z" Sep 10 11:17:21.975739 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:17:21.975661 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-588dd546db-njz8z"] Sep 10 11:17:21.978850 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:17:21.978825 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5a8e836f_0e99_49e5_be42_68431d7c0aff.slice/crio-eba315623ab511b58087a4e732f02b466c73ad4f556a2645906adfd84266662c WatchSource:0}: Error finding container eba315623ab511b58087a4e732f02b466c73ad4f556a2645906adfd84266662c: Status 404 returned error can't find the container with id eba315623ab511b58087a4e732f02b466c73ad4f556a2645906adfd84266662c Sep 10 11:17:21.980774 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:17:21.980758 2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 10 11:17:22.236609 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:17:22.236525 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-588dd546db-njz8z" event={"ID":"5a8e836f-0e99-49e5-be42-68431d7c0aff","Type":"ContainerStarted","Data":"eba315623ab511b58087a4e732f02b466c73ad4f556a2645906adfd84266662c"} Sep 10 11:17:25.250341 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:17:25.250302 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-588dd546db-njz8z" event={"ID":"5a8e836f-0e99-49e5-be42-68431d7c0aff","Type":"ContainerStarted","Data":"82dbf86331f56c37f2936a3cb7e6429378f36098a939d6d17c1ec72f5c626a11"} Sep 10 11:17:25.250695 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:17:25.250428 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="feast-operator-system/feast-operator-controller-manager-588dd546db-njz8z" Sep 10 11:17:25.270125 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:17:25.270083 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="feast-operator-system/feast-operator-controller-manager-588dd546db-njz8z" podStartSLOduration=1.8403588690000001 podStartE2EDuration="4.270070115s" totalImagesPullingTime="2.429711246s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 11:17:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 11:17:25.268997095 +0000 UTC m=+310.865558302" watchObservedRunningTime="2026-09-10 11:17:25.270070115 +0000 UTC m=+310.866631329" Sep 10 11:17:36.256903 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:17:36.256870 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="feast-operator-system/feast-operator-controller-manager-588dd546db-njz8z" Sep 10 11:17:57.760534 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:17:57.760500 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast/feast-simple-feast-setup-6675cdddf-nlxjd"] Sep 10 11:17:57.767288 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:17:57.767266 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-6675cdddf-nlxjd" Sep 10 11:17:57.770973 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:17:57.770950 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"kube-root-ca.crt\"" Sep 10 11:17:57.771098 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:17:57.770963 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-intra-comm\"" Sep 10 11:17:57.771098 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:17:57.770950 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-online-tls\"" Sep 10 11:17:57.771098 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:17:57.771042 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-ui-tls\"" Sep 10 11:17:57.771098 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:17:57.771082 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"openshift-service-ca.crt\"" Sep 10 11:17:57.771360 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:17:57.771343 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-registry-tls\"" Sep 10 11:17:57.771429 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:17:57.771345 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-dockercfg-sfwjz\"" Sep 10 11:17:57.771485 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:17:57.771470 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-offline-tls\"" Sep 10 11:17:57.778489 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:17:57.778469 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-6675cdddf-nlxjd"] Sep 10 11:17:57.863505 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:17:57.863483 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2wxzg\" (UniqueName: \"kubernetes.io/projected/d23c9ead-2d05-4491-91b9-f183ede122f7-kube-api-access-2wxzg\") pod \"feast-simple-feast-setup-6675cdddf-nlxjd\" (UID: \"d23c9ead-2d05-4491-91b9-f183ede122f7\") " pod="test-ns-feast/feast-simple-feast-setup-6675cdddf-nlxjd" Sep 10 11:17:57.863623 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:17:57.863515 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/d23c9ead-2d05-4491-91b9-f183ede122f7-offline-tls\") pod \"feast-simple-feast-setup-6675cdddf-nlxjd\" (UID: \"d23c9ead-2d05-4491-91b9-f183ede122f7\") " pod="test-ns-feast/feast-simple-feast-setup-6675cdddf-nlxjd" Sep 10 11:17:57.863623 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:17:57.863531 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/d23c9ead-2d05-4491-91b9-f183ede122f7-online-tls\") pod \"feast-simple-feast-setup-6675cdddf-nlxjd\" (UID: \"d23c9ead-2d05-4491-91b9-f183ede122f7\") " pod="test-ns-feast/feast-simple-feast-setup-6675cdddf-nlxjd" Sep 10 11:17:57.863623 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:17:57.863608 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/d23c9ead-2d05-4491-91b9-f183ede122f7-feast-data\") pod \"feast-simple-feast-setup-6675cdddf-nlxjd\" (UID: \"d23c9ead-2d05-4491-91b9-f183ede122f7\") " pod="test-ns-feast/feast-simple-feast-setup-6675cdddf-nlxjd" Sep 10 11:17:57.863747 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:17:57.863662 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/d23c9ead-2d05-4491-91b9-f183ede122f7-ui-tls\") pod \"feast-simple-feast-setup-6675cdddf-nlxjd\" (UID: \"d23c9ead-2d05-4491-91b9-f183ede122f7\") " pod="test-ns-feast/feast-simple-feast-setup-6675cdddf-nlxjd" Sep 10 11:17:57.863747 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:17:57.863681 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/d23c9ead-2d05-4491-91b9-f183ede122f7-registry-tls\") pod \"feast-simple-feast-setup-6675cdddf-nlxjd\" (UID: \"d23c9ead-2d05-4491-91b9-f183ede122f7\") " pod="test-ns-feast/feast-simple-feast-setup-6675cdddf-nlxjd" Sep 10 11:17:57.964263 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:17:57.964235 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/d23c9ead-2d05-4491-91b9-f183ede122f7-feast-data\") pod \"feast-simple-feast-setup-6675cdddf-nlxjd\" (UID: \"d23c9ead-2d05-4491-91b9-f183ede122f7\") " pod="test-ns-feast/feast-simple-feast-setup-6675cdddf-nlxjd" Sep 10 11:17:57.964375 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:17:57.964269 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/d23c9ead-2d05-4491-91b9-f183ede122f7-ui-tls\") pod \"feast-simple-feast-setup-6675cdddf-nlxjd\" (UID: \"d23c9ead-2d05-4491-91b9-f183ede122f7\") " pod="test-ns-feast/feast-simple-feast-setup-6675cdddf-nlxjd" Sep 10 11:17:57.964375 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:17:57.964296 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/d23c9ead-2d05-4491-91b9-f183ede122f7-registry-tls\") pod \"feast-simple-feast-setup-6675cdddf-nlxjd\" (UID: \"d23c9ead-2d05-4491-91b9-f183ede122f7\") " pod="test-ns-feast/feast-simple-feast-setup-6675cdddf-nlxjd" Sep 10 11:17:57.964489 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:17:57.964373 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2wxzg\" (UniqueName: \"kubernetes.io/projected/d23c9ead-2d05-4491-91b9-f183ede122f7-kube-api-access-2wxzg\") pod \"feast-simple-feast-setup-6675cdddf-nlxjd\" (UID: \"d23c9ead-2d05-4491-91b9-f183ede122f7\") " pod="test-ns-feast/feast-simple-feast-setup-6675cdddf-nlxjd" Sep 10 11:17:57.964489 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:17:57.964408 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/d23c9ead-2d05-4491-91b9-f183ede122f7-offline-tls\") pod \"feast-simple-feast-setup-6675cdddf-nlxjd\" (UID: \"d23c9ead-2d05-4491-91b9-f183ede122f7\") " pod="test-ns-feast/feast-simple-feast-setup-6675cdddf-nlxjd" Sep 10 11:17:57.964489 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:17:57.964434 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/d23c9ead-2d05-4491-91b9-f183ede122f7-online-tls\") pod \"feast-simple-feast-setup-6675cdddf-nlxjd\" (UID: \"d23c9ead-2d05-4491-91b9-f183ede122f7\") " pod="test-ns-feast/feast-simple-feast-setup-6675cdddf-nlxjd" Sep 10 11:17:57.964665 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:17:57.964643 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/d23c9ead-2d05-4491-91b9-f183ede122f7-feast-data\") pod \"feast-simple-feast-setup-6675cdddf-nlxjd\" (UID: \"d23c9ead-2d05-4491-91b9-f183ede122f7\") " pod="test-ns-feast/feast-simple-feast-setup-6675cdddf-nlxjd" Sep 10 11:17:57.964725 ip-10-0-134-73 kubenswrapper[2564]: E0910 11:17:57.964707 2564 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-online-tls: secret "feast-simple-feast-setup-online-tls" not found Sep 10 11:17:57.971015 ip-10-0-134-73 kubenswrapper[2564]: E0910 11:17:57.965477 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d23c9ead-2d05-4491-91b9-f183ede122f7-online-tls podName:d23c9ead-2d05-4491-91b9-f183ede122f7 nodeName:}" failed. No retries permitted until 2026-09-10 11:17:58.465446404 +0000 UTC m=+344.062007603 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "online-tls" (UniqueName: "kubernetes.io/secret/d23c9ead-2d05-4491-91b9-f183ede122f7-online-tls") pod "feast-simple-feast-setup-6675cdddf-nlxjd" (UID: "d23c9ead-2d05-4491-91b9-f183ede122f7") : secret "feast-simple-feast-setup-online-tls" not found Sep 10 11:17:57.971015 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:17:57.967709 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/d23c9ead-2d05-4491-91b9-f183ede122f7-ui-tls\") pod \"feast-simple-feast-setup-6675cdddf-nlxjd\" (UID: \"d23c9ead-2d05-4491-91b9-f183ede122f7\") " pod="test-ns-feast/feast-simple-feast-setup-6675cdddf-nlxjd" Sep 10 11:17:57.971897 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:17:57.971871 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/d23c9ead-2d05-4491-91b9-f183ede122f7-registry-tls\") pod \"feast-simple-feast-setup-6675cdddf-nlxjd\" (UID: \"d23c9ead-2d05-4491-91b9-f183ede122f7\") " pod="test-ns-feast/feast-simple-feast-setup-6675cdddf-nlxjd" Sep 10 11:17:57.972056 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:17:57.972037 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/d23c9ead-2d05-4491-91b9-f183ede122f7-offline-tls\") pod \"feast-simple-feast-setup-6675cdddf-nlxjd\" (UID: \"d23c9ead-2d05-4491-91b9-f183ede122f7\") " pod="test-ns-feast/feast-simple-feast-setup-6675cdddf-nlxjd" Sep 10 11:17:57.973534 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:17:57.973506 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2wxzg\" (UniqueName: \"kubernetes.io/projected/d23c9ead-2d05-4491-91b9-f183ede122f7-kube-api-access-2wxzg\") pod \"feast-simple-feast-setup-6675cdddf-nlxjd\" (UID: \"d23c9ead-2d05-4491-91b9-f183ede122f7\") " pod="test-ns-feast/feast-simple-feast-setup-6675cdddf-nlxjd" Sep 10 11:17:58.468702 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:17:58.468663 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/d23c9ead-2d05-4491-91b9-f183ede122f7-online-tls\") pod \"feast-simple-feast-setup-6675cdddf-nlxjd\" (UID: \"d23c9ead-2d05-4491-91b9-f183ede122f7\") " pod="test-ns-feast/feast-simple-feast-setup-6675cdddf-nlxjd" Sep 10 11:17:58.471006 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:17:58.470982 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/d23c9ead-2d05-4491-91b9-f183ede122f7-online-tls\") pod \"feast-simple-feast-setup-6675cdddf-nlxjd\" (UID: \"d23c9ead-2d05-4491-91b9-f183ede122f7\") " pod="test-ns-feast/feast-simple-feast-setup-6675cdddf-nlxjd" Sep 10 11:17:58.684651 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:17:58.684624 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-6675cdddf-nlxjd" Sep 10 11:17:58.967483 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:17:58.967452 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd23c9ead_2d05_4491_91b9_f183ede122f7.slice/crio-a213047c7603e5ce930b87867d603d156102e18356660e4b56737faa3fa326ef WatchSource:0}: Error finding container a213047c7603e5ce930b87867d603d156102e18356660e4b56737faa3fa326ef: Status 404 returned error can't find the container with id a213047c7603e5ce930b87867d603d156102e18356660e4b56737faa3fa326ef Sep 10 11:17:58.968228 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:17:58.968204 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-6675cdddf-nlxjd"] Sep 10 11:17:59.378382 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:17:59.378342 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-6675cdddf-nlxjd" event={"ID":"d23c9ead-2d05-4491-91b9-f183ede122f7","Type":"ContainerStarted","Data":"a213047c7603e5ce930b87867d603d156102e18356660e4b56737faa3fa326ef"} Sep 10 11:18:23.484154 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:18:23.484050 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-6675cdddf-nlxjd" event={"ID":"d23c9ead-2d05-4491-91b9-f183ede122f7","Type":"ContainerStarted","Data":"ee8967c5ca689cbb708c83fc02c9244cc1af68d120e3fa316125cfcd6bc2c8b9"} Sep 10 11:18:28.505637 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:18:28.505563 2564 generic.go:356] "Generic (PLEG): container finished" podID="d23c9ead-2d05-4491-91b9-f183ede122f7" containerID="ee8967c5ca689cbb708c83fc02c9244cc1af68d120e3fa316125cfcd6bc2c8b9" exitCode=0 Sep 10 11:18:28.506019 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:18:28.505638 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-6675cdddf-nlxjd" event={"ID":"d23c9ead-2d05-4491-91b9-f183ede122f7","Type":"ContainerDied","Data":"ee8967c5ca689cbb708c83fc02c9244cc1af68d120e3fa316125cfcd6bc2c8b9"} Sep 10 11:18:29.512005 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:18:29.511966 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-6675cdddf-nlxjd" event={"ID":"d23c9ead-2d05-4491-91b9-f183ede122f7","Type":"ContainerStarted","Data":"c92b3873035f2513f1f6ff4a8a113b02612cfdbf385829e617381505562ae2c5"} Sep 10 11:18:35.537946 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:18:35.537912 2564 generic.go:356] "Generic (PLEG): container finished" podID="d23c9ead-2d05-4491-91b9-f183ede122f7" containerID="c92b3873035f2513f1f6ff4a8a113b02612cfdbf385829e617381505562ae2c5" exitCode=0 Sep 10 11:18:35.538429 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:18:35.537981 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-6675cdddf-nlxjd" event={"ID":"d23c9ead-2d05-4491-91b9-f183ede122f7","Type":"ContainerDied","Data":"c92b3873035f2513f1f6ff4a8a113b02612cfdbf385829e617381505562ae2c5"} Sep 10 11:18:35.548023 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:18:35.548001 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-intra-comm\"" Sep 10 11:18:36.547649 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:18:36.547607 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-6675cdddf-nlxjd" event={"ID":"d23c9ead-2d05-4491-91b9-f183ede122f7","Type":"ContainerStarted","Data":"ed1f2a78c7eb5cd29094cf0ba81086ea3f622dc72fbb9a2392419688a9aaf4d9"} Sep 10 11:18:36.548121 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:18:36.547673 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-6675cdddf-nlxjd" event={"ID":"d23c9ead-2d05-4491-91b9-f183ede122f7","Type":"ContainerStarted","Data":"cfb21f9877e0b63308fc9293c9aa788fec52b1e02c4bfadbc1cbca8ce3d43c99"} Sep 10 11:18:36.548121 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:18:36.547697 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-6675cdddf-nlxjd" event={"ID":"d23c9ead-2d05-4491-91b9-f183ede122f7","Type":"ContainerStarted","Data":"9358403e7ae1ff48325d6fcae3488b17ce2ce48e6e4a54d5b6bbffdafc22a791"} Sep 10 11:18:36.548121 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:18:36.547714 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-6675cdddf-nlxjd" event={"ID":"d23c9ead-2d05-4491-91b9-f183ede122f7","Type":"ContainerStarted","Data":"a56fa000659d3bdc5926debdc5fccba698fd6f7b308800bbcaf71d9e6c05b9a1"} Sep 10 11:18:36.575824 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:18:36.575757 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast/feast-simple-feast-setup-6675cdddf-nlxjd" podStartSLOduration=15.346079314 podStartE2EDuration="39.575734064s" totalImagesPullingTime="24.22965475s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 11:17:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 11:18:36.572360044 +0000 UTC m=+382.168921291" watchObservedRunningTime="2026-09-10 11:18:36.575734064 +0000 UTC m=+382.172295276" Sep 10 11:18:37.685635 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:18:37.685597 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-6675cdddf-nlxjd" Sep 10 11:18:37.686091 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:18:37.685654 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-6675cdddf-nlxjd" Sep 10 11:18:37.686091 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:18:37.685670 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-6675cdddf-nlxjd" Sep 10 11:18:37.686091 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:18:37.685687 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-6675cdddf-nlxjd" Sep 10 11:18:37.687664 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:18:37.687543 2564 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-6675cdddf-nlxjd" podUID="d23c9ead-2d05-4491-91b9-f183ede122f7" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.24:8443: connect: connection refused" Sep 10 11:18:37.687664 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:18:37.687571 2564 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-6675cdddf-nlxjd" podUID="d23c9ead-2d05-4491-91b9-f183ede122f7" containerName="online" probeResult="failure" output="Get \"https://10.132.0.24:6567/health\": dial tcp 10.132.0.24:6567: connect: connection refused" Sep 10 11:18:37.687664 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:18:37.687597 2564 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-6675cdddf-nlxjd" podUID="d23c9ead-2d05-4491-91b9-f183ede122f7" containerName="offline" probeResult="failure" output="dial tcp 10.132.0.24:8816: connect: connection refused" Sep 10 11:18:37.687664 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:18:37.687558 2564 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-6675cdddf-nlxjd" podUID="d23c9ead-2d05-4491-91b9-f183ede122f7" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.24:6571: connect: connection refused" Sep 10 11:18:38.685327 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:18:38.685265 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-6675cdddf-nlxjd" Sep 10 11:18:38.685327 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:18:38.685329 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-6675cdddf-nlxjd" Sep 10 11:18:38.685580 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:18:38.685355 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-6675cdddf-nlxjd" Sep 10 11:18:38.685580 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:18:38.685372 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-6675cdddf-nlxjd" Sep 10 11:18:40.685204 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:18:40.685161 2564 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-6675cdddf-nlxjd" podUID="d23c9ead-2d05-4491-91b9-f183ede122f7" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.24:8443: connect: connection refused" Sep 10 11:18:40.685793 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:18:40.685161 2564 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-6675cdddf-nlxjd" podUID="d23c9ead-2d05-4491-91b9-f183ede122f7" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.24:6571: connect: connection refused" Sep 10 11:18:40.685793 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:18:40.685188 2564 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-6675cdddf-nlxjd" podUID="d23c9ead-2d05-4491-91b9-f183ede122f7" containerName="online" probeResult="failure" output="Get \"https://10.132.0.24:6567/health\": dial tcp 10.132.0.24:6567: connect: connection refused" Sep 10 11:18:40.686031 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:18:40.685317 2564 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-6675cdddf-nlxjd" podUID="d23c9ead-2d05-4491-91b9-f183ede122f7" containerName="offline" probeResult="failure" output="dial tcp 10.132.0.24:8816: connect: connection refused" Sep 10 11:18:43.685830 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:18:43.685786 2564 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-6675cdddf-nlxjd" podUID="d23c9ead-2d05-4491-91b9-f183ede122f7" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.24:8443: connect: connection refused" Sep 10 11:18:43.686934 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:18:43.686906 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-6675cdddf-nlxjd" Sep 10 11:18:43.687077 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:18:43.687062 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-6675cdddf-nlxjd" Sep 10 11:18:43.687991 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:18:43.687969 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-6675cdddf-nlxjd" Sep 10 11:18:43.688069 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:18:43.688057 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-6675cdddf-nlxjd" Sep 10 11:18:43.691841 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:18:43.691822 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-6675cdddf-nlxjd" Sep 10 11:18:44.594654 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:18:44.594625 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-6675cdddf-nlxjd" Sep 10 11:18:46.685594 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:18:46.685561 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-6675cdddf-nlxjd" Sep 10 11:18:47.604045 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:18:47.604011 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-6675cdddf-nlxjd" Sep 10 11:19:50.079489 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:19:50.079417 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-6675cdddf-nlxjd"] Sep 10 11:19:50.080012 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:19:50.079661 2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-6675cdddf-nlxjd" podUID="d23c9ead-2d05-4491-91b9-f183ede122f7" containerName="registry" containerID="cri-o://a56fa000659d3bdc5926debdc5fccba698fd6f7b308800bbcaf71d9e6c05b9a1" gracePeriod=30 Sep 10 11:19:50.080012 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:19:50.079730 2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-6675cdddf-nlxjd" podUID="d23c9ead-2d05-4491-91b9-f183ede122f7" containerName="offline" containerID="cri-o://cfb21f9877e0b63308fc9293c9aa788fec52b1e02c4bfadbc1cbca8ce3d43c99" gracePeriod=30 Sep 10 11:19:50.080012 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:19:50.079816 2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-6675cdddf-nlxjd" podUID="d23c9ead-2d05-4491-91b9-f183ede122f7" containerName="ui" containerID="cri-o://ed1f2a78c7eb5cd29094cf0ba81086ea3f622dc72fbb9a2392419688a9aaf4d9" gracePeriod=30 Sep 10 11:19:50.080012 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:19:50.079933 2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-6675cdddf-nlxjd" podUID="d23c9ead-2d05-4491-91b9-f183ede122f7" containerName="online" containerID="cri-o://9358403e7ae1ff48325d6fcae3488b17ce2ce48e6e4a54d5b6bbffdafc22a791" gracePeriod=30 Sep 10 11:19:50.489654 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:19:50.489620 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast/feast-simple-feast-setup-6675cdddf-rsbnw"] Sep 10 11:19:50.493316 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:19:50.493298 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-6675cdddf-rsbnw" Sep 10 11:19:50.496542 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:19:50.496512 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-dockercfg-6tqz7\"" Sep 10 11:19:50.518520 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:19:50.518494 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-6675cdddf-rsbnw"] Sep 10 11:19:50.528035 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:19:50.528012 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/f56467c8-d70a-42ad-b579-3be2e73a95bb-offline-tls\") pod \"feast-simple-feast-setup-6675cdddf-rsbnw\" (UID: \"f56467c8-d70a-42ad-b579-3be2e73a95bb\") " pod="test-ns-feast/feast-simple-feast-setup-6675cdddf-rsbnw" Sep 10 11:19:50.528165 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:19:50.528072 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/f56467c8-d70a-42ad-b579-3be2e73a95bb-feast-data\") pod \"feast-simple-feast-setup-6675cdddf-rsbnw\" (UID: \"f56467c8-d70a-42ad-b579-3be2e73a95bb\") " pod="test-ns-feast/feast-simple-feast-setup-6675cdddf-rsbnw" Sep 10 11:19:50.528165 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:19:50.528143 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h2hdv\" (UniqueName: \"kubernetes.io/projected/f56467c8-d70a-42ad-b579-3be2e73a95bb-kube-api-access-h2hdv\") pod \"feast-simple-feast-setup-6675cdddf-rsbnw\" (UID: \"f56467c8-d70a-42ad-b579-3be2e73a95bb\") " pod="test-ns-feast/feast-simple-feast-setup-6675cdddf-rsbnw" Sep 10 11:19:50.528244 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:19:50.528185 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/f56467c8-d70a-42ad-b579-3be2e73a95bb-registry-tls\") pod \"feast-simple-feast-setup-6675cdddf-rsbnw\" (UID: \"f56467c8-d70a-42ad-b579-3be2e73a95bb\") " pod="test-ns-feast/feast-simple-feast-setup-6675cdddf-rsbnw" Sep 10 11:19:50.528244 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:19:50.528207 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/f56467c8-d70a-42ad-b579-3be2e73a95bb-ui-tls\") pod \"feast-simple-feast-setup-6675cdddf-rsbnw\" (UID: \"f56467c8-d70a-42ad-b579-3be2e73a95bb\") " pod="test-ns-feast/feast-simple-feast-setup-6675cdddf-rsbnw" Sep 10 11:19:50.528244 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:19:50.528233 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/f56467c8-d70a-42ad-b579-3be2e73a95bb-online-tls\") pod \"feast-simple-feast-setup-6675cdddf-rsbnw\" (UID: \"f56467c8-d70a-42ad-b579-3be2e73a95bb\") " pod="test-ns-feast/feast-simple-feast-setup-6675cdddf-rsbnw" Sep 10 11:19:50.629213 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:19:50.629187 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/f56467c8-d70a-42ad-b579-3be2e73a95bb-offline-tls\") pod \"feast-simple-feast-setup-6675cdddf-rsbnw\" (UID: \"f56467c8-d70a-42ad-b579-3be2e73a95bb\") " pod="test-ns-feast/feast-simple-feast-setup-6675cdddf-rsbnw" Sep 10 11:19:50.629325 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:19:50.629252 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/f56467c8-d70a-42ad-b579-3be2e73a95bb-feast-data\") pod \"feast-simple-feast-setup-6675cdddf-rsbnw\" (UID: \"f56467c8-d70a-42ad-b579-3be2e73a95bb\") " pod="test-ns-feast/feast-simple-feast-setup-6675cdddf-rsbnw" Sep 10 11:19:50.629325 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:19:50.629274 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h2hdv\" (UniqueName: \"kubernetes.io/projected/f56467c8-d70a-42ad-b579-3be2e73a95bb-kube-api-access-h2hdv\") pod \"feast-simple-feast-setup-6675cdddf-rsbnw\" (UID: \"f56467c8-d70a-42ad-b579-3be2e73a95bb\") " pod="test-ns-feast/feast-simple-feast-setup-6675cdddf-rsbnw" Sep 10 11:19:50.629325 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:19:50.629294 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/f56467c8-d70a-42ad-b579-3be2e73a95bb-registry-tls\") pod \"feast-simple-feast-setup-6675cdddf-rsbnw\" (UID: \"f56467c8-d70a-42ad-b579-3be2e73a95bb\") " pod="test-ns-feast/feast-simple-feast-setup-6675cdddf-rsbnw" Sep 10 11:19:50.629325 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:19:50.629310 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/f56467c8-d70a-42ad-b579-3be2e73a95bb-ui-tls\") pod \"feast-simple-feast-setup-6675cdddf-rsbnw\" (UID: \"f56467c8-d70a-42ad-b579-3be2e73a95bb\") " pod="test-ns-feast/feast-simple-feast-setup-6675cdddf-rsbnw" Sep 10 11:19:50.629505 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:19:50.629326 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/f56467c8-d70a-42ad-b579-3be2e73a95bb-online-tls\") pod \"feast-simple-feast-setup-6675cdddf-rsbnw\" (UID: \"f56467c8-d70a-42ad-b579-3be2e73a95bb\") " pod="test-ns-feast/feast-simple-feast-setup-6675cdddf-rsbnw" Sep 10 11:19:50.629505 ip-10-0-134-73 kubenswrapper[2564]: E0910 11:19:50.629419 2564 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-online-tls: secret "feast-simple-feast-setup-online-tls" not found Sep 10 11:19:50.629505 ip-10-0-134-73 kubenswrapper[2564]: E0910 11:19:50.629469 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f56467c8-d70a-42ad-b579-3be2e73a95bb-online-tls podName:f56467c8-d70a-42ad-b579-3be2e73a95bb nodeName:}" failed. No retries permitted until 2026-09-10 11:19:51.129452354 +0000 UTC m=+456.726013547 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "online-tls" (UniqueName: "kubernetes.io/secret/f56467c8-d70a-42ad-b579-3be2e73a95bb-online-tls") pod "feast-simple-feast-setup-6675cdddf-rsbnw" (UID: "f56467c8-d70a-42ad-b579-3be2e73a95bb") : secret "feast-simple-feast-setup-online-tls" not found Sep 10 11:19:50.630415 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:19:50.630393 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/f56467c8-d70a-42ad-b579-3be2e73a95bb-feast-data\") pod \"feast-simple-feast-setup-6675cdddf-rsbnw\" (UID: \"f56467c8-d70a-42ad-b579-3be2e73a95bb\") " pod="test-ns-feast/feast-simple-feast-setup-6675cdddf-rsbnw" Sep 10 11:19:50.631299 ip-10-0-134-73 kubenswrapper[2564]: E0910 11:19:50.631276 2564 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-ui-tls: secret "feast-simple-feast-setup-ui-tls" not found Sep 10 11:19:50.631423 ip-10-0-134-73 kubenswrapper[2564]: E0910 11:19:50.631334 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f56467c8-d70a-42ad-b579-3be2e73a95bb-ui-tls podName:f56467c8-d70a-42ad-b579-3be2e73a95bb nodeName:}" failed. No retries permitted until 2026-09-10 11:19:51.13131857 +0000 UTC m=+456.727879765 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "ui-tls" (UniqueName: "kubernetes.io/secret/f56467c8-d70a-42ad-b579-3be2e73a95bb-ui-tls") pod "feast-simple-feast-setup-6675cdddf-rsbnw" (UID: "f56467c8-d70a-42ad-b579-3be2e73a95bb") : secret "feast-simple-feast-setup-ui-tls" not found Sep 10 11:19:50.631784 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:19:50.631763 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/f56467c8-d70a-42ad-b579-3be2e73a95bb-offline-tls\") pod \"feast-simple-feast-setup-6675cdddf-rsbnw\" (UID: \"f56467c8-d70a-42ad-b579-3be2e73a95bb\") " pod="test-ns-feast/feast-simple-feast-setup-6675cdddf-rsbnw" Sep 10 11:19:50.633149 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:19:50.633124 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/f56467c8-d70a-42ad-b579-3be2e73a95bb-registry-tls\") pod \"feast-simple-feast-setup-6675cdddf-rsbnw\" (UID: \"f56467c8-d70a-42ad-b579-3be2e73a95bb\") " pod="test-ns-feast/feast-simple-feast-setup-6675cdddf-rsbnw" Sep 10 11:19:50.643219 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:19:50.643195 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h2hdv\" (UniqueName: \"kubernetes.io/projected/f56467c8-d70a-42ad-b579-3be2e73a95bb-kube-api-access-h2hdv\") pod \"feast-simple-feast-setup-6675cdddf-rsbnw\" (UID: \"f56467c8-d70a-42ad-b579-3be2e73a95bb\") " pod="test-ns-feast/feast-simple-feast-setup-6675cdddf-rsbnw" Sep 10 11:19:50.855759 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:19:50.855728 2564 generic.go:356] "Generic (PLEG): container finished" podID="d23c9ead-2d05-4491-91b9-f183ede122f7" containerID="ed1f2a78c7eb5cd29094cf0ba81086ea3f622dc72fbb9a2392419688a9aaf4d9" exitCode=0 Sep 10 11:19:50.855946 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:19:50.855807 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-6675cdddf-nlxjd" event={"ID":"d23c9ead-2d05-4491-91b9-f183ede122f7","Type":"ContainerDied","Data":"ed1f2a78c7eb5cd29094cf0ba81086ea3f622dc72fbb9a2392419688a9aaf4d9"} Sep 10 11:19:51.133674 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:19:51.133600 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/f56467c8-d70a-42ad-b579-3be2e73a95bb-ui-tls\") pod \"feast-simple-feast-setup-6675cdddf-rsbnw\" (UID: \"f56467c8-d70a-42ad-b579-3be2e73a95bb\") " pod="test-ns-feast/feast-simple-feast-setup-6675cdddf-rsbnw" Sep 10 11:19:51.133674 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:19:51.133635 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/f56467c8-d70a-42ad-b579-3be2e73a95bb-online-tls\") pod \"feast-simple-feast-setup-6675cdddf-rsbnw\" (UID: \"f56467c8-d70a-42ad-b579-3be2e73a95bb\") " pod="test-ns-feast/feast-simple-feast-setup-6675cdddf-rsbnw" Sep 10 11:19:51.135833 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:19:51.135808 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/f56467c8-d70a-42ad-b579-3be2e73a95bb-online-tls\") pod \"feast-simple-feast-setup-6675cdddf-rsbnw\" (UID: \"f56467c8-d70a-42ad-b579-3be2e73a95bb\") " pod="test-ns-feast/feast-simple-feast-setup-6675cdddf-rsbnw" Sep 10 11:19:51.135945 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:19:51.135835 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/f56467c8-d70a-42ad-b579-3be2e73a95bb-ui-tls\") pod \"feast-simple-feast-setup-6675cdddf-rsbnw\" (UID: \"f56467c8-d70a-42ad-b579-3be2e73a95bb\") " pod="test-ns-feast/feast-simple-feast-setup-6675cdddf-rsbnw" Sep 10 11:19:51.403741 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:19:51.403670 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-6675cdddf-rsbnw" Sep 10 11:19:51.686612 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:19:51.686544 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-6675cdddf-rsbnw"] Sep 10 11:19:51.689424 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:19:51.689402 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf56467c8_d70a_42ad_b579_3be2e73a95bb.slice/crio-5513fc3c1c2cce85cb1cdd9c38f34c6ee99361a72977779cea422b784ac8ea31 WatchSource:0}: Error finding container 5513fc3c1c2cce85cb1cdd9c38f34c6ee99361a72977779cea422b784ac8ea31: Status 404 returned error can't find the container with id 5513fc3c1c2cce85cb1cdd9c38f34c6ee99361a72977779cea422b784ac8ea31 Sep 10 11:19:51.862268 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:19:51.862241 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-6675cdddf-rsbnw" event={"ID":"f56467c8-d70a-42ad-b579-3be2e73a95bb","Type":"ContainerStarted","Data":"1bf685a5b9a66a3bcd3d9fe9cafeb468a546caa3ddbd9b953a81feb2af950ac5"} Sep 10 11:19:51.862414 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:19:51.862280 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-6675cdddf-rsbnw" event={"ID":"f56467c8-d70a-42ad-b579-3be2e73a95bb","Type":"ContainerStarted","Data":"5513fc3c1c2cce85cb1cdd9c38f34c6ee99361a72977779cea422b784ac8ea31"} Sep 10 11:19:51.865554 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:19:51.865531 2564 generic.go:356] "Generic (PLEG): container finished" podID="d23c9ead-2d05-4491-91b9-f183ede122f7" containerID="9358403e7ae1ff48325d6fcae3488b17ce2ce48e6e4a54d5b6bbffdafc22a791" exitCode=0 Sep 10 11:19:51.865634 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:19:51.865586 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-6675cdddf-nlxjd" event={"ID":"d23c9ead-2d05-4491-91b9-f183ede122f7","Type":"ContainerDied","Data":"9358403e7ae1ff48325d6fcae3488b17ce2ce48e6e4a54d5b6bbffdafc22a791"} Sep 10 11:19:54.592679 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:19:54.592615 2564 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-6675cdddf-nlxjd" podUID="d23c9ead-2d05-4491-91b9-f183ede122f7" containerName="online" probeResult="failure" output="Get \"https://10.132.0.24:6567/health\": dial tcp 10.132.0.24:6567: connect: connection refused" Sep 10 11:19:56.887381 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:19:56.887348 2564 generic.go:356] "Generic (PLEG): container finished" podID="f56467c8-d70a-42ad-b579-3be2e73a95bb" containerID="1bf685a5b9a66a3bcd3d9fe9cafeb468a546caa3ddbd9b953a81feb2af950ac5" exitCode=0 Sep 10 11:19:56.887789 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:19:56.887425 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-6675cdddf-rsbnw" event={"ID":"f56467c8-d70a-42ad-b579-3be2e73a95bb","Type":"ContainerDied","Data":"1bf685a5b9a66a3bcd3d9fe9cafeb468a546caa3ddbd9b953a81feb2af950ac5"} Sep 10 11:19:57.604671 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:19:57.604622 2564 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-6675cdddf-nlxjd" podUID="d23c9ead-2d05-4491-91b9-f183ede122f7" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.24:8443: connect: connection refused" Sep 10 11:19:57.893063 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:19:57.892985 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-6675cdddf-rsbnw" event={"ID":"f56467c8-d70a-42ad-b579-3be2e73a95bb","Type":"ContainerStarted","Data":"2188090f4322fef966da67b6e585906b0088b9367c34f9b4e2de7a665ff5dcf6"} Sep 10 11:20:02.915418 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:20:02.915385 2564 generic.go:356] "Generic (PLEG): container finished" podID="f56467c8-d70a-42ad-b579-3be2e73a95bb" containerID="2188090f4322fef966da67b6e585906b0088b9367c34f9b4e2de7a665ff5dcf6" exitCode=0 Sep 10 11:20:02.916677 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:20:02.916647 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-6675cdddf-rsbnw" event={"ID":"f56467c8-d70a-42ad-b579-3be2e73a95bb","Type":"ContainerDied","Data":"2188090f4322fef966da67b6e585906b0088b9367c34f9b4e2de7a665ff5dcf6"} Sep 10 11:20:03.926251 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:20:03.926213 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-6675cdddf-rsbnw" event={"ID":"f56467c8-d70a-42ad-b579-3be2e73a95bb","Type":"ContainerStarted","Data":"5d65974a8c2b710f775803f02ecafaf93f444d61f2de6b72e904195916543e29"} Sep 10 11:20:03.926792 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:20:03.926769 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-6675cdddf-rsbnw" event={"ID":"f56467c8-d70a-42ad-b579-3be2e73a95bb","Type":"ContainerStarted","Data":"142cc001093585885d6bf02902a1bb61ff5d35b81c365085425d1b2eaca9e7f8"} Sep 10 11:20:03.926937 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:20:03.926913 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-6675cdddf-rsbnw" event={"ID":"f56467c8-d70a-42ad-b579-3be2e73a95bb","Type":"ContainerStarted","Data":"278835be24fc247993853e2fd7fefe3638903dd67d7ce7804150514dc93a5a92"} Sep 10 11:20:03.926937 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:20:03.926941 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-6675cdddf-rsbnw" event={"ID":"f56467c8-d70a-42ad-b579-3be2e73a95bb","Type":"ContainerStarted","Data":"63d1f66f9fc5575df36f9bd7a5070fc267e2dc8081028404842793f816ddeef6"} Sep 10 11:20:03.958217 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:20:03.958157 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast/feast-simple-feast-setup-6675cdddf-rsbnw" podStartSLOduration=13.958135684 podStartE2EDuration="13.958135684s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 11:19:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 11:20:03.956475406 +0000 UTC m=+469.553036622" watchObservedRunningTime="2026-09-10 11:20:03.958135684 +0000 UTC m=+469.554696900" Sep 10 11:20:04.592204 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:20:04.592156 2564 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-6675cdddf-nlxjd" podUID="d23c9ead-2d05-4491-91b9-f183ede122f7" containerName="online" probeResult="failure" output="Get \"https://10.132.0.24:6567/health\": dial tcp 10.132.0.24:6567: connect: connection refused" Sep 10 11:20:06.406803 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:20:06.404620 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-6675cdddf-rsbnw" Sep 10 11:20:06.406803 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:20:06.404687 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-6675cdddf-rsbnw" Sep 10 11:20:06.406803 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:20:06.404708 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-6675cdddf-rsbnw" Sep 10 11:20:06.406803 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:20:06.404727 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-6675cdddf-rsbnw" Sep 10 11:20:06.406803 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:20:06.406784 2564 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-6675cdddf-rsbnw" podUID="f56467c8-d70a-42ad-b579-3be2e73a95bb" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.25:6571: connect: connection refused" Sep 10 11:20:06.407480 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:20:06.407174 2564 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-6675cdddf-rsbnw" podUID="f56467c8-d70a-42ad-b579-3be2e73a95bb" containerName="online" probeResult="failure" output="Get \"https://10.132.0.25:6567/health\": dial tcp 10.132.0.25:6567: connect: connection refused" Sep 10 11:20:06.407480 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:20:06.407248 2564 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-6675cdddf-rsbnw" podUID="f56467c8-d70a-42ad-b579-3be2e73a95bb" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.25:8443: connect: connection refused" Sep 10 11:20:06.407480 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:20:06.407294 2564 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-6675cdddf-rsbnw" podUID="f56467c8-d70a-42ad-b579-3be2e73a95bb" containerName="offline" probeResult="failure" output="dial tcp 10.132.0.25:8816: connect: connection refused" Sep 10 11:20:07.604184 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:20:07.604131 2564 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-6675cdddf-nlxjd" podUID="d23c9ead-2d05-4491-91b9-f183ede122f7" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.24:8443: connect: connection refused" Sep 10 11:20:09.404153 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:20:09.404098 2564 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-6675cdddf-rsbnw" podUID="f56467c8-d70a-42ad-b579-3be2e73a95bb" containerName="offline" probeResult="failure" output="dial tcp 10.132.0.25:8816: connect: connection refused" Sep 10 11:20:09.404153 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:20:09.404133 2564 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-6675cdddf-rsbnw" podUID="f56467c8-d70a-42ad-b579-3be2e73a95bb" containerName="online" probeResult="failure" output="Get \"https://10.132.0.25:6567/health\": dial tcp 10.132.0.25:6567: connect: connection refused" Sep 10 11:20:09.404704 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:20:09.404098 2564 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-6675cdddf-rsbnw" podUID="f56467c8-d70a-42ad-b579-3be2e73a95bb" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.25:8443: connect: connection refused" Sep 10 11:20:09.404704 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:20:09.404097 2564 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-6675cdddf-rsbnw" podUID="f56467c8-d70a-42ad-b579-3be2e73a95bb" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.25:6571: connect: connection refused" Sep 10 11:20:11.403742 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:20:11.403707 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-6675cdddf-rsbnw" Sep 10 11:20:11.404148 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:20:11.403760 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-6675cdddf-rsbnw" Sep 10 11:20:11.404148 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:20:11.403775 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-6675cdddf-rsbnw" Sep 10 11:20:11.404148 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:20:11.403788 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-6675cdddf-rsbnw" Sep 10 11:20:12.404901 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:20:12.404843 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-6675cdddf-rsbnw" Sep 10 11:20:12.405372 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:20:12.405211 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-6675cdddf-rsbnw" Sep 10 11:20:12.405484 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:20:12.405462 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-6675cdddf-rsbnw" Sep 10 11:20:12.405750 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:20:12.405733 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-6675cdddf-rsbnw" Sep 10 11:20:12.405802 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:20:12.405786 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-6675cdddf-rsbnw" Sep 10 11:20:12.410186 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:20:12.410169 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-6675cdddf-rsbnw" Sep 10 11:20:12.976175 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:20:12.976149 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-6675cdddf-rsbnw" Sep 10 11:20:12.978661 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:20:12.978639 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-6675cdddf-rsbnw" Sep 10 11:20:14.592241 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:20:14.592199 2564 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-6675cdddf-nlxjd" podUID="d23c9ead-2d05-4491-91b9-f183ede122f7" containerName="online" probeResult="failure" output="Get \"https://10.132.0.24:6567/health\": dial tcp 10.132.0.24:6567: connect: connection refused" Sep 10 11:20:14.592631 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:20:14.592335 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-6675cdddf-nlxjd" Sep 10 11:20:17.603927 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:20:17.603886 2564 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-6675cdddf-nlxjd" podUID="d23c9ead-2d05-4491-91b9-f183ede122f7" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.24:8443: connect: connection refused" Sep 10 11:20:17.604309 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:20:17.604012 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-6675cdddf-nlxjd" Sep 10 11:20:20.730355 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:20:20.730330 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-6675cdddf-nlxjd" Sep 10 11:20:20.882183 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:20:20.882150 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/d23c9ead-2d05-4491-91b9-f183ede122f7-online-tls\") pod \"d23c9ead-2d05-4491-91b9-f183ede122f7\" (UID: \"d23c9ead-2d05-4491-91b9-f183ede122f7\") " Sep 10 11:20:20.882183 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:20:20.882187 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/d23c9ead-2d05-4491-91b9-f183ede122f7-offline-tls\") pod \"d23c9ead-2d05-4491-91b9-f183ede122f7\" (UID: \"d23c9ead-2d05-4491-91b9-f183ede122f7\") " Sep 10 11:20:20.882420 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:20:20.882227 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2wxzg\" (UniqueName: \"kubernetes.io/projected/d23c9ead-2d05-4491-91b9-f183ede122f7-kube-api-access-2wxzg\") pod \"d23c9ead-2d05-4491-91b9-f183ede122f7\" (UID: \"d23c9ead-2d05-4491-91b9-f183ede122f7\") " Sep 10 11:20:20.882420 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:20:20.882253 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/d23c9ead-2d05-4491-91b9-f183ede122f7-registry-tls\") pod \"d23c9ead-2d05-4491-91b9-f183ede122f7\" (UID: \"d23c9ead-2d05-4491-91b9-f183ede122f7\") " Sep 10 11:20:20.882420 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:20:20.882365 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/d23c9ead-2d05-4491-91b9-f183ede122f7-ui-tls\") pod \"d23c9ead-2d05-4491-91b9-f183ede122f7\" (UID: \"d23c9ead-2d05-4491-91b9-f183ede122f7\") " Sep 10 11:20:20.882420 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:20:20.882409 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/d23c9ead-2d05-4491-91b9-f183ede122f7-feast-data\") pod \"d23c9ead-2d05-4491-91b9-f183ede122f7\" (UID: \"d23c9ead-2d05-4491-91b9-f183ede122f7\") " Sep 10 11:20:20.883151 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:20:20.883121 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d23c9ead-2d05-4491-91b9-f183ede122f7-feast-data" (OuterVolumeSpecName: "feast-data") pod "d23c9ead-2d05-4491-91b9-f183ede122f7" (UID: "d23c9ead-2d05-4491-91b9-f183ede122f7"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 10 11:20:20.884481 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:20:20.884459 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d23c9ead-2d05-4491-91b9-f183ede122f7-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "d23c9ead-2d05-4491-91b9-f183ede122f7" (UID: "d23c9ead-2d05-4491-91b9-f183ede122f7"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 10 11:20:20.884769 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:20:20.884753 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d23c9ead-2d05-4491-91b9-f183ede122f7-online-tls" (OuterVolumeSpecName: "online-tls") pod "d23c9ead-2d05-4491-91b9-f183ede122f7" (UID: "d23c9ead-2d05-4491-91b9-f183ede122f7"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 10 11:20:20.884951 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:20:20.884931 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d23c9ead-2d05-4491-91b9-f183ede122f7-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "d23c9ead-2d05-4491-91b9-f183ede122f7" (UID: "d23c9ead-2d05-4491-91b9-f183ede122f7"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 10 11:20:20.885013 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:20:20.884950 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d23c9ead-2d05-4491-91b9-f183ede122f7-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "d23c9ead-2d05-4491-91b9-f183ede122f7" (UID: "d23c9ead-2d05-4491-91b9-f183ede122f7"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 10 11:20:20.885013 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:20:20.884958 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d23c9ead-2d05-4491-91b9-f183ede122f7-kube-api-access-2wxzg" (OuterVolumeSpecName: "kube-api-access-2wxzg") pod "d23c9ead-2d05-4491-91b9-f183ede122f7" (UID: "d23c9ead-2d05-4491-91b9-f183ede122f7"). InnerVolumeSpecName "kube-api-access-2wxzg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 11:20:20.983624 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:20:20.983589 2564 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/d23c9ead-2d05-4491-91b9-f183ede122f7-ui-tls\") on node \"ip-10-0-134-73.ec2.internal\" DevicePath \"\"" Sep 10 11:20:20.983624 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:20:20.983618 2564 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/d23c9ead-2d05-4491-91b9-f183ede122f7-feast-data\") on node \"ip-10-0-134-73.ec2.internal\" DevicePath \"\"" Sep 10 11:20:20.983624 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:20:20.983629 2564 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/d23c9ead-2d05-4491-91b9-f183ede122f7-online-tls\") on node \"ip-10-0-134-73.ec2.internal\" DevicePath \"\"" Sep 10 11:20:20.983624 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:20:20.983636 2564 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/d23c9ead-2d05-4491-91b9-f183ede122f7-offline-tls\") on node \"ip-10-0-134-73.ec2.internal\" DevicePath \"\"" Sep 10 11:20:20.983900 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:20:20.983645 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2wxzg\" (UniqueName: \"kubernetes.io/projected/d23c9ead-2d05-4491-91b9-f183ede122f7-kube-api-access-2wxzg\") on node \"ip-10-0-134-73.ec2.internal\" DevicePath \"\"" Sep 10 11:20:20.983900 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:20:20.983654 2564 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/d23c9ead-2d05-4491-91b9-f183ede122f7-registry-tls\") on node \"ip-10-0-134-73.ec2.internal\" DevicePath \"\"" Sep 10 11:20:21.007612 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:20:21.007581 2564 generic.go:356] "Generic (PLEG): container finished" podID="d23c9ead-2d05-4491-91b9-f183ede122f7" containerID="cfb21f9877e0b63308fc9293c9aa788fec52b1e02c4bfadbc1cbca8ce3d43c99" exitCode=137 Sep 10 11:20:21.007612 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:20:21.007605 2564 generic.go:356] "Generic (PLEG): container finished" podID="d23c9ead-2d05-4491-91b9-f183ede122f7" containerID="a56fa000659d3bdc5926debdc5fccba698fd6f7b308800bbcaf71d9e6c05b9a1" exitCode=137 Sep 10 11:20:21.007790 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:20:21.007651 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-6675cdddf-nlxjd" event={"ID":"d23c9ead-2d05-4491-91b9-f183ede122f7","Type":"ContainerDied","Data":"cfb21f9877e0b63308fc9293c9aa788fec52b1e02c4bfadbc1cbca8ce3d43c99"} Sep 10 11:20:21.007790 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:20:21.007654 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-6675cdddf-nlxjd" Sep 10 11:20:21.007790 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:20:21.007686 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-6675cdddf-nlxjd" event={"ID":"d23c9ead-2d05-4491-91b9-f183ede122f7","Type":"ContainerDied","Data":"a56fa000659d3bdc5926debdc5fccba698fd6f7b308800bbcaf71d9e6c05b9a1"} Sep 10 11:20:21.007790 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:20:21.007700 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-6675cdddf-nlxjd" event={"ID":"d23c9ead-2d05-4491-91b9-f183ede122f7","Type":"ContainerDied","Data":"a213047c7603e5ce930b87867d603d156102e18356660e4b56737faa3fa326ef"} Sep 10 11:20:21.007790 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:20:21.007716 2564 scope.go:117] "RemoveContainer" containerID="ed1f2a78c7eb5cd29094cf0ba81086ea3f622dc72fbb9a2392419688a9aaf4d9" Sep 10 11:20:21.015688 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:20:21.015669 2564 scope.go:117] "RemoveContainer" containerID="cfb21f9877e0b63308fc9293c9aa788fec52b1e02c4bfadbc1cbca8ce3d43c99" Sep 10 11:20:21.023125 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:20:21.023106 2564 scope.go:117] "RemoveContainer" containerID="9358403e7ae1ff48325d6fcae3488b17ce2ce48e6e4a54d5b6bbffdafc22a791" Sep 10 11:20:21.029338 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:20:21.029277 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-6675cdddf-nlxjd"] Sep 10 11:20:21.032638 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:20:21.032619 2564 scope.go:117] "RemoveContainer" containerID="a56fa000659d3bdc5926debdc5fccba698fd6f7b308800bbcaf71d9e6c05b9a1" Sep 10 11:20:21.035959 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:20:21.035936 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-6675cdddf-nlxjd"] Sep 10 11:20:21.040548 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:20:21.040528 2564 scope.go:117] "RemoveContainer" containerID="c92b3873035f2513f1f6ff4a8a113b02612cfdbf385829e617381505562ae2c5" Sep 10 11:20:21.047561 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:20:21.047546 2564 scope.go:117] "RemoveContainer" containerID="ee8967c5ca689cbb708c83fc02c9244cc1af68d120e3fa316125cfcd6bc2c8b9" Sep 10 11:20:21.054492 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:20:21.054466 2564 scope.go:117] "RemoveContainer" containerID="ed1f2a78c7eb5cd29094cf0ba81086ea3f622dc72fbb9a2392419688a9aaf4d9" Sep 10 11:20:21.054774 ip-10-0-134-73 kubenswrapper[2564]: E0910 11:20:21.054755 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ed1f2a78c7eb5cd29094cf0ba81086ea3f622dc72fbb9a2392419688a9aaf4d9\": container with ID starting with ed1f2a78c7eb5cd29094cf0ba81086ea3f622dc72fbb9a2392419688a9aaf4d9 not found: ID does not exist" containerID="ed1f2a78c7eb5cd29094cf0ba81086ea3f622dc72fbb9a2392419688a9aaf4d9" Sep 10 11:20:21.054821 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:20:21.054783 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ed1f2a78c7eb5cd29094cf0ba81086ea3f622dc72fbb9a2392419688a9aaf4d9"} err="failed to get container status \"ed1f2a78c7eb5cd29094cf0ba81086ea3f622dc72fbb9a2392419688a9aaf4d9\": rpc error: code = NotFound desc = could not find container \"ed1f2a78c7eb5cd29094cf0ba81086ea3f622dc72fbb9a2392419688a9aaf4d9\": container with ID starting with ed1f2a78c7eb5cd29094cf0ba81086ea3f622dc72fbb9a2392419688a9aaf4d9 not found: ID does not exist" Sep 10 11:20:21.054876 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:20:21.054822 2564 scope.go:117] "RemoveContainer" containerID="cfb21f9877e0b63308fc9293c9aa788fec52b1e02c4bfadbc1cbca8ce3d43c99" Sep 10 11:20:21.055084 ip-10-0-134-73 kubenswrapper[2564]: E0910 11:20:21.055067 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cfb21f9877e0b63308fc9293c9aa788fec52b1e02c4bfadbc1cbca8ce3d43c99\": container with ID starting with cfb21f9877e0b63308fc9293c9aa788fec52b1e02c4bfadbc1cbca8ce3d43c99 not found: ID does not exist" containerID="cfb21f9877e0b63308fc9293c9aa788fec52b1e02c4bfadbc1cbca8ce3d43c99" Sep 10 11:20:21.055118 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:20:21.055098 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cfb21f9877e0b63308fc9293c9aa788fec52b1e02c4bfadbc1cbca8ce3d43c99"} err="failed to get container status \"cfb21f9877e0b63308fc9293c9aa788fec52b1e02c4bfadbc1cbca8ce3d43c99\": rpc error: code = NotFound desc = could not find container \"cfb21f9877e0b63308fc9293c9aa788fec52b1e02c4bfadbc1cbca8ce3d43c99\": container with ID starting with cfb21f9877e0b63308fc9293c9aa788fec52b1e02c4bfadbc1cbca8ce3d43c99 not found: ID does not exist" Sep 10 11:20:21.055118 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:20:21.055114 2564 scope.go:117] "RemoveContainer" containerID="9358403e7ae1ff48325d6fcae3488b17ce2ce48e6e4a54d5b6bbffdafc22a791" Sep 10 11:20:21.055359 ip-10-0-134-73 kubenswrapper[2564]: E0910 11:20:21.055342 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9358403e7ae1ff48325d6fcae3488b17ce2ce48e6e4a54d5b6bbffdafc22a791\": container with ID starting with 9358403e7ae1ff48325d6fcae3488b17ce2ce48e6e4a54d5b6bbffdafc22a791 not found: ID does not exist" containerID="9358403e7ae1ff48325d6fcae3488b17ce2ce48e6e4a54d5b6bbffdafc22a791" Sep 10 11:20:21.055399 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:20:21.055363 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9358403e7ae1ff48325d6fcae3488b17ce2ce48e6e4a54d5b6bbffdafc22a791"} err="failed to get container status \"9358403e7ae1ff48325d6fcae3488b17ce2ce48e6e4a54d5b6bbffdafc22a791\": rpc error: code = NotFound desc = could not find container \"9358403e7ae1ff48325d6fcae3488b17ce2ce48e6e4a54d5b6bbffdafc22a791\": container with ID starting with 9358403e7ae1ff48325d6fcae3488b17ce2ce48e6e4a54d5b6bbffdafc22a791 not found: ID does not exist" Sep 10 11:20:21.055399 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:20:21.055377 2564 scope.go:117] "RemoveContainer" containerID="a56fa000659d3bdc5926debdc5fccba698fd6f7b308800bbcaf71d9e6c05b9a1" Sep 10 11:20:21.055610 ip-10-0-134-73 kubenswrapper[2564]: E0910 11:20:21.055593 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a56fa000659d3bdc5926debdc5fccba698fd6f7b308800bbcaf71d9e6c05b9a1\": container with ID starting with a56fa000659d3bdc5926debdc5fccba698fd6f7b308800bbcaf71d9e6c05b9a1 not found: ID does not exist" containerID="a56fa000659d3bdc5926debdc5fccba698fd6f7b308800bbcaf71d9e6c05b9a1" Sep 10 11:20:21.055693 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:20:21.055612 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a56fa000659d3bdc5926debdc5fccba698fd6f7b308800bbcaf71d9e6c05b9a1"} err="failed to get container status \"a56fa000659d3bdc5926debdc5fccba698fd6f7b308800bbcaf71d9e6c05b9a1\": rpc error: code = NotFound desc = could not find container \"a56fa000659d3bdc5926debdc5fccba698fd6f7b308800bbcaf71d9e6c05b9a1\": container with ID starting with a56fa000659d3bdc5926debdc5fccba698fd6f7b308800bbcaf71d9e6c05b9a1 not found: ID does not exist" Sep 10 11:20:21.055693 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:20:21.055624 2564 scope.go:117] "RemoveContainer" containerID="c92b3873035f2513f1f6ff4a8a113b02612cfdbf385829e617381505562ae2c5" Sep 10 11:20:21.055885 ip-10-0-134-73 kubenswrapper[2564]: E0910 11:20:21.055844 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c92b3873035f2513f1f6ff4a8a113b02612cfdbf385829e617381505562ae2c5\": container with ID starting with c92b3873035f2513f1f6ff4a8a113b02612cfdbf385829e617381505562ae2c5 not found: ID does not exist" containerID="c92b3873035f2513f1f6ff4a8a113b02612cfdbf385829e617381505562ae2c5" Sep 10 11:20:21.055960 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:20:21.055885 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c92b3873035f2513f1f6ff4a8a113b02612cfdbf385829e617381505562ae2c5"} err="failed to get container status \"c92b3873035f2513f1f6ff4a8a113b02612cfdbf385829e617381505562ae2c5\": rpc error: code = NotFound desc = could not find container \"c92b3873035f2513f1f6ff4a8a113b02612cfdbf385829e617381505562ae2c5\": container with ID starting with c92b3873035f2513f1f6ff4a8a113b02612cfdbf385829e617381505562ae2c5 not found: ID does not exist" Sep 10 11:20:21.055960 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:20:21.055904 2564 scope.go:117] "RemoveContainer" containerID="ee8967c5ca689cbb708c83fc02c9244cc1af68d120e3fa316125cfcd6bc2c8b9" Sep 10 11:20:21.056159 ip-10-0-134-73 kubenswrapper[2564]: E0910 11:20:21.056142 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ee8967c5ca689cbb708c83fc02c9244cc1af68d120e3fa316125cfcd6bc2c8b9\": container with ID starting with ee8967c5ca689cbb708c83fc02c9244cc1af68d120e3fa316125cfcd6bc2c8b9 not found: ID does not exist" containerID="ee8967c5ca689cbb708c83fc02c9244cc1af68d120e3fa316125cfcd6bc2c8b9" Sep 10 11:20:21.056202 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:20:21.056162 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ee8967c5ca689cbb708c83fc02c9244cc1af68d120e3fa316125cfcd6bc2c8b9"} err="failed to get container status \"ee8967c5ca689cbb708c83fc02c9244cc1af68d120e3fa316125cfcd6bc2c8b9\": rpc error: code = NotFound desc = could not find container \"ee8967c5ca689cbb708c83fc02c9244cc1af68d120e3fa316125cfcd6bc2c8b9\": container with ID starting with ee8967c5ca689cbb708c83fc02c9244cc1af68d120e3fa316125cfcd6bc2c8b9 not found: ID does not exist" Sep 10 11:20:21.056202 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:20:21.056176 2564 scope.go:117] "RemoveContainer" containerID="ed1f2a78c7eb5cd29094cf0ba81086ea3f622dc72fbb9a2392419688a9aaf4d9" Sep 10 11:20:21.056399 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:20:21.056383 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ed1f2a78c7eb5cd29094cf0ba81086ea3f622dc72fbb9a2392419688a9aaf4d9"} err="failed to get container status \"ed1f2a78c7eb5cd29094cf0ba81086ea3f622dc72fbb9a2392419688a9aaf4d9\": rpc error: code = NotFound desc = could not find container \"ed1f2a78c7eb5cd29094cf0ba81086ea3f622dc72fbb9a2392419688a9aaf4d9\": container with ID starting with ed1f2a78c7eb5cd29094cf0ba81086ea3f622dc72fbb9a2392419688a9aaf4d9 not found: ID does not exist" Sep 10 11:20:21.056442 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:20:21.056399 2564 scope.go:117] "RemoveContainer" containerID="cfb21f9877e0b63308fc9293c9aa788fec52b1e02c4bfadbc1cbca8ce3d43c99" Sep 10 11:20:21.056581 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:20:21.056567 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cfb21f9877e0b63308fc9293c9aa788fec52b1e02c4bfadbc1cbca8ce3d43c99"} err="failed to get container status \"cfb21f9877e0b63308fc9293c9aa788fec52b1e02c4bfadbc1cbca8ce3d43c99\": rpc error: code = NotFound desc = could not find container \"cfb21f9877e0b63308fc9293c9aa788fec52b1e02c4bfadbc1cbca8ce3d43c99\": container with ID starting with cfb21f9877e0b63308fc9293c9aa788fec52b1e02c4bfadbc1cbca8ce3d43c99 not found: ID does not exist" Sep 10 11:20:21.056581 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:20:21.056580 2564 scope.go:117] "RemoveContainer" containerID="9358403e7ae1ff48325d6fcae3488b17ce2ce48e6e4a54d5b6bbffdafc22a791" Sep 10 11:20:21.056777 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:20:21.056761 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9358403e7ae1ff48325d6fcae3488b17ce2ce48e6e4a54d5b6bbffdafc22a791"} err="failed to get container status \"9358403e7ae1ff48325d6fcae3488b17ce2ce48e6e4a54d5b6bbffdafc22a791\": rpc error: code = NotFound desc = could not find container \"9358403e7ae1ff48325d6fcae3488b17ce2ce48e6e4a54d5b6bbffdafc22a791\": container with ID starting with 9358403e7ae1ff48325d6fcae3488b17ce2ce48e6e4a54d5b6bbffdafc22a791 not found: ID does not exist" Sep 10 11:20:21.056818 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:20:21.056777 2564 scope.go:117] "RemoveContainer" containerID="a56fa000659d3bdc5926debdc5fccba698fd6f7b308800bbcaf71d9e6c05b9a1" Sep 10 11:20:21.056975 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:20:21.056960 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a56fa000659d3bdc5926debdc5fccba698fd6f7b308800bbcaf71d9e6c05b9a1"} err="failed to get container status \"a56fa000659d3bdc5926debdc5fccba698fd6f7b308800bbcaf71d9e6c05b9a1\": rpc error: code = NotFound desc = could not find container \"a56fa000659d3bdc5926debdc5fccba698fd6f7b308800bbcaf71d9e6c05b9a1\": container with ID starting with a56fa000659d3bdc5926debdc5fccba698fd6f7b308800bbcaf71d9e6c05b9a1 not found: ID does not exist" Sep 10 11:20:21.057014 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:20:21.056975 2564 scope.go:117] "RemoveContainer" containerID="c92b3873035f2513f1f6ff4a8a113b02612cfdbf385829e617381505562ae2c5" Sep 10 11:20:21.057166 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:20:21.057151 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c92b3873035f2513f1f6ff4a8a113b02612cfdbf385829e617381505562ae2c5"} err="failed to get container status \"c92b3873035f2513f1f6ff4a8a113b02612cfdbf385829e617381505562ae2c5\": rpc error: code = NotFound desc = could not find container \"c92b3873035f2513f1f6ff4a8a113b02612cfdbf385829e617381505562ae2c5\": container with ID starting with c92b3873035f2513f1f6ff4a8a113b02612cfdbf385829e617381505562ae2c5 not found: ID does not exist" Sep 10 11:20:21.057211 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:20:21.057166 2564 scope.go:117] "RemoveContainer" containerID="ee8967c5ca689cbb708c83fc02c9244cc1af68d120e3fa316125cfcd6bc2c8b9" Sep 10 11:20:21.057346 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:20:21.057331 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ee8967c5ca689cbb708c83fc02c9244cc1af68d120e3fa316125cfcd6bc2c8b9"} err="failed to get container status \"ee8967c5ca689cbb708c83fc02c9244cc1af68d120e3fa316125cfcd6bc2c8b9\": rpc error: code = NotFound desc = could not find container \"ee8967c5ca689cbb708c83fc02c9244cc1af68d120e3fa316125cfcd6bc2c8b9\": container with ID starting with ee8967c5ca689cbb708c83fc02c9244cc1af68d120e3fa316125cfcd6bc2c8b9 not found: ID does not exist" Sep 10 11:20:22.917650 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:20:22.917614 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d23c9ead-2d05-4491-91b9-f183ede122f7" path="/var/lib/kubelet/pods/d23c9ead-2d05-4491-91b9-f183ede122f7/volumes" Sep 10 11:21:15.564923 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:21:15.564885 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-687bb8675b-7n2zf"] Sep 10 11:21:15.565348 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:21:15.565171 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d23c9ead-2d05-4491-91b9-f183ede122f7" containerName="online" Sep 10 11:21:15.565348 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:21:15.565182 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="d23c9ead-2d05-4491-91b9-f183ede122f7" containerName="online" Sep 10 11:21:15.565348 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:21:15.565192 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d23c9ead-2d05-4491-91b9-f183ede122f7" containerName="registry" Sep 10 11:21:15.565348 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:21:15.565198 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="d23c9ead-2d05-4491-91b9-f183ede122f7" containerName="registry" Sep 10 11:21:15.565348 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:21:15.565208 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d23c9ead-2d05-4491-91b9-f183ede122f7" containerName="feast-apply" Sep 10 11:21:15.565348 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:21:15.565214 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="d23c9ead-2d05-4491-91b9-f183ede122f7" containerName="feast-apply" Sep 10 11:21:15.565348 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:21:15.565225 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d23c9ead-2d05-4491-91b9-f183ede122f7" containerName="ui" Sep 10 11:21:15.565348 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:21:15.565230 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="d23c9ead-2d05-4491-91b9-f183ede122f7" containerName="ui" Sep 10 11:21:15.565348 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:21:15.565238 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d23c9ead-2d05-4491-91b9-f183ede122f7" containerName="offline" Sep 10 11:21:15.565348 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:21:15.565245 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="d23c9ead-2d05-4491-91b9-f183ede122f7" containerName="offline" Sep 10 11:21:15.565348 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:21:15.565252 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d23c9ead-2d05-4491-91b9-f183ede122f7" containerName="feast-init" Sep 10 11:21:15.565348 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:21:15.565257 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="d23c9ead-2d05-4491-91b9-f183ede122f7" containerName="feast-init" Sep 10 11:21:15.565348 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:21:15.565306 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="d23c9ead-2d05-4491-91b9-f183ede122f7" containerName="offline" Sep 10 11:21:15.565348 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:21:15.565313 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="d23c9ead-2d05-4491-91b9-f183ede122f7" containerName="online" Sep 10 11:21:15.565348 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:21:15.565319 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="d23c9ead-2d05-4491-91b9-f183ede122f7" containerName="ui" Sep 10 11:21:15.565348 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:21:15.565325 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="d23c9ead-2d05-4491-91b9-f183ede122f7" containerName="registry" Sep 10 11:21:15.569577 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:21:15.569561 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-687bb8675b-7n2zf" Sep 10 11:21:15.572342 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:21:15.572313 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-intra-comm\"" Sep 10 11:21:15.573413 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:21:15.573362 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-client-ca\"" Sep 10 11:21:15.573557 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:21:15.573441 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-offline-tls\"" Sep 10 11:21:15.573557 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:21:15.573495 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-ui-tls\"" Sep 10 11:21:15.573815 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:21:15.573799 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"openshift-service-ca.crt\"" Sep 10 11:21:15.573992 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:21:15.573979 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"kube-root-ca.crt\"" Sep 10 11:21:15.574642 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:21:15.574623 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-online-tls\"" Sep 10 11:21:15.574912 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:21:15.574897 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-dockercfg-qz95f\"" Sep 10 11:21:15.597447 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:21:15.597410 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-687bb8675b-7n2zf"] Sep 10 11:21:15.683924 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:21:15.683882 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/93233a4e-718c-4a87-b09b-403263acf1fe-registry-tls\") pod \"feast-simple-feast-remote-setup-687bb8675b-7n2zf\" (UID: \"93233a4e-718c-4a87-b09b-403263acf1fe\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-687bb8675b-7n2zf" Sep 10 11:21:15.684110 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:21:15.683940 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6ndqx\" (UniqueName: \"kubernetes.io/projected/93233a4e-718c-4a87-b09b-403263acf1fe-kube-api-access-6ndqx\") pod \"feast-simple-feast-remote-setup-687bb8675b-7n2zf\" (UID: \"93233a4e-718c-4a87-b09b-403263acf1fe\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-687bb8675b-7n2zf" Sep 10 11:21:15.684110 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:21:15.684079 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/93233a4e-718c-4a87-b09b-403263acf1fe-offline-tls\") pod \"feast-simple-feast-remote-setup-687bb8675b-7n2zf\" (UID: \"93233a4e-718c-4a87-b09b-403263acf1fe\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-687bb8675b-7n2zf" Sep 10 11:21:15.684199 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:21:15.684113 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/93233a4e-718c-4a87-b09b-403263acf1fe-online-tls\") pod \"feast-simple-feast-remote-setup-687bb8675b-7n2zf\" (UID: \"93233a4e-718c-4a87-b09b-403263acf1fe\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-687bb8675b-7n2zf" Sep 10 11:21:15.684199 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:21:15.684131 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/93233a4e-718c-4a87-b09b-403263acf1fe-feast-data\") pod \"feast-simple-feast-remote-setup-687bb8675b-7n2zf\" (UID: \"93233a4e-718c-4a87-b09b-403263acf1fe\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-687bb8675b-7n2zf" Sep 10 11:21:15.684199 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:21:15.684148 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/93233a4e-718c-4a87-b09b-403263acf1fe-ui-tls\") pod \"feast-simple-feast-remote-setup-687bb8675b-7n2zf\" (UID: \"93233a4e-718c-4a87-b09b-403263acf1fe\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-687bb8675b-7n2zf" Sep 10 11:21:15.785465 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:21:15.785424 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/93233a4e-718c-4a87-b09b-403263acf1fe-offline-tls\") pod \"feast-simple-feast-remote-setup-687bb8675b-7n2zf\" (UID: \"93233a4e-718c-4a87-b09b-403263acf1fe\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-687bb8675b-7n2zf" Sep 10 11:21:15.785465 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:21:15.785463 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/93233a4e-718c-4a87-b09b-403263acf1fe-online-tls\") pod \"feast-simple-feast-remote-setup-687bb8675b-7n2zf\" (UID: \"93233a4e-718c-4a87-b09b-403263acf1fe\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-687bb8675b-7n2zf" Sep 10 11:21:15.785715 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:21:15.785482 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/93233a4e-718c-4a87-b09b-403263acf1fe-feast-data\") pod \"feast-simple-feast-remote-setup-687bb8675b-7n2zf\" (UID: \"93233a4e-718c-4a87-b09b-403263acf1fe\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-687bb8675b-7n2zf" Sep 10 11:21:15.785715 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:21:15.785498 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/93233a4e-718c-4a87-b09b-403263acf1fe-ui-tls\") pod \"feast-simple-feast-remote-setup-687bb8675b-7n2zf\" (UID: \"93233a4e-718c-4a87-b09b-403263acf1fe\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-687bb8675b-7n2zf" Sep 10 11:21:15.785715 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:21:15.785525 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/93233a4e-718c-4a87-b09b-403263acf1fe-registry-tls\") pod \"feast-simple-feast-remote-setup-687bb8675b-7n2zf\" (UID: \"93233a4e-718c-4a87-b09b-403263acf1fe\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-687bb8675b-7n2zf" Sep 10 11:21:15.785715 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:21:15.785556 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6ndqx\" (UniqueName: \"kubernetes.io/projected/93233a4e-718c-4a87-b09b-403263acf1fe-kube-api-access-6ndqx\") pod \"feast-simple-feast-remote-setup-687bb8675b-7n2zf\" (UID: \"93233a4e-718c-4a87-b09b-403263acf1fe\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-687bb8675b-7n2zf" Sep 10 11:21:15.785995 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:21:15.785965 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/93233a4e-718c-4a87-b09b-403263acf1fe-feast-data\") pod \"feast-simple-feast-remote-setup-687bb8675b-7n2zf\" (UID: \"93233a4e-718c-4a87-b09b-403263acf1fe\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-687bb8675b-7n2zf" Sep 10 11:21:15.786350 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:21:15.786327 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/93233a4e-718c-4a87-b09b-403263acf1fe-registry-tls\") pod \"feast-simple-feast-remote-setup-687bb8675b-7n2zf\" (UID: \"93233a4e-718c-4a87-b09b-403263acf1fe\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-687bb8675b-7n2zf" Sep 10 11:21:15.788213 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:21:15.788187 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/93233a4e-718c-4a87-b09b-403263acf1fe-online-tls\") pod \"feast-simple-feast-remote-setup-687bb8675b-7n2zf\" (UID: \"93233a4e-718c-4a87-b09b-403263acf1fe\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-687bb8675b-7n2zf" Sep 10 11:21:15.788318 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:21:15.788187 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/93233a4e-718c-4a87-b09b-403263acf1fe-offline-tls\") pod \"feast-simple-feast-remote-setup-687bb8675b-7n2zf\" (UID: \"93233a4e-718c-4a87-b09b-403263acf1fe\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-687bb8675b-7n2zf" Sep 10 11:21:15.788318 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:21:15.788242 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/93233a4e-718c-4a87-b09b-403263acf1fe-ui-tls\") pod \"feast-simple-feast-remote-setup-687bb8675b-7n2zf\" (UID: \"93233a4e-718c-4a87-b09b-403263acf1fe\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-687bb8675b-7n2zf" Sep 10 11:21:15.797919 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:21:15.797895 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6ndqx\" (UniqueName: \"kubernetes.io/projected/93233a4e-718c-4a87-b09b-403263acf1fe-kube-api-access-6ndqx\") pod \"feast-simple-feast-remote-setup-687bb8675b-7n2zf\" (UID: \"93233a4e-718c-4a87-b09b-403263acf1fe\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-687bb8675b-7n2zf" Sep 10 11:21:15.879541 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:21:15.879505 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-687bb8675b-7n2zf" Sep 10 11:21:16.177069 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:21:16.177022 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-687bb8675b-7n2zf"] Sep 10 11:21:16.179787 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:21:16.179757 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod93233a4e_718c_4a87_b09b_403263acf1fe.slice/crio-0b4a0600647d807840bab5890282fb6b8078bab8130ed3217f4238e76a0584d5 WatchSource:0}: Error finding container 0b4a0600647d807840bab5890282fb6b8078bab8130ed3217f4238e76a0584d5: Status 404 returned error can't find the container with id 0b4a0600647d807840bab5890282fb6b8078bab8130ed3217f4238e76a0584d5 Sep 10 11:21:16.232269 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:21:16.232233 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-687bb8675b-7n2zf" event={"ID":"93233a4e-718c-4a87-b09b-403263acf1fe","Type":"ContainerStarted","Data":"0b4a0600647d807840bab5890282fb6b8078bab8130ed3217f4238e76a0584d5"} Sep 10 11:21:17.238622 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:21:17.238587 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-687bb8675b-7n2zf" event={"ID":"93233a4e-718c-4a87-b09b-403263acf1fe","Type":"ContainerStarted","Data":"b99aff48e64484f6ebedef71814e93af80075f3a3af11bb4087b674d2651875f"} Sep 10 11:21:21.259253 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:21:21.259170 2564 generic.go:356] "Generic (PLEG): container finished" podID="93233a4e-718c-4a87-b09b-403263acf1fe" containerID="b99aff48e64484f6ebedef71814e93af80075f3a3af11bb4087b674d2651875f" exitCode=0 Sep 10 11:21:21.259253 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:21:21.259241 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-687bb8675b-7n2zf" event={"ID":"93233a4e-718c-4a87-b09b-403263acf1fe","Type":"ContainerDied","Data":"b99aff48e64484f6ebedef71814e93af80075f3a3af11bb4087b674d2651875f"} Sep 10 11:21:22.276093 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:21:22.276054 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-687bb8675b-7n2zf" event={"ID":"93233a4e-718c-4a87-b09b-403263acf1fe","Type":"ContainerStarted","Data":"ba08bf7c6df2195f585618ba01783b85cb411d85ca842ad9a945fae906f55c1a"} Sep 10 11:21:45.367394 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:21:45.367357 2564 generic.go:356] "Generic (PLEG): container finished" podID="93233a4e-718c-4a87-b09b-403263acf1fe" containerID="ba08bf7c6df2195f585618ba01783b85cb411d85ca842ad9a945fae906f55c1a" exitCode=0 Sep 10 11:21:45.367757 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:21:45.367410 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-687bb8675b-7n2zf" event={"ID":"93233a4e-718c-4a87-b09b-403263acf1fe","Type":"ContainerDied","Data":"ba08bf7c6df2195f585618ba01783b85cb411d85ca842ad9a945fae906f55c1a"} Sep 10 11:21:46.376455 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:21:46.376407 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-687bb8675b-7n2zf" event={"ID":"93233a4e-718c-4a87-b09b-403263acf1fe","Type":"ContainerStarted","Data":"d02e4031a8a5c90dac15b845fba4591bcdc0c8e197bc396b402f641525d466f1"} Sep 10 11:21:46.376957 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:21:46.376475 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-687bb8675b-7n2zf" event={"ID":"93233a4e-718c-4a87-b09b-403263acf1fe","Type":"ContainerStarted","Data":"851f26fc8941c52c271b73e9af4c2c5e230a58cfeebf57e892462e4b11265b24"} Sep 10 11:21:46.376957 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:21:46.376495 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-687bb8675b-7n2zf" event={"ID":"93233a4e-718c-4a87-b09b-403263acf1fe","Type":"ContainerStarted","Data":"eb8616806f40b6b530d5d71791c7894b7dd9c7ae6873e1e2c2d6707b526ef2b1"} Sep 10 11:21:46.402193 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:21:46.402146 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-687bb8675b-7n2zf" podStartSLOduration=31.402126342 podStartE2EDuration="31.402126342s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 11:21:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 11:21:46.400427934 +0000 UTC m=+571.996989152" watchObservedRunningTime="2026-09-10 11:21:46.402126342 +0000 UTC m=+571.998687558" Sep 10 11:21:48.879963 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:21:48.879917 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-687bb8675b-7n2zf" Sep 10 11:21:48.880426 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:21:48.880003 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-687bb8675b-7n2zf" Sep 10 11:21:48.880426 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:21:48.880026 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-687bb8675b-7n2zf" Sep 10 11:21:48.881959 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:21:48.881923 2564 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-687bb8675b-7n2zf" podUID="93233a4e-718c-4a87-b09b-403263acf1fe" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.26:8443: connect: connection refused" Sep 10 11:21:48.881959 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:21:48.881941 2564 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-687bb8675b-7n2zf" podUID="93233a4e-718c-4a87-b09b-403263acf1fe" containerName="online" probeResult="failure" output="Get \"https://10.132.0.26:6567/health\": dial tcp 10.132.0.26:6567: connect: connection refused" Sep 10 11:21:48.882122 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:21:48.881947 2564 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-687bb8675b-7n2zf" podUID="93233a4e-718c-4a87-b09b-403263acf1fe" containerName="offline" probeResult="failure" output="dial tcp 10.132.0.26:8816: connect: connection refused" Sep 10 11:21:51.880968 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:21:51.880918 2564 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-687bb8675b-7n2zf" podUID="93233a4e-718c-4a87-b09b-403263acf1fe" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.26:8443: connect: connection refused" Sep 10 11:21:51.881457 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:21:51.880918 2564 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-687bb8675b-7n2zf" podUID="93233a4e-718c-4a87-b09b-403263acf1fe" containerName="offline" probeResult="failure" output="dial tcp 10.132.0.26:8816: connect: connection refused" Sep 10 11:21:51.881457 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:21:51.881031 2564 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-687bb8675b-7n2zf" podUID="93233a4e-718c-4a87-b09b-403263acf1fe" containerName="online" probeResult="failure" output="Get \"https://10.132.0.26:6567/health\": dial tcp 10.132.0.26:6567: connect: connection refused" Sep 10 11:21:54.881156 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:21:54.881119 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-687bb8675b-7n2zf" Sep 10 11:21:54.881558 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:21:54.881299 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-687bb8675b-7n2zf" Sep 10 11:21:54.881644 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:21:54.881627 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-687bb8675b-7n2zf" Sep 10 11:21:54.881712 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:21:54.881659 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-687bb8675b-7n2zf" Sep 10 11:21:54.881984 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:21:54.881962 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-687bb8675b-7n2zf" Sep 10 11:21:54.882083 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:21:54.882028 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-687bb8675b-7n2zf" Sep 10 11:21:54.904756 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:21:54.904731 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-687bb8675b-7n2zf" Sep 10 11:21:55.423108 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:21:55.423068 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-687bb8675b-7n2zf" Sep 10 11:21:55.443782 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:21:55.443757 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-687bb8675b-7n2zf" Sep 10 11:22:14.849226 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:22:14.849197 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-l2hf2_7f298f77-06d2-4ea6-b4fc-cb2c5e9080de/console-operator/1.log" Sep 10 11:22:14.849627 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:22:14.849316 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-l2hf2_7f298f77-06d2-4ea6-b4fc-cb2c5e9080de/console-operator/1.log" Sep 10 11:22:57.783443 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:22:57.783411 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-687bb8675b-7n2zf"] Sep 10 11:22:57.783957 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:22:57.783622 2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-687bb8675b-7n2zf" podUID="93233a4e-718c-4a87-b09b-403263acf1fe" containerName="online" containerID="cri-o://eb8616806f40b6b530d5d71791c7894b7dd9c7ae6873e1e2c2d6707b526ef2b1" gracePeriod=30 Sep 10 11:22:57.783957 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:22:57.783675 2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-687bb8675b-7n2zf" podUID="93233a4e-718c-4a87-b09b-403263acf1fe" containerName="offline" containerID="cri-o://851f26fc8941c52c271b73e9af4c2c5e230a58cfeebf57e892462e4b11265b24" gracePeriod=30 Sep 10 11:22:57.783957 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:22:57.783691 2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-687bb8675b-7n2zf" podUID="93233a4e-718c-4a87-b09b-403263acf1fe" containerName="ui" containerID="cri-o://d02e4031a8a5c90dac15b845fba4591bcdc0c8e197bc396b402f641525d466f1" gracePeriod=30 Sep 10 11:22:57.898393 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:22:57.898357 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-6675cdddf-rsbnw"] Sep 10 11:22:57.898713 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:22:57.898663 2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-6675cdddf-rsbnw" podUID="f56467c8-d70a-42ad-b579-3be2e73a95bb" containerName="registry" containerID="cri-o://63d1f66f9fc5575df36f9bd7a5070fc267e2dc8081028404842793f816ddeef6" gracePeriod=30 Sep 10 11:22:57.898812 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:22:57.898710 2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-6675cdddf-rsbnw" podUID="f56467c8-d70a-42ad-b579-3be2e73a95bb" containerName="online" containerID="cri-o://278835be24fc247993853e2fd7fefe3638903dd67d7ce7804150514dc93a5a92" gracePeriod=30 Sep 10 11:22:57.898885 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:22:57.898834 2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-6675cdddf-rsbnw" podUID="f56467c8-d70a-42ad-b579-3be2e73a95bb" containerName="ui" containerID="cri-o://5d65974a8c2b710f775803f02ecafaf93f444d61f2de6b72e904195916543e29" gracePeriod=30 Sep 10 11:22:57.899047 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:22:57.899019 2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-6675cdddf-rsbnw" podUID="f56467c8-d70a-42ad-b579-3be2e73a95bb" containerName="offline" containerID="cri-o://142cc001093585885d6bf02902a1bb61ff5d35b81c365085425d1b2eaca9e7f8" gracePeriod=30 Sep 10 11:22:58.680750 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:22:58.680714 2564 generic.go:356] "Generic (PLEG): container finished" podID="f56467c8-d70a-42ad-b579-3be2e73a95bb" containerID="5d65974a8c2b710f775803f02ecafaf93f444d61f2de6b72e904195916543e29" exitCode=0 Sep 10 11:22:58.680865 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:22:58.680785 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-6675cdddf-rsbnw" event={"ID":"f56467c8-d70a-42ad-b579-3be2e73a95bb","Type":"ContainerDied","Data":"5d65974a8c2b710f775803f02ecafaf93f444d61f2de6b72e904195916543e29"} Sep 10 11:22:58.683506 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:22:58.683485 2564 generic.go:356] "Generic (PLEG): container finished" podID="93233a4e-718c-4a87-b09b-403263acf1fe" containerID="d02e4031a8a5c90dac15b845fba4591bcdc0c8e197bc396b402f641525d466f1" exitCode=0 Sep 10 11:22:58.683506 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:22:58.683505 2564 generic.go:356] "Generic (PLEG): container finished" podID="93233a4e-718c-4a87-b09b-403263acf1fe" containerID="eb8616806f40b6b530d5d71791c7894b7dd9c7ae6873e1e2c2d6707b526ef2b1" exitCode=0 Sep 10 11:22:58.683627 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:22:58.683524 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-687bb8675b-7n2zf" event={"ID":"93233a4e-718c-4a87-b09b-403263acf1fe","Type":"ContainerDied","Data":"d02e4031a8a5c90dac15b845fba4591bcdc0c8e197bc396b402f641525d466f1"} Sep 10 11:22:58.683627 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:22:58.683550 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-687bb8675b-7n2zf" event={"ID":"93233a4e-718c-4a87-b09b-403263acf1fe","Type":"ContainerDied","Data":"eb8616806f40b6b530d5d71791c7894b7dd9c7ae6873e1e2c2d6707b526ef2b1"} Sep 10 11:22:59.690776 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:22:59.690737 2564 generic.go:356] "Generic (PLEG): container finished" podID="f56467c8-d70a-42ad-b579-3be2e73a95bb" containerID="278835be24fc247993853e2fd7fefe3638903dd67d7ce7804150514dc93a5a92" exitCode=0 Sep 10 11:22:59.690776 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:22:59.690781 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-6675cdddf-rsbnw" event={"ID":"f56467c8-d70a-42ad-b579-3be2e73a95bb","Type":"ContainerDied","Data":"278835be24fc247993853e2fd7fefe3638903dd67d7ce7804150514dc93a5a92"} Sep 10 11:23:02.976496 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:23:02.976450 2564 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-6675cdddf-rsbnw" podUID="f56467c8-d70a-42ad-b579-3be2e73a95bb" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.25:8443: connect: connection refused" Sep 10 11:23:02.976496 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:23:02.976471 2564 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-6675cdddf-rsbnw" podUID="f56467c8-d70a-42ad-b579-3be2e73a95bb" containerName="online" probeResult="failure" output="Get \"https://10.132.0.25:6567/health\": dial tcp 10.132.0.25:6567: connect: connection refused" Sep 10 11:23:04.882595 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:23:04.882557 2564 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-687bb8675b-7n2zf" podUID="93233a4e-718c-4a87-b09b-403263acf1fe" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.26:8443: connect: connection refused" Sep 10 11:23:05.423694 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:23:05.423646 2564 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-687bb8675b-7n2zf" podUID="93233a4e-718c-4a87-b09b-403263acf1fe" containerName="online" probeResult="failure" output="Get \"https://10.132.0.26:6567/health\": dial tcp 10.132.0.26:6567: connect: connection refused" Sep 10 11:23:12.976063 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:23:12.976020 2564 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-6675cdddf-rsbnw" podUID="f56467c8-d70a-42ad-b579-3be2e73a95bb" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.25:8443: connect: connection refused" Sep 10 11:23:12.976408 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:23:12.976072 2564 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-6675cdddf-rsbnw" podUID="f56467c8-d70a-42ad-b579-3be2e73a95bb" containerName="online" probeResult="failure" output="Get \"https://10.132.0.25:6567/health\": dial tcp 10.132.0.25:6567: connect: connection refused" Sep 10 11:23:14.882711 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:23:14.882664 2564 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-687bb8675b-7n2zf" podUID="93233a4e-718c-4a87-b09b-403263acf1fe" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.26:8443: connect: connection refused" Sep 10 11:23:15.423632 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:23:15.423591 2564 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-687bb8675b-7n2zf" podUID="93233a4e-718c-4a87-b09b-403263acf1fe" containerName="online" probeResult="failure" output="Get \"https://10.132.0.26:6567/health\": dial tcp 10.132.0.26:6567: connect: connection refused" Sep 10 11:23:22.976028 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:23:22.975983 2564 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-6675cdddf-rsbnw" podUID="f56467c8-d70a-42ad-b579-3be2e73a95bb" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.25:8443: connect: connection refused" Sep 10 11:23:22.976573 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:23:22.976024 2564 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-6675cdddf-rsbnw" podUID="f56467c8-d70a-42ad-b579-3be2e73a95bb" containerName="online" probeResult="failure" output="Get \"https://10.132.0.25:6567/health\": dial tcp 10.132.0.25:6567: connect: connection refused" Sep 10 11:23:22.976573 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:23:22.976099 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-6675cdddf-rsbnw" Sep 10 11:23:22.976573 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:23:22.976268 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-6675cdddf-rsbnw" Sep 10 11:23:24.882778 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:23:24.882735 2564 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-687bb8675b-7n2zf" podUID="93233a4e-718c-4a87-b09b-403263acf1fe" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.26:8443: connect: connection refused" Sep 10 11:23:24.883245 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:23:24.882919 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-687bb8675b-7n2zf" Sep 10 11:23:25.424012 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:23:25.423975 2564 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-687bb8675b-7n2zf" podUID="93233a4e-718c-4a87-b09b-403263acf1fe" containerName="online" probeResult="failure" output="Get \"https://10.132.0.26:6567/health\": dial tcp 10.132.0.26:6567: connect: connection refused" Sep 10 11:23:25.424177 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:23:25.424075 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-687bb8675b-7n2zf" Sep 10 11:23:28.022026 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:23:28.022006 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-687bb8675b-7n2zf" Sep 10 11:23:28.182604 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:23:28.182577 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/93233a4e-718c-4a87-b09b-403263acf1fe-feast-data\") pod \"93233a4e-718c-4a87-b09b-403263acf1fe\" (UID: \"93233a4e-718c-4a87-b09b-403263acf1fe\") " Sep 10 11:23:28.182761 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:23:28.182612 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/93233a4e-718c-4a87-b09b-403263acf1fe-online-tls\") pod \"93233a4e-718c-4a87-b09b-403263acf1fe\" (UID: \"93233a4e-718c-4a87-b09b-403263acf1fe\") " Sep 10 11:23:28.182761 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:23:28.182653 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/93233a4e-718c-4a87-b09b-403263acf1fe-registry-tls\") pod \"93233a4e-718c-4a87-b09b-403263acf1fe\" (UID: \"93233a4e-718c-4a87-b09b-403263acf1fe\") " Sep 10 11:23:28.182761 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:23:28.182683 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6ndqx\" (UniqueName: \"kubernetes.io/projected/93233a4e-718c-4a87-b09b-403263acf1fe-kube-api-access-6ndqx\") pod \"93233a4e-718c-4a87-b09b-403263acf1fe\" (UID: \"93233a4e-718c-4a87-b09b-403263acf1fe\") " Sep 10 11:23:28.182761 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:23:28.182706 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/93233a4e-718c-4a87-b09b-403263acf1fe-ui-tls\") pod \"93233a4e-718c-4a87-b09b-403263acf1fe\" (UID: \"93233a4e-718c-4a87-b09b-403263acf1fe\") " Sep 10 11:23:28.182761 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:23:28.182760 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/93233a4e-718c-4a87-b09b-403263acf1fe-offline-tls\") pod \"93233a4e-718c-4a87-b09b-403263acf1fe\" (UID: \"93233a4e-718c-4a87-b09b-403263acf1fe\") " Sep 10 11:23:28.183103 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:23:28.183082 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/93233a4e-718c-4a87-b09b-403263acf1fe-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "93233a4e-718c-4a87-b09b-403263acf1fe" (UID: "93233a4e-718c-4a87-b09b-403263acf1fe"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 10 11:23:28.183216 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:23:28.183185 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/93233a4e-718c-4a87-b09b-403263acf1fe-feast-data" (OuterVolumeSpecName: "feast-data") pod "93233a4e-718c-4a87-b09b-403263acf1fe" (UID: "93233a4e-718c-4a87-b09b-403263acf1fe"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 10 11:23:28.184956 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:23:28.184926 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/93233a4e-718c-4a87-b09b-403263acf1fe-online-tls" (OuterVolumeSpecName: "online-tls") pod "93233a4e-718c-4a87-b09b-403263acf1fe" (UID: "93233a4e-718c-4a87-b09b-403263acf1fe"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 10 11:23:28.185056 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:23:28.184961 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/93233a4e-718c-4a87-b09b-403263acf1fe-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "93233a4e-718c-4a87-b09b-403263acf1fe" (UID: "93233a4e-718c-4a87-b09b-403263acf1fe"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 10 11:23:28.185056 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:23:28.185031 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/93233a4e-718c-4a87-b09b-403263acf1fe-kube-api-access-6ndqx" (OuterVolumeSpecName: "kube-api-access-6ndqx") pod "93233a4e-718c-4a87-b09b-403263acf1fe" (UID: "93233a4e-718c-4a87-b09b-403263acf1fe"). InnerVolumeSpecName "kube-api-access-6ndqx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 11:23:28.185056 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:23:28.185033 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/93233a4e-718c-4a87-b09b-403263acf1fe-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "93233a4e-718c-4a87-b09b-403263acf1fe" (UID: "93233a4e-718c-4a87-b09b-403263acf1fe"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 10 11:23:28.283833 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:23:28.283803 2564 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/93233a4e-718c-4a87-b09b-403263acf1fe-registry-tls\") on node \"ip-10-0-134-73.ec2.internal\" DevicePath \"\"" Sep 10 11:23:28.283833 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:23:28.283832 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6ndqx\" (UniqueName: \"kubernetes.io/projected/93233a4e-718c-4a87-b09b-403263acf1fe-kube-api-access-6ndqx\") on node \"ip-10-0-134-73.ec2.internal\" DevicePath \"\"" Sep 10 11:23:28.284031 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:23:28.283848 2564 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/93233a4e-718c-4a87-b09b-403263acf1fe-ui-tls\") on node \"ip-10-0-134-73.ec2.internal\" DevicePath \"\"" Sep 10 11:23:28.284031 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:23:28.283875 2564 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/93233a4e-718c-4a87-b09b-403263acf1fe-offline-tls\") on node \"ip-10-0-134-73.ec2.internal\" DevicePath \"\"" Sep 10 11:23:28.284031 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:23:28.283884 2564 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/93233a4e-718c-4a87-b09b-403263acf1fe-feast-data\") on node \"ip-10-0-134-73.ec2.internal\" DevicePath \"\"" Sep 10 11:23:28.284031 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:23:28.283918 2564 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/93233a4e-718c-4a87-b09b-403263acf1fe-online-tls\") on node \"ip-10-0-134-73.ec2.internal\" DevicePath \"\"" Sep 10 11:23:28.546667 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:23:28.546641 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-6675cdddf-rsbnw" Sep 10 11:23:28.686916 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:23:28.686807 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/f56467c8-d70a-42ad-b579-3be2e73a95bb-feast-data\") pod \"f56467c8-d70a-42ad-b579-3be2e73a95bb\" (UID: \"f56467c8-d70a-42ad-b579-3be2e73a95bb\") " Sep 10 11:23:28.687053 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:23:28.686923 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/f56467c8-d70a-42ad-b579-3be2e73a95bb-offline-tls\") pod \"f56467c8-d70a-42ad-b579-3be2e73a95bb\" (UID: \"f56467c8-d70a-42ad-b579-3be2e73a95bb\") " Sep 10 11:23:28.687053 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:23:28.686980 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/f56467c8-d70a-42ad-b579-3be2e73a95bb-ui-tls\") pod \"f56467c8-d70a-42ad-b579-3be2e73a95bb\" (UID: \"f56467c8-d70a-42ad-b579-3be2e73a95bb\") " Sep 10 11:23:28.687053 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:23:28.687014 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h2hdv\" (UniqueName: \"kubernetes.io/projected/f56467c8-d70a-42ad-b579-3be2e73a95bb-kube-api-access-h2hdv\") pod \"f56467c8-d70a-42ad-b579-3be2e73a95bb\" (UID: \"f56467c8-d70a-42ad-b579-3be2e73a95bb\") " Sep 10 11:23:28.687053 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:23:28.687038 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/f56467c8-d70a-42ad-b579-3be2e73a95bb-online-tls\") pod \"f56467c8-d70a-42ad-b579-3be2e73a95bb\" (UID: \"f56467c8-d70a-42ad-b579-3be2e73a95bb\") " Sep 10 11:23:28.687265 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:23:28.687061 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/f56467c8-d70a-42ad-b579-3be2e73a95bb-registry-tls\") pod \"f56467c8-d70a-42ad-b579-3be2e73a95bb\" (UID: \"f56467c8-d70a-42ad-b579-3be2e73a95bb\") " Sep 10 11:23:28.687412 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:23:28.687386 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f56467c8-d70a-42ad-b579-3be2e73a95bb-feast-data" (OuterVolumeSpecName: "feast-data") pod "f56467c8-d70a-42ad-b579-3be2e73a95bb" (UID: "f56467c8-d70a-42ad-b579-3be2e73a95bb"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 10 11:23:28.689210 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:23:28.689179 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f56467c8-d70a-42ad-b579-3be2e73a95bb-kube-api-access-h2hdv" (OuterVolumeSpecName: "kube-api-access-h2hdv") pod "f56467c8-d70a-42ad-b579-3be2e73a95bb" (UID: "f56467c8-d70a-42ad-b579-3be2e73a95bb"). InnerVolumeSpecName "kube-api-access-h2hdv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 11:23:28.689318 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:23:28.689205 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f56467c8-d70a-42ad-b579-3be2e73a95bb-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "f56467c8-d70a-42ad-b579-3be2e73a95bb" (UID: "f56467c8-d70a-42ad-b579-3be2e73a95bb"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 10 11:23:28.689452 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:23:28.689431 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f56467c8-d70a-42ad-b579-3be2e73a95bb-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "f56467c8-d70a-42ad-b579-3be2e73a95bb" (UID: "f56467c8-d70a-42ad-b579-3be2e73a95bb"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 10 11:23:28.689582 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:23:28.689565 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f56467c8-d70a-42ad-b579-3be2e73a95bb-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "f56467c8-d70a-42ad-b579-3be2e73a95bb" (UID: "f56467c8-d70a-42ad-b579-3be2e73a95bb"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 10 11:23:28.689635 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:23:28.689578 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f56467c8-d70a-42ad-b579-3be2e73a95bb-online-tls" (OuterVolumeSpecName: "online-tls") pod "f56467c8-d70a-42ad-b579-3be2e73a95bb" (UID: "f56467c8-d70a-42ad-b579-3be2e73a95bb"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 10 11:23:28.787942 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:23:28.787873 2564 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/f56467c8-d70a-42ad-b579-3be2e73a95bb-feast-data\") on node \"ip-10-0-134-73.ec2.internal\" DevicePath \"\"" Sep 10 11:23:28.787942 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:23:28.787899 2564 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/f56467c8-d70a-42ad-b579-3be2e73a95bb-offline-tls\") on node \"ip-10-0-134-73.ec2.internal\" DevicePath \"\"" Sep 10 11:23:28.787942 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:23:28.787907 2564 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/f56467c8-d70a-42ad-b579-3be2e73a95bb-ui-tls\") on node \"ip-10-0-134-73.ec2.internal\" DevicePath \"\"" Sep 10 11:23:28.787942 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:23:28.787916 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h2hdv\" (UniqueName: \"kubernetes.io/projected/f56467c8-d70a-42ad-b579-3be2e73a95bb-kube-api-access-h2hdv\") on node \"ip-10-0-134-73.ec2.internal\" DevicePath \"\"" Sep 10 11:23:28.787942 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:23:28.787924 2564 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/f56467c8-d70a-42ad-b579-3be2e73a95bb-online-tls\") on node \"ip-10-0-134-73.ec2.internal\" DevicePath \"\"" Sep 10 11:23:28.787942 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:23:28.787932 2564 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/f56467c8-d70a-42ad-b579-3be2e73a95bb-registry-tls\") on node \"ip-10-0-134-73.ec2.internal\" DevicePath \"\"" Sep 10 11:23:28.807289 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:23:28.807254 2564 generic.go:356] "Generic (PLEG): container finished" podID="f56467c8-d70a-42ad-b579-3be2e73a95bb" containerID="142cc001093585885d6bf02902a1bb61ff5d35b81c365085425d1b2eaca9e7f8" exitCode=137 Sep 10 11:23:28.807289 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:23:28.807287 2564 generic.go:356] "Generic (PLEG): container finished" podID="f56467c8-d70a-42ad-b579-3be2e73a95bb" containerID="63d1f66f9fc5575df36f9bd7a5070fc267e2dc8081028404842793f816ddeef6" exitCode=137 Sep 10 11:23:28.807471 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:23:28.807309 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-6675cdddf-rsbnw" event={"ID":"f56467c8-d70a-42ad-b579-3be2e73a95bb","Type":"ContainerDied","Data":"142cc001093585885d6bf02902a1bb61ff5d35b81c365085425d1b2eaca9e7f8"} Sep 10 11:23:28.807471 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:23:28.807327 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-6675cdddf-rsbnw" Sep 10 11:23:28.807471 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:23:28.807368 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-6675cdddf-rsbnw" event={"ID":"f56467c8-d70a-42ad-b579-3be2e73a95bb","Type":"ContainerDied","Data":"63d1f66f9fc5575df36f9bd7a5070fc267e2dc8081028404842793f816ddeef6"} Sep 10 11:23:28.807471 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:23:28.807392 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-6675cdddf-rsbnw" event={"ID":"f56467c8-d70a-42ad-b579-3be2e73a95bb","Type":"ContainerDied","Data":"5513fc3c1c2cce85cb1cdd9c38f34c6ee99361a72977779cea422b784ac8ea31"} Sep 10 11:23:28.807471 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:23:28.807417 2564 scope.go:117] "RemoveContainer" containerID="5d65974a8c2b710f775803f02ecafaf93f444d61f2de6b72e904195916543e29" Sep 10 11:23:28.810882 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:23:28.810718 2564 generic.go:356] "Generic (PLEG): container finished" podID="93233a4e-718c-4a87-b09b-403263acf1fe" containerID="851f26fc8941c52c271b73e9af4c2c5e230a58cfeebf57e892462e4b11265b24" exitCode=137 Sep 10 11:23:28.810882 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:23:28.810744 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-687bb8675b-7n2zf" event={"ID":"93233a4e-718c-4a87-b09b-403263acf1fe","Type":"ContainerDied","Data":"851f26fc8941c52c271b73e9af4c2c5e230a58cfeebf57e892462e4b11265b24"} Sep 10 11:23:28.810882 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:23:28.810775 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-687bb8675b-7n2zf" event={"ID":"93233a4e-718c-4a87-b09b-403263acf1fe","Type":"ContainerDied","Data":"0b4a0600647d807840bab5890282fb6b8078bab8130ed3217f4238e76a0584d5"} Sep 10 11:23:28.810882 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:23:28.810831 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-687bb8675b-7n2zf" Sep 10 11:23:28.820503 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:23:28.820488 2564 scope.go:117] "RemoveContainer" containerID="142cc001093585885d6bf02902a1bb61ff5d35b81c365085425d1b2eaca9e7f8" Sep 10 11:23:28.827667 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:23:28.827652 2564 scope.go:117] "RemoveContainer" containerID="278835be24fc247993853e2fd7fefe3638903dd67d7ce7804150514dc93a5a92" Sep 10 11:23:28.832212 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:23:28.832192 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-6675cdddf-rsbnw"] Sep 10 11:23:28.835767 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:23:28.835749 2564 scope.go:117] "RemoveContainer" containerID="63d1f66f9fc5575df36f9bd7a5070fc267e2dc8081028404842793f816ddeef6" Sep 10 11:23:28.836496 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:23:28.836477 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-6675cdddf-rsbnw"] Sep 10 11:23:28.843014 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:23:28.842992 2564 scope.go:117] "RemoveContainer" containerID="2188090f4322fef966da67b6e585906b0088b9367c34f9b4e2de7a665ff5dcf6" Sep 10 11:23:28.848445 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:23:28.848426 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-687bb8675b-7n2zf"] Sep 10 11:23:28.850051 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:23:28.850037 2564 scope.go:117] "RemoveContainer" containerID="1bf685a5b9a66a3bcd3d9fe9cafeb468a546caa3ddbd9b953a81feb2af950ac5" Sep 10 11:23:28.854350 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:23:28.854325 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-687bb8675b-7n2zf"] Sep 10 11:23:28.857333 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:23:28.857319 2564 scope.go:117] "RemoveContainer" containerID="5d65974a8c2b710f775803f02ecafaf93f444d61f2de6b72e904195916543e29" Sep 10 11:23:28.857594 ip-10-0-134-73 kubenswrapper[2564]: E0910 11:23:28.857577 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5d65974a8c2b710f775803f02ecafaf93f444d61f2de6b72e904195916543e29\": container with ID starting with 5d65974a8c2b710f775803f02ecafaf93f444d61f2de6b72e904195916543e29 not found: ID does not exist" containerID="5d65974a8c2b710f775803f02ecafaf93f444d61f2de6b72e904195916543e29" Sep 10 11:23:28.857642 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:23:28.857602 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5d65974a8c2b710f775803f02ecafaf93f444d61f2de6b72e904195916543e29"} err="failed to get container status \"5d65974a8c2b710f775803f02ecafaf93f444d61f2de6b72e904195916543e29\": rpc error: code = NotFound desc = could not find container \"5d65974a8c2b710f775803f02ecafaf93f444d61f2de6b72e904195916543e29\": container with ID starting with 5d65974a8c2b710f775803f02ecafaf93f444d61f2de6b72e904195916543e29 not found: ID does not exist" Sep 10 11:23:28.857642 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:23:28.857619 2564 scope.go:117] "RemoveContainer" containerID="142cc001093585885d6bf02902a1bb61ff5d35b81c365085425d1b2eaca9e7f8" Sep 10 11:23:28.857905 ip-10-0-134-73 kubenswrapper[2564]: E0910 11:23:28.857885 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"142cc001093585885d6bf02902a1bb61ff5d35b81c365085425d1b2eaca9e7f8\": container with ID starting with 142cc001093585885d6bf02902a1bb61ff5d35b81c365085425d1b2eaca9e7f8 not found: ID does not exist" containerID="142cc001093585885d6bf02902a1bb61ff5d35b81c365085425d1b2eaca9e7f8" Sep 10 11:23:28.857973 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:23:28.857911 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"142cc001093585885d6bf02902a1bb61ff5d35b81c365085425d1b2eaca9e7f8"} err="failed to get container status \"142cc001093585885d6bf02902a1bb61ff5d35b81c365085425d1b2eaca9e7f8\": rpc error: code = NotFound desc = could not find container \"142cc001093585885d6bf02902a1bb61ff5d35b81c365085425d1b2eaca9e7f8\": container with ID starting with 142cc001093585885d6bf02902a1bb61ff5d35b81c365085425d1b2eaca9e7f8 not found: ID does not exist" Sep 10 11:23:28.857973 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:23:28.857934 2564 scope.go:117] "RemoveContainer" containerID="278835be24fc247993853e2fd7fefe3638903dd67d7ce7804150514dc93a5a92" Sep 10 11:23:28.858190 ip-10-0-134-73 kubenswrapper[2564]: E0910 11:23:28.858170 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"278835be24fc247993853e2fd7fefe3638903dd67d7ce7804150514dc93a5a92\": container with ID starting with 278835be24fc247993853e2fd7fefe3638903dd67d7ce7804150514dc93a5a92 not found: ID does not exist" containerID="278835be24fc247993853e2fd7fefe3638903dd67d7ce7804150514dc93a5a92" Sep 10 11:23:28.858255 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:23:28.858200 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"278835be24fc247993853e2fd7fefe3638903dd67d7ce7804150514dc93a5a92"} err="failed to get container status \"278835be24fc247993853e2fd7fefe3638903dd67d7ce7804150514dc93a5a92\": rpc error: code = NotFound desc = could not find container \"278835be24fc247993853e2fd7fefe3638903dd67d7ce7804150514dc93a5a92\": container with ID starting with 278835be24fc247993853e2fd7fefe3638903dd67d7ce7804150514dc93a5a92 not found: ID does not exist" Sep 10 11:23:28.858255 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:23:28.858221 2564 scope.go:117] "RemoveContainer" containerID="63d1f66f9fc5575df36f9bd7a5070fc267e2dc8081028404842793f816ddeef6" Sep 10 11:23:28.858468 ip-10-0-134-73 kubenswrapper[2564]: E0910 11:23:28.858453 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"63d1f66f9fc5575df36f9bd7a5070fc267e2dc8081028404842793f816ddeef6\": container with ID starting with 63d1f66f9fc5575df36f9bd7a5070fc267e2dc8081028404842793f816ddeef6 not found: ID does not exist" containerID="63d1f66f9fc5575df36f9bd7a5070fc267e2dc8081028404842793f816ddeef6" Sep 10 11:23:28.858508 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:23:28.858471 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"63d1f66f9fc5575df36f9bd7a5070fc267e2dc8081028404842793f816ddeef6"} err="failed to get container status \"63d1f66f9fc5575df36f9bd7a5070fc267e2dc8081028404842793f816ddeef6\": rpc error: code = NotFound desc = could not find container \"63d1f66f9fc5575df36f9bd7a5070fc267e2dc8081028404842793f816ddeef6\": container with ID starting with 63d1f66f9fc5575df36f9bd7a5070fc267e2dc8081028404842793f816ddeef6 not found: ID does not exist" Sep 10 11:23:28.858508 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:23:28.858486 2564 scope.go:117] "RemoveContainer" containerID="2188090f4322fef966da67b6e585906b0088b9367c34f9b4e2de7a665ff5dcf6" Sep 10 11:23:28.858706 ip-10-0-134-73 kubenswrapper[2564]: E0910 11:23:28.858689 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2188090f4322fef966da67b6e585906b0088b9367c34f9b4e2de7a665ff5dcf6\": container with ID starting with 2188090f4322fef966da67b6e585906b0088b9367c34f9b4e2de7a665ff5dcf6 not found: ID does not exist" containerID="2188090f4322fef966da67b6e585906b0088b9367c34f9b4e2de7a665ff5dcf6" Sep 10 11:23:28.858767 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:23:28.858713 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2188090f4322fef966da67b6e585906b0088b9367c34f9b4e2de7a665ff5dcf6"} err="failed to get container status \"2188090f4322fef966da67b6e585906b0088b9367c34f9b4e2de7a665ff5dcf6\": rpc error: code = NotFound desc = could not find container \"2188090f4322fef966da67b6e585906b0088b9367c34f9b4e2de7a665ff5dcf6\": container with ID starting with 2188090f4322fef966da67b6e585906b0088b9367c34f9b4e2de7a665ff5dcf6 not found: ID does not exist" Sep 10 11:23:28.858767 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:23:28.858745 2564 scope.go:117] "RemoveContainer" containerID="1bf685a5b9a66a3bcd3d9fe9cafeb468a546caa3ddbd9b953a81feb2af950ac5" Sep 10 11:23:28.858992 ip-10-0-134-73 kubenswrapper[2564]: E0910 11:23:28.858973 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1bf685a5b9a66a3bcd3d9fe9cafeb468a546caa3ddbd9b953a81feb2af950ac5\": container with ID starting with 1bf685a5b9a66a3bcd3d9fe9cafeb468a546caa3ddbd9b953a81feb2af950ac5 not found: ID does not exist" containerID="1bf685a5b9a66a3bcd3d9fe9cafeb468a546caa3ddbd9b953a81feb2af950ac5" Sep 10 11:23:28.859051 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:23:28.858995 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1bf685a5b9a66a3bcd3d9fe9cafeb468a546caa3ddbd9b953a81feb2af950ac5"} err="failed to get container status \"1bf685a5b9a66a3bcd3d9fe9cafeb468a546caa3ddbd9b953a81feb2af950ac5\": rpc error: code = NotFound desc = could not find container \"1bf685a5b9a66a3bcd3d9fe9cafeb468a546caa3ddbd9b953a81feb2af950ac5\": container with ID starting with 1bf685a5b9a66a3bcd3d9fe9cafeb468a546caa3ddbd9b953a81feb2af950ac5 not found: ID does not exist" Sep 10 11:23:28.859051 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:23:28.859009 2564 scope.go:117] "RemoveContainer" containerID="5d65974a8c2b710f775803f02ecafaf93f444d61f2de6b72e904195916543e29" Sep 10 11:23:28.859220 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:23:28.859204 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5d65974a8c2b710f775803f02ecafaf93f444d61f2de6b72e904195916543e29"} err="failed to get container status \"5d65974a8c2b710f775803f02ecafaf93f444d61f2de6b72e904195916543e29\": rpc error: code = NotFound desc = could not find container \"5d65974a8c2b710f775803f02ecafaf93f444d61f2de6b72e904195916543e29\": container with ID starting with 5d65974a8c2b710f775803f02ecafaf93f444d61f2de6b72e904195916543e29 not found: ID does not exist" Sep 10 11:23:28.859257 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:23:28.859220 2564 scope.go:117] "RemoveContainer" containerID="142cc001093585885d6bf02902a1bb61ff5d35b81c365085425d1b2eaca9e7f8" Sep 10 11:23:28.859423 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:23:28.859405 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"142cc001093585885d6bf02902a1bb61ff5d35b81c365085425d1b2eaca9e7f8"} err="failed to get container status \"142cc001093585885d6bf02902a1bb61ff5d35b81c365085425d1b2eaca9e7f8\": rpc error: code = NotFound desc = could not find container \"142cc001093585885d6bf02902a1bb61ff5d35b81c365085425d1b2eaca9e7f8\": container with ID starting with 142cc001093585885d6bf02902a1bb61ff5d35b81c365085425d1b2eaca9e7f8 not found: ID does not exist" Sep 10 11:23:28.859462 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:23:28.859423 2564 scope.go:117] "RemoveContainer" containerID="278835be24fc247993853e2fd7fefe3638903dd67d7ce7804150514dc93a5a92" Sep 10 11:23:28.859614 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:23:28.859596 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"278835be24fc247993853e2fd7fefe3638903dd67d7ce7804150514dc93a5a92"} err="failed to get container status \"278835be24fc247993853e2fd7fefe3638903dd67d7ce7804150514dc93a5a92\": rpc error: code = NotFound desc = could not find container \"278835be24fc247993853e2fd7fefe3638903dd67d7ce7804150514dc93a5a92\": container with ID starting with 278835be24fc247993853e2fd7fefe3638903dd67d7ce7804150514dc93a5a92 not found: ID does not exist" Sep 10 11:23:28.859614 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:23:28.859613 2564 scope.go:117] "RemoveContainer" containerID="63d1f66f9fc5575df36f9bd7a5070fc267e2dc8081028404842793f816ddeef6" Sep 10 11:23:28.859885 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:23:28.859850 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"63d1f66f9fc5575df36f9bd7a5070fc267e2dc8081028404842793f816ddeef6"} err="failed to get container status \"63d1f66f9fc5575df36f9bd7a5070fc267e2dc8081028404842793f816ddeef6\": rpc error: code = NotFound desc = could not find container \"63d1f66f9fc5575df36f9bd7a5070fc267e2dc8081028404842793f816ddeef6\": container with ID starting with 63d1f66f9fc5575df36f9bd7a5070fc267e2dc8081028404842793f816ddeef6 not found: ID does not exist" Sep 10 11:23:28.859947 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:23:28.859886 2564 scope.go:117] "RemoveContainer" containerID="2188090f4322fef966da67b6e585906b0088b9367c34f9b4e2de7a665ff5dcf6" Sep 10 11:23:28.860114 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:23:28.860096 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2188090f4322fef966da67b6e585906b0088b9367c34f9b4e2de7a665ff5dcf6"} err="failed to get container status \"2188090f4322fef966da67b6e585906b0088b9367c34f9b4e2de7a665ff5dcf6\": rpc error: code = NotFound desc = could not find container \"2188090f4322fef966da67b6e585906b0088b9367c34f9b4e2de7a665ff5dcf6\": container with ID starting with 2188090f4322fef966da67b6e585906b0088b9367c34f9b4e2de7a665ff5dcf6 not found: ID does not exist" Sep 10 11:23:28.860169 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:23:28.860115 2564 scope.go:117] "RemoveContainer" containerID="1bf685a5b9a66a3bcd3d9fe9cafeb468a546caa3ddbd9b953a81feb2af950ac5" Sep 10 11:23:28.860367 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:23:28.860350 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1bf685a5b9a66a3bcd3d9fe9cafeb468a546caa3ddbd9b953a81feb2af950ac5"} err="failed to get container status \"1bf685a5b9a66a3bcd3d9fe9cafeb468a546caa3ddbd9b953a81feb2af950ac5\": rpc error: code = NotFound desc = could not find container \"1bf685a5b9a66a3bcd3d9fe9cafeb468a546caa3ddbd9b953a81feb2af950ac5\": container with ID starting with 1bf685a5b9a66a3bcd3d9fe9cafeb468a546caa3ddbd9b953a81feb2af950ac5 not found: ID does not exist" Sep 10 11:23:28.860367 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:23:28.860367 2564 scope.go:117] "RemoveContainer" containerID="d02e4031a8a5c90dac15b845fba4591bcdc0c8e197bc396b402f641525d466f1" Sep 10 11:23:28.868709 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:23:28.868690 2564 scope.go:117] "RemoveContainer" containerID="851f26fc8941c52c271b73e9af4c2c5e230a58cfeebf57e892462e4b11265b24" Sep 10 11:23:28.876220 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:23:28.876205 2564 scope.go:117] "RemoveContainer" containerID="eb8616806f40b6b530d5d71791c7894b7dd9c7ae6873e1e2c2d6707b526ef2b1" Sep 10 11:23:28.883175 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:23:28.883159 2564 scope.go:117] "RemoveContainer" containerID="ba08bf7c6df2195f585618ba01783b85cb411d85ca842ad9a945fae906f55c1a" Sep 10 11:23:28.889647 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:23:28.889633 2564 scope.go:117] "RemoveContainer" containerID="b99aff48e64484f6ebedef71814e93af80075f3a3af11bb4087b674d2651875f" Sep 10 11:23:28.896077 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:23:28.896061 2564 scope.go:117] "RemoveContainer" containerID="d02e4031a8a5c90dac15b845fba4591bcdc0c8e197bc396b402f641525d466f1" Sep 10 11:23:28.896314 ip-10-0-134-73 kubenswrapper[2564]: E0910 11:23:28.896298 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d02e4031a8a5c90dac15b845fba4591bcdc0c8e197bc396b402f641525d466f1\": container with ID starting with d02e4031a8a5c90dac15b845fba4591bcdc0c8e197bc396b402f641525d466f1 not found: ID does not exist" containerID="d02e4031a8a5c90dac15b845fba4591bcdc0c8e197bc396b402f641525d466f1" Sep 10 11:23:28.896363 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:23:28.896319 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d02e4031a8a5c90dac15b845fba4591bcdc0c8e197bc396b402f641525d466f1"} err="failed to get container status \"d02e4031a8a5c90dac15b845fba4591bcdc0c8e197bc396b402f641525d466f1\": rpc error: code = NotFound desc = could not find container \"d02e4031a8a5c90dac15b845fba4591bcdc0c8e197bc396b402f641525d466f1\": container with ID starting with d02e4031a8a5c90dac15b845fba4591bcdc0c8e197bc396b402f641525d466f1 not found: ID does not exist" Sep 10 11:23:28.896363 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:23:28.896334 2564 scope.go:117] "RemoveContainer" containerID="851f26fc8941c52c271b73e9af4c2c5e230a58cfeebf57e892462e4b11265b24" Sep 10 11:23:28.896536 ip-10-0-134-73 kubenswrapper[2564]: E0910 11:23:28.896521 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"851f26fc8941c52c271b73e9af4c2c5e230a58cfeebf57e892462e4b11265b24\": container with ID starting with 851f26fc8941c52c271b73e9af4c2c5e230a58cfeebf57e892462e4b11265b24 not found: ID does not exist" containerID="851f26fc8941c52c271b73e9af4c2c5e230a58cfeebf57e892462e4b11265b24" Sep 10 11:23:28.896574 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:23:28.896540 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"851f26fc8941c52c271b73e9af4c2c5e230a58cfeebf57e892462e4b11265b24"} err="failed to get container status \"851f26fc8941c52c271b73e9af4c2c5e230a58cfeebf57e892462e4b11265b24\": rpc error: code = NotFound desc = could not find container \"851f26fc8941c52c271b73e9af4c2c5e230a58cfeebf57e892462e4b11265b24\": container with ID starting with 851f26fc8941c52c271b73e9af4c2c5e230a58cfeebf57e892462e4b11265b24 not found: ID does not exist" Sep 10 11:23:28.896574 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:23:28.896553 2564 scope.go:117] "RemoveContainer" containerID="eb8616806f40b6b530d5d71791c7894b7dd9c7ae6873e1e2c2d6707b526ef2b1" Sep 10 11:23:28.896758 ip-10-0-134-73 kubenswrapper[2564]: E0910 11:23:28.896745 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"eb8616806f40b6b530d5d71791c7894b7dd9c7ae6873e1e2c2d6707b526ef2b1\": container with ID starting with eb8616806f40b6b530d5d71791c7894b7dd9c7ae6873e1e2c2d6707b526ef2b1 not found: ID does not exist" containerID="eb8616806f40b6b530d5d71791c7894b7dd9c7ae6873e1e2c2d6707b526ef2b1" Sep 10 11:23:28.896797 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:23:28.896760 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eb8616806f40b6b530d5d71791c7894b7dd9c7ae6873e1e2c2d6707b526ef2b1"} err="failed to get container status \"eb8616806f40b6b530d5d71791c7894b7dd9c7ae6873e1e2c2d6707b526ef2b1\": rpc error: code = NotFound desc = could not find container \"eb8616806f40b6b530d5d71791c7894b7dd9c7ae6873e1e2c2d6707b526ef2b1\": container with ID starting with eb8616806f40b6b530d5d71791c7894b7dd9c7ae6873e1e2c2d6707b526ef2b1 not found: ID does not exist" Sep 10 11:23:28.896797 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:23:28.896773 2564 scope.go:117] "RemoveContainer" containerID="ba08bf7c6df2195f585618ba01783b85cb411d85ca842ad9a945fae906f55c1a" Sep 10 11:23:28.896992 ip-10-0-134-73 kubenswrapper[2564]: E0910 11:23:28.896976 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ba08bf7c6df2195f585618ba01783b85cb411d85ca842ad9a945fae906f55c1a\": container with ID starting with ba08bf7c6df2195f585618ba01783b85cb411d85ca842ad9a945fae906f55c1a not found: ID does not exist" containerID="ba08bf7c6df2195f585618ba01783b85cb411d85ca842ad9a945fae906f55c1a" Sep 10 11:23:28.897038 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:23:28.896996 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ba08bf7c6df2195f585618ba01783b85cb411d85ca842ad9a945fae906f55c1a"} err="failed to get container status \"ba08bf7c6df2195f585618ba01783b85cb411d85ca842ad9a945fae906f55c1a\": rpc error: code = NotFound desc = could not find container \"ba08bf7c6df2195f585618ba01783b85cb411d85ca842ad9a945fae906f55c1a\": container with ID starting with ba08bf7c6df2195f585618ba01783b85cb411d85ca842ad9a945fae906f55c1a not found: ID does not exist" Sep 10 11:23:28.897038 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:23:28.897008 2564 scope.go:117] "RemoveContainer" containerID="b99aff48e64484f6ebedef71814e93af80075f3a3af11bb4087b674d2651875f" Sep 10 11:23:28.897197 ip-10-0-134-73 kubenswrapper[2564]: E0910 11:23:28.897183 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b99aff48e64484f6ebedef71814e93af80075f3a3af11bb4087b674d2651875f\": container with ID starting with b99aff48e64484f6ebedef71814e93af80075f3a3af11bb4087b674d2651875f not found: ID does not exist" containerID="b99aff48e64484f6ebedef71814e93af80075f3a3af11bb4087b674d2651875f" Sep 10 11:23:28.897232 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:23:28.897200 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b99aff48e64484f6ebedef71814e93af80075f3a3af11bb4087b674d2651875f"} err="failed to get container status \"b99aff48e64484f6ebedef71814e93af80075f3a3af11bb4087b674d2651875f\": rpc error: code = NotFound desc = could not find container \"b99aff48e64484f6ebedef71814e93af80075f3a3af11bb4087b674d2651875f\": container with ID starting with b99aff48e64484f6ebedef71814e93af80075f3a3af11bb4087b674d2651875f not found: ID does not exist" Sep 10 11:23:28.916230 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:23:28.916211 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="93233a4e-718c-4a87-b09b-403263acf1fe" path="/var/lib/kubelet/pods/93233a4e-718c-4a87-b09b-403263acf1fe/volumes" Sep 10 11:23:28.916735 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:23:28.916722 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f56467c8-d70a-42ad-b579-3be2e73a95bb" path="/var/lib/kubelet/pods/f56467c8-d70a-42ad-b579-3be2e73a95bb/volumes" Sep 10 11:23:41.037634 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:23:41.037602 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast/postgres-864846d4f5-rrfq8"] Sep 10 11:23:41.037998 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:23:41.037898 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f56467c8-d70a-42ad-b579-3be2e73a95bb" containerName="feast-init" Sep 10 11:23:41.037998 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:23:41.037911 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="f56467c8-d70a-42ad-b579-3be2e73a95bb" containerName="feast-init" Sep 10 11:23:41.037998 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:23:41.037922 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="93233a4e-718c-4a87-b09b-403263acf1fe" containerName="feast-init" Sep 10 11:23:41.037998 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:23:41.037927 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="93233a4e-718c-4a87-b09b-403263acf1fe" containerName="feast-init" Sep 10 11:23:41.037998 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:23:41.037935 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="93233a4e-718c-4a87-b09b-403263acf1fe" containerName="feast-apply" Sep 10 11:23:41.037998 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:23:41.037942 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="93233a4e-718c-4a87-b09b-403263acf1fe" containerName="feast-apply" Sep 10 11:23:41.037998 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:23:41.037950 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f56467c8-d70a-42ad-b579-3be2e73a95bb" containerName="feast-apply" Sep 10 11:23:41.037998 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:23:41.037955 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="f56467c8-d70a-42ad-b579-3be2e73a95bb" containerName="feast-apply" Sep 10 11:23:41.037998 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:23:41.037962 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f56467c8-d70a-42ad-b579-3be2e73a95bb" containerName="registry" Sep 10 11:23:41.037998 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:23:41.037968 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="f56467c8-d70a-42ad-b579-3be2e73a95bb" containerName="registry" Sep 10 11:23:41.037998 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:23:41.037975 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f56467c8-d70a-42ad-b579-3be2e73a95bb" containerName="offline" Sep 10 11:23:41.037998 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:23:41.037980 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="f56467c8-d70a-42ad-b579-3be2e73a95bb" containerName="offline" Sep 10 11:23:41.037998 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:23:41.037986 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="93233a4e-718c-4a87-b09b-403263acf1fe" containerName="ui" Sep 10 11:23:41.037998 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:23:41.037990 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="93233a4e-718c-4a87-b09b-403263acf1fe" containerName="ui" Sep 10 11:23:41.037998 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:23:41.038000 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f56467c8-d70a-42ad-b579-3be2e73a95bb" containerName="online" Sep 10 11:23:41.037998 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:23:41.038005 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="f56467c8-d70a-42ad-b579-3be2e73a95bb" containerName="online" Sep 10 11:23:41.038446 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:23:41.038012 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="93233a4e-718c-4a87-b09b-403263acf1fe" containerName="offline" Sep 10 11:23:41.038446 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:23:41.038017 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="93233a4e-718c-4a87-b09b-403263acf1fe" containerName="offline" Sep 10 11:23:41.038446 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:23:41.038026 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f56467c8-d70a-42ad-b579-3be2e73a95bb" containerName="ui" Sep 10 11:23:41.038446 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:23:41.038031 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="f56467c8-d70a-42ad-b579-3be2e73a95bb" containerName="ui" Sep 10 11:23:41.038446 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:23:41.038036 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="93233a4e-718c-4a87-b09b-403263acf1fe" containerName="online" Sep 10 11:23:41.038446 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:23:41.038040 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="93233a4e-718c-4a87-b09b-403263acf1fe" containerName="online" Sep 10 11:23:41.038446 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:23:41.038085 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="f56467c8-d70a-42ad-b579-3be2e73a95bb" containerName="registry" Sep 10 11:23:41.038446 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:23:41.038092 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="f56467c8-d70a-42ad-b579-3be2e73a95bb" containerName="online" Sep 10 11:23:41.038446 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:23:41.038096 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="93233a4e-718c-4a87-b09b-403263acf1fe" containerName="ui" Sep 10 11:23:41.038446 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:23:41.038104 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="93233a4e-718c-4a87-b09b-403263acf1fe" containerName="online" Sep 10 11:23:41.038446 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:23:41.038110 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="f56467c8-d70a-42ad-b579-3be2e73a95bb" containerName="ui" Sep 10 11:23:41.038446 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:23:41.038118 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="f56467c8-d70a-42ad-b579-3be2e73a95bb" containerName="offline" Sep 10 11:23:41.038446 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:23:41.038123 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="93233a4e-718c-4a87-b09b-403263acf1fe" containerName="offline" Sep 10 11:23:41.040866 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:23:41.040835 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/postgres-864846d4f5-rrfq8" Sep 10 11:23:41.045075 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:23:41.045051 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"kube-root-ca.crt\"" Sep 10 11:23:41.045222 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:23:41.045134 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"postgres-secret\"" Sep 10 11:23:41.045792 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:23:41.045775 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"default-dockercfg-xfghn\"" Sep 10 11:23:41.045891 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:23:41.045799 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"openshift-service-ca.crt\"" Sep 10 11:23:41.051753 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:23:41.051733 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/postgres-864846d4f5-rrfq8"] Sep 10 11:23:41.069120 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:23:41.069093 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/1e05384c-870e-4482-9e52-f7edb32885b0-postgresdata\") pod \"postgres-864846d4f5-rrfq8\" (UID: \"1e05384c-870e-4482-9e52-f7edb32885b0\") " pod="test-ns-feast/postgres-864846d4f5-rrfq8" Sep 10 11:23:41.069225 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:23:41.069172 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h8mkq\" (UniqueName: \"kubernetes.io/projected/1e05384c-870e-4482-9e52-f7edb32885b0-kube-api-access-h8mkq\") pod \"postgres-864846d4f5-rrfq8\" (UID: \"1e05384c-870e-4482-9e52-f7edb32885b0\") " pod="test-ns-feast/postgres-864846d4f5-rrfq8" Sep 10 11:23:41.169944 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:23:41.169917 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/1e05384c-870e-4482-9e52-f7edb32885b0-postgresdata\") pod \"postgres-864846d4f5-rrfq8\" (UID: \"1e05384c-870e-4482-9e52-f7edb32885b0\") " pod="test-ns-feast/postgres-864846d4f5-rrfq8" Sep 10 11:23:41.170060 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:23:41.169959 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h8mkq\" (UniqueName: \"kubernetes.io/projected/1e05384c-870e-4482-9e52-f7edb32885b0-kube-api-access-h8mkq\") pod \"postgres-864846d4f5-rrfq8\" (UID: \"1e05384c-870e-4482-9e52-f7edb32885b0\") " pod="test-ns-feast/postgres-864846d4f5-rrfq8" Sep 10 11:23:41.170276 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:23:41.170256 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/1e05384c-870e-4482-9e52-f7edb32885b0-postgresdata\") pod \"postgres-864846d4f5-rrfq8\" (UID: \"1e05384c-870e-4482-9e52-f7edb32885b0\") " pod="test-ns-feast/postgres-864846d4f5-rrfq8" Sep 10 11:23:41.178458 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:23:41.178433 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h8mkq\" (UniqueName: \"kubernetes.io/projected/1e05384c-870e-4482-9e52-f7edb32885b0-kube-api-access-h8mkq\") pod \"postgres-864846d4f5-rrfq8\" (UID: \"1e05384c-870e-4482-9e52-f7edb32885b0\") " pod="test-ns-feast/postgres-864846d4f5-rrfq8" Sep 10 11:23:41.358636 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:23:41.358603 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/postgres-864846d4f5-rrfq8" Sep 10 11:23:41.623447 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:23:41.623373 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/postgres-864846d4f5-rrfq8"] Sep 10 11:23:41.626526 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:23:41.626494 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1e05384c_870e_4482_9e52_f7edb32885b0.slice/crio-d9d5761349fa7714b76923457c4a714d3ba6ad6078a06c99c3cf8e30cffad76a WatchSource:0}: Error finding container d9d5761349fa7714b76923457c4a714d3ba6ad6078a06c99c3cf8e30cffad76a: Status 404 returned error can't find the container with id d9d5761349fa7714b76923457c4a714d3ba6ad6078a06c99c3cf8e30cffad76a Sep 10 11:23:41.628281 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:23:41.628266 2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 10 11:23:41.862497 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:23:41.862468 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/postgres-864846d4f5-rrfq8" event={"ID":"1e05384c-870e-4482-9e52-f7edb32885b0","Type":"ContainerStarted","Data":"d9d5761349fa7714b76923457c4a714d3ba6ad6078a06c99c3cf8e30cffad76a"} Sep 10 11:23:46.886355 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:23:46.886320 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/postgres-864846d4f5-rrfq8" event={"ID":"1e05384c-870e-4482-9e52-f7edb32885b0","Type":"ContainerStarted","Data":"fe915aa2a91e06079d9e709dbd9497e88204396e596589450cd2f63b76d952d9"} Sep 10 11:23:46.902375 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:23:46.902332 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast/postgres-864846d4f5-rrfq8" podStartSLOduration=1.0049538 podStartE2EDuration="5.902318404s" totalImagesPullingTime="4.897364604s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 11:23:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 11:23:46.901367708 +0000 UTC m=+692.497928922" watchObservedRunningTime="2026-09-10 11:23:46.902318404 +0000 UTC m=+692.498879618" Sep 10 11:23:49.882112 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:23:49.882072 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast/feast-credit-scoring-5fd7d5db65-thrv2"] Sep 10 11:23:49.889795 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:23:49.889766 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-credit-scoring-5fd7d5db65-thrv2" Sep 10 11:23:49.892472 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:23:49.892440 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-credit-scoring-offline-tls\"" Sep 10 11:23:49.892599 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:23:49.892477 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"feast-credit-scoring-intra-comm\"" Sep 10 11:23:49.892699 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:23:49.892683 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-credit-scoring-online-tls\"" Sep 10 11:23:49.892800 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:23:49.892781 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-credit-scoring-registry-tls\"" Sep 10 11:23:49.893176 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:23:49.893144 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-credit-scoring-dockercfg-b6m6h\"" Sep 10 11:23:49.901416 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:23:49.901397 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-credit-scoring-5fd7d5db65-thrv2"] Sep 10 11:23:49.930839 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:23:49.930815 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/bc4d3114-1390-4071-b44f-4ce8532a797b-feast-data\") pod \"feast-credit-scoring-5fd7d5db65-thrv2\" (UID: \"bc4d3114-1390-4071-b44f-4ce8532a797b\") " pod="test-ns-feast/feast-credit-scoring-5fd7d5db65-thrv2" Sep 10 11:23:49.930930 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:23:49.930876 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/bc4d3114-1390-4071-b44f-4ce8532a797b-offline-tls\") pod \"feast-credit-scoring-5fd7d5db65-thrv2\" (UID: \"bc4d3114-1390-4071-b44f-4ce8532a797b\") " pod="test-ns-feast/feast-credit-scoring-5fd7d5db65-thrv2" Sep 10 11:23:49.930979 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:23:49.930951 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v9tww\" (UniqueName: \"kubernetes.io/projected/bc4d3114-1390-4071-b44f-4ce8532a797b-kube-api-access-v9tww\") pod \"feast-credit-scoring-5fd7d5db65-thrv2\" (UID: \"bc4d3114-1390-4071-b44f-4ce8532a797b\") " pod="test-ns-feast/feast-credit-scoring-5fd7d5db65-thrv2" Sep 10 11:23:49.931014 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:23:49.930984 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/bc4d3114-1390-4071-b44f-4ce8532a797b-online-tls\") pod \"feast-credit-scoring-5fd7d5db65-thrv2\" (UID: \"bc4d3114-1390-4071-b44f-4ce8532a797b\") " pod="test-ns-feast/feast-credit-scoring-5fd7d5db65-thrv2" Sep 10 11:23:49.931045 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:23:49.931019 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/bc4d3114-1390-4071-b44f-4ce8532a797b-registry-tls\") pod \"feast-credit-scoring-5fd7d5db65-thrv2\" (UID: \"bc4d3114-1390-4071-b44f-4ce8532a797b\") " pod="test-ns-feast/feast-credit-scoring-5fd7d5db65-thrv2" Sep 10 11:23:50.031683 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:23:50.031657 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/bc4d3114-1390-4071-b44f-4ce8532a797b-feast-data\") pod \"feast-credit-scoring-5fd7d5db65-thrv2\" (UID: \"bc4d3114-1390-4071-b44f-4ce8532a797b\") " pod="test-ns-feast/feast-credit-scoring-5fd7d5db65-thrv2" Sep 10 11:23:50.031763 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:23:50.031701 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/bc4d3114-1390-4071-b44f-4ce8532a797b-offline-tls\") pod \"feast-credit-scoring-5fd7d5db65-thrv2\" (UID: \"bc4d3114-1390-4071-b44f-4ce8532a797b\") " pod="test-ns-feast/feast-credit-scoring-5fd7d5db65-thrv2" Sep 10 11:23:50.031763 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:23:50.031743 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v9tww\" (UniqueName: \"kubernetes.io/projected/bc4d3114-1390-4071-b44f-4ce8532a797b-kube-api-access-v9tww\") pod \"feast-credit-scoring-5fd7d5db65-thrv2\" (UID: \"bc4d3114-1390-4071-b44f-4ce8532a797b\") " pod="test-ns-feast/feast-credit-scoring-5fd7d5db65-thrv2" Sep 10 11:23:50.031840 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:23:50.031775 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/bc4d3114-1390-4071-b44f-4ce8532a797b-online-tls\") pod \"feast-credit-scoring-5fd7d5db65-thrv2\" (UID: \"bc4d3114-1390-4071-b44f-4ce8532a797b\") " pod="test-ns-feast/feast-credit-scoring-5fd7d5db65-thrv2" Sep 10 11:23:50.031840 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:23:50.031829 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/bc4d3114-1390-4071-b44f-4ce8532a797b-registry-tls\") pod \"feast-credit-scoring-5fd7d5db65-thrv2\" (UID: \"bc4d3114-1390-4071-b44f-4ce8532a797b\") " pod="test-ns-feast/feast-credit-scoring-5fd7d5db65-thrv2" Sep 10 11:23:50.031977 ip-10-0-134-73 kubenswrapper[2564]: E0910 11:23:50.031960 2564 secret.go:189] Couldn't get secret test-ns-feast/feast-credit-scoring-registry-tls: secret "feast-credit-scoring-registry-tls" not found Sep 10 11:23:50.032052 ip-10-0-134-73 kubenswrapper[2564]: E0910 11:23:50.032033 2564 secret.go:189] Couldn't get secret test-ns-feast/feast-credit-scoring-online-tls: secret "feast-credit-scoring-online-tls" not found Sep 10 11:23:50.032110 ip-10-0-134-73 kubenswrapper[2564]: E0910 11:23:50.032037 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bc4d3114-1390-4071-b44f-4ce8532a797b-registry-tls podName:bc4d3114-1390-4071-b44f-4ce8532a797b nodeName:}" failed. No retries permitted until 2026-09-10 11:23:50.53201629 +0000 UTC m=+696.128577485 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/secret/bc4d3114-1390-4071-b44f-4ce8532a797b-registry-tls") pod "feast-credit-scoring-5fd7d5db65-thrv2" (UID: "bc4d3114-1390-4071-b44f-4ce8532a797b") : secret "feast-credit-scoring-registry-tls" not found Sep 10 11:23:50.032166 ip-10-0-134-73 kubenswrapper[2564]: E0910 11:23:50.032110 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bc4d3114-1390-4071-b44f-4ce8532a797b-online-tls podName:bc4d3114-1390-4071-b44f-4ce8532a797b nodeName:}" failed. No retries permitted until 2026-09-10 11:23:50.532096407 +0000 UTC m=+696.128657600 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "online-tls" (UniqueName: "kubernetes.io/secret/bc4d3114-1390-4071-b44f-4ce8532a797b-online-tls") pod "feast-credit-scoring-5fd7d5db65-thrv2" (UID: "bc4d3114-1390-4071-b44f-4ce8532a797b") : secret "feast-credit-scoring-online-tls" not found Sep 10 11:23:50.032166 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:23:50.032116 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/bc4d3114-1390-4071-b44f-4ce8532a797b-feast-data\") pod \"feast-credit-scoring-5fd7d5db65-thrv2\" (UID: \"bc4d3114-1390-4071-b44f-4ce8532a797b\") " pod="test-ns-feast/feast-credit-scoring-5fd7d5db65-thrv2" Sep 10 11:23:50.034163 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:23:50.034143 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/bc4d3114-1390-4071-b44f-4ce8532a797b-offline-tls\") pod \"feast-credit-scoring-5fd7d5db65-thrv2\" (UID: \"bc4d3114-1390-4071-b44f-4ce8532a797b\") " pod="test-ns-feast/feast-credit-scoring-5fd7d5db65-thrv2" Sep 10 11:23:50.040141 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:23:50.040122 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v9tww\" (UniqueName: \"kubernetes.io/projected/bc4d3114-1390-4071-b44f-4ce8532a797b-kube-api-access-v9tww\") pod \"feast-credit-scoring-5fd7d5db65-thrv2\" (UID: \"bc4d3114-1390-4071-b44f-4ce8532a797b\") " pod="test-ns-feast/feast-credit-scoring-5fd7d5db65-thrv2" Sep 10 11:23:50.536408 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:23:50.536375 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/bc4d3114-1390-4071-b44f-4ce8532a797b-online-tls\") pod \"feast-credit-scoring-5fd7d5db65-thrv2\" (UID: \"bc4d3114-1390-4071-b44f-4ce8532a797b\") " pod="test-ns-feast/feast-credit-scoring-5fd7d5db65-thrv2" Sep 10 11:23:50.536557 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:23:50.536417 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/bc4d3114-1390-4071-b44f-4ce8532a797b-registry-tls\") pod \"feast-credit-scoring-5fd7d5db65-thrv2\" (UID: \"bc4d3114-1390-4071-b44f-4ce8532a797b\") " pod="test-ns-feast/feast-credit-scoring-5fd7d5db65-thrv2" Sep 10 11:23:50.538837 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:23:50.538808 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/bc4d3114-1390-4071-b44f-4ce8532a797b-registry-tls\") pod \"feast-credit-scoring-5fd7d5db65-thrv2\" (UID: \"bc4d3114-1390-4071-b44f-4ce8532a797b\") " pod="test-ns-feast/feast-credit-scoring-5fd7d5db65-thrv2" Sep 10 11:23:50.538972 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:23:50.538897 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/bc4d3114-1390-4071-b44f-4ce8532a797b-online-tls\") pod \"feast-credit-scoring-5fd7d5db65-thrv2\" (UID: \"bc4d3114-1390-4071-b44f-4ce8532a797b\") " pod="test-ns-feast/feast-credit-scoring-5fd7d5db65-thrv2" Sep 10 11:23:50.799453 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:23:50.799369 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-credit-scoring-5fd7d5db65-thrv2" Sep 10 11:23:51.077099 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:23:51.077031 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-credit-scoring-5fd7d5db65-thrv2"] Sep 10 11:23:51.079793 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:23:51.079761 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbc4d3114_1390_4071_b44f_4ce8532a797b.slice/crio-4996af39112b1bf7bbd71c9e1efd8403b94bc4dfd802cb331ce0b9de5c3ea101 WatchSource:0}: Error finding container 4996af39112b1bf7bbd71c9e1efd8403b94bc4dfd802cb331ce0b9de5c3ea101: Status 404 returned error can't find the container with id 4996af39112b1bf7bbd71c9e1efd8403b94bc4dfd802cb331ce0b9de5c3ea101 Sep 10 11:23:51.907324 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:23:51.907287 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-5fd7d5db65-thrv2" event={"ID":"bc4d3114-1390-4071-b44f-4ce8532a797b","Type":"ContainerStarted","Data":"51ce5b5edb347425f29267dd41ae222ca351057f1e3158fdbfb064f0c957d1bf"} Sep 10 11:23:51.907512 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:23:51.907344 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-5fd7d5db65-thrv2" event={"ID":"bc4d3114-1390-4071-b44f-4ce8532a797b","Type":"ContainerStarted","Data":"4996af39112b1bf7bbd71c9e1efd8403b94bc4dfd802cb331ce0b9de5c3ea101"} Sep 10 11:23:52.913209 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:23:52.913173 2564 generic.go:356] "Generic (PLEG): container finished" podID="bc4d3114-1390-4071-b44f-4ce8532a797b" containerID="51ce5b5edb347425f29267dd41ae222ca351057f1e3158fdbfb064f0c957d1bf" exitCode=0 Sep 10 11:23:52.916443 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:23:52.916414 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-5fd7d5db65-thrv2" event={"ID":"bc4d3114-1390-4071-b44f-4ce8532a797b","Type":"ContainerDied","Data":"51ce5b5edb347425f29267dd41ae222ca351057f1e3158fdbfb064f0c957d1bf"} Sep 10 11:23:53.918809 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:23:53.918774 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-5fd7d5db65-thrv2" event={"ID":"bc4d3114-1390-4071-b44f-4ce8532a797b","Type":"ContainerStarted","Data":"634cff10dd3a7da4a29fcc1cb13d2f4e962c35cf6e359d20db2bb552c9d91a5d"} Sep 10 11:23:59.944210 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:23:59.944177 2564 generic.go:356] "Generic (PLEG): container finished" podID="bc4d3114-1390-4071-b44f-4ce8532a797b" containerID="634cff10dd3a7da4a29fcc1cb13d2f4e962c35cf6e359d20db2bb552c9d91a5d" exitCode=0 Sep 10 11:23:59.944584 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:23:59.944260 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-5fd7d5db65-thrv2" event={"ID":"bc4d3114-1390-4071-b44f-4ce8532a797b","Type":"ContainerDied","Data":"634cff10dd3a7da4a29fcc1cb13d2f4e962c35cf6e359d20db2bb552c9d91a5d"} Sep 10 11:24:00.953234 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:24:00.953199 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-5fd7d5db65-thrv2" event={"ID":"bc4d3114-1390-4071-b44f-4ce8532a797b","Type":"ContainerStarted","Data":"62bd7d22febb68d2c18cdf53d7c3299777dccb19826efb9333857e4bd8ae906e"} Sep 10 11:24:00.953691 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:24:00.953263 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-5fd7d5db65-thrv2" event={"ID":"bc4d3114-1390-4071-b44f-4ce8532a797b","Type":"ContainerStarted","Data":"0fe09aac73cffc47b972e2a4b5cef50ccd210a0772f2def1688d269ef0089905"} Sep 10 11:24:00.953691 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:24:00.953287 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-5fd7d5db65-thrv2" event={"ID":"bc4d3114-1390-4071-b44f-4ce8532a797b","Type":"ContainerStarted","Data":"b698efee5f95f7a368dbbef8a9ab18407b059dbc031baf5508ad74e92f30e385"} Sep 10 11:24:02.799740 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:24:02.799698 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-credit-scoring-5fd7d5db65-thrv2" Sep 10 11:24:02.800383 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:24:02.800357 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-credit-scoring-5fd7d5db65-thrv2" Sep 10 11:24:02.800522 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:24:02.800400 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-credit-scoring-5fd7d5db65-thrv2" Sep 10 11:24:02.801613 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:24:02.801578 2564 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-credit-scoring-5fd7d5db65-thrv2" podUID="bc4d3114-1390-4071-b44f-4ce8532a797b" containerName="offline" probeResult="failure" output="dial tcp 10.132.0.28:8816: connect: connection refused" Sep 10 11:24:02.801727 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:24:02.801603 2564 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-credit-scoring-5fd7d5db65-thrv2" podUID="bc4d3114-1390-4071-b44f-4ce8532a797b" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.28:6571: connect: connection refused" Sep 10 11:24:02.801727 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:24:02.801630 2564 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-credit-scoring-5fd7d5db65-thrv2" podUID="bc4d3114-1390-4071-b44f-4ce8532a797b" containerName="online" probeResult="failure" output="Get \"https://10.132.0.28:6567/health\": dial tcp 10.132.0.28:6567: connect: connection refused" Sep 10 11:24:05.800386 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:24:05.800328 2564 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-credit-scoring-5fd7d5db65-thrv2" podUID="bc4d3114-1390-4071-b44f-4ce8532a797b" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.28:6571: connect: connection refused" Sep 10 11:24:05.800386 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:24:05.800354 2564 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-credit-scoring-5fd7d5db65-thrv2" podUID="bc4d3114-1390-4071-b44f-4ce8532a797b" containerName="offline" probeResult="failure" output="dial tcp 10.132.0.28:8816: connect: connection refused" Sep 10 11:24:05.801006 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:24:05.800418 2564 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-credit-scoring-5fd7d5db65-thrv2" podUID="bc4d3114-1390-4071-b44f-4ce8532a797b" containerName="online" probeResult="failure" output="Get \"https://10.132.0.28:6567/health\": dial tcp 10.132.0.28:6567: connect: connection refused" Sep 10 11:24:08.800287 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:24:08.800181 2564 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-credit-scoring-5fd7d5db65-thrv2" podUID="bc4d3114-1390-4071-b44f-4ce8532a797b" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.28:6571: connect: connection refused" Sep 10 11:24:08.801091 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:24:08.801067 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-credit-scoring-5fd7d5db65-thrv2" Sep 10 11:24:08.801549 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:24:08.801524 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-credit-scoring-5fd7d5db65-thrv2" Sep 10 11:24:08.801927 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:24:08.801908 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-credit-scoring-5fd7d5db65-thrv2" Sep 10 11:24:08.808493 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:24:08.808475 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-credit-scoring-5fd7d5db65-thrv2" Sep 10 11:24:08.824325 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:24:08.824286 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast/feast-credit-scoring-5fd7d5db65-thrv2" podStartSLOduration=19.82427406 podStartE2EDuration="19.82427406s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 11:23:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 11:24:00.985564579 +0000 UTC m=+706.582125795" watchObservedRunningTime="2026-09-10 11:24:08.82427406 +0000 UTC m=+714.420835274" Sep 10 11:24:08.997467 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:24:08.997438 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-credit-scoring-5fd7d5db65-thrv2" Sep 10 11:24:09.001776 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:24:09.001754 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-credit-scoring-5fd7d5db65-thrv2" Sep 10 11:24:10.800038 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:24:10.800002 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-credit-scoring-5fd7d5db65-thrv2" Sep 10 11:24:11.799833 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:24:11.799786 2564 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-credit-scoring-5fd7d5db65-thrv2" podUID="bc4d3114-1390-4071-b44f-4ce8532a797b" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.28:6571: connect: connection refused" Sep 10 11:24:14.800708 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:24:14.800676 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-credit-scoring-5fd7d5db65-thrv2" Sep 10 11:24:14.801468 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:24:14.801450 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-credit-scoring-5fd7d5db65-thrv2" Sep 10 11:25:18.836326 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:25:18.836290 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-credit-scoring-5fd7d5db65-thrv2"] Sep 10 11:25:18.836801 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:25:18.836516 2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-credit-scoring-5fd7d5db65-thrv2" podUID="bc4d3114-1390-4071-b44f-4ce8532a797b" containerName="registry" containerID="cri-o://b698efee5f95f7a368dbbef8a9ab18407b059dbc031baf5508ad74e92f30e385" gracePeriod=30 Sep 10 11:25:18.836801 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:25:18.836547 2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-credit-scoring-5fd7d5db65-thrv2" podUID="bc4d3114-1390-4071-b44f-4ce8532a797b" containerName="online" containerID="cri-o://0fe09aac73cffc47b972e2a4b5cef50ccd210a0772f2def1688d269ef0089905" gracePeriod=30 Sep 10 11:25:18.836801 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:25:18.836547 2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-credit-scoring-5fd7d5db65-thrv2" podUID="bc4d3114-1390-4071-b44f-4ce8532a797b" containerName="offline" containerID="cri-o://62bd7d22febb68d2c18cdf53d7c3299777dccb19826efb9333857e4bd8ae906e" gracePeriod=30 Sep 10 11:25:18.853223 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:25:18.853195 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/postgres-864846d4f5-rrfq8"] Sep 10 11:25:18.853371 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:25:18.853353 2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/postgres-864846d4f5-rrfq8" podUID="1e05384c-870e-4482-9e52-f7edb32885b0" containerName="postgres" containerID="cri-o://fe915aa2a91e06079d9e709dbd9497e88204396e596589450cd2f63b76d952d9" gracePeriod=30 Sep 10 11:25:18.997924 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:25:18.997885 2564 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-credit-scoring-5fd7d5db65-thrv2" podUID="bc4d3114-1390-4071-b44f-4ce8532a797b" containerName="online" probeResult="failure" output="Get \"https://10.132.0.28:6567/health\": dial tcp 10.132.0.28:6567: connect: connection refused" Sep 10 11:25:19.095580 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:25:19.095528 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/postgres-864846d4f5-rrfq8" Sep 10 11:25:19.228922 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:25:19.228885 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h8mkq\" (UniqueName: \"kubernetes.io/projected/1e05384c-870e-4482-9e52-f7edb32885b0-kube-api-access-h8mkq\") pod \"1e05384c-870e-4482-9e52-f7edb32885b0\" (UID: \"1e05384c-870e-4482-9e52-f7edb32885b0\") " Sep 10 11:25:19.229081 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:25:19.228984 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/1e05384c-870e-4482-9e52-f7edb32885b0-postgresdata\") pod \"1e05384c-870e-4482-9e52-f7edb32885b0\" (UID: \"1e05384c-870e-4482-9e52-f7edb32885b0\") " Sep 10 11:25:19.231053 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:25:19.231017 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1e05384c-870e-4482-9e52-f7edb32885b0-kube-api-access-h8mkq" (OuterVolumeSpecName: "kube-api-access-h8mkq") pod "1e05384c-870e-4482-9e52-f7edb32885b0" (UID: "1e05384c-870e-4482-9e52-f7edb32885b0"). InnerVolumeSpecName "kube-api-access-h8mkq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 11:25:19.258498 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:25:19.258467 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1e05384c-870e-4482-9e52-f7edb32885b0-postgresdata" (OuterVolumeSpecName: "postgresdata") pod "1e05384c-870e-4482-9e52-f7edb32885b0" (UID: "1e05384c-870e-4482-9e52-f7edb32885b0"). InnerVolumeSpecName "postgresdata". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 10 11:25:19.285300 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:25:19.285260 2564 generic.go:356] "Generic (PLEG): container finished" podID="1e05384c-870e-4482-9e52-f7edb32885b0" containerID="fe915aa2a91e06079d9e709dbd9497e88204396e596589450cd2f63b76d952d9" exitCode=0 Sep 10 11:25:19.285442 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:25:19.285321 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/postgres-864846d4f5-rrfq8" Sep 10 11:25:19.285442 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:25:19.285342 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/postgres-864846d4f5-rrfq8" event={"ID":"1e05384c-870e-4482-9e52-f7edb32885b0","Type":"ContainerDied","Data":"fe915aa2a91e06079d9e709dbd9497e88204396e596589450cd2f63b76d952d9"} Sep 10 11:25:19.285442 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:25:19.285403 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/postgres-864846d4f5-rrfq8" event={"ID":"1e05384c-870e-4482-9e52-f7edb32885b0","Type":"ContainerDied","Data":"d9d5761349fa7714b76923457c4a714d3ba6ad6078a06c99c3cf8e30cffad76a"} Sep 10 11:25:19.285442 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:25:19.285426 2564 scope.go:117] "RemoveContainer" containerID="fe915aa2a91e06079d9e709dbd9497e88204396e596589450cd2f63b76d952d9" Sep 10 11:25:19.294695 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:25:19.294675 2564 scope.go:117] "RemoveContainer" containerID="fe915aa2a91e06079d9e709dbd9497e88204396e596589450cd2f63b76d952d9" Sep 10 11:25:19.295045 ip-10-0-134-73 kubenswrapper[2564]: E0910 11:25:19.295021 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fe915aa2a91e06079d9e709dbd9497e88204396e596589450cd2f63b76d952d9\": container with ID starting with fe915aa2a91e06079d9e709dbd9497e88204396e596589450cd2f63b76d952d9 not found: ID does not exist" containerID="fe915aa2a91e06079d9e709dbd9497e88204396e596589450cd2f63b76d952d9" Sep 10 11:25:19.295132 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:25:19.295053 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fe915aa2a91e06079d9e709dbd9497e88204396e596589450cd2f63b76d952d9"} err="failed to get container status \"fe915aa2a91e06079d9e709dbd9497e88204396e596589450cd2f63b76d952d9\": rpc error: code = NotFound desc = could not find container \"fe915aa2a91e06079d9e709dbd9497e88204396e596589450cd2f63b76d952d9\": container with ID starting with fe915aa2a91e06079d9e709dbd9497e88204396e596589450cd2f63b76d952d9 not found: ID does not exist" Sep 10 11:25:19.306941 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:25:19.306915 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/postgres-864846d4f5-rrfq8"] Sep 10 11:25:19.310438 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:25:19.310415 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/postgres-864846d4f5-rrfq8"] Sep 10 11:25:19.330480 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:25:19.330452 2564 reconciler_common.go:299] "Volume detached for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/1e05384c-870e-4482-9e52-f7edb32885b0-postgresdata\") on node \"ip-10-0-134-73.ec2.internal\" DevicePath \"\"" Sep 10 11:25:19.330480 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:25:19.330477 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h8mkq\" (UniqueName: \"kubernetes.io/projected/1e05384c-870e-4482-9e52-f7edb32885b0-kube-api-access-h8mkq\") on node \"ip-10-0-134-73.ec2.internal\" DevicePath \"\"" Sep 10 11:25:20.292531 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:25:20.292487 2564 generic.go:356] "Generic (PLEG): container finished" podID="bc4d3114-1390-4071-b44f-4ce8532a797b" containerID="0fe09aac73cffc47b972e2a4b5cef50ccd210a0772f2def1688d269ef0089905" exitCode=0 Sep 10 11:25:20.292912 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:25:20.292540 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-5fd7d5db65-thrv2" event={"ID":"bc4d3114-1390-4071-b44f-4ce8532a797b","Type":"ContainerDied","Data":"0fe09aac73cffc47b972e2a4b5cef50ccd210a0772f2def1688d269ef0089905"} Sep 10 11:25:20.916821 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:25:20.916786 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1e05384c-870e-4482-9e52-f7edb32885b0" path="/var/lib/kubelet/pods/1e05384c-870e-4482-9e52-f7edb32885b0/volumes" Sep 10 11:25:28.998150 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:25:28.998108 2564 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-credit-scoring-5fd7d5db65-thrv2" podUID="bc4d3114-1390-4071-b44f-4ce8532a797b" containerName="online" probeResult="failure" output="Get \"https://10.132.0.28:6567/health\": dial tcp 10.132.0.28:6567: connect: connection refused" Sep 10 11:25:38.998404 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:25:38.998322 2564 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-credit-scoring-5fd7d5db65-thrv2" podUID="bc4d3114-1390-4071-b44f-4ce8532a797b" containerName="online" probeResult="failure" output="Get \"https://10.132.0.28:6567/health\": dial tcp 10.132.0.28:6567: connect: connection refused" Sep 10 11:25:38.998919 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:25:38.998438 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-credit-scoring-5fd7d5db65-thrv2" Sep 10 11:25:48.997669 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:25:48.997623 2564 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-credit-scoring-5fd7d5db65-thrv2" podUID="bc4d3114-1390-4071-b44f-4ce8532a797b" containerName="online" probeResult="failure" output="Get \"https://10.132.0.28:6567/health\": dial tcp 10.132.0.28:6567: connect: connection refused" Sep 10 11:25:49.403763 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:25:49.403727 2564 generic.go:356] "Generic (PLEG): container finished" podID="bc4d3114-1390-4071-b44f-4ce8532a797b" containerID="62bd7d22febb68d2c18cdf53d7c3299777dccb19826efb9333857e4bd8ae906e" exitCode=137 Sep 10 11:25:49.403763 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:25:49.403762 2564 generic.go:356] "Generic (PLEG): container finished" podID="bc4d3114-1390-4071-b44f-4ce8532a797b" containerID="b698efee5f95f7a368dbbef8a9ab18407b059dbc031baf5508ad74e92f30e385" exitCode=137 Sep 10 11:25:49.403991 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:25:49.403810 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-5fd7d5db65-thrv2" event={"ID":"bc4d3114-1390-4071-b44f-4ce8532a797b","Type":"ContainerDied","Data":"62bd7d22febb68d2c18cdf53d7c3299777dccb19826efb9333857e4bd8ae906e"} Sep 10 11:25:49.403991 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:25:49.403896 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-5fd7d5db65-thrv2" event={"ID":"bc4d3114-1390-4071-b44f-4ce8532a797b","Type":"ContainerDied","Data":"b698efee5f95f7a368dbbef8a9ab18407b059dbc031baf5508ad74e92f30e385"} Sep 10 11:25:49.483749 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:25:49.483727 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-credit-scoring-5fd7d5db65-thrv2" Sep 10 11:25:49.650342 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:25:49.650262 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v9tww\" (UniqueName: \"kubernetes.io/projected/bc4d3114-1390-4071-b44f-4ce8532a797b-kube-api-access-v9tww\") pod \"bc4d3114-1390-4071-b44f-4ce8532a797b\" (UID: \"bc4d3114-1390-4071-b44f-4ce8532a797b\") " Sep 10 11:25:49.650342 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:25:49.650312 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/bc4d3114-1390-4071-b44f-4ce8532a797b-offline-tls\") pod \"bc4d3114-1390-4071-b44f-4ce8532a797b\" (UID: \"bc4d3114-1390-4071-b44f-4ce8532a797b\") " Sep 10 11:25:49.650551 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:25:49.650354 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/bc4d3114-1390-4071-b44f-4ce8532a797b-registry-tls\") pod \"bc4d3114-1390-4071-b44f-4ce8532a797b\" (UID: \"bc4d3114-1390-4071-b44f-4ce8532a797b\") " Sep 10 11:25:49.650551 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:25:49.650375 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/bc4d3114-1390-4071-b44f-4ce8532a797b-feast-data\") pod \"bc4d3114-1390-4071-b44f-4ce8532a797b\" (UID: \"bc4d3114-1390-4071-b44f-4ce8532a797b\") " Sep 10 11:25:49.650551 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:25:49.650399 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/bc4d3114-1390-4071-b44f-4ce8532a797b-online-tls\") pod \"bc4d3114-1390-4071-b44f-4ce8532a797b\" (UID: \"bc4d3114-1390-4071-b44f-4ce8532a797b\") " Sep 10 11:25:49.652399 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:25:49.652364 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bc4d3114-1390-4071-b44f-4ce8532a797b-kube-api-access-v9tww" (OuterVolumeSpecName: "kube-api-access-v9tww") pod "bc4d3114-1390-4071-b44f-4ce8532a797b" (UID: "bc4d3114-1390-4071-b44f-4ce8532a797b"). InnerVolumeSpecName "kube-api-access-v9tww". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 11:25:49.652503 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:25:49.652393 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bc4d3114-1390-4071-b44f-4ce8532a797b-online-tls" (OuterVolumeSpecName: "online-tls") pod "bc4d3114-1390-4071-b44f-4ce8532a797b" (UID: "bc4d3114-1390-4071-b44f-4ce8532a797b"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 10 11:25:49.652503 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:25:49.652457 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bc4d3114-1390-4071-b44f-4ce8532a797b-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "bc4d3114-1390-4071-b44f-4ce8532a797b" (UID: "bc4d3114-1390-4071-b44f-4ce8532a797b"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 10 11:25:49.652696 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:25:49.652670 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bc4d3114-1390-4071-b44f-4ce8532a797b-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "bc4d3114-1390-4071-b44f-4ce8532a797b" (UID: "bc4d3114-1390-4071-b44f-4ce8532a797b"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 10 11:25:49.659108 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:25:49.659086 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bc4d3114-1390-4071-b44f-4ce8532a797b-feast-data" (OuterVolumeSpecName: "feast-data") pod "bc4d3114-1390-4071-b44f-4ce8532a797b" (UID: "bc4d3114-1390-4071-b44f-4ce8532a797b"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 10 11:25:49.751427 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:25:49.751400 2564 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/bc4d3114-1390-4071-b44f-4ce8532a797b-registry-tls\") on node \"ip-10-0-134-73.ec2.internal\" DevicePath \"\"" Sep 10 11:25:49.751427 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:25:49.751422 2564 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/bc4d3114-1390-4071-b44f-4ce8532a797b-feast-data\") on node \"ip-10-0-134-73.ec2.internal\" DevicePath \"\"" Sep 10 11:25:49.751427 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:25:49.751431 2564 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/bc4d3114-1390-4071-b44f-4ce8532a797b-online-tls\") on node \"ip-10-0-134-73.ec2.internal\" DevicePath \"\"" Sep 10 11:25:49.751580 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:25:49.751440 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v9tww\" (UniqueName: \"kubernetes.io/projected/bc4d3114-1390-4071-b44f-4ce8532a797b-kube-api-access-v9tww\") on node \"ip-10-0-134-73.ec2.internal\" DevicePath \"\"" Sep 10 11:25:49.751580 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:25:49.751448 2564 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/bc4d3114-1390-4071-b44f-4ce8532a797b-offline-tls\") on node \"ip-10-0-134-73.ec2.internal\" DevicePath \"\"" Sep 10 11:25:50.409961 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:25:50.409927 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-5fd7d5db65-thrv2" event={"ID":"bc4d3114-1390-4071-b44f-4ce8532a797b","Type":"ContainerDied","Data":"4996af39112b1bf7bbd71c9e1efd8403b94bc4dfd802cb331ce0b9de5c3ea101"} Sep 10 11:25:50.409961 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:25:50.409951 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-credit-scoring-5fd7d5db65-thrv2" Sep 10 11:25:50.410404 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:25:50.409987 2564 scope.go:117] "RemoveContainer" containerID="62bd7d22febb68d2c18cdf53d7c3299777dccb19826efb9333857e4bd8ae906e" Sep 10 11:25:50.418673 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:25:50.418656 2564 scope.go:117] "RemoveContainer" containerID="0fe09aac73cffc47b972e2a4b5cef50ccd210a0772f2def1688d269ef0089905" Sep 10 11:25:50.426049 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:25:50.426033 2564 scope.go:117] "RemoveContainer" containerID="b698efee5f95f7a368dbbef8a9ab18407b059dbc031baf5508ad74e92f30e385" Sep 10 11:25:50.433009 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:25:50.432942 2564 scope.go:117] "RemoveContainer" containerID="634cff10dd3a7da4a29fcc1cb13d2f4e962c35cf6e359d20db2bb552c9d91a5d" Sep 10 11:25:50.433652 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:25:50.433629 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-credit-scoring-5fd7d5db65-thrv2"] Sep 10 11:25:50.437354 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:25:50.437335 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/feast-credit-scoring-5fd7d5db65-thrv2"] Sep 10 11:25:50.441924 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:25:50.441907 2564 scope.go:117] "RemoveContainer" containerID="51ce5b5edb347425f29267dd41ae222ca351057f1e3158fdbfb064f0c957d1bf" Sep 10 11:25:50.917202 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:25:50.917167 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bc4d3114-1390-4071-b44f-4ce8532a797b" path="/var/lib/kubelet/pods/bc4d3114-1390-4071-b44f-4ce8532a797b/volumes" Sep 10 11:27:14.872057 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:27:14.871973 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-l2hf2_7f298f77-06d2-4ea6-b4fc-cb2c5e9080de/console-operator/1.log" Sep 10 11:27:14.872575 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:27:14.872197 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-l2hf2_7f298f77-06d2-4ea6-b4fc-cb2c5e9080de/console-operator/1.log" Sep 10 11:27:54.796037 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:27:54.796002 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast-rest/redis-69bbd798b6-884sb"] Sep 10 11:27:54.796457 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:27:54.796332 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bc4d3114-1390-4071-b44f-4ce8532a797b" containerName="registry" Sep 10 11:27:54.796457 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:27:54.796347 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="bc4d3114-1390-4071-b44f-4ce8532a797b" containerName="registry" Sep 10 11:27:54.796457 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:27:54.796363 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bc4d3114-1390-4071-b44f-4ce8532a797b" containerName="feast-apply" Sep 10 11:27:54.796457 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:27:54.796373 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="bc4d3114-1390-4071-b44f-4ce8532a797b" containerName="feast-apply" Sep 10 11:27:54.796457 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:27:54.796382 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bc4d3114-1390-4071-b44f-4ce8532a797b" containerName="feast-init" Sep 10 11:27:54.796457 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:27:54.796388 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="bc4d3114-1390-4071-b44f-4ce8532a797b" containerName="feast-init" Sep 10 11:27:54.796457 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:27:54.796405 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1e05384c-870e-4482-9e52-f7edb32885b0" containerName="postgres" Sep 10 11:27:54.796457 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:27:54.796412 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="1e05384c-870e-4482-9e52-f7edb32885b0" containerName="postgres" Sep 10 11:27:54.796457 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:27:54.796422 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bc4d3114-1390-4071-b44f-4ce8532a797b" containerName="online" Sep 10 11:27:54.796457 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:27:54.796430 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="bc4d3114-1390-4071-b44f-4ce8532a797b" containerName="online" Sep 10 11:27:54.796457 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:27:54.796438 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bc4d3114-1390-4071-b44f-4ce8532a797b" containerName="offline" Sep 10 11:27:54.796457 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:27:54.796446 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="bc4d3114-1390-4071-b44f-4ce8532a797b" containerName="offline" Sep 10 11:27:54.796992 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:27:54.796509 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="1e05384c-870e-4482-9e52-f7edb32885b0" containerName="postgres" Sep 10 11:27:54.796992 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:27:54.796520 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="bc4d3114-1390-4071-b44f-4ce8532a797b" containerName="online" Sep 10 11:27:54.796992 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:27:54.796529 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="bc4d3114-1390-4071-b44f-4ce8532a797b" containerName="registry" Sep 10 11:27:54.796992 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:27:54.796540 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="bc4d3114-1390-4071-b44f-4ce8532a797b" containerName="offline" Sep 10 11:27:54.806333 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:27:54.806315 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/redis-69bbd798b6-884sb" Sep 10 11:27:54.808928 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:27:54.808908 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast-rest\"/\"openshift-service-ca.crt\"" Sep 10 11:27:54.809045 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:27:54.808994 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"default-dockercfg-g8z4t\"" Sep 10 11:27:54.809122 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:27:54.809103 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast-rest\"/\"kube-root-ca.crt\"" Sep 10 11:27:54.812178 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:27:54.812158 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast-rest/redis-69bbd798b6-884sb"] Sep 10 11:27:54.845953 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:27:54.845929 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bqxgx\" (UniqueName: \"kubernetes.io/projected/2d8dddbf-0a91-47a6-90de-970b876fde04-kube-api-access-bqxgx\") pod \"redis-69bbd798b6-884sb\" (UID: \"2d8dddbf-0a91-47a6-90de-970b876fde04\") " pod="test-ns-feast-rest/redis-69bbd798b6-884sb" Sep 10 11:27:54.946567 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:27:54.946543 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bqxgx\" (UniqueName: \"kubernetes.io/projected/2d8dddbf-0a91-47a6-90de-970b876fde04-kube-api-access-bqxgx\") pod \"redis-69bbd798b6-884sb\" (UID: \"2d8dddbf-0a91-47a6-90de-970b876fde04\") " pod="test-ns-feast-rest/redis-69bbd798b6-884sb" Sep 10 11:27:54.955532 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:27:54.955506 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bqxgx\" (UniqueName: \"kubernetes.io/projected/2d8dddbf-0a91-47a6-90de-970b876fde04-kube-api-access-bqxgx\") pod \"redis-69bbd798b6-884sb\" (UID: \"2d8dddbf-0a91-47a6-90de-970b876fde04\") " pod="test-ns-feast-rest/redis-69bbd798b6-884sb" Sep 10 11:27:55.132317 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:27:55.132296 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/redis-69bbd798b6-884sb" Sep 10 11:27:55.401969 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:27:55.401787 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast-rest/redis-69bbd798b6-884sb"] Sep 10 11:27:55.404559 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:27:55.404525 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2d8dddbf_0a91_47a6_90de_970b876fde04.slice/crio-b65df3004c6f371ae3827a3dd676d068ec7c8cd4dfc22bdc6aebaada9fc468be WatchSource:0}: Error finding container b65df3004c6f371ae3827a3dd676d068ec7c8cd4dfc22bdc6aebaada9fc468be: Status 404 returned error can't find the container with id b65df3004c6f371ae3827a3dd676d068ec7c8cd4dfc22bdc6aebaada9fc468be Sep 10 11:27:55.885405 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:27:55.885369 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/redis-69bbd798b6-884sb" event={"ID":"2d8dddbf-0a91-47a6-90de-970b876fde04","Type":"ContainerStarted","Data":"b65df3004c6f371ae3827a3dd676d068ec7c8cd4dfc22bdc6aebaada9fc468be"} Sep 10 11:27:56.891368 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:27:56.891328 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/redis-69bbd798b6-884sb" event={"ID":"2d8dddbf-0a91-47a6-90de-970b876fde04","Type":"ContainerStarted","Data":"a3a9468ce3eab9abd69b7c53e6f09fc90f2e920e9a36551fe708951018621ab6"} Sep 10 11:27:56.908110 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:27:56.908069 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast-rest/redis-69bbd798b6-884sb" podStartSLOduration=1.586033611 podStartE2EDuration="2.908053033s" totalImagesPullingTime="1.322019422s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 11:27:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 11:27:56.906238315 +0000 UTC m=+942.502799530" watchObservedRunningTime="2026-09-10 11:27:56.908053033 +0000 UTC m=+942.504614248" Sep 10 11:28:00.233397 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:28:00.233362 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast-rest/postgres-864846d4f5-ms2w8"] Sep 10 11:28:00.237102 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:28:00.237075 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/postgres-864846d4f5-ms2w8" Sep 10 11:28:00.240003 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:28:00.239953 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"postgres-secret\"" Sep 10 11:28:00.251144 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:28:00.250245 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast-rest/postgres-864846d4f5-ms2w8"] Sep 10 11:28:00.279893 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:28:00.279866 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9hrvc\" (UniqueName: \"kubernetes.io/projected/e938502a-1308-41b3-83af-ff0ec2f02bfc-kube-api-access-9hrvc\") pod \"postgres-864846d4f5-ms2w8\" (UID: \"e938502a-1308-41b3-83af-ff0ec2f02bfc\") " pod="test-ns-feast-rest/postgres-864846d4f5-ms2w8" Sep 10 11:28:00.279990 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:28:00.279950 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/e938502a-1308-41b3-83af-ff0ec2f02bfc-postgresdata\") pod \"postgres-864846d4f5-ms2w8\" (UID: \"e938502a-1308-41b3-83af-ff0ec2f02bfc\") " pod="test-ns-feast-rest/postgres-864846d4f5-ms2w8" Sep 10 11:28:00.380270 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:28:00.380242 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9hrvc\" (UniqueName: \"kubernetes.io/projected/e938502a-1308-41b3-83af-ff0ec2f02bfc-kube-api-access-9hrvc\") pod \"postgres-864846d4f5-ms2w8\" (UID: \"e938502a-1308-41b3-83af-ff0ec2f02bfc\") " pod="test-ns-feast-rest/postgres-864846d4f5-ms2w8" Sep 10 11:28:00.380380 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:28:00.380311 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/e938502a-1308-41b3-83af-ff0ec2f02bfc-postgresdata\") pod \"postgres-864846d4f5-ms2w8\" (UID: \"e938502a-1308-41b3-83af-ff0ec2f02bfc\") " pod="test-ns-feast-rest/postgres-864846d4f5-ms2w8" Sep 10 11:28:00.380659 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:28:00.380640 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/e938502a-1308-41b3-83af-ff0ec2f02bfc-postgresdata\") pod \"postgres-864846d4f5-ms2w8\" (UID: \"e938502a-1308-41b3-83af-ff0ec2f02bfc\") " pod="test-ns-feast-rest/postgres-864846d4f5-ms2w8" Sep 10 11:28:00.391983 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:28:00.391962 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9hrvc\" (UniqueName: \"kubernetes.io/projected/e938502a-1308-41b3-83af-ff0ec2f02bfc-kube-api-access-9hrvc\") pod \"postgres-864846d4f5-ms2w8\" (UID: \"e938502a-1308-41b3-83af-ff0ec2f02bfc\") " pod="test-ns-feast-rest/postgres-864846d4f5-ms2w8" Sep 10 11:28:00.552143 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:28:00.552091 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/postgres-864846d4f5-ms2w8" Sep 10 11:28:00.823738 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:28:00.823669 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast-rest/postgres-864846d4f5-ms2w8"] Sep 10 11:28:00.826563 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:28:00.826537 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode938502a_1308_41b3_83af_ff0ec2f02bfc.slice/crio-8546346ef1e8de8785478ece3271ed9bac3ccc83dd0df664e176fde3f379e950 WatchSource:0}: Error finding container 8546346ef1e8de8785478ece3271ed9bac3ccc83dd0df664e176fde3f379e950: Status 404 returned error can't find the container with id 8546346ef1e8de8785478ece3271ed9bac3ccc83dd0df664e176fde3f379e950 Sep 10 11:28:00.908457 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:28:00.908432 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/postgres-864846d4f5-ms2w8" event={"ID":"e938502a-1308-41b3-83af-ff0ec2f02bfc","Type":"ContainerStarted","Data":"893839debb82d7a7f0385db8959054313922a5d3b7191c828f0f10b189314c4b"} Sep 10 11:28:00.908576 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:28:00.908475 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/postgres-864846d4f5-ms2w8" event={"ID":"e938502a-1308-41b3-83af-ff0ec2f02bfc","Type":"ContainerStarted","Data":"8546346ef1e8de8785478ece3271ed9bac3ccc83dd0df664e176fde3f379e950"} Sep 10 11:28:00.926324 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:28:00.926281 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast-rest/postgres-864846d4f5-ms2w8" podStartSLOduration=0.926266338 podStartE2EDuration="926.266338ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 11:28:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 11:28:00.92523964 +0000 UTC m=+946.521800876" watchObservedRunningTime="2026-09-10 11:28:00.926266338 +0000 UTC m=+946.522827555" Sep 10 11:28:05.799370 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:28:05.799329 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast-rest/feast-credit-scoring-768dfbc75c-vl2ww"] Sep 10 11:28:05.805680 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:28:05.805659 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/feast-credit-scoring-768dfbc75c-vl2ww" Sep 10 11:28:05.808169 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:28:05.808139 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"feast-credit-scoring-registry-tls\"" Sep 10 11:28:05.808301 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:28:05.808250 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast-rest\"/\"feast-credit-scoring-intra-comm\"" Sep 10 11:28:05.808551 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:28:05.808527 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"feast-credit-scoring-online-tls\"" Sep 10 11:28:05.808664 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:28:05.808552 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"feast-credit-scoring-dockercfg-wlgqs\"" Sep 10 11:28:05.814471 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:28:05.814448 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast-rest/feast-credit-scoring-768dfbc75c-vl2ww"] Sep 10 11:28:05.821578 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:28:05.821554 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z9bpc\" (UniqueName: \"kubernetes.io/projected/07af8c61-559f-4234-91bb-f3678779ff86-kube-api-access-z9bpc\") pod \"feast-credit-scoring-768dfbc75c-vl2ww\" (UID: \"07af8c61-559f-4234-91bb-f3678779ff86\") " pod="test-ns-feast-rest/feast-credit-scoring-768dfbc75c-vl2ww" Sep 10 11:28:05.821687 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:28:05.821589 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/07af8c61-559f-4234-91bb-f3678779ff86-feast-data\") pod \"feast-credit-scoring-768dfbc75c-vl2ww\" (UID: \"07af8c61-559f-4234-91bb-f3678779ff86\") " pod="test-ns-feast-rest/feast-credit-scoring-768dfbc75c-vl2ww" Sep 10 11:28:05.821687 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:28:05.821643 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/07af8c61-559f-4234-91bb-f3678779ff86-online-tls\") pod \"feast-credit-scoring-768dfbc75c-vl2ww\" (UID: \"07af8c61-559f-4234-91bb-f3678779ff86\") " pod="test-ns-feast-rest/feast-credit-scoring-768dfbc75c-vl2ww" Sep 10 11:28:05.821687 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:28:05.821669 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/07af8c61-559f-4234-91bb-f3678779ff86-registry-tls\") pod \"feast-credit-scoring-768dfbc75c-vl2ww\" (UID: \"07af8c61-559f-4234-91bb-f3678779ff86\") " pod="test-ns-feast-rest/feast-credit-scoring-768dfbc75c-vl2ww" Sep 10 11:28:05.922334 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:28:05.922307 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z9bpc\" (UniqueName: \"kubernetes.io/projected/07af8c61-559f-4234-91bb-f3678779ff86-kube-api-access-z9bpc\") pod \"feast-credit-scoring-768dfbc75c-vl2ww\" (UID: \"07af8c61-559f-4234-91bb-f3678779ff86\") " pod="test-ns-feast-rest/feast-credit-scoring-768dfbc75c-vl2ww" Sep 10 11:28:05.922334 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:28:05.922335 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/07af8c61-559f-4234-91bb-f3678779ff86-feast-data\") pod \"feast-credit-scoring-768dfbc75c-vl2ww\" (UID: \"07af8c61-559f-4234-91bb-f3678779ff86\") " pod="test-ns-feast-rest/feast-credit-scoring-768dfbc75c-vl2ww" Sep 10 11:28:05.922478 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:28:05.922363 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/07af8c61-559f-4234-91bb-f3678779ff86-online-tls\") pod \"feast-credit-scoring-768dfbc75c-vl2ww\" (UID: \"07af8c61-559f-4234-91bb-f3678779ff86\") " pod="test-ns-feast-rest/feast-credit-scoring-768dfbc75c-vl2ww" Sep 10 11:28:05.922478 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:28:05.922471 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/07af8c61-559f-4234-91bb-f3678779ff86-registry-tls\") pod \"feast-credit-scoring-768dfbc75c-vl2ww\" (UID: \"07af8c61-559f-4234-91bb-f3678779ff86\") " pod="test-ns-feast-rest/feast-credit-scoring-768dfbc75c-vl2ww" Sep 10 11:28:05.922736 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:28:05.922717 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/07af8c61-559f-4234-91bb-f3678779ff86-feast-data\") pod \"feast-credit-scoring-768dfbc75c-vl2ww\" (UID: \"07af8c61-559f-4234-91bb-f3678779ff86\") " pod="test-ns-feast-rest/feast-credit-scoring-768dfbc75c-vl2ww" Sep 10 11:28:05.924824 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:28:05.924800 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/07af8c61-559f-4234-91bb-f3678779ff86-online-tls\") pod \"feast-credit-scoring-768dfbc75c-vl2ww\" (UID: \"07af8c61-559f-4234-91bb-f3678779ff86\") " pod="test-ns-feast-rest/feast-credit-scoring-768dfbc75c-vl2ww" Sep 10 11:28:05.925025 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:28:05.925005 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/07af8c61-559f-4234-91bb-f3678779ff86-registry-tls\") pod \"feast-credit-scoring-768dfbc75c-vl2ww\" (UID: \"07af8c61-559f-4234-91bb-f3678779ff86\") " pod="test-ns-feast-rest/feast-credit-scoring-768dfbc75c-vl2ww" Sep 10 11:28:05.930439 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:28:05.930419 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z9bpc\" (UniqueName: \"kubernetes.io/projected/07af8c61-559f-4234-91bb-f3678779ff86-kube-api-access-z9bpc\") pod \"feast-credit-scoring-768dfbc75c-vl2ww\" (UID: \"07af8c61-559f-4234-91bb-f3678779ff86\") " pod="test-ns-feast-rest/feast-credit-scoring-768dfbc75c-vl2ww" Sep 10 11:28:06.114703 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:28:06.114672 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/feast-credit-scoring-768dfbc75c-vl2ww" Sep 10 11:28:06.393540 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:28:06.393350 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast-rest/feast-credit-scoring-768dfbc75c-vl2ww"] Sep 10 11:28:06.395660 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:28:06.395632 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod07af8c61_559f_4234_91bb_f3678779ff86.slice/crio-8c69b41097eb18bdff0499258be7e17cf65c47f99db31a1ff6450697ad240720 WatchSource:0}: Error finding container 8c69b41097eb18bdff0499258be7e17cf65c47f99db31a1ff6450697ad240720: Status 404 returned error can't find the container with id 8c69b41097eb18bdff0499258be7e17cf65c47f99db31a1ff6450697ad240720 Sep 10 11:28:06.933620 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:28:06.933578 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-768dfbc75c-vl2ww" event={"ID":"07af8c61-559f-4234-91bb-f3678779ff86","Type":"ContainerStarted","Data":"bcd592f574d5354f5b0a5fa6a6a08123c9062c6c4637a4b5595ab930ac913838"} Sep 10 11:28:06.934061 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:28:06.933634 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-768dfbc75c-vl2ww" event={"ID":"07af8c61-559f-4234-91bb-f3678779ff86","Type":"ContainerStarted","Data":"8c69b41097eb18bdff0499258be7e17cf65c47f99db31a1ff6450697ad240720"} Sep 10 11:28:08.944148 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:28:08.944115 2564 generic.go:356] "Generic (PLEG): container finished" podID="07af8c61-559f-4234-91bb-f3678779ff86" containerID="bcd592f574d5354f5b0a5fa6a6a08123c9062c6c4637a4b5595ab930ac913838" exitCode=0 Sep 10 11:28:08.944549 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:28:08.944177 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-768dfbc75c-vl2ww" event={"ID":"07af8c61-559f-4234-91bb-f3678779ff86","Type":"ContainerDied","Data":"bcd592f574d5354f5b0a5fa6a6a08123c9062c6c4637a4b5595ab930ac913838"} Sep 10 11:28:09.950483 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:28:09.950449 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-768dfbc75c-vl2ww" event={"ID":"07af8c61-559f-4234-91bb-f3678779ff86","Type":"ContainerStarted","Data":"aaaac3d08b438de2d7c710270c3daab259caf9f458be622ab0d9bb0e289d1998"} Sep 10 11:28:15.981955 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:28:15.981921 2564 generic.go:356] "Generic (PLEG): container finished" podID="07af8c61-559f-4234-91bb-f3678779ff86" containerID="aaaac3d08b438de2d7c710270c3daab259caf9f458be622ab0d9bb0e289d1998" exitCode=0 Sep 10 11:28:15.982307 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:28:15.981967 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-768dfbc75c-vl2ww" event={"ID":"07af8c61-559f-4234-91bb-f3678779ff86","Type":"ContainerDied","Data":"aaaac3d08b438de2d7c710270c3daab259caf9f458be622ab0d9bb0e289d1998"} Sep 10 11:28:15.985515 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:28:15.985492 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast-rest\"/\"feast-credit-scoring-intra-comm\"" Sep 10 11:28:16.989751 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:28:16.989712 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-768dfbc75c-vl2ww" event={"ID":"07af8c61-559f-4234-91bb-f3678779ff86","Type":"ContainerStarted","Data":"2f701c9e30c934c0355d40b633b37f306ebe07a8853709b81d0df390d9667cc2"} Sep 10 11:28:16.990155 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:28:16.989785 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-768dfbc75c-vl2ww" event={"ID":"07af8c61-559f-4234-91bb-f3678779ff86","Type":"ContainerStarted","Data":"e8f5652c82f6c2b2dcde5aadbf32459d5b86d42ca978dac6393473b0a3af2957"} Sep 10 11:28:17.014985 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:28:17.014919 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast-rest/feast-credit-scoring-768dfbc75c-vl2ww" podStartSLOduration=12.014897935 podStartE2EDuration="12.014897935s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 11:28:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 11:28:17.014567473 +0000 UTC m=+962.611128708" watchObservedRunningTime="2026-09-10 11:28:17.014897935 +0000 UTC m=+962.611459152" Sep 10 11:28:18.114959 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:28:18.114925 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast-rest/feast-credit-scoring-768dfbc75c-vl2ww" Sep 10 11:28:18.115319 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:28:18.114981 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast-rest/feast-credit-scoring-768dfbc75c-vl2ww" Sep 10 11:28:18.116752 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:28:18.116725 2564 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-credit-scoring-768dfbc75c-vl2ww" podUID="07af8c61-559f-4234-91bb-f3678779ff86" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.31:6571: connect: connection refused" Sep 10 11:28:18.116841 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:28:18.116769 2564 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-credit-scoring-768dfbc75c-vl2ww" podUID="07af8c61-559f-4234-91bb-f3678779ff86" containerName="online" probeResult="failure" output="Get \"https://10.132.0.31:6567/health\": dial tcp 10.132.0.31:6567: connect: connection refused" Sep 10 11:28:21.115803 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:28:21.115753 2564 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-credit-scoring-768dfbc75c-vl2ww" podUID="07af8c61-559f-4234-91bb-f3678779ff86" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.31:6571: connect: connection refused" Sep 10 11:28:21.115803 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:28:21.115785 2564 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-credit-scoring-768dfbc75c-vl2ww" podUID="07af8c61-559f-4234-91bb-f3678779ff86" containerName="online" probeResult="failure" output="Get \"https://10.132.0.31:6567/health\": dial tcp 10.132.0.31:6567: connect: connection refused" Sep 10 11:28:24.115372 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:28:24.115327 2564 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-credit-scoring-768dfbc75c-vl2ww" podUID="07af8c61-559f-4234-91bb-f3678779ff86" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.31:6571: connect: connection refused" Sep 10 11:28:24.121197 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:28:24.121171 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast-rest/feast-credit-scoring-768dfbc75c-vl2ww" Sep 10 11:28:24.121544 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:28:24.121524 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast-rest/feast-credit-scoring-768dfbc75c-vl2ww" Sep 10 11:28:24.124517 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:28:24.124494 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast-rest/feast-credit-scoring-768dfbc75c-vl2ww" Sep 10 11:28:26.115571 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:28:26.115532 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast-rest/feast-credit-scoring-768dfbc75c-vl2ww" Sep 10 11:28:27.115739 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:28:27.115695 2564 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-credit-scoring-768dfbc75c-vl2ww" podUID="07af8c61-559f-4234-91bb-f3678779ff86" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.31:6571: connect: connection refused" Sep 10 11:28:30.115699 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:28:30.115673 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast-rest/feast-credit-scoring-768dfbc75c-vl2ww" Sep 10 11:28:30.116991 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:28:30.116971 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast-rest/feast-credit-scoring-768dfbc75c-vl2ww" Sep 10 11:28:31.683243 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:28:31.683210 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast-rest/feast-driver-ranking-7f8668d9db-fcm2m"] Sep 10 11:28:31.688019 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:28:31.687997 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/feast-driver-ranking-7f8668d9db-fcm2m" Sep 10 11:28:31.691225 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:28:31.691202 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"feast-driver-ranking-online-tls\"" Sep 10 11:28:31.691763 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:28:31.691749 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast-rest\"/\"feast-driver-ranking-intra-comm\"" Sep 10 11:28:31.691830 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:28:31.691798 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"feast-driver-ranking-dockercfg-ntcs7\"" Sep 10 11:28:31.693114 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:28:31.693097 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"feast-driver-ranking-registry-tls\"" Sep 10 11:28:31.700039 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:28:31.700006 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast-rest/feast-driver-ranking-7f8668d9db-fcm2m"] Sep 10 11:28:31.814644 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:28:31.814614 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/e2f2ef21-9a34-41ee-a782-9ec8fc0c6728-online-tls\") pod \"feast-driver-ranking-7f8668d9db-fcm2m\" (UID: \"e2f2ef21-9a34-41ee-a782-9ec8fc0c6728\") " pod="test-ns-feast-rest/feast-driver-ranking-7f8668d9db-fcm2m" Sep 10 11:28:31.814785 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:28:31.814648 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zm9sk\" (UniqueName: \"kubernetes.io/projected/e2f2ef21-9a34-41ee-a782-9ec8fc0c6728-kube-api-access-zm9sk\") pod \"feast-driver-ranking-7f8668d9db-fcm2m\" (UID: \"e2f2ef21-9a34-41ee-a782-9ec8fc0c6728\") " pod="test-ns-feast-rest/feast-driver-ranking-7f8668d9db-fcm2m" Sep 10 11:28:31.814785 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:28:31.814697 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/e2f2ef21-9a34-41ee-a782-9ec8fc0c6728-feast-data\") pod \"feast-driver-ranking-7f8668d9db-fcm2m\" (UID: \"e2f2ef21-9a34-41ee-a782-9ec8fc0c6728\") " pod="test-ns-feast-rest/feast-driver-ranking-7f8668d9db-fcm2m" Sep 10 11:28:31.814785 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:28:31.814757 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/e2f2ef21-9a34-41ee-a782-9ec8fc0c6728-registry-tls\") pod \"feast-driver-ranking-7f8668d9db-fcm2m\" (UID: \"e2f2ef21-9a34-41ee-a782-9ec8fc0c6728\") " pod="test-ns-feast-rest/feast-driver-ranking-7f8668d9db-fcm2m" Sep 10 11:28:31.915048 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:28:31.915020 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/e2f2ef21-9a34-41ee-a782-9ec8fc0c6728-registry-tls\") pod \"feast-driver-ranking-7f8668d9db-fcm2m\" (UID: \"e2f2ef21-9a34-41ee-a782-9ec8fc0c6728\") " pod="test-ns-feast-rest/feast-driver-ranking-7f8668d9db-fcm2m" Sep 10 11:28:31.915173 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:28:31.915055 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/e2f2ef21-9a34-41ee-a782-9ec8fc0c6728-online-tls\") pod \"feast-driver-ranking-7f8668d9db-fcm2m\" (UID: \"e2f2ef21-9a34-41ee-a782-9ec8fc0c6728\") " pod="test-ns-feast-rest/feast-driver-ranking-7f8668d9db-fcm2m" Sep 10 11:28:31.915173 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:28:31.915070 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zm9sk\" (UniqueName: \"kubernetes.io/projected/e2f2ef21-9a34-41ee-a782-9ec8fc0c6728-kube-api-access-zm9sk\") pod \"feast-driver-ranking-7f8668d9db-fcm2m\" (UID: \"e2f2ef21-9a34-41ee-a782-9ec8fc0c6728\") " pod="test-ns-feast-rest/feast-driver-ranking-7f8668d9db-fcm2m" Sep 10 11:28:31.915173 ip-10-0-134-73 kubenswrapper[2564]: E0910 11:28:31.915163 2564 secret.go:189] Couldn't get secret test-ns-feast-rest/feast-driver-ranking-online-tls: secret "feast-driver-ranking-online-tls" not found Sep 10 11:28:31.915326 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:28:31.915197 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/e2f2ef21-9a34-41ee-a782-9ec8fc0c6728-feast-data\") pod \"feast-driver-ranking-7f8668d9db-fcm2m\" (UID: \"e2f2ef21-9a34-41ee-a782-9ec8fc0c6728\") " pod="test-ns-feast-rest/feast-driver-ranking-7f8668d9db-fcm2m" Sep 10 11:28:31.915326 ip-10-0-134-73 kubenswrapper[2564]: E0910 11:28:31.915213 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e2f2ef21-9a34-41ee-a782-9ec8fc0c6728-online-tls podName:e2f2ef21-9a34-41ee-a782-9ec8fc0c6728 nodeName:}" failed. No retries permitted until 2026-09-10 11:28:32.415199677 +0000 UTC m=+978.011760873 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "online-tls" (UniqueName: "kubernetes.io/secret/e2f2ef21-9a34-41ee-a782-9ec8fc0c6728-online-tls") pod "feast-driver-ranking-7f8668d9db-fcm2m" (UID: "e2f2ef21-9a34-41ee-a782-9ec8fc0c6728") : secret "feast-driver-ranking-online-tls" not found Sep 10 11:28:31.915512 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:28:31.915495 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/e2f2ef21-9a34-41ee-a782-9ec8fc0c6728-feast-data\") pod \"feast-driver-ranking-7f8668d9db-fcm2m\" (UID: \"e2f2ef21-9a34-41ee-a782-9ec8fc0c6728\") " pod="test-ns-feast-rest/feast-driver-ranking-7f8668d9db-fcm2m" Sep 10 11:28:31.917403 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:28:31.917380 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/e2f2ef21-9a34-41ee-a782-9ec8fc0c6728-registry-tls\") pod \"feast-driver-ranking-7f8668d9db-fcm2m\" (UID: \"e2f2ef21-9a34-41ee-a782-9ec8fc0c6728\") " pod="test-ns-feast-rest/feast-driver-ranking-7f8668d9db-fcm2m" Sep 10 11:28:31.925645 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:28:31.925621 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zm9sk\" (UniqueName: \"kubernetes.io/projected/e2f2ef21-9a34-41ee-a782-9ec8fc0c6728-kube-api-access-zm9sk\") pod \"feast-driver-ranking-7f8668d9db-fcm2m\" (UID: \"e2f2ef21-9a34-41ee-a782-9ec8fc0c6728\") " pod="test-ns-feast-rest/feast-driver-ranking-7f8668d9db-fcm2m" Sep 10 11:28:32.419513 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:28:32.419483 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/e2f2ef21-9a34-41ee-a782-9ec8fc0c6728-online-tls\") pod \"feast-driver-ranking-7f8668d9db-fcm2m\" (UID: \"e2f2ef21-9a34-41ee-a782-9ec8fc0c6728\") " pod="test-ns-feast-rest/feast-driver-ranking-7f8668d9db-fcm2m" Sep 10 11:28:32.422018 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:28:32.421998 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/e2f2ef21-9a34-41ee-a782-9ec8fc0c6728-online-tls\") pod \"feast-driver-ranking-7f8668d9db-fcm2m\" (UID: \"e2f2ef21-9a34-41ee-a782-9ec8fc0c6728\") " pod="test-ns-feast-rest/feast-driver-ranking-7f8668d9db-fcm2m" Sep 10 11:28:32.596551 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:28:32.596517 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/feast-driver-ranking-7f8668d9db-fcm2m" Sep 10 11:28:32.870475 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:28:32.870447 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast-rest/feast-driver-ranking-7f8668d9db-fcm2m"] Sep 10 11:28:32.872381 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:28:32.872354 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode2f2ef21_9a34_41ee_a782_9ec8fc0c6728.slice/crio-540098fbad6676c3274672669fa3ad3a21564a8d8b13b679ec4e28116b38f4c6 WatchSource:0}: Error finding container 540098fbad6676c3274672669fa3ad3a21564a8d8b13b679ec4e28116b38f4c6: Status 404 returned error can't find the container with id 540098fbad6676c3274672669fa3ad3a21564a8d8b13b679ec4e28116b38f4c6 Sep 10 11:28:33.063316 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:28:33.063282 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-7f8668d9db-fcm2m" event={"ID":"e2f2ef21-9a34-41ee-a782-9ec8fc0c6728","Type":"ContainerStarted","Data":"f462c5c008cfa6c12650da1e0f455ee53ebf32b1ef2ae62f12fbcf79d4f6a6bd"} Sep 10 11:28:33.063478 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:28:33.063337 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-7f8668d9db-fcm2m" event={"ID":"e2f2ef21-9a34-41ee-a782-9ec8fc0c6728","Type":"ContainerStarted","Data":"540098fbad6676c3274672669fa3ad3a21564a8d8b13b679ec4e28116b38f4c6"} Sep 10 11:28:38.083724 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:28:38.083693 2564 generic.go:356] "Generic (PLEG): container finished" podID="e2f2ef21-9a34-41ee-a782-9ec8fc0c6728" containerID="f462c5c008cfa6c12650da1e0f455ee53ebf32b1ef2ae62f12fbcf79d4f6a6bd" exitCode=0 Sep 10 11:28:38.084106 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:28:38.083767 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-7f8668d9db-fcm2m" event={"ID":"e2f2ef21-9a34-41ee-a782-9ec8fc0c6728","Type":"ContainerDied","Data":"f462c5c008cfa6c12650da1e0f455ee53ebf32b1ef2ae62f12fbcf79d4f6a6bd"} Sep 10 11:28:39.089312 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:28:39.089283 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-7f8668d9db-fcm2m" event={"ID":"e2f2ef21-9a34-41ee-a782-9ec8fc0c6728","Type":"ContainerStarted","Data":"9859931d7531fe2449a8f4d578967fcfddd41ee419b934a4796a545be7fb7904"} Sep 10 11:28:45.115532 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:28:45.115494 2564 generic.go:356] "Generic (PLEG): container finished" podID="e2f2ef21-9a34-41ee-a782-9ec8fc0c6728" containerID="9859931d7531fe2449a8f4d578967fcfddd41ee419b934a4796a545be7fb7904" exitCode=0 Sep 10 11:28:45.115939 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:28:45.115563 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-7f8668d9db-fcm2m" event={"ID":"e2f2ef21-9a34-41ee-a782-9ec8fc0c6728","Type":"ContainerDied","Data":"9859931d7531fe2449a8f4d578967fcfddd41ee419b934a4796a545be7fb7904"} Sep 10 11:28:46.123008 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:28:46.122975 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-7f8668d9db-fcm2m" event={"ID":"e2f2ef21-9a34-41ee-a782-9ec8fc0c6728","Type":"ContainerStarted","Data":"a0dc3ebb37662e55617c1229762437a99425b5d76fc4ff34f119bd969f83b884"} Sep 10 11:28:46.123380 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:28:46.123030 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-7f8668d9db-fcm2m" event={"ID":"e2f2ef21-9a34-41ee-a782-9ec8fc0c6728","Type":"ContainerStarted","Data":"9f65d0233b6477d1eb2ebbb5dc5ea2ac4a296f6773445b77ed732ddf04746e91"} Sep 10 11:28:46.148711 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:28:46.148629 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast-rest/feast-driver-ranking-7f8668d9db-fcm2m" podStartSLOduration=15.148615006 podStartE2EDuration="15.148615006s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 11:28:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 11:28:46.147501278 +0000 UTC m=+991.744062516" watchObservedRunningTime="2026-09-10 11:28:46.148615006 +0000 UTC m=+991.745176219" Sep 10 11:28:47.597499 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:28:47.597457 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast-rest/feast-driver-ranking-7f8668d9db-fcm2m" Sep 10 11:28:47.597899 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:28:47.597550 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast-rest/feast-driver-ranking-7f8668d9db-fcm2m" Sep 10 11:28:47.599384 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:28:47.599345 2564 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-driver-ranking-7f8668d9db-fcm2m" podUID="e2f2ef21-9a34-41ee-a782-9ec8fc0c6728" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.32:6571: connect: connection refused" Sep 10 11:28:47.599523 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:28:47.599416 2564 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-driver-ranking-7f8668d9db-fcm2m" podUID="e2f2ef21-9a34-41ee-a782-9ec8fc0c6728" containerName="online" probeResult="failure" output="Get \"https://10.132.0.32:6567/health\": dial tcp 10.132.0.32:6567: connect: connection refused" Sep 10 11:28:50.597139 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:28:50.597093 2564 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-driver-ranking-7f8668d9db-fcm2m" podUID="e2f2ef21-9a34-41ee-a782-9ec8fc0c6728" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.32:6571: connect: connection refused" Sep 10 11:28:50.597139 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:28:50.597116 2564 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-driver-ranking-7f8668d9db-fcm2m" podUID="e2f2ef21-9a34-41ee-a782-9ec8fc0c6728" containerName="online" probeResult="failure" output="Get \"https://10.132.0.32:6567/health\": dial tcp 10.132.0.32:6567: connect: connection refused" Sep 10 11:28:52.597399 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:28:52.597349 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast-rest/feast-driver-ranking-7f8668d9db-fcm2m" Sep 10 11:28:52.597900 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:28:52.597433 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast-rest/feast-driver-ranking-7f8668d9db-fcm2m" Sep 10 11:28:53.597817 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:28:53.597774 2564 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-driver-ranking-7f8668d9db-fcm2m" podUID="e2f2ef21-9a34-41ee-a782-9ec8fc0c6728" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.32:6571: connect: connection refused" Sep 10 11:28:53.603835 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:28:53.603807 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast-rest/feast-driver-ranking-7f8668d9db-fcm2m" Sep 10 11:28:54.166320 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:28:54.166283 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast-rest/feast-driver-ranking-7f8668d9db-fcm2m" Sep 10 11:28:56.598139 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:28:56.598105 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast-rest/feast-driver-ranking-7f8668d9db-fcm2m" Sep 10 11:28:56.598994 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:28:56.598973 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast-rest/feast-driver-ranking-7f8668d9db-fcm2m" Sep 10 11:30:15.389513 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:30:15.389432 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-588dd546db-njz8z"] Sep 10 11:30:15.389997 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:30:15.389631 2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="feast-operator-system/feast-operator-controller-manager-588dd546db-njz8z" podUID="5a8e836f-0e99-49e5-be42-68431d7c0aff" containerName="manager" containerID="cri-o://82dbf86331f56c37f2936a3cb7e6429378f36098a939d6d17c1ec72f5c626a11" gracePeriod=10 Sep 10 11:30:15.508975 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:30:15.508947 2564 generic.go:356] "Generic (PLEG): container finished" podID="5a8e836f-0e99-49e5-be42-68431d7c0aff" containerID="82dbf86331f56c37f2936a3cb7e6429378f36098a939d6d17c1ec72f5c626a11" exitCode=0 Sep 10 11:30:15.509076 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:30:15.508997 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-588dd546db-njz8z" event={"ID":"5a8e836f-0e99-49e5-be42-68431d7c0aff","Type":"ContainerDied","Data":"82dbf86331f56c37f2936a3cb7e6429378f36098a939d6d17c1ec72f5c626a11"} Sep 10 11:30:15.672913 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:30:15.672884 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-588dd546db-njz8z" Sep 10 11:30:15.721212 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:30:15.721182 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2rtvk\" (UniqueName: \"kubernetes.io/projected/5a8e836f-0e99-49e5-be42-68431d7c0aff-kube-api-access-2rtvk\") pod \"5a8e836f-0e99-49e5-be42-68431d7c0aff\" (UID: \"5a8e836f-0e99-49e5-be42-68431d7c0aff\") " Sep 10 11:30:15.723696 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:30:15.723664 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5a8e836f-0e99-49e5-be42-68431d7c0aff-kube-api-access-2rtvk" (OuterVolumeSpecName: "kube-api-access-2rtvk") pod "5a8e836f-0e99-49e5-be42-68431d7c0aff" (UID: "5a8e836f-0e99-49e5-be42-68431d7c0aff"). InnerVolumeSpecName "kube-api-access-2rtvk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 11:30:15.724699 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:30:15.724675 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast-rest/feast-credit-scoring-768dfbc75c-vl2ww"] Sep 10 11:30:15.724974 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:30:15.724948 2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast-rest/feast-credit-scoring-768dfbc75c-vl2ww" podUID="07af8c61-559f-4234-91bb-f3678779ff86" containerName="registry" containerID="cri-o://e8f5652c82f6c2b2dcde5aadbf32459d5b86d42ca978dac6393473b0a3af2957" gracePeriod=30 Sep 10 11:30:15.725067 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:30:15.725017 2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast-rest/feast-credit-scoring-768dfbc75c-vl2ww" podUID="07af8c61-559f-4234-91bb-f3678779ff86" containerName="online" containerID="cri-o://2f701c9e30c934c0355d40b633b37f306ebe07a8853709b81d0df390d9667cc2" gracePeriod=30 Sep 10 11:30:15.745340 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:30:15.745317 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast-rest/feast-driver-ranking-7f8668d9db-fcm2m"] Sep 10 11:30:15.745550 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:30:15.745526 2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast-rest/feast-driver-ranking-7f8668d9db-fcm2m" podUID="e2f2ef21-9a34-41ee-a782-9ec8fc0c6728" containerName="registry" containerID="cri-o://9f65d0233b6477d1eb2ebbb5dc5ea2ac4a296f6773445b77ed732ddf04746e91" gracePeriod=30 Sep 10 11:30:15.745659 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:30:15.745566 2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast-rest/feast-driver-ranking-7f8668d9db-fcm2m" podUID="e2f2ef21-9a34-41ee-a782-9ec8fc0c6728" containerName="online" containerID="cri-o://a0dc3ebb37662e55617c1229762437a99425b5d76fc4ff34f119bd969f83b884" gracePeriod=30 Sep 10 11:30:15.821952 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:30:15.821918 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2rtvk\" (UniqueName: \"kubernetes.io/projected/5a8e836f-0e99-49e5-be42-68431d7c0aff-kube-api-access-2rtvk\") on node \"ip-10-0-134-73.ec2.internal\" DevicePath \"\"" Sep 10 11:30:16.514904 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:30:16.514847 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-588dd546db-njz8z" event={"ID":"5a8e836f-0e99-49e5-be42-68431d7c0aff","Type":"ContainerDied","Data":"eba315623ab511b58087a4e732f02b466c73ad4f556a2645906adfd84266662c"} Sep 10 11:30:16.514904 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:30:16.514899 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-588dd546db-njz8z" Sep 10 11:30:16.515380 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:30:16.514946 2564 scope.go:117] "RemoveContainer" containerID="82dbf86331f56c37f2936a3cb7e6429378f36098a939d6d17c1ec72f5c626a11" Sep 10 11:30:16.540380 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:30:16.540357 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-588dd546db-njz8z"] Sep 10 11:30:16.543721 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:30:16.543701 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-588dd546db-njz8z"] Sep 10 11:30:16.917812 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:30:16.917775 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5a8e836f-0e99-49e5-be42-68431d7c0aff" path="/var/lib/kubelet/pods/5a8e836f-0e99-49e5-be42-68431d7c0aff/volumes" Sep 10 11:30:17.237943 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:30:17.237837 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast-rest/postgres-864846d4f5-ms2w8"] Sep 10 11:30:17.238087 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:30:17.238035 2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast-rest/postgres-864846d4f5-ms2w8" podUID="e938502a-1308-41b3-83af-ff0ec2f02bfc" containerName="postgres" containerID="cri-o://893839debb82d7a7f0385db8959054313922a5d3b7191c828f0f10b189314c4b" gracePeriod=30 Sep 10 11:30:17.251746 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:30:17.251719 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast-rest/redis-69bbd798b6-884sb"] Sep 10 11:30:17.251915 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:30:17.251892 2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast-rest/redis-69bbd798b6-884sb" podUID="2d8dddbf-0a91-47a6-90de-970b876fde04" containerName="redis" containerID="cri-o://a3a9468ce3eab9abd69b7c53e6f09fc90f2e920e9a36551fe708951018621ab6" gracePeriod=30 Sep 10 11:30:17.500645 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:30:17.500622 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/postgres-864846d4f5-ms2w8" Sep 10 11:30:17.508661 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:30:17.508642 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/redis-69bbd798b6-884sb" Sep 10 11:30:17.535230 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:30:17.535201 2564 generic.go:356] "Generic (PLEG): container finished" podID="2d8dddbf-0a91-47a6-90de-970b876fde04" containerID="a3a9468ce3eab9abd69b7c53e6f09fc90f2e920e9a36551fe708951018621ab6" exitCode=0 Sep 10 11:30:17.535610 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:30:17.535264 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/redis-69bbd798b6-884sb" Sep 10 11:30:17.535610 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:30:17.535291 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/redis-69bbd798b6-884sb" event={"ID":"2d8dddbf-0a91-47a6-90de-970b876fde04","Type":"ContainerDied","Data":"a3a9468ce3eab9abd69b7c53e6f09fc90f2e920e9a36551fe708951018621ab6"} Sep 10 11:30:17.535610 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:30:17.535335 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/redis-69bbd798b6-884sb" event={"ID":"2d8dddbf-0a91-47a6-90de-970b876fde04","Type":"ContainerDied","Data":"b65df3004c6f371ae3827a3dd676d068ec7c8cd4dfc22bdc6aebaada9fc468be"} Sep 10 11:30:17.535610 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:30:17.535360 2564 scope.go:117] "RemoveContainer" containerID="a3a9468ce3eab9abd69b7c53e6f09fc90f2e920e9a36551fe708951018621ab6" Sep 10 11:30:17.538644 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:30:17.538622 2564 generic.go:356] "Generic (PLEG): container finished" podID="e2f2ef21-9a34-41ee-a782-9ec8fc0c6728" containerID="a0dc3ebb37662e55617c1229762437a99425b5d76fc4ff34f119bd969f83b884" exitCode=0 Sep 10 11:30:17.538748 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:30:17.538701 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-7f8668d9db-fcm2m" event={"ID":"e2f2ef21-9a34-41ee-a782-9ec8fc0c6728","Type":"ContainerDied","Data":"a0dc3ebb37662e55617c1229762437a99425b5d76fc4ff34f119bd969f83b884"} Sep 10 11:30:17.540353 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:30:17.540331 2564 generic.go:356] "Generic (PLEG): container finished" podID="e938502a-1308-41b3-83af-ff0ec2f02bfc" containerID="893839debb82d7a7f0385db8959054313922a5d3b7191c828f0f10b189314c4b" exitCode=0 Sep 10 11:30:17.540596 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:30:17.540393 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/postgres-864846d4f5-ms2w8" Sep 10 11:30:17.540704 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:30:17.540411 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/postgres-864846d4f5-ms2w8" event={"ID":"e938502a-1308-41b3-83af-ff0ec2f02bfc","Type":"ContainerDied","Data":"893839debb82d7a7f0385db8959054313922a5d3b7191c828f0f10b189314c4b"} Sep 10 11:30:17.540763 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:30:17.540722 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/postgres-864846d4f5-ms2w8" event={"ID":"e938502a-1308-41b3-83af-ff0ec2f02bfc","Type":"ContainerDied","Data":"8546346ef1e8de8785478ece3271ed9bac3ccc83dd0df664e176fde3f379e950"} Sep 10 11:30:17.543555 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:30:17.543532 2564 generic.go:356] "Generic (PLEG): container finished" podID="07af8c61-559f-4234-91bb-f3678779ff86" containerID="2f701c9e30c934c0355d40b633b37f306ebe07a8853709b81d0df390d9667cc2" exitCode=0 Sep 10 11:30:17.543660 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:30:17.543601 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-768dfbc75c-vl2ww" event={"ID":"07af8c61-559f-4234-91bb-f3678779ff86","Type":"ContainerDied","Data":"2f701c9e30c934c0355d40b633b37f306ebe07a8853709b81d0df390d9667cc2"} Sep 10 11:30:17.545616 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:30:17.545600 2564 scope.go:117] "RemoveContainer" containerID="a3a9468ce3eab9abd69b7c53e6f09fc90f2e920e9a36551fe708951018621ab6" Sep 10 11:30:17.545915 ip-10-0-134-73 kubenswrapper[2564]: E0910 11:30:17.545890 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a3a9468ce3eab9abd69b7c53e6f09fc90f2e920e9a36551fe708951018621ab6\": container with ID starting with a3a9468ce3eab9abd69b7c53e6f09fc90f2e920e9a36551fe708951018621ab6 not found: ID does not exist" containerID="a3a9468ce3eab9abd69b7c53e6f09fc90f2e920e9a36551fe708951018621ab6" Sep 10 11:30:17.545990 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:30:17.545920 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a3a9468ce3eab9abd69b7c53e6f09fc90f2e920e9a36551fe708951018621ab6"} err="failed to get container status \"a3a9468ce3eab9abd69b7c53e6f09fc90f2e920e9a36551fe708951018621ab6\": rpc error: code = NotFound desc = could not find container \"a3a9468ce3eab9abd69b7c53e6f09fc90f2e920e9a36551fe708951018621ab6\": container with ID starting with a3a9468ce3eab9abd69b7c53e6f09fc90f2e920e9a36551fe708951018621ab6 not found: ID does not exist" Sep 10 11:30:17.545990 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:30:17.545936 2564 scope.go:117] "RemoveContainer" containerID="893839debb82d7a7f0385db8959054313922a5d3b7191c828f0f10b189314c4b" Sep 10 11:30:17.553473 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:30:17.553459 2564 scope.go:117] "RemoveContainer" containerID="893839debb82d7a7f0385db8959054313922a5d3b7191c828f0f10b189314c4b" Sep 10 11:30:17.553755 ip-10-0-134-73 kubenswrapper[2564]: E0910 11:30:17.553731 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"893839debb82d7a7f0385db8959054313922a5d3b7191c828f0f10b189314c4b\": container with ID starting with 893839debb82d7a7f0385db8959054313922a5d3b7191c828f0f10b189314c4b not found: ID does not exist" containerID="893839debb82d7a7f0385db8959054313922a5d3b7191c828f0f10b189314c4b" Sep 10 11:30:17.553816 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:30:17.553762 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"893839debb82d7a7f0385db8959054313922a5d3b7191c828f0f10b189314c4b"} err="failed to get container status \"893839debb82d7a7f0385db8959054313922a5d3b7191c828f0f10b189314c4b\": rpc error: code = NotFound desc = could not find container \"893839debb82d7a7f0385db8959054313922a5d3b7191c828f0f10b189314c4b\": container with ID starting with 893839debb82d7a7f0385db8959054313922a5d3b7191c828f0f10b189314c4b not found: ID does not exist" Sep 10 11:30:17.637945 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:30:17.637916 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bqxgx\" (UniqueName: \"kubernetes.io/projected/2d8dddbf-0a91-47a6-90de-970b876fde04-kube-api-access-bqxgx\") pod \"2d8dddbf-0a91-47a6-90de-970b876fde04\" (UID: \"2d8dddbf-0a91-47a6-90de-970b876fde04\") " Sep 10 11:30:17.638081 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:30:17.637965 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9hrvc\" (UniqueName: \"kubernetes.io/projected/e938502a-1308-41b3-83af-ff0ec2f02bfc-kube-api-access-9hrvc\") pod \"e938502a-1308-41b3-83af-ff0ec2f02bfc\" (UID: \"e938502a-1308-41b3-83af-ff0ec2f02bfc\") " Sep 10 11:30:17.638081 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:30:17.638054 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/e938502a-1308-41b3-83af-ff0ec2f02bfc-postgresdata\") pod \"e938502a-1308-41b3-83af-ff0ec2f02bfc\" (UID: \"e938502a-1308-41b3-83af-ff0ec2f02bfc\") " Sep 10 11:30:17.640108 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:30:17.640068 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e938502a-1308-41b3-83af-ff0ec2f02bfc-kube-api-access-9hrvc" (OuterVolumeSpecName: "kube-api-access-9hrvc") pod "e938502a-1308-41b3-83af-ff0ec2f02bfc" (UID: "e938502a-1308-41b3-83af-ff0ec2f02bfc"). InnerVolumeSpecName "kube-api-access-9hrvc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 11:30:17.640216 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:30:17.640192 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2d8dddbf-0a91-47a6-90de-970b876fde04-kube-api-access-bqxgx" (OuterVolumeSpecName: "kube-api-access-bqxgx") pod "2d8dddbf-0a91-47a6-90de-970b876fde04" (UID: "2d8dddbf-0a91-47a6-90de-970b876fde04"). InnerVolumeSpecName "kube-api-access-bqxgx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 11:30:17.668265 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:30:17.668233 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e938502a-1308-41b3-83af-ff0ec2f02bfc-postgresdata" (OuterVolumeSpecName: "postgresdata") pod "e938502a-1308-41b3-83af-ff0ec2f02bfc" (UID: "e938502a-1308-41b3-83af-ff0ec2f02bfc"). InnerVolumeSpecName "postgresdata". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 10 11:30:17.738681 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:30:17.738651 2564 reconciler_common.go:299] "Volume detached for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/e938502a-1308-41b3-83af-ff0ec2f02bfc-postgresdata\") on node \"ip-10-0-134-73.ec2.internal\" DevicePath \"\"" Sep 10 11:30:17.738681 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:30:17.738677 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bqxgx\" (UniqueName: \"kubernetes.io/projected/2d8dddbf-0a91-47a6-90de-970b876fde04-kube-api-access-bqxgx\") on node \"ip-10-0-134-73.ec2.internal\" DevicePath \"\"" Sep 10 11:30:17.738681 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:30:17.738687 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9hrvc\" (UniqueName: \"kubernetes.io/projected/e938502a-1308-41b3-83af-ff0ec2f02bfc-kube-api-access-9hrvc\") on node \"ip-10-0-134-73.ec2.internal\" DevicePath \"\"" Sep 10 11:30:17.856048 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:30:17.856021 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast-rest/redis-69bbd798b6-884sb"] Sep 10 11:30:17.859696 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:30:17.859674 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast-rest/redis-69bbd798b6-884sb"] Sep 10 11:30:17.869585 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:30:17.869562 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast-rest/postgres-864846d4f5-ms2w8"] Sep 10 11:30:17.872116 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:30:17.872086 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast-rest/postgres-864846d4f5-ms2w8"] Sep 10 11:30:18.917257 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:30:18.917224 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2d8dddbf-0a91-47a6-90de-970b876fde04" path="/var/lib/kubelet/pods/2d8dddbf-0a91-47a6-90de-970b876fde04/volumes" Sep 10 11:30:18.917621 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:30:18.917546 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e938502a-1308-41b3-83af-ff0ec2f02bfc" path="/var/lib/kubelet/pods/e938502a-1308-41b3-83af-ff0ec2f02bfc/volumes" Sep 10 11:30:24.122739 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:30:24.122687 2564 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast-rest/feast-credit-scoring-768dfbc75c-vl2ww" podUID="07af8c61-559f-4234-91bb-f3678779ff86" containerName="online" probeResult="failure" output="Get \"https://10.132.0.31:6567/health\": dial tcp 10.132.0.31:6567: connect: connection refused" Sep 10 11:30:24.162677 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:30:24.162638 2564 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast-rest/feast-driver-ranking-7f8668d9db-fcm2m" podUID="e2f2ef21-9a34-41ee-a782-9ec8fc0c6728" containerName="online" probeResult="failure" output="Get \"https://10.132.0.32:6567/health\": dial tcp 10.132.0.32:6567: connect: connection refused" Sep 10 11:30:34.122645 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:30:34.122603 2564 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast-rest/feast-credit-scoring-768dfbc75c-vl2ww" podUID="07af8c61-559f-4234-91bb-f3678779ff86" containerName="online" probeResult="failure" output="Get \"https://10.132.0.31:6567/health\": dial tcp 10.132.0.31:6567: connect: connection refused" Sep 10 11:30:34.162651 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:30:34.162615 2564 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast-rest/feast-driver-ranking-7f8668d9db-fcm2m" podUID="e2f2ef21-9a34-41ee-a782-9ec8fc0c6728" containerName="online" probeResult="failure" output="Get \"https://10.132.0.32:6567/health\": dial tcp 10.132.0.32:6567: connect: connection refused" Sep 10 11:30:44.122789 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:30:44.122743 2564 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast-rest/feast-credit-scoring-768dfbc75c-vl2ww" podUID="07af8c61-559f-4234-91bb-f3678779ff86" containerName="online" probeResult="failure" output="Get \"https://10.132.0.31:6567/health\": dial tcp 10.132.0.31:6567: connect: connection refused" Sep 10 11:30:44.123208 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:30:44.122925 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast-rest/feast-credit-scoring-768dfbc75c-vl2ww" Sep 10 11:30:44.162966 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:30:44.162924 2564 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast-rest/feast-driver-ranking-7f8668d9db-fcm2m" podUID="e2f2ef21-9a34-41ee-a782-9ec8fc0c6728" containerName="online" probeResult="failure" output="Get \"https://10.132.0.32:6567/health\": dial tcp 10.132.0.32:6567: connect: connection refused" Sep 10 11:30:44.163115 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:30:44.163052 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast-rest/feast-driver-ranking-7f8668d9db-fcm2m" Sep 10 11:30:46.373868 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:30:46.373833 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/feast-credit-scoring-768dfbc75c-vl2ww" Sep 10 11:30:46.420277 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:30:46.420256 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/feast-driver-ranking-7f8668d9db-fcm2m" Sep 10 11:30:46.571585 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:30:46.571493 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/07af8c61-559f-4234-91bb-f3678779ff86-online-tls\") pod \"07af8c61-559f-4234-91bb-f3678779ff86\" (UID: \"07af8c61-559f-4234-91bb-f3678779ff86\") " Sep 10 11:30:46.571585 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:30:46.571533 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/e2f2ef21-9a34-41ee-a782-9ec8fc0c6728-online-tls\") pod \"e2f2ef21-9a34-41ee-a782-9ec8fc0c6728\" (UID: \"e2f2ef21-9a34-41ee-a782-9ec8fc0c6728\") " Sep 10 11:30:46.571585 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:30:46.571555 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/07af8c61-559f-4234-91bb-f3678779ff86-feast-data\") pod \"07af8c61-559f-4234-91bb-f3678779ff86\" (UID: \"07af8c61-559f-4234-91bb-f3678779ff86\") " Sep 10 11:30:46.571585 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:30:46.571582 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/e2f2ef21-9a34-41ee-a782-9ec8fc0c6728-feast-data\") pod \"e2f2ef21-9a34-41ee-a782-9ec8fc0c6728\" (UID: \"e2f2ef21-9a34-41ee-a782-9ec8fc0c6728\") " Sep 10 11:30:46.571911 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:30:46.571609 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/e2f2ef21-9a34-41ee-a782-9ec8fc0c6728-registry-tls\") pod \"e2f2ef21-9a34-41ee-a782-9ec8fc0c6728\" (UID: \"e2f2ef21-9a34-41ee-a782-9ec8fc0c6728\") " Sep 10 11:30:46.571911 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:30:46.571681 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z9bpc\" (UniqueName: \"kubernetes.io/projected/07af8c61-559f-4234-91bb-f3678779ff86-kube-api-access-z9bpc\") pod \"07af8c61-559f-4234-91bb-f3678779ff86\" (UID: \"07af8c61-559f-4234-91bb-f3678779ff86\") " Sep 10 11:30:46.571911 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:30:46.571710 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/07af8c61-559f-4234-91bb-f3678779ff86-registry-tls\") pod \"07af8c61-559f-4234-91bb-f3678779ff86\" (UID: \"07af8c61-559f-4234-91bb-f3678779ff86\") " Sep 10 11:30:46.571911 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:30:46.571760 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zm9sk\" (UniqueName: \"kubernetes.io/projected/e2f2ef21-9a34-41ee-a782-9ec8fc0c6728-kube-api-access-zm9sk\") pod \"e2f2ef21-9a34-41ee-a782-9ec8fc0c6728\" (UID: \"e2f2ef21-9a34-41ee-a782-9ec8fc0c6728\") " Sep 10 11:30:46.572136 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:30:46.572096 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e2f2ef21-9a34-41ee-a782-9ec8fc0c6728-feast-data" (OuterVolumeSpecName: "feast-data") pod "e2f2ef21-9a34-41ee-a782-9ec8fc0c6728" (UID: "e2f2ef21-9a34-41ee-a782-9ec8fc0c6728"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 10 11:30:46.574288 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:30:46.574250 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e2f2ef21-9a34-41ee-a782-9ec8fc0c6728-kube-api-access-zm9sk" (OuterVolumeSpecName: "kube-api-access-zm9sk") pod "e2f2ef21-9a34-41ee-a782-9ec8fc0c6728" (UID: "e2f2ef21-9a34-41ee-a782-9ec8fc0c6728"). InnerVolumeSpecName "kube-api-access-zm9sk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 11:30:46.574404 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:30:46.574283 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/07af8c61-559f-4234-91bb-f3678779ff86-online-tls" (OuterVolumeSpecName: "online-tls") pod "07af8c61-559f-4234-91bb-f3678779ff86" (UID: "07af8c61-559f-4234-91bb-f3678779ff86"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 10 11:30:46.574404 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:30:46.574289 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e2f2ef21-9a34-41ee-a782-9ec8fc0c6728-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "e2f2ef21-9a34-41ee-a782-9ec8fc0c6728" (UID: "e2f2ef21-9a34-41ee-a782-9ec8fc0c6728"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 10 11:30:46.574404 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:30:46.574361 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/07af8c61-559f-4234-91bb-f3678779ff86-kube-api-access-z9bpc" (OuterVolumeSpecName: "kube-api-access-z9bpc") pod "07af8c61-559f-4234-91bb-f3678779ff86" (UID: "07af8c61-559f-4234-91bb-f3678779ff86"). InnerVolumeSpecName "kube-api-access-z9bpc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 11:30:46.574634 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:30:46.574611 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/07af8c61-559f-4234-91bb-f3678779ff86-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "07af8c61-559f-4234-91bb-f3678779ff86" (UID: "07af8c61-559f-4234-91bb-f3678779ff86"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 10 11:30:46.574634 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:30:46.574622 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e2f2ef21-9a34-41ee-a782-9ec8fc0c6728-online-tls" (OuterVolumeSpecName: "online-tls") pod "e2f2ef21-9a34-41ee-a782-9ec8fc0c6728" (UID: "e2f2ef21-9a34-41ee-a782-9ec8fc0c6728"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 10 11:30:46.581474 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:30:46.581448 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/07af8c61-559f-4234-91bb-f3678779ff86-feast-data" (OuterVolumeSpecName: "feast-data") pod "07af8c61-559f-4234-91bb-f3678779ff86" (UID: "07af8c61-559f-4234-91bb-f3678779ff86"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 10 11:30:46.659431 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:30:46.659389 2564 generic.go:356] "Generic (PLEG): container finished" podID="07af8c61-559f-4234-91bb-f3678779ff86" containerID="e8f5652c82f6c2b2dcde5aadbf32459d5b86d42ca978dac6393473b0a3af2957" exitCode=137 Sep 10 11:30:46.659576 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:30:46.659455 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/feast-credit-scoring-768dfbc75c-vl2ww" Sep 10 11:30:46.659576 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:30:46.659472 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-768dfbc75c-vl2ww" event={"ID":"07af8c61-559f-4234-91bb-f3678779ff86","Type":"ContainerDied","Data":"e8f5652c82f6c2b2dcde5aadbf32459d5b86d42ca978dac6393473b0a3af2957"} Sep 10 11:30:46.659576 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:30:46.659535 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-768dfbc75c-vl2ww" event={"ID":"07af8c61-559f-4234-91bb-f3678779ff86","Type":"ContainerDied","Data":"8c69b41097eb18bdff0499258be7e17cf65c47f99db31a1ff6450697ad240720"} Sep 10 11:30:46.659576 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:30:46.659563 2564 scope.go:117] "RemoveContainer" containerID="2f701c9e30c934c0355d40b633b37f306ebe07a8853709b81d0df390d9667cc2" Sep 10 11:30:46.662019 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:30:46.661997 2564 generic.go:356] "Generic (PLEG): container finished" podID="e2f2ef21-9a34-41ee-a782-9ec8fc0c6728" containerID="9f65d0233b6477d1eb2ebbb5dc5ea2ac4a296f6773445b77ed732ddf04746e91" exitCode=137 Sep 10 11:30:46.662119 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:30:46.662066 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-7f8668d9db-fcm2m" event={"ID":"e2f2ef21-9a34-41ee-a782-9ec8fc0c6728","Type":"ContainerDied","Data":"9f65d0233b6477d1eb2ebbb5dc5ea2ac4a296f6773445b77ed732ddf04746e91"} Sep 10 11:30:46.662119 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:30:46.662076 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/feast-driver-ranking-7f8668d9db-fcm2m" Sep 10 11:30:46.662119 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:30:46.662095 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-7f8668d9db-fcm2m" event={"ID":"e2f2ef21-9a34-41ee-a782-9ec8fc0c6728","Type":"ContainerDied","Data":"540098fbad6676c3274672669fa3ad3a21564a8d8b13b679ec4e28116b38f4c6"} Sep 10 11:30:46.668447 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:30:46.668426 2564 scope.go:117] "RemoveContainer" containerID="e8f5652c82f6c2b2dcde5aadbf32459d5b86d42ca978dac6393473b0a3af2957" Sep 10 11:30:46.672367 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:30:46.672280 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z9bpc\" (UniqueName: \"kubernetes.io/projected/07af8c61-559f-4234-91bb-f3678779ff86-kube-api-access-z9bpc\") on node \"ip-10-0-134-73.ec2.internal\" DevicePath \"\"" Sep 10 11:30:46.672367 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:30:46.672297 2564 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/07af8c61-559f-4234-91bb-f3678779ff86-registry-tls\") on node \"ip-10-0-134-73.ec2.internal\" DevicePath \"\"" Sep 10 11:30:46.672367 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:30:46.672311 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zm9sk\" (UniqueName: \"kubernetes.io/projected/e2f2ef21-9a34-41ee-a782-9ec8fc0c6728-kube-api-access-zm9sk\") on node \"ip-10-0-134-73.ec2.internal\" DevicePath \"\"" Sep 10 11:30:46.672367 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:30:46.672351 2564 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/07af8c61-559f-4234-91bb-f3678779ff86-online-tls\") on node \"ip-10-0-134-73.ec2.internal\" DevicePath \"\"" Sep 10 11:30:46.672367 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:30:46.672365 2564 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/e2f2ef21-9a34-41ee-a782-9ec8fc0c6728-online-tls\") on node \"ip-10-0-134-73.ec2.internal\" DevicePath \"\"" Sep 10 11:30:46.672573 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:30:46.672377 2564 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/07af8c61-559f-4234-91bb-f3678779ff86-feast-data\") on node \"ip-10-0-134-73.ec2.internal\" DevicePath \"\"" Sep 10 11:30:46.672573 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:30:46.672390 2564 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/e2f2ef21-9a34-41ee-a782-9ec8fc0c6728-feast-data\") on node \"ip-10-0-134-73.ec2.internal\" DevicePath \"\"" Sep 10 11:30:46.672573 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:30:46.672403 2564 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/e2f2ef21-9a34-41ee-a782-9ec8fc0c6728-registry-tls\") on node \"ip-10-0-134-73.ec2.internal\" DevicePath \"\"" Sep 10 11:30:46.677233 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:30:46.677218 2564 scope.go:117] "RemoveContainer" containerID="aaaac3d08b438de2d7c710270c3daab259caf9f458be622ab0d9bb0e289d1998" Sep 10 11:30:46.683045 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:30:46.683022 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast-rest/feast-credit-scoring-768dfbc75c-vl2ww"] Sep 10 11:30:46.685047 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:30:46.685029 2564 scope.go:117] "RemoveContainer" containerID="bcd592f574d5354f5b0a5fa6a6a08123c9062c6c4637a4b5595ab930ac913838" Sep 10 11:30:46.686010 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:30:46.685992 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast-rest/feast-credit-scoring-768dfbc75c-vl2ww"] Sep 10 11:30:46.692360 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:30:46.692343 2564 scope.go:117] "RemoveContainer" containerID="2f701c9e30c934c0355d40b633b37f306ebe07a8853709b81d0df390d9667cc2" Sep 10 11:30:46.692618 ip-10-0-134-73 kubenswrapper[2564]: E0910 11:30:46.692593 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2f701c9e30c934c0355d40b633b37f306ebe07a8853709b81d0df390d9667cc2\": container with ID starting with 2f701c9e30c934c0355d40b633b37f306ebe07a8853709b81d0df390d9667cc2 not found: ID does not exist" containerID="2f701c9e30c934c0355d40b633b37f306ebe07a8853709b81d0df390d9667cc2" Sep 10 11:30:46.692676 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:30:46.692622 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2f701c9e30c934c0355d40b633b37f306ebe07a8853709b81d0df390d9667cc2"} err="failed to get container status \"2f701c9e30c934c0355d40b633b37f306ebe07a8853709b81d0df390d9667cc2\": rpc error: code = NotFound desc = could not find container \"2f701c9e30c934c0355d40b633b37f306ebe07a8853709b81d0df390d9667cc2\": container with ID starting with 2f701c9e30c934c0355d40b633b37f306ebe07a8853709b81d0df390d9667cc2 not found: ID does not exist" Sep 10 11:30:46.692676 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:30:46.692640 2564 scope.go:117] "RemoveContainer" containerID="e8f5652c82f6c2b2dcde5aadbf32459d5b86d42ca978dac6393473b0a3af2957" Sep 10 11:30:46.692897 ip-10-0-134-73 kubenswrapper[2564]: E0910 11:30:46.692875 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e8f5652c82f6c2b2dcde5aadbf32459d5b86d42ca978dac6393473b0a3af2957\": container with ID starting with e8f5652c82f6c2b2dcde5aadbf32459d5b86d42ca978dac6393473b0a3af2957 not found: ID does not exist" containerID="e8f5652c82f6c2b2dcde5aadbf32459d5b86d42ca978dac6393473b0a3af2957" Sep 10 11:30:46.692942 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:30:46.692906 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e8f5652c82f6c2b2dcde5aadbf32459d5b86d42ca978dac6393473b0a3af2957"} err="failed to get container status \"e8f5652c82f6c2b2dcde5aadbf32459d5b86d42ca978dac6393473b0a3af2957\": rpc error: code = NotFound desc = could not find container \"e8f5652c82f6c2b2dcde5aadbf32459d5b86d42ca978dac6393473b0a3af2957\": container with ID starting with e8f5652c82f6c2b2dcde5aadbf32459d5b86d42ca978dac6393473b0a3af2957 not found: ID does not exist" Sep 10 11:30:46.692942 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:30:46.692928 2564 scope.go:117] "RemoveContainer" containerID="aaaac3d08b438de2d7c710270c3daab259caf9f458be622ab0d9bb0e289d1998" Sep 10 11:30:46.693208 ip-10-0-134-73 kubenswrapper[2564]: E0910 11:30:46.693164 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"aaaac3d08b438de2d7c710270c3daab259caf9f458be622ab0d9bb0e289d1998\": container with ID starting with aaaac3d08b438de2d7c710270c3daab259caf9f458be622ab0d9bb0e289d1998 not found: ID does not exist" containerID="aaaac3d08b438de2d7c710270c3daab259caf9f458be622ab0d9bb0e289d1998" Sep 10 11:30:46.693208 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:30:46.693187 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aaaac3d08b438de2d7c710270c3daab259caf9f458be622ab0d9bb0e289d1998"} err="failed to get container status \"aaaac3d08b438de2d7c710270c3daab259caf9f458be622ab0d9bb0e289d1998\": rpc error: code = NotFound desc = could not find container \"aaaac3d08b438de2d7c710270c3daab259caf9f458be622ab0d9bb0e289d1998\": container with ID starting with aaaac3d08b438de2d7c710270c3daab259caf9f458be622ab0d9bb0e289d1998 not found: ID does not exist" Sep 10 11:30:46.693208 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:30:46.693202 2564 scope.go:117] "RemoveContainer" containerID="bcd592f574d5354f5b0a5fa6a6a08123c9062c6c4637a4b5595ab930ac913838" Sep 10 11:30:46.693550 ip-10-0-134-73 kubenswrapper[2564]: E0910 11:30:46.693524 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bcd592f574d5354f5b0a5fa6a6a08123c9062c6c4637a4b5595ab930ac913838\": container with ID starting with bcd592f574d5354f5b0a5fa6a6a08123c9062c6c4637a4b5595ab930ac913838 not found: ID does not exist" containerID="bcd592f574d5354f5b0a5fa6a6a08123c9062c6c4637a4b5595ab930ac913838" Sep 10 11:30:46.693659 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:30:46.693556 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bcd592f574d5354f5b0a5fa6a6a08123c9062c6c4637a4b5595ab930ac913838"} err="failed to get container status \"bcd592f574d5354f5b0a5fa6a6a08123c9062c6c4637a4b5595ab930ac913838\": rpc error: code = NotFound desc = could not find container \"bcd592f574d5354f5b0a5fa6a6a08123c9062c6c4637a4b5595ab930ac913838\": container with ID starting with bcd592f574d5354f5b0a5fa6a6a08123c9062c6c4637a4b5595ab930ac913838 not found: ID does not exist" Sep 10 11:30:46.693659 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:30:46.693582 2564 scope.go:117] "RemoveContainer" containerID="a0dc3ebb37662e55617c1229762437a99425b5d76fc4ff34f119bd969f83b884" Sep 10 11:30:46.694959 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:30:46.694940 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast-rest/feast-driver-ranking-7f8668d9db-fcm2m"] Sep 10 11:30:46.698195 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:30:46.698177 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast-rest/feast-driver-ranking-7f8668d9db-fcm2m"] Sep 10 11:30:46.701588 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:30:46.701573 2564 scope.go:117] "RemoveContainer" containerID="9f65d0233b6477d1eb2ebbb5dc5ea2ac4a296f6773445b77ed732ddf04746e91" Sep 10 11:30:46.708363 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:30:46.708347 2564 scope.go:117] "RemoveContainer" containerID="9859931d7531fe2449a8f4d578967fcfddd41ee419b934a4796a545be7fb7904" Sep 10 11:30:46.715066 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:30:46.715048 2564 scope.go:117] "RemoveContainer" containerID="f462c5c008cfa6c12650da1e0f455ee53ebf32b1ef2ae62f12fbcf79d4f6a6bd" Sep 10 11:30:46.721805 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:30:46.721786 2564 scope.go:117] "RemoveContainer" containerID="a0dc3ebb37662e55617c1229762437a99425b5d76fc4ff34f119bd969f83b884" Sep 10 11:30:46.722113 ip-10-0-134-73 kubenswrapper[2564]: E0910 11:30:46.722095 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a0dc3ebb37662e55617c1229762437a99425b5d76fc4ff34f119bd969f83b884\": container with ID starting with a0dc3ebb37662e55617c1229762437a99425b5d76fc4ff34f119bd969f83b884 not found: ID does not exist" containerID="a0dc3ebb37662e55617c1229762437a99425b5d76fc4ff34f119bd969f83b884" Sep 10 11:30:46.722297 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:30:46.722125 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a0dc3ebb37662e55617c1229762437a99425b5d76fc4ff34f119bd969f83b884"} err="failed to get container status \"a0dc3ebb37662e55617c1229762437a99425b5d76fc4ff34f119bd969f83b884\": rpc error: code = NotFound desc = could not find container \"a0dc3ebb37662e55617c1229762437a99425b5d76fc4ff34f119bd969f83b884\": container with ID starting with a0dc3ebb37662e55617c1229762437a99425b5d76fc4ff34f119bd969f83b884 not found: ID does not exist" Sep 10 11:30:46.722297 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:30:46.722144 2564 scope.go:117] "RemoveContainer" containerID="9f65d0233b6477d1eb2ebbb5dc5ea2ac4a296f6773445b77ed732ddf04746e91" Sep 10 11:30:46.722427 ip-10-0-134-73 kubenswrapper[2564]: E0910 11:30:46.722409 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9f65d0233b6477d1eb2ebbb5dc5ea2ac4a296f6773445b77ed732ddf04746e91\": container with ID starting with 9f65d0233b6477d1eb2ebbb5dc5ea2ac4a296f6773445b77ed732ddf04746e91 not found: ID does not exist" containerID="9f65d0233b6477d1eb2ebbb5dc5ea2ac4a296f6773445b77ed732ddf04746e91" Sep 10 11:30:46.722465 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:30:46.722440 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9f65d0233b6477d1eb2ebbb5dc5ea2ac4a296f6773445b77ed732ddf04746e91"} err="failed to get container status \"9f65d0233b6477d1eb2ebbb5dc5ea2ac4a296f6773445b77ed732ddf04746e91\": rpc error: code = NotFound desc = could not find container \"9f65d0233b6477d1eb2ebbb5dc5ea2ac4a296f6773445b77ed732ddf04746e91\": container with ID starting with 9f65d0233b6477d1eb2ebbb5dc5ea2ac4a296f6773445b77ed732ddf04746e91 not found: ID does not exist" Sep 10 11:30:46.722465 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:30:46.722455 2564 scope.go:117] "RemoveContainer" containerID="9859931d7531fe2449a8f4d578967fcfddd41ee419b934a4796a545be7fb7904" Sep 10 11:30:46.722697 ip-10-0-134-73 kubenswrapper[2564]: E0910 11:30:46.722680 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9859931d7531fe2449a8f4d578967fcfddd41ee419b934a4796a545be7fb7904\": container with ID starting with 9859931d7531fe2449a8f4d578967fcfddd41ee419b934a4796a545be7fb7904 not found: ID does not exist" containerID="9859931d7531fe2449a8f4d578967fcfddd41ee419b934a4796a545be7fb7904" Sep 10 11:30:46.722760 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:30:46.722697 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9859931d7531fe2449a8f4d578967fcfddd41ee419b934a4796a545be7fb7904"} err="failed to get container status \"9859931d7531fe2449a8f4d578967fcfddd41ee419b934a4796a545be7fb7904\": rpc error: code = NotFound desc = could not find container \"9859931d7531fe2449a8f4d578967fcfddd41ee419b934a4796a545be7fb7904\": container with ID starting with 9859931d7531fe2449a8f4d578967fcfddd41ee419b934a4796a545be7fb7904 not found: ID does not exist" Sep 10 11:30:46.722760 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:30:46.722708 2564 scope.go:117] "RemoveContainer" containerID="f462c5c008cfa6c12650da1e0f455ee53ebf32b1ef2ae62f12fbcf79d4f6a6bd" Sep 10 11:30:46.723026 ip-10-0-134-73 kubenswrapper[2564]: E0910 11:30:46.722948 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f462c5c008cfa6c12650da1e0f455ee53ebf32b1ef2ae62f12fbcf79d4f6a6bd\": container with ID starting with f462c5c008cfa6c12650da1e0f455ee53ebf32b1ef2ae62f12fbcf79d4f6a6bd not found: ID does not exist" containerID="f462c5c008cfa6c12650da1e0f455ee53ebf32b1ef2ae62f12fbcf79d4f6a6bd" Sep 10 11:30:46.723026 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:30:46.722967 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f462c5c008cfa6c12650da1e0f455ee53ebf32b1ef2ae62f12fbcf79d4f6a6bd"} err="failed to get container status \"f462c5c008cfa6c12650da1e0f455ee53ebf32b1ef2ae62f12fbcf79d4f6a6bd\": rpc error: code = NotFound desc = could not find container \"f462c5c008cfa6c12650da1e0f455ee53ebf32b1ef2ae62f12fbcf79d4f6a6bd\": container with ID starting with f462c5c008cfa6c12650da1e0f455ee53ebf32b1ef2ae62f12fbcf79d4f6a6bd not found: ID does not exist" Sep 10 11:30:46.917032 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:30:46.917000 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="07af8c61-559f-4234-91bb-f3678779ff86" path="/var/lib/kubelet/pods/07af8c61-559f-4234-91bb-f3678779ff86/volumes" Sep 10 11:30:46.917494 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:30:46.917481 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e2f2ef21-9a34-41ee-a782-9ec8fc0c6728" path="/var/lib/kubelet/pods/e2f2ef21-9a34-41ee-a782-9ec8fc0c6728/volumes" Sep 10 11:32:14.893386 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:32:14.893356 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-l2hf2_7f298f77-06d2-4ea6-b4fc-cb2c5e9080de/console-operator/1.log" Sep 10 11:32:14.894986 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:32:14.894965 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-l2hf2_7f298f77-06d2-4ea6-b4fc-cb2c5e9080de/console-operator/1.log" Sep 10 11:37:13.024817 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:37:13.024779 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-p9mpn/must-gather-klkcl"] Sep 10 11:37:13.025245 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:37:13.025085 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e2f2ef21-9a34-41ee-a782-9ec8fc0c6728" containerName="registry" Sep 10 11:37:13.025245 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:37:13.025097 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="e2f2ef21-9a34-41ee-a782-9ec8fc0c6728" containerName="registry" Sep 10 11:37:13.025245 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:37:13.025109 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="07af8c61-559f-4234-91bb-f3678779ff86" containerName="registry" Sep 10 11:37:13.025245 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:37:13.025115 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="07af8c61-559f-4234-91bb-f3678779ff86" containerName="registry" Sep 10 11:37:13.025245 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:37:13.025125 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="07af8c61-559f-4234-91bb-f3678779ff86" containerName="feast-init" Sep 10 11:37:13.025245 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:37:13.025130 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="07af8c61-559f-4234-91bb-f3678779ff86" containerName="feast-init" Sep 10 11:37:13.025245 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:37:13.025141 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e2f2ef21-9a34-41ee-a782-9ec8fc0c6728" containerName="online" Sep 10 11:37:13.025245 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:37:13.025146 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="e2f2ef21-9a34-41ee-a782-9ec8fc0c6728" containerName="online" Sep 10 11:37:13.025245 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:37:13.025152 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5a8e836f-0e99-49e5-be42-68431d7c0aff" containerName="manager" Sep 10 11:37:13.025245 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:37:13.025158 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="5a8e836f-0e99-49e5-be42-68431d7c0aff" containerName="manager" Sep 10 11:37:13.025245 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:37:13.025164 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e2f2ef21-9a34-41ee-a782-9ec8fc0c6728" containerName="feast-apply" Sep 10 11:37:13.025245 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:37:13.025169 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="e2f2ef21-9a34-41ee-a782-9ec8fc0c6728" containerName="feast-apply" Sep 10 11:37:13.025245 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:37:13.025175 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="07af8c61-559f-4234-91bb-f3678779ff86" containerName="feast-apply" Sep 10 11:37:13.025245 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:37:13.025181 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="07af8c61-559f-4234-91bb-f3678779ff86" containerName="feast-apply" Sep 10 11:37:13.025245 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:37:13.025188 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2d8dddbf-0a91-47a6-90de-970b876fde04" containerName="redis" Sep 10 11:37:13.025245 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:37:13.025193 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="2d8dddbf-0a91-47a6-90de-970b876fde04" containerName="redis" Sep 10 11:37:13.025245 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:37:13.025199 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e938502a-1308-41b3-83af-ff0ec2f02bfc" containerName="postgres" Sep 10 11:37:13.025245 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:37:13.025204 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="e938502a-1308-41b3-83af-ff0ec2f02bfc" containerName="postgres" Sep 10 11:37:13.025245 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:37:13.025209 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e2f2ef21-9a34-41ee-a782-9ec8fc0c6728" containerName="feast-init" Sep 10 11:37:13.025245 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:37:13.025213 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="e2f2ef21-9a34-41ee-a782-9ec8fc0c6728" containerName="feast-init" Sep 10 11:37:13.025245 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:37:13.025223 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="07af8c61-559f-4234-91bb-f3678779ff86" containerName="online" Sep 10 11:37:13.025245 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:37:13.025228 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="07af8c61-559f-4234-91bb-f3678779ff86" containerName="online" Sep 10 11:37:13.025977 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:37:13.025276 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="e938502a-1308-41b3-83af-ff0ec2f02bfc" containerName="postgres" Sep 10 11:37:13.025977 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:37:13.025284 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="2d8dddbf-0a91-47a6-90de-970b876fde04" containerName="redis" Sep 10 11:37:13.025977 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:37:13.025291 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="07af8c61-559f-4234-91bb-f3678779ff86" containerName="registry" Sep 10 11:37:13.025977 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:37:13.025296 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="07af8c61-559f-4234-91bb-f3678779ff86" containerName="online" Sep 10 11:37:13.025977 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:37:13.025302 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="e2f2ef21-9a34-41ee-a782-9ec8fc0c6728" containerName="online" Sep 10 11:37:13.025977 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:37:13.025307 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="e2f2ef21-9a34-41ee-a782-9ec8fc0c6728" containerName="registry" Sep 10 11:37:13.025977 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:37:13.025312 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="5a8e836f-0e99-49e5-be42-68431d7c0aff" containerName="manager" Sep 10 11:37:13.028157 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:37:13.028142 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-p9mpn/must-gather-klkcl" Sep 10 11:37:13.031500 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:37:13.031481 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-p9mpn\"/\"default-dockercfg-2bxrp\"" Sep 10 11:37:13.032415 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:37:13.032396 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-p9mpn\"/\"openshift-service-ca.crt\"" Sep 10 11:37:13.033000 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:37:13.032982 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-p9mpn\"/\"kube-root-ca.crt\"" Sep 10 11:37:13.043486 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:37:13.043463 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-p9mpn/must-gather-klkcl"] Sep 10 11:37:13.067800 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:37:13.067770 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/ffdcdc93-00b2-4d6f-bf23-97eac9e4fba3-must-gather-output\") pod \"must-gather-klkcl\" (UID: \"ffdcdc93-00b2-4d6f-bf23-97eac9e4fba3\") " pod="openshift-must-gather-p9mpn/must-gather-klkcl" Sep 10 11:37:13.067957 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:37:13.067811 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xh4f5\" (UniqueName: \"kubernetes.io/projected/ffdcdc93-00b2-4d6f-bf23-97eac9e4fba3-kube-api-access-xh4f5\") pod \"must-gather-klkcl\" (UID: \"ffdcdc93-00b2-4d6f-bf23-97eac9e4fba3\") " pod="openshift-must-gather-p9mpn/must-gather-klkcl" Sep 10 11:37:13.168537 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:37:13.168505 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xh4f5\" (UniqueName: \"kubernetes.io/projected/ffdcdc93-00b2-4d6f-bf23-97eac9e4fba3-kube-api-access-xh4f5\") pod \"must-gather-klkcl\" (UID: \"ffdcdc93-00b2-4d6f-bf23-97eac9e4fba3\") " pod="openshift-must-gather-p9mpn/must-gather-klkcl" Sep 10 11:37:13.168729 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:37:13.168577 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/ffdcdc93-00b2-4d6f-bf23-97eac9e4fba3-must-gather-output\") pod \"must-gather-klkcl\" (UID: \"ffdcdc93-00b2-4d6f-bf23-97eac9e4fba3\") " pod="openshift-must-gather-p9mpn/must-gather-klkcl" Sep 10 11:37:13.168954 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:37:13.168935 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/ffdcdc93-00b2-4d6f-bf23-97eac9e4fba3-must-gather-output\") pod \"must-gather-klkcl\" (UID: \"ffdcdc93-00b2-4d6f-bf23-97eac9e4fba3\") " pod="openshift-must-gather-p9mpn/must-gather-klkcl" Sep 10 11:37:13.177116 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:37:13.177095 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xh4f5\" (UniqueName: \"kubernetes.io/projected/ffdcdc93-00b2-4d6f-bf23-97eac9e4fba3-kube-api-access-xh4f5\") pod \"must-gather-klkcl\" (UID: \"ffdcdc93-00b2-4d6f-bf23-97eac9e4fba3\") " pod="openshift-must-gather-p9mpn/must-gather-klkcl" Sep 10 11:37:13.346463 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:37:13.346376 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-p9mpn/must-gather-klkcl" Sep 10 11:37:13.617546 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:37:13.617513 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-p9mpn/must-gather-klkcl"] Sep 10 11:37:13.621187 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:37:13.621158 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podffdcdc93_00b2_4d6f_bf23_97eac9e4fba3.slice/crio-c5b5b53b0bb4a262dc09064b4620995b7e740d36739817eb35b12f503f3f9072 WatchSource:0}: Error finding container c5b5b53b0bb4a262dc09064b4620995b7e740d36739817eb35b12f503f3f9072: Status 404 returned error can't find the container with id c5b5b53b0bb4a262dc09064b4620995b7e740d36739817eb35b12f503f3f9072 Sep 10 11:37:13.623140 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:37:13.623123 2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 10 11:37:14.103511 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:37:14.103481 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-p9mpn/must-gather-klkcl" event={"ID":"ffdcdc93-00b2-4d6f-bf23-97eac9e4fba3","Type":"ContainerStarted","Data":"c5b5b53b0bb4a262dc09064b4620995b7e740d36739817eb35b12f503f3f9072"} Sep 10 11:37:14.928756 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:37:14.928724 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-l2hf2_7f298f77-06d2-4ea6-b4fc-cb2c5e9080de/console-operator/1.log" Sep 10 11:37:14.929440 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:37:14.929245 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-l2hf2_7f298f77-06d2-4ea6-b4fc-cb2c5e9080de/console-operator/1.log" Sep 10 11:37:20.139084 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:37:20.139042 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-p9mpn/must-gather-klkcl" event={"ID":"ffdcdc93-00b2-4d6f-bf23-97eac9e4fba3","Type":"ContainerStarted","Data":"2c50af11d532a92cd8065d6ed3315161faa61c0acb6fa5be411cb3c8674fd799"} Sep 10 11:37:20.139084 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:37:20.139086 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-p9mpn/must-gather-klkcl" event={"ID":"ffdcdc93-00b2-4d6f-bf23-97eac9e4fba3","Type":"ContainerStarted","Data":"f98e9c1d4899cd6a9e2414e6884ceb6b0d3bf397cc734f832a9e2fba224a2153"} Sep 10 11:37:20.155452 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:37:20.155405 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-p9mpn/must-gather-klkcl" podStartSLOduration=1.9586902510000002 podStartE2EDuration="8.155389864s" totalImagesPullingTime="6.196699613s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 11:37:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 11:37:20.154029052 +0000 UTC m=+1505.750590266" watchObservedRunningTime="2026-09-10 11:37:20.155389864 +0000 UTC m=+1505.751951079" Sep 10 11:37:30.182247 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:37:30.182210 2564 generic.go:356] "Generic (PLEG): container finished" podID="ffdcdc93-00b2-4d6f-bf23-97eac9e4fba3" containerID="f98e9c1d4899cd6a9e2414e6884ceb6b0d3bf397cc734f832a9e2fba224a2153" exitCode=0 Sep 10 11:37:30.182766 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:37:30.182285 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-p9mpn/must-gather-klkcl" event={"ID":"ffdcdc93-00b2-4d6f-bf23-97eac9e4fba3","Type":"ContainerDied","Data":"f98e9c1d4899cd6a9e2414e6884ceb6b0d3bf397cc734f832a9e2fba224a2153"} Sep 10 11:37:30.182766 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:37:30.182662 2564 scope.go:117] "RemoveContainer" containerID="f98e9c1d4899cd6a9e2414e6884ceb6b0d3bf397cc734f832a9e2fba224a2153" Sep 10 11:37:30.391918 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:37:30.391882 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-p9mpn_must-gather-klkcl_ffdcdc93-00b2-4d6f-bf23-97eac9e4fba3/gather/0.log" Sep 10 11:37:33.768081 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:37:33.768048 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-kxss9_c61d89d6-ef29-42ae-aa25-e350ab385462/global-pull-secret-syncer/0.log" Sep 10 11:37:33.847921 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:37:33.847894 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-pq4ct_77142edb-57e1-4da1-8eba-f104366a851f/konnectivity-agent/0.log" Sep 10 11:37:33.927980 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:37:33.927952 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-134-73.ec2.internal_fa04fa410118647777397f100391d4d1/haproxy/0.log" Sep 10 11:37:35.721775 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:37:35.721734 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-must-gather-p9mpn/must-gather-klkcl"] Sep 10 11:37:35.722355 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:37:35.721983 2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-must-gather-p9mpn/must-gather-klkcl" podUID="ffdcdc93-00b2-4d6f-bf23-97eac9e4fba3" containerName="copy" containerID="cri-o://2c50af11d532a92cd8065d6ed3315161faa61c0acb6fa5be411cb3c8674fd799" gracePeriod=2 Sep 10 11:37:35.728379 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:37:35.728355 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-must-gather-p9mpn/must-gather-klkcl"] Sep 10 11:37:35.729914 ip-10-0-134-73 kubenswrapper[2564]: E0910 11:37:35.729885 2564 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"ffdcdc93-00b2-4d6f-bf23-97eac9e4fba3\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"openshift-must-gather-p9mpn\"/\"must-gather-klkcl\": pods \"must-gather-klkcl\" not found" pod="openshift-must-gather-p9mpn/must-gather-klkcl" Sep 10 11:37:35.952985 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:37:35.952961 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-p9mpn_must-gather-klkcl_ffdcdc93-00b2-4d6f-bf23-97eac9e4fba3/copy/0.log" Sep 10 11:37:35.955517 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:37:35.955499 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-p9mpn/must-gather-klkcl" Sep 10 11:37:35.957653 ip-10-0-134-73 kubenswrapper[2564]: E0910 11:37:35.957627 2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-klkcl\" is forbidden: User \"system:node:ip-10-0-134-73.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-p9mpn\": no relationship found between node 'ip-10-0-134-73.ec2.internal' and this object" podUID="ffdcdc93-00b2-4d6f-bf23-97eac9e4fba3" pod="openshift-must-gather-p9mpn/must-gather-klkcl" Sep 10 11:37:36.035523 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:37:36.035452 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/ffdcdc93-00b2-4d6f-bf23-97eac9e4fba3-must-gather-output\") pod \"ffdcdc93-00b2-4d6f-bf23-97eac9e4fba3\" (UID: \"ffdcdc93-00b2-4d6f-bf23-97eac9e4fba3\") " Sep 10 11:37:36.035523 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:37:36.035523 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xh4f5\" (UniqueName: \"kubernetes.io/projected/ffdcdc93-00b2-4d6f-bf23-97eac9e4fba3-kube-api-access-xh4f5\") pod \"ffdcdc93-00b2-4d6f-bf23-97eac9e4fba3\" (UID: \"ffdcdc93-00b2-4d6f-bf23-97eac9e4fba3\") " Sep 10 11:37:36.035831 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:37:36.035803 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ffdcdc93-00b2-4d6f-bf23-97eac9e4fba3-must-gather-output" (OuterVolumeSpecName: "must-gather-output") pod "ffdcdc93-00b2-4d6f-bf23-97eac9e4fba3" (UID: "ffdcdc93-00b2-4d6f-bf23-97eac9e4fba3"). InnerVolumeSpecName "must-gather-output". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 10 11:37:36.037709 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:37:36.037688 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ffdcdc93-00b2-4d6f-bf23-97eac9e4fba3-kube-api-access-xh4f5" (OuterVolumeSpecName: "kube-api-access-xh4f5") pod "ffdcdc93-00b2-4d6f-bf23-97eac9e4fba3" (UID: "ffdcdc93-00b2-4d6f-bf23-97eac9e4fba3"). InnerVolumeSpecName "kube-api-access-xh4f5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 11:37:36.136170 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:37:36.136138 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xh4f5\" (UniqueName: \"kubernetes.io/projected/ffdcdc93-00b2-4d6f-bf23-97eac9e4fba3-kube-api-access-xh4f5\") on node \"ip-10-0-134-73.ec2.internal\" DevicePath \"\"" Sep 10 11:37:36.136170 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:37:36.136163 2564 reconciler_common.go:299] "Volume detached for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/ffdcdc93-00b2-4d6f-bf23-97eac9e4fba3-must-gather-output\") on node \"ip-10-0-134-73.ec2.internal\" DevicePath \"\"" Sep 10 11:37:36.207055 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:37:36.207032 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-p9mpn_must-gather-klkcl_ffdcdc93-00b2-4d6f-bf23-97eac9e4fba3/copy/0.log" Sep 10 11:37:36.207382 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:37:36.207359 2564 generic.go:356] "Generic (PLEG): container finished" podID="ffdcdc93-00b2-4d6f-bf23-97eac9e4fba3" containerID="2c50af11d532a92cd8065d6ed3315161faa61c0acb6fa5be411cb3c8674fd799" exitCode=143 Sep 10 11:37:36.207468 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:37:36.207412 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-p9mpn/must-gather-klkcl" Sep 10 11:37:36.207468 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:37:36.207462 2564 scope.go:117] "RemoveContainer" containerID="2c50af11d532a92cd8065d6ed3315161faa61c0acb6fa5be411cb3c8674fd799" Sep 10 11:37:36.210077 ip-10-0-134-73 kubenswrapper[2564]: E0910 11:37:36.210046 2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-klkcl\" is forbidden: User \"system:node:ip-10-0-134-73.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-p9mpn\": no relationship found between node 'ip-10-0-134-73.ec2.internal' and this object" podUID="ffdcdc93-00b2-4d6f-bf23-97eac9e4fba3" pod="openshift-must-gather-p9mpn/must-gather-klkcl" Sep 10 11:37:36.216130 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:37:36.215940 2564 scope.go:117] "RemoveContainer" containerID="f98e9c1d4899cd6a9e2414e6884ceb6b0d3bf397cc734f832a9e2fba224a2153" Sep 10 11:37:36.217791 ip-10-0-134-73 kubenswrapper[2564]: E0910 11:37:36.217768 2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-klkcl\" is forbidden: User \"system:node:ip-10-0-134-73.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-p9mpn\": no relationship found between node 'ip-10-0-134-73.ec2.internal' and this object" podUID="ffdcdc93-00b2-4d6f-bf23-97eac9e4fba3" pod="openshift-must-gather-p9mpn/must-gather-klkcl" Sep 10 11:37:36.227771 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:37:36.227754 2564 scope.go:117] "RemoveContainer" containerID="2c50af11d532a92cd8065d6ed3315161faa61c0acb6fa5be411cb3c8674fd799" Sep 10 11:37:36.228051 ip-10-0-134-73 kubenswrapper[2564]: E0910 11:37:36.228032 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2c50af11d532a92cd8065d6ed3315161faa61c0acb6fa5be411cb3c8674fd799\": container with ID starting with 2c50af11d532a92cd8065d6ed3315161faa61c0acb6fa5be411cb3c8674fd799 not found: ID does not exist" containerID="2c50af11d532a92cd8065d6ed3315161faa61c0acb6fa5be411cb3c8674fd799" Sep 10 11:37:36.228111 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:37:36.228059 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2c50af11d532a92cd8065d6ed3315161faa61c0acb6fa5be411cb3c8674fd799"} err="failed to get container status \"2c50af11d532a92cd8065d6ed3315161faa61c0acb6fa5be411cb3c8674fd799\": rpc error: code = NotFound desc = could not find container \"2c50af11d532a92cd8065d6ed3315161faa61c0acb6fa5be411cb3c8674fd799\": container with ID starting with 2c50af11d532a92cd8065d6ed3315161faa61c0acb6fa5be411cb3c8674fd799 not found: ID does not exist" Sep 10 11:37:36.228111 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:37:36.228074 2564 scope.go:117] "RemoveContainer" containerID="f98e9c1d4899cd6a9e2414e6884ceb6b0d3bf397cc734f832a9e2fba224a2153" Sep 10 11:37:36.228285 ip-10-0-134-73 kubenswrapper[2564]: E0910 11:37:36.228272 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f98e9c1d4899cd6a9e2414e6884ceb6b0d3bf397cc734f832a9e2fba224a2153\": container with ID starting with f98e9c1d4899cd6a9e2414e6884ceb6b0d3bf397cc734f832a9e2fba224a2153 not found: ID does not exist" containerID="f98e9c1d4899cd6a9e2414e6884ceb6b0d3bf397cc734f832a9e2fba224a2153" Sep 10 11:37:36.228328 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:37:36.228287 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f98e9c1d4899cd6a9e2414e6884ceb6b0d3bf397cc734f832a9e2fba224a2153"} err="failed to get container status \"f98e9c1d4899cd6a9e2414e6884ceb6b0d3bf397cc734f832a9e2fba224a2153\": rpc error: code = NotFound desc = could not find container \"f98e9c1d4899cd6a9e2414e6884ceb6b0d3bf397cc734f832a9e2fba224a2153\": container with ID starting with f98e9c1d4899cd6a9e2414e6884ceb6b0d3bf397cc734f832a9e2fba224a2153 not found: ID does not exist" Sep 10 11:37:36.917033 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:37:36.916998 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ffdcdc93-00b2-4d6f-bf23-97eac9e4fba3" path="/var/lib/kubelet/pods/ffdcdc93-00b2-4d6f-bf23-97eac9e4fba3/volumes" Sep 10 11:37:37.821908 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:37:37.821879 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-6cdcc96965-cw9qc_07ed66ee-327a-4767-a989-0cc7574b0c0f/cluster-monitoring-operator/0.log" Sep 10 11:37:38.236577 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:37:38.236549 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-pvpkj_5f6f3d44-cc80-4965-a007-7a53e9790f9f/node-exporter/0.log" Sep 10 11:37:38.267691 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:37:38.267665 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-pvpkj_5f6f3d44-cc80-4965-a007-7a53e9790f9f/kube-rbac-proxy/0.log" Sep 10 11:37:38.289798 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:37:38.289776 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-pvpkj_5f6f3d44-cc80-4965-a007-7a53e9790f9f/init-textfile/0.log" Sep 10 11:37:38.650808 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:37:38.650776 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-78f599db79-wg57c_e9183ea6-bdca-47c6-b0b9-f3e8e3f51783/prometheus-operator-admission-webhook/0.log" Sep 10 11:37:40.167815 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:37:40.167779 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-79977f9844-bz6mz_c062102c-aa53-4355-9921-4d46efdf94c9/networking-console-plugin/0.log" Sep 10 11:37:40.671259 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:37:40.671228 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-l2hf2_7f298f77-06d2-4ea6-b4fc-cb2c5e9080de/console-operator/1.log" Sep 10 11:37:40.677632 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:37:40.677607 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-l2hf2_7f298f77-06d2-4ea6-b4fc-cb2c5e9080de/console-operator/2.log" Sep 10 11:37:41.129217 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:37:41.129184 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-85d98c998f-xd4wd_83b0361a-4ac0-46ce-9542-e92483e72b82/download-server/0.log" Sep 10 11:37:41.576264 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:37:41.576180 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-472bx/perf-node-gather-daemonset-tshb8"] Sep 10 11:37:41.576656 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:37:41.576442 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ffdcdc93-00b2-4d6f-bf23-97eac9e4fba3" containerName="gather" Sep 10 11:37:41.576656 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:37:41.576453 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="ffdcdc93-00b2-4d6f-bf23-97eac9e4fba3" containerName="gather" Sep 10 11:37:41.576656 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:37:41.576465 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ffdcdc93-00b2-4d6f-bf23-97eac9e4fba3" containerName="copy" Sep 10 11:37:41.576656 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:37:41.576470 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="ffdcdc93-00b2-4d6f-bf23-97eac9e4fba3" containerName="copy" Sep 10 11:37:41.576656 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:37:41.576530 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="ffdcdc93-00b2-4d6f-bf23-97eac9e4fba3" containerName="gather" Sep 10 11:37:41.576656 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:37:41.576538 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="ffdcdc93-00b2-4d6f-bf23-97eac9e4fba3" containerName="copy" Sep 10 11:37:41.581486 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:37:41.581466 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-472bx/perf-node-gather-daemonset-tshb8" Sep 10 11:37:41.583903 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:37:41.583880 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-472bx\"/\"openshift-service-ca.crt\"" Sep 10 11:37:41.583903 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:37:41.583895 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-472bx\"/\"default-dockercfg-qb59r\"" Sep 10 11:37:41.584948 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:37:41.584928 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-472bx\"/\"kube-root-ca.crt\"" Sep 10 11:37:41.590016 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:37:41.589993 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-472bx/perf-node-gather-daemonset-tshb8"] Sep 10 11:37:41.669606 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:37:41.669577 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-695c895bd6-ppgz5_eea0842b-55ea-4845-8e5f-61bb84d918eb/volume-data-source-validator/0.log" Sep 10 11:37:41.673267 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:37:41.673245 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ddbkz\" (UniqueName: \"kubernetes.io/projected/9a7983a2-c0d4-460b-bc10-393f9b951a7d-kube-api-access-ddbkz\") pod \"perf-node-gather-daemonset-tshb8\" (UID: \"9a7983a2-c0d4-460b-bc10-393f9b951a7d\") " pod="openshift-must-gather-472bx/perf-node-gather-daemonset-tshb8" Sep 10 11:37:41.673372 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:37:41.673280 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/9a7983a2-c0d4-460b-bc10-393f9b951a7d-podres\") pod \"perf-node-gather-daemonset-tshb8\" (UID: \"9a7983a2-c0d4-460b-bc10-393f9b951a7d\") " pod="openshift-must-gather-472bx/perf-node-gather-daemonset-tshb8" Sep 10 11:37:41.673372 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:37:41.673298 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9a7983a2-c0d4-460b-bc10-393f9b951a7d-sys\") pod \"perf-node-gather-daemonset-tshb8\" (UID: \"9a7983a2-c0d4-460b-bc10-393f9b951a7d\") " pod="openshift-must-gather-472bx/perf-node-gather-daemonset-tshb8" Sep 10 11:37:41.673372 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:37:41.673315 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9a7983a2-c0d4-460b-bc10-393f9b951a7d-lib-modules\") pod \"perf-node-gather-daemonset-tshb8\" (UID: \"9a7983a2-c0d4-460b-bc10-393f9b951a7d\") " pod="openshift-must-gather-472bx/perf-node-gather-daemonset-tshb8" Sep 10 11:37:41.673485 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:37:41.673396 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/9a7983a2-c0d4-460b-bc10-393f9b951a7d-proc\") pod \"perf-node-gather-daemonset-tshb8\" (UID: \"9a7983a2-c0d4-460b-bc10-393f9b951a7d\") " pod="openshift-must-gather-472bx/perf-node-gather-daemonset-tshb8" Sep 10 11:37:41.773984 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:37:41.773953 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ddbkz\" (UniqueName: \"kubernetes.io/projected/9a7983a2-c0d4-460b-bc10-393f9b951a7d-kube-api-access-ddbkz\") pod \"perf-node-gather-daemonset-tshb8\" (UID: \"9a7983a2-c0d4-460b-bc10-393f9b951a7d\") " pod="openshift-must-gather-472bx/perf-node-gather-daemonset-tshb8" Sep 10 11:37:41.774138 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:37:41.773990 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/9a7983a2-c0d4-460b-bc10-393f9b951a7d-podres\") pod \"perf-node-gather-daemonset-tshb8\" (UID: \"9a7983a2-c0d4-460b-bc10-393f9b951a7d\") " pod="openshift-must-gather-472bx/perf-node-gather-daemonset-tshb8" Sep 10 11:37:41.774138 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:37:41.774007 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9a7983a2-c0d4-460b-bc10-393f9b951a7d-sys\") pod \"perf-node-gather-daemonset-tshb8\" (UID: \"9a7983a2-c0d4-460b-bc10-393f9b951a7d\") " pod="openshift-must-gather-472bx/perf-node-gather-daemonset-tshb8" Sep 10 11:37:41.774138 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:37:41.774025 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9a7983a2-c0d4-460b-bc10-393f9b951a7d-lib-modules\") pod \"perf-node-gather-daemonset-tshb8\" (UID: \"9a7983a2-c0d4-460b-bc10-393f9b951a7d\") " pod="openshift-must-gather-472bx/perf-node-gather-daemonset-tshb8" Sep 10 11:37:41.774138 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:37:41.774113 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9a7983a2-c0d4-460b-bc10-393f9b951a7d-sys\") pod \"perf-node-gather-daemonset-tshb8\" (UID: \"9a7983a2-c0d4-460b-bc10-393f9b951a7d\") " pod="openshift-must-gather-472bx/perf-node-gather-daemonset-tshb8" Sep 10 11:37:41.774138 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:37:41.774126 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/9a7983a2-c0d4-460b-bc10-393f9b951a7d-podres\") pod \"perf-node-gather-daemonset-tshb8\" (UID: \"9a7983a2-c0d4-460b-bc10-393f9b951a7d\") " pod="openshift-must-gather-472bx/perf-node-gather-daemonset-tshb8" Sep 10 11:37:41.774377 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:37:41.774190 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/9a7983a2-c0d4-460b-bc10-393f9b951a7d-proc\") pod \"perf-node-gather-daemonset-tshb8\" (UID: \"9a7983a2-c0d4-460b-bc10-393f9b951a7d\") " pod="openshift-must-gather-472bx/perf-node-gather-daemonset-tshb8" Sep 10 11:37:41.774377 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:37:41.774235 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9a7983a2-c0d4-460b-bc10-393f9b951a7d-lib-modules\") pod \"perf-node-gather-daemonset-tshb8\" (UID: \"9a7983a2-c0d4-460b-bc10-393f9b951a7d\") " pod="openshift-must-gather-472bx/perf-node-gather-daemonset-tshb8" Sep 10 11:37:41.774377 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:37:41.774289 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/9a7983a2-c0d4-460b-bc10-393f9b951a7d-proc\") pod \"perf-node-gather-daemonset-tshb8\" (UID: \"9a7983a2-c0d4-460b-bc10-393f9b951a7d\") " pod="openshift-must-gather-472bx/perf-node-gather-daemonset-tshb8" Sep 10 11:37:41.784148 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:37:41.784120 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ddbkz\" (UniqueName: \"kubernetes.io/projected/9a7983a2-c0d4-460b-bc10-393f9b951a7d-kube-api-access-ddbkz\") pod \"perf-node-gather-daemonset-tshb8\" (UID: \"9a7983a2-c0d4-460b-bc10-393f9b951a7d\") " pod="openshift-must-gather-472bx/perf-node-gather-daemonset-tshb8" Sep 10 11:37:41.890884 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:37:41.890844 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-472bx/perf-node-gather-daemonset-tshb8" Sep 10 11:37:42.160798 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:37:42.160723 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-472bx/perf-node-gather-daemonset-tshb8"] Sep 10 11:37:42.163897 ip-10-0-134-73 kubenswrapper[2564]: W0910 11:37:42.163866 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod9a7983a2_c0d4_460b_bc10_393f9b951a7d.slice/crio-1a1aab0d291d9b8cb009fcfd2d34a25a3647e025e29db6c6b369e108d569a743 WatchSource:0}: Error finding container 1a1aab0d291d9b8cb009fcfd2d34a25a3647e025e29db6c6b369e108d569a743: Status 404 returned error can't find the container with id 1a1aab0d291d9b8cb009fcfd2d34a25a3647e025e29db6c6b369e108d569a743 Sep 10 11:37:42.232178 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:37:42.232148 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-472bx/perf-node-gather-daemonset-tshb8" event={"ID":"9a7983a2-c0d4-460b-bc10-393f9b951a7d","Type":"ContainerStarted","Data":"b7c5d6b868c9c288a17a2f1b7c101e22fc31ee2846f1c4284f4a5a46de3b699c"} Sep 10 11:37:42.232277 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:37:42.232206 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-472bx/perf-node-gather-daemonset-tshb8" event={"ID":"9a7983a2-c0d4-460b-bc10-393f9b951a7d","Type":"ContainerStarted","Data":"1a1aab0d291d9b8cb009fcfd2d34a25a3647e025e29db6c6b369e108d569a743"} Sep 10 11:37:42.232277 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:37:42.232255 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-472bx/perf-node-gather-daemonset-tshb8" Sep 10 11:37:42.248292 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:37:42.248253 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-472bx/perf-node-gather-daemonset-tshb8" podStartSLOduration=1.248238732 podStartE2EDuration="1.248238732s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 11:37:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 11:37:42.247478774 +0000 UTC m=+1527.844039990" watchObservedRunningTime="2026-09-10 11:37:42.248238732 +0000 UTC m=+1527.844799947" Sep 10 11:37:42.580875 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:37:42.580759 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-crh79_68178850-698c-4ff6-82b8-b345e52851b8/dns/0.log" Sep 10 11:37:42.604305 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:37:42.604281 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-crh79_68178850-698c-4ff6-82b8-b345e52851b8/kube-rbac-proxy/0.log" Sep 10 11:37:42.727296 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:37:42.727267 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-zgkgx_d1b87354-8843-4e59-8a85-68c875f472e6/dns-node-resolver/0.log" Sep 10 11:37:43.172347 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:37:43.172314 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-285k7_60a628d5-3863-4793-802f-e07a7157dcdf/node-ca/0.log" Sep 10 11:37:43.934143 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:37:43.934109 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-879b8884d-8tjr9_7a9cb7ef-ebb9-48cc-8a51-f83540a85612/router/0.log" Sep 10 11:37:44.244524 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:37:44.244446 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-4bkc6_1e1b3fbc-ac27-424e-85be-c2dc53c62d3e/serve-healthcheck-canary/0.log" Sep 10 11:37:44.637107 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:37:44.637079 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-76bcd6ccf5-2srs4_2aeac0f7-3e8b-4d33-abcc-ae757048a5cf/insights-operator/1.log" Sep 10 11:37:44.637301 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:37:44.637121 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-76bcd6ccf5-2srs4_2aeac0f7-3e8b-4d33-abcc-ae757048a5cf/insights-operator/0.log" Sep 10 11:37:44.662675 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:37:44.662649 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-7sfr4_63846292-2743-4e69-adfc-178618b942f1/kube-rbac-proxy/0.log" Sep 10 11:37:44.684019 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:37:44.683987 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-7sfr4_63846292-2743-4e69-adfc-178618b942f1/exporter/0.log" Sep 10 11:37:44.706405 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:37:44.706378 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-7sfr4_63846292-2743-4e69-adfc-178618b942f1/extractor/0.log" Sep 10 11:37:48.246031 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:37:48.246002 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-472bx/perf-node-gather-daemonset-tshb8" Sep 10 11:37:49.471046 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:37:49.470985 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-8d7dd4675-t55dh_9e565424-7eca-4f29-8582-664fac065238/kube-storage-version-migrator-operator/1.log" Sep 10 11:37:49.472550 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:37:49.472515 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-8d7dd4675-t55dh_9e565424-7eca-4f29-8582-664fac065238/kube-storage-version-migrator-operator/0.log" Sep 10 11:37:50.767598 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:37:50.767497 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-dpgnj_1d5ea621-658b-4058-9b1a-d4c976651be0/kube-multus-additional-cni-plugins/0.log" Sep 10 11:37:50.790290 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:37:50.790251 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-dpgnj_1d5ea621-658b-4058-9b1a-d4c976651be0/egress-router-binary-copy/0.log" Sep 10 11:37:50.816895 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:37:50.816847 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-dpgnj_1d5ea621-658b-4058-9b1a-d4c976651be0/cni-plugins/0.log" Sep 10 11:37:50.839797 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:37:50.839765 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-dpgnj_1d5ea621-658b-4058-9b1a-d4c976651be0/bond-cni-plugin/0.log" Sep 10 11:37:50.863881 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:37:50.863844 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-dpgnj_1d5ea621-658b-4058-9b1a-d4c976651be0/routeoverride-cni/0.log" Sep 10 11:37:50.886185 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:37:50.886157 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-dpgnj_1d5ea621-658b-4058-9b1a-d4c976651be0/whereabouts-cni-bincopy/0.log" Sep 10 11:37:50.906090 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:37:50.906065 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-dpgnj_1d5ea621-658b-4058-9b1a-d4c976651be0/whereabouts-cni/0.log" Sep 10 11:37:51.131038 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:37:51.130971 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-r6sr6_1bf42e41-3da3-4bc1-8388-c0157fb5ae44/kube-multus/0.log" Sep 10 11:37:51.154833 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:37:51.154777 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-54z9n_794743e8-fee9-426f-9546-161a898541e2/network-metrics-daemon/0.log" Sep 10 11:37:51.173729 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:37:51.173700 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-54z9n_794743e8-fee9-426f-9546-161a898541e2/kube-rbac-proxy/0.log" Sep 10 11:37:52.223248 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:37:52.223220 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-t5n27_433a8dab-963b-403e-a78f-b3b4fbeadf8f/ovn-controller/0.log" Sep 10 11:37:52.240041 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:37:52.240016 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-t5n27_433a8dab-963b-403e-a78f-b3b4fbeadf8f/ovn-acl-logging/0.log" Sep 10 11:37:52.265413 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:37:52.265388 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-t5n27_433a8dab-963b-403e-a78f-b3b4fbeadf8f/kube-rbac-proxy-node/0.log" Sep 10 11:37:52.288158 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:37:52.288131 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-t5n27_433a8dab-963b-403e-a78f-b3b4fbeadf8f/kube-rbac-proxy-ovn-metrics/0.log" Sep 10 11:37:52.306870 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:37:52.306839 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-t5n27_433a8dab-963b-403e-a78f-b3b4fbeadf8f/northd/0.log" Sep 10 11:37:52.327593 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:37:52.327571 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-t5n27_433a8dab-963b-403e-a78f-b3b4fbeadf8f/nbdb/0.log" Sep 10 11:37:52.350944 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:37:52.350922 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-t5n27_433a8dab-963b-403e-a78f-b3b4fbeadf8f/sbdb/0.log" Sep 10 11:37:52.405229 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:37:52.405206 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-t5n27_433a8dab-963b-403e-a78f-b3b4fbeadf8f/ovnkube-controller/0.log" Sep 10 11:37:53.623830 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:37:53.623793 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-source-685456655f-z7mhl_341ed071-292a-4066-b98a-3cf04a4cbf93/check-endpoints/0.log" Sep 10 11:37:53.682833 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:37:53.682801 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-bvnw9_1f233d76-b986-4ec6-a096-e4bc9d53101f/network-check-target-container/0.log" Sep 10 11:37:54.809808 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:37:54.809773 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-z697w_d659be6f-7ae8-4309-8d20-0954a8b188ad/iptables-alerter/0.log" Sep 10 11:37:55.515367 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:37:55.515336 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_tuned-8mbpl_d79e1737-1635-4c9c-8ad3-1ed1537ee844/tuned/0.log" Sep 10 11:37:57.276377 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:37:57.276344 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-samples-operator_cluster-samples-operator-7cdcfcf76c-sckxh_3e0bbd18-8afb-43e7-8e61-04d516f482f0/cluster-samples-operator/0.log" Sep 10 11:37:57.292727 ip-10-0-134-73 kubenswrapper[2564]: I0910 11:37:57.292694 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-samples-operator_cluster-samples-operator-7cdcfcf76c-sckxh_3e0bbd18-8afb-43e7-8e61-04d516f482f0/cluster-samples-operator-watch/0.log"