Sep 10 16:01:06.452351 ip-10-0-135-53 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Sep 10 16:01:06.452362 ip-10-0-135-53 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Sep 10 16:01:06.452369 ip-10-0-135-53 systemd[1]: kubelet.service: Failed with result 'resources'. Sep 10 16:01:06.452560 ip-10-0-135-53 systemd[1]: Failed to start Kubernetes Kubelet. Sep 10 16:01:16.597262 ip-10-0-135-53 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Sep 10 16:01:16.597283 ip-10-0-135-53 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 88e8e3936d5744cdb288f9a3c366912c -- Sep 10 16:02:55.343571 ip-10-0-135-53 systemd[1]: Starting Kubernetes Kubelet... Sep 10 16:02:55.739545 ip-10-0-135-53 kubenswrapper[2574]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 10 16:02:55.739545 ip-10-0-135-53 kubenswrapper[2574]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Sep 10 16:02:55.739545 ip-10-0-135-53 kubenswrapper[2574]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 10 16:02:55.739545 ip-10-0-135-53 kubenswrapper[2574]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Sep 10 16:02:55.739545 ip-10-0-135-53 kubenswrapper[2574]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 10 16:02:55.741588 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:55.741495 2574 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Sep 10 16:02:55.745749 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.745734 2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 10 16:02:55.745749 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.745749 2574 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 10 16:02:55.745815 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.745753 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 10 16:02:55.745815 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.745756 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 10 16:02:55.745815 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.745759 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 10 16:02:55.745815 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.745762 2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 10 16:02:55.745815 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.745765 2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 10 16:02:55.745815 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.745768 2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 10 16:02:55.745815 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.745771 2574 feature_gate.go:328] unrecognized feature gate: Example2 Sep 10 16:02:55.745815 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.745774 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 10 16:02:55.745815 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.745777 2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 10 16:02:55.745815 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.745782 2574 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 10 16:02:55.745815 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.745786 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 10 16:02:55.745815 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.745789 2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 10 16:02:55.745815 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.745792 2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 10 16:02:55.745815 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.745795 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 10 16:02:55.745815 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.745798 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 10 16:02:55.745815 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.745801 2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 10 16:02:55.745815 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.745804 2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 10 16:02:55.745815 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.745807 2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 10 16:02:55.745815 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.745811 2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 10 16:02:55.745815 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.745814 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 10 16:02:55.746305 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.745816 2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 10 16:02:55.746305 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.745820 2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 10 16:02:55.746305 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.745823 2574 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 10 16:02:55.746305 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.745826 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 10 16:02:55.746305 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.745829 2574 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 10 16:02:55.746305 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.745832 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 10 16:02:55.746305 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.745835 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 10 16:02:55.746305 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.745838 2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 10 16:02:55.746305 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.745841 2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 10 16:02:55.746305 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.745843 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 10 16:02:55.746305 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.745846 2574 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 10 16:02:55.746305 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.745848 2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 10 16:02:55.746305 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.745851 2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 10 16:02:55.746305 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.745855 2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 10 16:02:55.746305 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.745857 2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 10 16:02:55.746305 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.745860 2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 10 16:02:55.746305 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.745863 2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 10 16:02:55.746305 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.745865 2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 10 16:02:55.746305 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.745868 2574 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 10 16:02:55.746769 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.745870 2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 10 16:02:55.746769 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.745873 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 10 16:02:55.746769 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.745875 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 10 16:02:55.746769 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.745878 2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 10 16:02:55.746769 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.745883 2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 10 16:02:55.746769 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.745886 2574 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 10 16:02:55.746769 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.745889 2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 10 16:02:55.746769 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.745892 2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 10 16:02:55.746769 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.745895 2574 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 10 16:02:55.746769 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.745898 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 10 16:02:55.746769 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.745900 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 10 16:02:55.746769 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.745904 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 10 16:02:55.746769 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.745907 2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 10 16:02:55.746769 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.745909 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 10 16:02:55.746769 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.745913 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 10 16:02:55.746769 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.745917 2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 10 16:02:55.746769 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.745920 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 10 16:02:55.746769 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.745924 2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 10 16:02:55.746769 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.745927 2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 10 16:02:55.747239 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.745930 2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 10 16:02:55.747239 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.745933 2574 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 10 16:02:55.747239 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.745935 2574 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 10 16:02:55.747239 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.745938 2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 10 16:02:55.747239 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.745940 2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 10 16:02:55.747239 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.745943 2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 10 16:02:55.747239 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.745945 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 10 16:02:55.747239 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.745948 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 10 16:02:55.747239 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.745950 2574 feature_gate.go:328] unrecognized feature gate: Example Sep 10 16:02:55.747239 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.745953 2574 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 10 16:02:55.747239 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.745955 2574 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 10 16:02:55.747239 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.745958 2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 10 16:02:55.747239 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.745960 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 10 16:02:55.747239 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.745963 2574 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 10 16:02:55.747239 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.745965 2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 10 16:02:55.747239 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.745969 2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 10 16:02:55.747239 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.745972 2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 10 16:02:55.747239 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.745974 2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 10 16:02:55.747239 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.745977 2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 10 16:02:55.747239 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.745980 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 10 16:02:55.747755 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.745982 2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 10 16:02:55.747755 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.745985 2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 10 16:02:55.747755 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.745988 2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 10 16:02:55.747755 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.745990 2574 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 10 16:02:55.747755 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.745993 2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 10 16:02:55.747755 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.745996 2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 10 16:02:55.747755 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.745999 2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 10 16:02:55.747755 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.746002 2574 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 10 16:02:55.747755 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.746004 2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 10 16:02:55.747755 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.746007 2574 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 10 16:02:55.747755 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.746009 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 10 16:02:55.747755 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.746012 2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 10 16:02:55.747755 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.746014 2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 10 16:02:55.747755 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.746017 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 10 16:02:55.747755 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.746019 2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 10 16:02:55.747755 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.746022 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 10 16:02:55.747755 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.746024 2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 10 16:02:55.747755 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.746027 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 10 16:02:55.747755 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.746029 2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 10 16:02:55.748307 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.746754 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 10 16:02:55.748307 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.746760 2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 10 16:02:55.748307 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.746766 2574 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 10 16:02:55.748307 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.746770 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 10 16:02:55.748307 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.746773 2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 10 16:02:55.748307 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.746777 2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 10 16:02:55.748307 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.746780 2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 10 16:02:55.748307 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.746783 2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 10 16:02:55.748307 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.746787 2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 10 16:02:55.748307 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.746790 2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 10 16:02:55.748307 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.746793 2574 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 10 16:02:55.748307 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.746796 2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 10 16:02:55.748307 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.746799 2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 10 16:02:55.748307 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.746802 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 10 16:02:55.748307 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.746805 2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 10 16:02:55.748307 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.746807 2574 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 10 16:02:55.748307 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.746810 2574 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 10 16:02:55.748307 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.746813 2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 10 16:02:55.748307 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.746816 2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 10 16:02:55.748307 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.746818 2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 10 16:02:55.748805 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.746822 2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 10 16:02:55.748805 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.746825 2574 feature_gate.go:328] unrecognized feature gate: Example2 Sep 10 16:02:55.748805 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.746827 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 10 16:02:55.748805 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.746830 2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 10 16:02:55.748805 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.746832 2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 10 16:02:55.748805 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.746835 2574 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 10 16:02:55.748805 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.746837 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 10 16:02:55.748805 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.746840 2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 10 16:02:55.748805 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.746842 2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 10 16:02:55.748805 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.746845 2574 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 10 16:02:55.748805 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.746849 2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 10 16:02:55.748805 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.746854 2574 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 10 16:02:55.748805 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.746857 2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 10 16:02:55.748805 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.746860 2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 10 16:02:55.748805 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.746863 2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 10 16:02:55.748805 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.746866 2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 10 16:02:55.748805 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.746868 2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 10 16:02:55.748805 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.746871 2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 10 16:02:55.748805 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.746874 2574 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 10 16:02:55.749291 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.746877 2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 10 16:02:55.749291 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.746880 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 10 16:02:55.749291 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.746883 2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 10 16:02:55.749291 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.746886 2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 10 16:02:55.749291 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.746889 2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 10 16:02:55.749291 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.746892 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 10 16:02:55.749291 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.746894 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 10 16:02:55.749291 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.746897 2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 10 16:02:55.749291 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.746899 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 10 16:02:55.749291 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.746902 2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 10 16:02:55.749291 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.746905 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 10 16:02:55.749291 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.746908 2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 10 16:02:55.749291 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.746910 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 10 16:02:55.749291 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.746913 2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 10 16:02:55.749291 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.746916 2574 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 10 16:02:55.749291 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.746919 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 10 16:02:55.749291 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.746921 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 10 16:02:55.749291 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.746924 2574 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 10 16:02:55.749291 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.746926 2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 10 16:02:55.749291 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.746929 2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 10 16:02:55.749787 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.746931 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 10 16:02:55.749787 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.746934 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 10 16:02:55.749787 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.746936 2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 10 16:02:55.749787 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.746940 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 10 16:02:55.749787 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.746942 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 10 16:02:55.749787 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.746945 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 10 16:02:55.749787 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.746947 2574 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 10 16:02:55.749787 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.746950 2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 10 16:02:55.749787 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.746952 2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 10 16:02:55.749787 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.746955 2574 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 10 16:02:55.749787 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.746958 2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 10 16:02:55.749787 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.746962 2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 10 16:02:55.749787 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.746965 2574 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 10 16:02:55.749787 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.746968 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 10 16:02:55.749787 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.746970 2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 10 16:02:55.749787 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.746972 2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 10 16:02:55.749787 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.746976 2574 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 10 16:02:55.749787 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.746979 2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 10 16:02:55.749787 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.746982 2574 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 10 16:02:55.750248 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.746984 2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 10 16:02:55.750248 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.746987 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 10 16:02:55.750248 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.746989 2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 10 16:02:55.750248 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.746995 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 10 16:02:55.750248 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.746998 2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 10 16:02:55.750248 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.747000 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 10 16:02:55.750248 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.747003 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 10 16:02:55.750248 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.747005 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 10 16:02:55.750248 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.747008 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 10 16:02:55.750248 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.747010 2574 feature_gate.go:328] unrecognized feature gate: Example Sep 10 16:02:55.750248 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.747013 2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 10 16:02:55.750248 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.747015 2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 10 16:02:55.750248 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.747018 2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 10 16:02:55.750248 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.747021 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 10 16:02:55.750248 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.747023 2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 10 16:02:55.750248 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.747026 2574 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 10 16:02:55.750248 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.747028 2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 10 16:02:55.750248 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.747031 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 10 16:02:55.750248 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.747033 2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 10 16:02:55.750248 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.747036 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 10 16:02:55.750744 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.747039 2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 10 16:02:55.750744 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.747427 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 10 16:02:55.750744 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.747432 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 10 16:02:55.750744 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.747435 2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 10 16:02:55.750744 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.747438 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 10 16:02:55.750744 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.747441 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 10 16:02:55.750744 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.747443 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 10 16:02:55.750744 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.747446 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 10 16:02:55.750744 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.747449 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 10 16:02:55.750744 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.747455 2574 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 10 16:02:55.750744 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.747458 2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 10 16:02:55.750744 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.747461 2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 10 16:02:55.750744 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.747464 2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 10 16:02:55.750744 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.747466 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 10 16:02:55.750744 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.747469 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 10 16:02:55.750744 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.747474 2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 10 16:02:55.750744 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.747476 2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 10 16:02:55.750744 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.747479 2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 10 16:02:55.750744 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.747481 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 10 16:02:55.750744 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.747484 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 10 16:02:55.751219 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.747487 2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 10 16:02:55.751219 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.747489 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 10 16:02:55.751219 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.747492 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 10 16:02:55.751219 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.747494 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 10 16:02:55.751219 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.747497 2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 10 16:02:55.751219 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.747500 2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 10 16:02:55.751219 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.747502 2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 10 16:02:55.751219 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.747505 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 10 16:02:55.751219 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.747509 2574 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 10 16:02:55.751219 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.747513 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 10 16:02:55.751219 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.747516 2574 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 10 16:02:55.751219 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.747519 2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 10 16:02:55.751219 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.747522 2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 10 16:02:55.751219 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.747524 2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 10 16:02:55.751219 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.747527 2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 10 16:02:55.751219 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.747530 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 10 16:02:55.751219 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.747533 2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 10 16:02:55.751219 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.747536 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 10 16:02:55.751219 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.747539 2574 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 10 16:02:55.751678 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.747541 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 10 16:02:55.751678 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.747544 2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 10 16:02:55.751678 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.747547 2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 10 16:02:55.751678 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.747550 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 10 16:02:55.751678 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.747553 2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 10 16:02:55.751678 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.747555 2574 feature_gate.go:328] unrecognized feature gate: Example2 Sep 10 16:02:55.751678 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.747558 2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 10 16:02:55.751678 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.747562 2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 10 16:02:55.751678 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.747566 2574 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 10 16:02:55.751678 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.747569 2574 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 10 16:02:55.751678 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.747573 2574 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 10 16:02:55.751678 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.747575 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 10 16:02:55.751678 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.747578 2574 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 10 16:02:55.751678 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.747580 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 10 16:02:55.751678 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.747583 2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 10 16:02:55.751678 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.747585 2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 10 16:02:55.751678 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.747588 2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 10 16:02:55.751678 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.747590 2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 10 16:02:55.751678 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.747593 2574 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 10 16:02:55.752138 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.747595 2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 10 16:02:55.752138 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.747598 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 10 16:02:55.752138 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.747601 2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 10 16:02:55.752138 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.747604 2574 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 10 16:02:55.752138 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.747606 2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 10 16:02:55.752138 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.747608 2574 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 10 16:02:55.752138 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.747611 2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 10 16:02:55.752138 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.747614 2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 10 16:02:55.752138 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.747616 2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 10 16:02:55.752138 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.747621 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 10 16:02:55.752138 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.747623 2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 10 16:02:55.752138 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.747626 2574 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 10 16:02:55.752138 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.747628 2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 10 16:02:55.752138 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.747631 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 10 16:02:55.752138 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.747633 2574 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 10 16:02:55.752138 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.747636 2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 10 16:02:55.752138 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.747638 2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 10 16:02:55.752138 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.747645 2574 feature_gate.go:328] unrecognized feature gate: Example Sep 10 16:02:55.752138 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.747648 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 10 16:02:55.752138 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.747651 2574 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 10 16:02:55.752676 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.747653 2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 10 16:02:55.752676 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.747657 2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 10 16:02:55.752676 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.747660 2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 10 16:02:55.752676 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.747662 2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 10 16:02:55.752676 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.747664 2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 10 16:02:55.752676 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.747667 2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 10 16:02:55.752676 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.747670 2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 10 16:02:55.752676 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.747672 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 10 16:02:55.752676 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.747675 2574 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 10 16:02:55.752676 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.747678 2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 10 16:02:55.752676 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.747680 2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 10 16:02:55.752676 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.747683 2574 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 10 16:02:55.752676 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.747685 2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 10 16:02:55.752676 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.747688 2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 10 16:02:55.752676 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.747690 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 10 16:02:55.752676 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.747693 2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 10 16:02:55.752676 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.747695 2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 10 16:02:55.752676 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.747697 2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 10 16:02:55.752676 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.747700 2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 10 16:02:55.752676 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.747702 2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 10 16:02:55.753161 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.747705 2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 10 16:02:55.753161 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.747709 2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 10 16:02:55.753161 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:55.747787 2574 flags.go:64] FLAG: --address="0.0.0.0" Sep 10 16:02:55.753161 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:55.747819 2574 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Sep 10 16:02:55.753161 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:55.747827 2574 flags.go:64] FLAG: --anonymous-auth="true" Sep 10 16:02:55.753161 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:55.747832 2574 flags.go:64] FLAG: --application-metrics-count-limit="100" Sep 10 16:02:55.753161 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:55.747836 2574 flags.go:64] FLAG: --authentication-token-webhook="false" Sep 10 16:02:55.753161 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:55.747839 2574 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Sep 10 16:02:55.753161 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:55.747843 2574 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Sep 10 16:02:55.753161 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:55.747847 2574 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Sep 10 16:02:55.753161 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:55.747851 2574 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Sep 10 16:02:55.753161 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:55.747854 2574 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Sep 10 16:02:55.753161 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:55.747858 2574 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Sep 10 16:02:55.753161 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:55.747862 2574 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Sep 10 16:02:55.753161 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:55.747865 2574 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Sep 10 16:02:55.753161 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:55.747868 2574 flags.go:64] FLAG: --cgroup-root="" Sep 10 16:02:55.753161 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:55.747871 2574 flags.go:64] FLAG: --cgroups-per-qos="true" Sep 10 16:02:55.753161 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:55.747873 2574 flags.go:64] FLAG: --client-ca-file="" Sep 10 16:02:55.753161 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:55.747876 2574 flags.go:64] FLAG: --cloud-provider="external" Sep 10 16:02:55.753161 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:55.747879 2574 flags.go:64] FLAG: --cluster-dns="[]" Sep 10 16:02:55.753161 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:55.747883 2574 flags.go:64] FLAG: --cluster-domain="" Sep 10 16:02:55.753161 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:55.747886 2574 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Sep 10 16:02:55.753161 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:55.747889 2574 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Sep 10 16:02:55.753161 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:55.747892 2574 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Sep 10 16:02:55.753767 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:55.747896 2574 flags.go:64] FLAG: --container-log-max-files="5" Sep 10 16:02:55.753767 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:55.747899 2574 flags.go:64] FLAG: --container-log-max-size="10Mi" Sep 10 16:02:55.753767 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:55.747902 2574 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Sep 10 16:02:55.753767 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:55.747905 2574 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Sep 10 16:02:55.753767 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:55.747909 2574 flags.go:64] FLAG: --containerd-namespace="k8s.io" Sep 10 16:02:55.753767 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:55.747912 2574 flags.go:64] FLAG: --contention-profiling="false" Sep 10 16:02:55.753767 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:55.747915 2574 flags.go:64] FLAG: --cpu-cfs-quota="true" Sep 10 16:02:55.753767 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:55.747917 2574 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Sep 10 16:02:55.753767 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:55.747921 2574 flags.go:64] FLAG: --cpu-manager-policy="none" Sep 10 16:02:55.753767 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:55.747925 2574 flags.go:64] FLAG: --cpu-manager-policy-options="" Sep 10 16:02:55.753767 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:55.747929 2574 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Sep 10 16:02:55.753767 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:55.747932 2574 flags.go:64] FLAG: --enable-controller-attach-detach="true" Sep 10 16:02:55.753767 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:55.747935 2574 flags.go:64] FLAG: --enable-debugging-handlers="true" Sep 10 16:02:55.753767 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:55.747937 2574 flags.go:64] FLAG: --enable-load-reader="false" Sep 10 16:02:55.753767 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:55.747940 2574 flags.go:64] FLAG: --enable-server="true" Sep 10 16:02:55.753767 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:55.747943 2574 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Sep 10 16:02:55.753767 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:55.747948 2574 flags.go:64] FLAG: --event-burst="100" Sep 10 16:02:55.753767 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:55.747951 2574 flags.go:64] FLAG: --event-qps="50" Sep 10 16:02:55.753767 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:55.747954 2574 flags.go:64] FLAG: --event-storage-age-limit="default=0" Sep 10 16:02:55.753767 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:55.747958 2574 flags.go:64] FLAG: --event-storage-event-limit="default=0" Sep 10 16:02:55.753767 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:55.747961 2574 flags.go:64] FLAG: --eviction-hard="" Sep 10 16:02:55.753767 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:55.747965 2574 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Sep 10 16:02:55.753767 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:55.747968 2574 flags.go:64] FLAG: --eviction-minimum-reclaim="" Sep 10 16:02:55.753767 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:55.747971 2574 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Sep 10 16:02:55.753767 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:55.747974 2574 flags.go:64] FLAG: --eviction-soft="" Sep 10 16:02:55.754404 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:55.747977 2574 flags.go:64] FLAG: --eviction-soft-grace-period="" Sep 10 16:02:55.754404 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:55.747980 2574 flags.go:64] FLAG: --exit-on-lock-contention="false" Sep 10 16:02:55.754404 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:55.747983 2574 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Sep 10 16:02:55.754404 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:55.747986 2574 flags.go:64] FLAG: --experimental-mounter-path="" Sep 10 16:02:55.754404 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:55.747989 2574 flags.go:64] FLAG: --fail-cgroupv1="false" Sep 10 16:02:55.754404 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:55.747992 2574 flags.go:64] FLAG: --fail-swap-on="true" Sep 10 16:02:55.754404 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:55.747994 2574 flags.go:64] FLAG: --feature-gates="" Sep 10 16:02:55.754404 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:55.747998 2574 flags.go:64] FLAG: --file-check-frequency="20s" Sep 10 16:02:55.754404 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:55.748001 2574 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Sep 10 16:02:55.754404 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:55.748004 2574 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Sep 10 16:02:55.754404 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:55.748007 2574 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Sep 10 16:02:55.754404 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:55.748010 2574 flags.go:64] FLAG: --healthz-port="10248" Sep 10 16:02:55.754404 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:55.748013 2574 flags.go:64] FLAG: --help="false" Sep 10 16:02:55.754404 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:55.748016 2574 flags.go:64] FLAG: --hostname-override="ip-10-0-135-53.ec2.internal" Sep 10 16:02:55.754404 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:55.748019 2574 flags.go:64] FLAG: --housekeeping-interval="10s" Sep 10 16:02:55.754404 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:55.748022 2574 flags.go:64] FLAG: --http-check-frequency="20s" Sep 10 16:02:55.754404 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:55.748027 2574 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Sep 10 16:02:55.754404 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:55.748030 2574 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Sep 10 16:02:55.754404 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:55.748034 2574 flags.go:64] FLAG: --image-gc-high-threshold="85" Sep 10 16:02:55.754404 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:55.748037 2574 flags.go:64] FLAG: --image-gc-low-threshold="80" Sep 10 16:02:55.754404 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:55.748039 2574 flags.go:64] FLAG: --image-service-endpoint="" Sep 10 16:02:55.754404 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:55.748042 2574 flags.go:64] FLAG: --kernel-memcg-notification="false" Sep 10 16:02:55.754404 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:55.748045 2574 flags.go:64] FLAG: --kube-api-burst="100" Sep 10 16:02:55.754993 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:55.748048 2574 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Sep 10 16:02:55.754993 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:55.748051 2574 flags.go:64] FLAG: --kube-api-qps="50" Sep 10 16:02:55.754993 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:55.748054 2574 flags.go:64] FLAG: --kube-reserved="" Sep 10 16:02:55.754993 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:55.748057 2574 flags.go:64] FLAG: --kube-reserved-cgroup="" Sep 10 16:02:55.754993 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:55.748060 2574 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Sep 10 16:02:55.754993 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:55.748064 2574 flags.go:64] FLAG: --kubelet-cgroups="" Sep 10 16:02:55.754993 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:55.748067 2574 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Sep 10 16:02:55.754993 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:55.748070 2574 flags.go:64] FLAG: --lock-file="" Sep 10 16:02:55.754993 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:55.748073 2574 flags.go:64] FLAG: --log-cadvisor-usage="false" Sep 10 16:02:55.754993 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:55.748076 2574 flags.go:64] FLAG: --log-flush-frequency="5s" Sep 10 16:02:55.754993 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:55.748079 2574 flags.go:64] FLAG: --log-json-info-buffer-size="0" Sep 10 16:02:55.754993 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:55.748085 2574 flags.go:64] FLAG: --log-json-split-stream="false" Sep 10 16:02:55.754993 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:55.748087 2574 flags.go:64] FLAG: --log-text-info-buffer-size="0" Sep 10 16:02:55.754993 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:55.748090 2574 flags.go:64] FLAG: --log-text-split-stream="false" Sep 10 16:02:55.754993 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:55.748093 2574 flags.go:64] FLAG: --logging-format="text" Sep 10 16:02:55.754993 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:55.748096 2574 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Sep 10 16:02:55.754993 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:55.748099 2574 flags.go:64] FLAG: --make-iptables-util-chains="true" Sep 10 16:02:55.754993 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:55.748102 2574 flags.go:64] FLAG: --manifest-url="" Sep 10 16:02:55.754993 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:55.748105 2574 flags.go:64] FLAG: --manifest-url-header="" Sep 10 16:02:55.754993 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:55.748109 2574 flags.go:64] FLAG: --max-housekeeping-interval="15s" Sep 10 16:02:55.754993 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:55.748112 2574 flags.go:64] FLAG: --max-open-files="1000000" Sep 10 16:02:55.754993 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:55.748116 2574 flags.go:64] FLAG: --max-pods="110" Sep 10 16:02:55.754993 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:55.748119 2574 flags.go:64] FLAG: --maximum-dead-containers="-1" Sep 10 16:02:55.754993 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:55.748122 2574 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Sep 10 16:02:55.754993 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:55.748125 2574 flags.go:64] FLAG: --memory-manager-policy="None" Sep 10 16:02:55.755630 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:55.748130 2574 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Sep 10 16:02:55.755630 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:55.748132 2574 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Sep 10 16:02:55.755630 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:55.748135 2574 flags.go:64] FLAG: --node-ip="0.0.0.0" Sep 10 16:02:55.755630 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:55.748138 2574 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Sep 10 16:02:55.755630 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:55.748145 2574 flags.go:64] FLAG: --node-status-max-images="50" Sep 10 16:02:55.755630 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:55.748148 2574 flags.go:64] FLAG: --node-status-update-frequency="10s" Sep 10 16:02:55.755630 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:55.748151 2574 flags.go:64] FLAG: --oom-score-adj="-999" Sep 10 16:02:55.755630 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:55.748155 2574 flags.go:64] FLAG: --pod-cidr="" Sep 10 16:02:55.755630 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:55.748158 2574 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8ccbacc999dbf9abad8f4009240188312b683f36ced4763eed166c1500c164b1" Sep 10 16:02:55.755630 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:55.748171 2574 flags.go:64] FLAG: --pod-manifest-path="" Sep 10 16:02:55.755630 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:55.748175 2574 flags.go:64] FLAG: --pod-max-pids="-1" Sep 10 16:02:55.755630 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:55.748178 2574 flags.go:64] FLAG: --pods-per-core="0" Sep 10 16:02:55.755630 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:55.748182 2574 flags.go:64] FLAG: --port="10250" Sep 10 16:02:55.755630 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:55.748185 2574 flags.go:64] FLAG: --protect-kernel-defaults="false" Sep 10 16:02:55.755630 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:55.748188 2574 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0088af39cb650e052" Sep 10 16:02:55.755630 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:55.748191 2574 flags.go:64] FLAG: --qos-reserved="" Sep 10 16:02:55.755630 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:55.748194 2574 flags.go:64] FLAG: --read-only-port="10255" Sep 10 16:02:55.755630 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:55.748197 2574 flags.go:64] FLAG: --register-node="true" Sep 10 16:02:55.755630 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:55.748200 2574 flags.go:64] FLAG: --register-with-taints="" Sep 10 16:02:55.755630 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:55.748204 2574 flags.go:64] FLAG: --registry-burst="10" Sep 10 16:02:55.755630 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:55.748207 2574 flags.go:64] FLAG: --registry-qps="5" Sep 10 16:02:55.755630 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:55.748209 2574 flags.go:64] FLAG: --reserved-cpus="" Sep 10 16:02:55.755630 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:55.748212 2574 flags.go:64] FLAG: --reserved-memory="" Sep 10 16:02:55.755630 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:55.748216 2574 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Sep 10 16:02:55.755630 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:55.748219 2574 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Sep 10 16:02:55.756291 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:55.748221 2574 flags.go:64] FLAG: --rotate-certificates="false" Sep 10 16:02:55.756291 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:55.748224 2574 flags.go:64] FLAG: --rotate-server-certificates="false" Sep 10 16:02:55.756291 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:55.748227 2574 flags.go:64] FLAG: --runonce="false" Sep 10 16:02:55.756291 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:55.748230 2574 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Sep 10 16:02:55.756291 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:55.748234 2574 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Sep 10 16:02:55.756291 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:55.748237 2574 flags.go:64] FLAG: --seccomp-default="false" Sep 10 16:02:55.756291 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:55.748239 2574 flags.go:64] FLAG: --serialize-image-pulls="true" Sep 10 16:02:55.756291 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:55.748244 2574 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Sep 10 16:02:55.756291 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:55.748247 2574 flags.go:64] FLAG: --storage-driver-db="cadvisor" Sep 10 16:02:55.756291 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:55.748250 2574 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Sep 10 16:02:55.756291 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:55.748253 2574 flags.go:64] FLAG: --storage-driver-password="root" Sep 10 16:02:55.756291 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:55.748256 2574 flags.go:64] FLAG: --storage-driver-secure="false" Sep 10 16:02:55.756291 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:55.748271 2574 flags.go:64] FLAG: --storage-driver-table="stats" Sep 10 16:02:55.756291 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:55.748274 2574 flags.go:64] FLAG: --storage-driver-user="root" Sep 10 16:02:55.756291 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:55.748277 2574 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Sep 10 16:02:55.756291 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:55.748280 2574 flags.go:64] FLAG: --sync-frequency="1m0s" Sep 10 16:02:55.756291 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:55.748283 2574 flags.go:64] FLAG: --system-cgroups="" Sep 10 16:02:55.756291 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:55.748287 2574 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Sep 10 16:02:55.756291 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:55.748293 2574 flags.go:64] FLAG: --system-reserved-cgroup="" Sep 10 16:02:55.756291 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:55.748296 2574 flags.go:64] FLAG: --tls-cert-file="" Sep 10 16:02:55.756291 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:55.748300 2574 flags.go:64] FLAG: --tls-cipher-suites="[]" Sep 10 16:02:55.756291 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:55.748304 2574 flags.go:64] FLAG: --tls-min-version="" Sep 10 16:02:55.756291 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:55.748307 2574 flags.go:64] FLAG: --tls-private-key-file="" Sep 10 16:02:55.756291 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:55.748310 2574 flags.go:64] FLAG: --topology-manager-policy="none" Sep 10 16:02:55.756291 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:55.748313 2574 flags.go:64] FLAG: --topology-manager-policy-options="" Sep 10 16:02:55.756906 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:55.748316 2574 flags.go:64] FLAG: --topology-manager-scope="container" Sep 10 16:02:55.756906 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:55.748319 2574 flags.go:64] FLAG: --v="2" Sep 10 16:02:55.756906 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:55.748322 2574 flags.go:64] FLAG: --version="false" Sep 10 16:02:55.756906 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:55.748326 2574 flags.go:64] FLAG: --vmodule="" Sep 10 16:02:55.756906 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:55.748335 2574 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Sep 10 16:02:55.756906 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:55.748338 2574 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Sep 10 16:02:55.756906 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.748470 2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 10 16:02:55.756906 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.748474 2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 10 16:02:55.756906 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.748476 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 10 16:02:55.756906 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.748480 2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 10 16:02:55.756906 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.748482 2574 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 10 16:02:55.756906 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.748485 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 10 16:02:55.756906 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.748488 2574 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 10 16:02:55.756906 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.748491 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 10 16:02:55.756906 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.748496 2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 10 16:02:55.756906 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.748500 2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 10 16:02:55.756906 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.748503 2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 10 16:02:55.756906 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.748505 2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 10 16:02:55.756906 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.748508 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 10 16:02:55.756906 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.748510 2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 10 16:02:55.756906 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.748513 2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 10 16:02:55.757449 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.748515 2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 10 16:02:55.757449 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.748518 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 10 16:02:55.757449 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.748520 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 10 16:02:55.757449 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.748524 2574 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 10 16:02:55.757449 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.748527 2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 10 16:02:55.757449 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.748530 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 10 16:02:55.757449 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.748532 2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 10 16:02:55.757449 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.748535 2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 10 16:02:55.757449 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.748538 2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 10 16:02:55.757449 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.748541 2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 10 16:02:55.757449 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.748543 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 10 16:02:55.757449 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.748545 2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 10 16:02:55.757449 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.748548 2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 10 16:02:55.757449 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.748551 2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 10 16:02:55.757449 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.748555 2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 10 16:02:55.757449 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.748558 2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 10 16:02:55.757449 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.748561 2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 10 16:02:55.757449 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.748564 2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 10 16:02:55.757449 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.748566 2574 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 10 16:02:55.757449 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.748569 2574 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 10 16:02:55.757946 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.748572 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 10 16:02:55.757946 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.748575 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 10 16:02:55.757946 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.748578 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 10 16:02:55.757946 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.748581 2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 10 16:02:55.757946 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.748584 2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 10 16:02:55.757946 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.748589 2574 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 10 16:02:55.757946 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.748592 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 10 16:02:55.757946 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.748594 2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 10 16:02:55.757946 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.748597 2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 10 16:02:55.757946 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.748600 2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 10 16:02:55.757946 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.748602 2574 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 10 16:02:55.757946 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.748605 2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 10 16:02:55.757946 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.748607 2574 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 10 16:02:55.757946 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.748610 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 10 16:02:55.757946 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.748612 2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 10 16:02:55.757946 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.748616 2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 10 16:02:55.757946 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.748619 2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 10 16:02:55.757946 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.748621 2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 10 16:02:55.757946 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.748624 2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 10 16:02:55.757946 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.748626 2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 10 16:02:55.758460 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.748629 2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 10 16:02:55.758460 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.748631 2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 10 16:02:55.758460 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.748634 2574 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 10 16:02:55.758460 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.748636 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 10 16:02:55.758460 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.748639 2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 10 16:02:55.758460 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.748641 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 10 16:02:55.758460 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.748644 2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 10 16:02:55.758460 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.748647 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 10 16:02:55.758460 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.748651 2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 10 16:02:55.758460 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.748655 2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 10 16:02:55.758460 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.748658 2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 10 16:02:55.758460 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.748662 2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 10 16:02:55.758460 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.748666 2574 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 10 16:02:55.758460 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.748670 2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 10 16:02:55.758460 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.748673 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 10 16:02:55.758460 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.748676 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 10 16:02:55.758460 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.748679 2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 10 16:02:55.758460 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.748683 2574 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 10 16:02:55.758460 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.748686 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 10 16:02:55.758935 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.748689 2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 10 16:02:55.758935 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.748691 2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 10 16:02:55.758935 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.748694 2574 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 10 16:02:55.758935 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.748697 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 10 16:02:55.758935 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.748699 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 10 16:02:55.758935 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.748702 2574 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 10 16:02:55.758935 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.748704 2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 10 16:02:55.758935 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.748707 2574 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 10 16:02:55.758935 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.748711 2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 10 16:02:55.758935 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.748713 2574 feature_gate.go:328] unrecognized feature gate: Example2 Sep 10 16:02:55.758935 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.748716 2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 10 16:02:55.758935 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.748718 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 10 16:02:55.758935 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.748721 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 10 16:02:55.758935 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.748724 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 10 16:02:55.758935 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.748727 2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 10 16:02:55.758935 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.748730 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 10 16:02:55.758935 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.748732 2574 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 10 16:02:55.758935 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.748734 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 10 16:02:55.758935 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.748737 2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 10 16:02:55.758935 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.748740 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 10 16:02:55.759429 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.748742 2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 10 16:02:55.759429 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.748745 2574 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 10 16:02:55.759429 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.748748 2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 10 16:02:55.759429 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.748750 2574 feature_gate.go:328] unrecognized feature gate: Example Sep 10 16:02:55.759429 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.748753 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 10 16:02:55.759429 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:55.749496 2574 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 10 16:02:55.759429 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:55.757369 2574 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Sep 10 16:02:55.759429 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:55.757384 2574 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Sep 10 16:02:55.759429 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:55.758284 2574 watchdog_linux.go:95] "Systemd watchdog is not enabled" Sep 10 16:02:55.759429 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:55.758292 2574 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Sep 10 16:02:55.759429 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.758357 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 10 16:02:55.759429 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.758362 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 10 16:02:55.759429 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.758366 2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 10 16:02:55.759429 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.758369 2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 10 16:02:55.759429 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.758372 2574 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 10 16:02:55.759851 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.758375 2574 feature_gate.go:328] unrecognized feature gate: Example Sep 10 16:02:55.759851 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.758377 2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 10 16:02:55.759851 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.758380 2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 10 16:02:55.759851 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.758383 2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 10 16:02:55.759851 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.758386 2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 10 16:02:55.759851 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.758389 2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 10 16:02:55.759851 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.758392 2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 10 16:02:55.759851 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.758395 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 10 16:02:55.759851 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.758397 2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 10 16:02:55.759851 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.758400 2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 10 16:02:55.759851 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.758403 2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 10 16:02:55.759851 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.758406 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 10 16:02:55.759851 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.758409 2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 10 16:02:55.759851 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.758412 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 10 16:02:55.759851 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.758414 2574 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 10 16:02:55.759851 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.758419 2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 10 16:02:55.759851 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.758423 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 10 16:02:55.759851 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.758426 2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 10 16:02:55.759851 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.758429 2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 10 16:02:55.759851 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.758432 2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 10 16:02:55.760365 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.758435 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 10 16:02:55.760365 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.758438 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 10 16:02:55.760365 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.758441 2574 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 10 16:02:55.760365 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.758444 2574 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 10 16:02:55.760365 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.758448 2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 10 16:02:55.760365 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.758451 2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 10 16:02:55.760365 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.758454 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 10 16:02:55.760365 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.758456 2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 10 16:02:55.760365 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.758459 2574 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 10 16:02:55.760365 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.758462 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 10 16:02:55.760365 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.758466 2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 10 16:02:55.760365 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.758469 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 10 16:02:55.760365 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.758471 2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 10 16:02:55.760365 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.758474 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 10 16:02:55.760365 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.758476 2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 10 16:02:55.760365 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.758479 2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 10 16:02:55.760365 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.758482 2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 10 16:02:55.760365 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.758484 2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 10 16:02:55.760365 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.758487 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 10 16:02:55.760365 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.758489 2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 10 16:02:55.760845 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.758492 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 10 16:02:55.760845 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.758499 2574 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 10 16:02:55.760845 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.758502 2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 10 16:02:55.760845 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.758504 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 10 16:02:55.760845 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.758512 2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 10 16:02:55.760845 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.758515 2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 10 16:02:55.760845 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.758518 2574 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 10 16:02:55.760845 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.758526 2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 10 16:02:55.760845 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.758529 2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 10 16:02:55.760845 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.758531 2574 feature_gate.go:328] unrecognized feature gate: Example2 Sep 10 16:02:55.760845 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.758534 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 10 16:02:55.760845 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.758536 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 10 16:02:55.760845 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.758539 2574 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 10 16:02:55.760845 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.758542 2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 10 16:02:55.760845 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.758544 2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 10 16:02:55.760845 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.758547 2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 10 16:02:55.760845 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.758550 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 10 16:02:55.760845 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.758552 2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 10 16:02:55.760845 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.758555 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 10 16:02:55.760845 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.758558 2574 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 10 16:02:55.761350 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.758560 2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 10 16:02:55.761350 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.758563 2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 10 16:02:55.761350 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.758565 2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 10 16:02:55.761350 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.758568 2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 10 16:02:55.761350 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.758570 2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 10 16:02:55.761350 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.758573 2574 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 10 16:02:55.761350 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.758576 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 10 16:02:55.761350 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.758578 2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 10 16:02:55.761350 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.758582 2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 10 16:02:55.761350 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.758586 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 10 16:02:55.761350 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.758590 2574 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 10 16:02:55.761350 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.758593 2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 10 16:02:55.761350 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.758596 2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 10 16:02:55.761350 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.758598 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 10 16:02:55.761350 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.758601 2574 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 10 16:02:55.761350 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.758603 2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 10 16:02:55.761350 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.758606 2574 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 10 16:02:55.761350 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.758614 2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 10 16:02:55.761350 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.758617 2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 10 16:02:55.761828 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.758619 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 10 16:02:55.761828 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.758622 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 10 16:02:55.761828 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.758624 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 10 16:02:55.761828 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.758627 2574 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 10 16:02:55.761828 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.758629 2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 10 16:02:55.761828 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.758632 2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 10 16:02:55.761828 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.758634 2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 10 16:02:55.761828 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.758637 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 10 16:02:55.761828 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.758640 2574 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 10 16:02:55.761828 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.758642 2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 10 16:02:55.761828 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.758645 2574 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 10 16:02:55.761828 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.758647 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 10 16:02:55.761828 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.758650 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 10 16:02:55.761828 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.758652 2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 10 16:02:55.761828 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.758655 2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 10 16:02:55.762186 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:55.758660 2574 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 10 16:02:55.762186 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.758811 2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 10 16:02:55.762186 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.758815 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 10 16:02:55.762186 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.758818 2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 10 16:02:55.762186 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.758821 2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 10 16:02:55.762186 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.758824 2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 10 16:02:55.762186 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.758826 2574 feature_gate.go:328] unrecognized feature gate: Example2 Sep 10 16:02:55.762186 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.758829 2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 10 16:02:55.762186 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.758832 2574 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 10 16:02:55.762186 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.758835 2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 10 16:02:55.762186 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.758837 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 10 16:02:55.762186 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.758840 2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 10 16:02:55.762186 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.758842 2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 10 16:02:55.762186 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.758845 2574 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 10 16:02:55.762186 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.758847 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 10 16:02:55.762586 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.758850 2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 10 16:02:55.762586 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.758859 2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 10 16:02:55.762586 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.758862 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 10 16:02:55.762586 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.758865 2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 10 16:02:55.762586 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.758870 2574 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 10 16:02:55.762586 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.758872 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 10 16:02:55.762586 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.758875 2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 10 16:02:55.762586 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.758878 2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 10 16:02:55.762586 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.758880 2574 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 10 16:02:55.762586 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.758883 2574 feature_gate.go:328] unrecognized feature gate: Example Sep 10 16:02:55.762586 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.758885 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 10 16:02:55.762586 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.758888 2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 10 16:02:55.762586 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.758891 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 10 16:02:55.762586 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.758893 2574 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 10 16:02:55.762586 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.758896 2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 10 16:02:55.762586 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.758898 2574 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 10 16:02:55.762586 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.758901 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 10 16:02:55.762586 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.758903 2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 10 16:02:55.762586 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.758906 2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 10 16:02:55.762586 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.758908 2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 10 16:02:55.763062 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.758911 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 10 16:02:55.763062 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.758913 2574 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 10 16:02:55.763062 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.758916 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 10 16:02:55.763062 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.758918 2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 10 16:02:55.763062 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.758921 2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 10 16:02:55.763062 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.758923 2574 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 10 16:02:55.763062 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.758926 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 10 16:02:55.763062 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.758928 2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 10 16:02:55.763062 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.758931 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 10 16:02:55.763062 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.758933 2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 10 16:02:55.763062 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.758936 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 10 16:02:55.763062 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.758939 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 10 16:02:55.763062 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.758941 2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 10 16:02:55.763062 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.758944 2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 10 16:02:55.763062 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.758952 2574 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 10 16:02:55.763062 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.758955 2574 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 10 16:02:55.763062 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.758957 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 10 16:02:55.763062 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.758960 2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 10 16:02:55.763062 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.758962 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 10 16:02:55.763062 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.758964 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 10 16:02:55.763566 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.758968 2574 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 10 16:02:55.763566 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.758972 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 10 16:02:55.763566 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.758975 2574 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 10 16:02:55.763566 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.758978 2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 10 16:02:55.763566 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.758981 2574 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 10 16:02:55.763566 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.758983 2574 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 10 16:02:55.763566 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.758986 2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 10 16:02:55.763566 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.758989 2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 10 16:02:55.763566 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.758991 2574 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 10 16:02:55.763566 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.758994 2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 10 16:02:55.763566 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.758997 2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 10 16:02:55.763566 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.758999 2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 10 16:02:55.763566 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.759002 2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 10 16:02:55.763566 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.759004 2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 10 16:02:55.763566 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.759007 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 10 16:02:55.763566 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.759009 2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 10 16:02:55.763566 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.759012 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 10 16:02:55.763566 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.759015 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 10 16:02:55.763566 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.759017 2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 10 16:02:55.763566 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.759020 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 10 16:02:55.764036 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.759022 2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 10 16:02:55.764036 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.759024 2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 10 16:02:55.764036 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.759027 2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 10 16:02:55.764036 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.759030 2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 10 16:02:55.764036 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.759034 2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 10 16:02:55.764036 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.759037 2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 10 16:02:55.764036 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.759040 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 10 16:02:55.764036 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.759049 2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 10 16:02:55.764036 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.759052 2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 10 16:02:55.764036 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.759055 2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 10 16:02:55.764036 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.759057 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 10 16:02:55.764036 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.759060 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 10 16:02:55.764036 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.759062 2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 10 16:02:55.764036 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.759065 2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 10 16:02:55.764036 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.759067 2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 10 16:02:55.764036 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.759070 2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 10 16:02:55.764036 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.759073 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 10 16:02:55.764036 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.759075 2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 10 16:02:55.764036 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.759078 2574 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 10 16:02:55.764583 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.759081 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 10 16:02:55.764583 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.759083 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 10 16:02:55.764583 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.759086 2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 10 16:02:55.764583 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.759088 2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 10 16:02:55.764583 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.759091 2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 10 16:02:55.764583 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:55.759093 2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 10 16:02:55.764583 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:55.759098 2574 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 10 16:02:55.764583 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:55.759211 2574 server.go:962] "Client rotation is on, will bootstrap in background" Sep 10 16:02:55.764583 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:55.761631 2574 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Sep 10 16:02:55.764583 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:55.762792 2574 server.go:1019] "Starting client certificate rotation" Sep 10 16:02:55.764583 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:55.762895 2574 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Sep 10 16:02:55.764583 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:55.762940 2574 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Sep 10 16:02:55.765730 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:55.765715 2574 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Sep 10 16:02:55.769134 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:55.769108 2574 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Sep 10 16:02:55.784359 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:55.784335 2574 log.go:25] "Validated CRI v1 runtime API" Sep 10 16:02:55.787809 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:55.787786 2574 log.go:25] "Validated CRI v1 image API" Sep 10 16:02:55.788704 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:55.788690 2574 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Sep 10 16:02:55.793070 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:55.793048 2574 fs.go:135] Filesystem UUIDs: map[4983929b-5079-484c-a95d-7d7aa72dabb1:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 bb028c22-f135-4f2e-b523-5c209e34e632:/dev/nvme0n1p3] Sep 10 16:02:55.793161 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:55.793068 2574 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Sep 10 16:02:55.798323 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:55.798305 2574 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Sep 10 16:02:55.798517 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:55.798396 2574 manager.go:216] Machine: {Timestamp:2026-09-10 16:02:55.796896433 +0000 UTC m=+0.362099968 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3115646 MemoryCapacity:33164476416 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec212e15fe3750d08fff625896ad49ca SystemUUID:ec212e15-fe37-50d0-8fff-625896ad49ca BootID:88e8e393-6d57-44cd-b288-f9a3c366912c Filesystems:[{Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582238208 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582238208 Type:vfs Inodes:4048398 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:ee:da:e5:6e:8b Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:ee:da:e5:6e:8b Speed:0 Mtu:9001} {Name:ovs-system MacAddress:2a:0f:19:99:57:3c Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164476416 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Sep 10 16:02:55.798517 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:55.798515 2574 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Sep 10 16:02:55.798704 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:55.798635 2574 manager.go:232] Version: {KernelVersion:5.14.0-570.138.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260901-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Sep 10 16:02:55.802314 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:55.802291 2574 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Sep 10 16:02:55.802458 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:55.802317 2574 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-135-53.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Sep 10 16:02:55.803184 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:55.803174 2574 topology_manager.go:138] "Creating topology manager with none policy" Sep 10 16:02:55.803219 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:55.803186 2574 container_manager_linux.go:309] "Creating device plugin manager" Sep 10 16:02:55.803219 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:55.803193 2574 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Sep 10 16:02:55.803219 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:55.803207 2574 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Sep 10 16:02:55.805422 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:55.805411 2574 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Sep 10 16:02:55.810737 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:55.810725 2574 state_mem.go:36] "Initialized new in-memory state store" Sep 10 16:02:55.810849 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:55.810840 2574 server.go:1240] "Using root directory" path="/var/lib/kubelet" Sep 10 16:02:55.810880 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:55.810875 2574 kubelet.go:486] "Attempting to sync node with API server" Sep 10 16:02:55.810911 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:55.810890 2574 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Sep 10 16:02:55.810911 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:55.810904 2574 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Sep 10 16:02:55.810968 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:55.810912 2574 kubelet.go:398] "Adding apiserver pod source" Sep 10 16:02:55.810968 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:55.810923 2574 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Sep 10 16:02:55.811338 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:55.811327 2574 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Sep 10 16:02:55.811382 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:55.811346 2574 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Sep 10 16:02:55.813699 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:55.813685 2574 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.12-5.rhaos4.21.gitd1ec63c.el9" apiVersion="v1" Sep 10 16:02:55.816538 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:55.816524 2574 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Sep 10 16:02:55.816580 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:55.816554 2574 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Sep 10 16:02:55.816748 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:55.816737 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Sep 10 16:02:55.816777 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:55.816754 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Sep 10 16:02:55.816777 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:55.816760 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Sep 10 16:02:55.816777 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:55.816764 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Sep 10 16:02:55.816777 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:55.816772 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Sep 10 16:02:55.816888 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:55.816783 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Sep 10 16:02:55.817415 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:55.817402 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Sep 10 16:02:55.817415 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:55.817413 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Sep 10 16:02:55.817528 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:55.817420 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Sep 10 16:02:55.817528 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:55.817426 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Sep 10 16:02:55.817528 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:55.817451 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Sep 10 16:02:55.817528 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:55.817465 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Sep 10 16:02:55.818320 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:55.818310 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Sep 10 16:02:55.818320 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:55.818319 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Sep 10 16:02:55.822278 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:55.822250 2574 server.go:1268] "Started kubelet" Sep 10 16:02:55.822405 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:55.822368 2574 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Sep 10 16:02:55.822728 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:55.822571 2574 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Sep 10 16:02:55.822857 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:55.822845 2574 server_v1.go:49] "podresources" method="list" useActivePods=true Sep 10 16:02:55.823583 ip-10-0-135-53 systemd[1]: Started Kubernetes Kubelet. Sep 10 16:02:55.827206 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:55.827169 2574 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-135-53.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Sep 10 16:02:55.827544 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:55.827523 2574 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Sep 10 16:02:55.827846 ip-10-0-135-53 kubenswrapper[2574]: E0910 16:02:55.827740 2574 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-135-53.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Sep 10 16:02:55.828775 ip-10-0-135-53 kubenswrapper[2574]: E0910 16:02:55.828723 2574 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Sep 10 16:02:55.829484 ip-10-0-135-53 kubenswrapper[2574]: E0910 16:02:55.829460 2574 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Sep 10 16:02:55.829837 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:55.829821 2574 server.go:310] "Adding debug handlers to kubelet server" Sep 10 16:02:55.833195 ip-10-0-135-53 kubenswrapper[2574]: E0910 16:02:55.832058 2574 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-135-53.ec2.internal.18d4011cf319fbee default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-135-53.ec2.internal,UID:ip-10-0-135-53.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-135-53.ec2.internal,},FirstTimestamp:2026-09-10 16:02:55.822207982 +0000 UTC m=+0.387411583,LastTimestamp:2026-09-10 16:02:55.822207982 +0000 UTC m=+0.387411583,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-135-53.ec2.internal,}" Sep 10 16:02:55.834310 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:55.834294 2574 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Sep 10 16:02:55.834993 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:55.834974 2574 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Sep 10 16:02:55.835109 ip-10-0-135-53 kubenswrapper[2574]: E0910 16:02:55.835093 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-53.ec2.internal\" not found" Sep 10 16:02:55.835725 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:55.835708 2574 factory.go:55] Registering systemd factory Sep 10 16:02:55.835725 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:55.835727 2574 factory.go:223] Registration of the systemd container factory successfully Sep 10 16:02:55.835829 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:55.835814 2574 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Sep 10 16:02:55.835864 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:55.835816 2574 volume_manager.go:311] "The desired_state_of_world populator starts" Sep 10 16:02:55.835864 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:55.835841 2574 volume_manager.go:313] "Starting Kubelet Volume Manager" Sep 10 16:02:55.835960 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:55.835924 2574 reconstruct.go:97] "Volume reconstruction finished" Sep 10 16:02:55.835960 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:55.835934 2574 reconciler.go:29] "Reconciler: start to sync state" Sep 10 16:02:55.835960 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:55.835956 2574 factory.go:153] Registering CRI-O factory Sep 10 16:02:55.836063 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:55.835969 2574 factory.go:223] Registration of the crio container factory successfully Sep 10 16:02:55.836063 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:55.836007 2574 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Sep 10 16:02:55.836063 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:55.836020 2574 factory.go:103] Registering Raw factory Sep 10 16:02:55.836063 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:55.836030 2574 manager.go:1196] Started watching for new ooms in manager Sep 10 16:02:55.836456 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:55.836445 2574 manager.go:349] Starting recovery of all containers Sep 10 16:02:55.840657 ip-10-0-135-53 kubenswrapper[2574]: E0910 16:02:55.840635 2574 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-135-53.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Sep 10 16:02:55.840742 ip-10-0-135-53 kubenswrapper[2574]: E0910 16:02:55.840699 2574 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Sep 10 16:02:55.846980 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:55.846962 2574 manager.go:354] Recovery completed Sep 10 16:02:55.848712 ip-10-0-135-53 kubenswrapper[2574]: E0910 16:02:55.848677 2574 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": inotify_add_watch /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory Sep 10 16:02:55.852104 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:55.851995 2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 10 16:02:55.854091 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:55.854069 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-53.ec2.internal" event="NodeHasSufficientMemory" Sep 10 16:02:55.854153 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:55.854108 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-53.ec2.internal" event="NodeHasNoDiskPressure" Sep 10 16:02:55.854153 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:55.854121 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-53.ec2.internal" event="NodeHasSufficientPID" Sep 10 16:02:55.854748 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:55.854732 2574 cpu_manager.go:222] "Starting CPU manager" policy="none" Sep 10 16:02:55.854748 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:55.854745 2574 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Sep 10 16:02:55.854748 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:55.854746 2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 10 16:02:55.854906 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:55.854760 2574 state_mem.go:36] "Initialized new in-memory state store" Sep 10 16:02:55.855527 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:55.855510 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-53.ec2.internal" event="NodeHasSufficientMemory" Sep 10 16:02:55.855614 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:55.855534 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-53.ec2.internal" event="NodeHasNoDiskPressure" Sep 10 16:02:55.855614 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:55.855543 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-53.ec2.internal" event="NodeHasSufficientPID" Sep 10 16:02:55.860223 ip-10-0-135-53 kubenswrapper[2574]: E0910 16:02:55.860126 2574 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-135-53.ec2.internal.18d4011cf5007fa6 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-135-53.ec2.internal,UID:ip-10-0-135-53.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-135-53.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-135-53.ec2.internal,},FirstTimestamp:2026-09-10 16:02:55.854092198 +0000 UTC m=+0.419295733,LastTimestamp:2026-09-10 16:02:55.854092198 +0000 UTC m=+0.419295733,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-135-53.ec2.internal,}" Sep 10 16:02:55.868948 ip-10-0-135-53 kubenswrapper[2574]: E0910 16:02:55.868870 2574 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-135-53.ec2.internal.18d4011cf500d70a default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-135-53.ec2.internal,UID:ip-10-0-135-53.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-135-53.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-135-53.ec2.internal,},FirstTimestamp:2026-09-10 16:02:55.85411457 +0000 UTC m=+0.419318105,LastTimestamp:2026-09-10 16:02:55.85411457 +0000 UTC m=+0.419318105,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-135-53.ec2.internal,}" Sep 10 16:02:55.885013 ip-10-0-135-53 kubenswrapper[2574]: E0910 16:02:55.884938 2574 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-135-53.ec2.internal.18d4011cf5010090 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-135-53.ec2.internal,UID:ip-10-0-135-53.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-135-53.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-135-53.ec2.internal,},FirstTimestamp:2026-09-10 16:02:55.8541252 +0000 UTC m=+0.419328735,LastTimestamp:2026-09-10 16:02:55.8541252 +0000 UTC m=+0.419328735,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-135-53.ec2.internal,}" Sep 10 16:02:55.905346 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:55.898534 2574 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-m4c59" Sep 10 16:02:55.905346 ip-10-0-135-53 kubenswrapper[2574]: E0910 16:02:55.902082 2574 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-135-53.ec2.internal.18d4011cf5007fa6\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-135-53.ec2.internal.18d4011cf5007fa6 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-135-53.ec2.internal,UID:ip-10-0-135-53.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-135-53.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-135-53.ec2.internal,},FirstTimestamp:2026-09-10 16:02:55.854092198 +0000 UTC m=+0.419295733,LastTimestamp:2026-09-10 16:02:55.855522296 +0000 UTC m=+0.420725831,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-135-53.ec2.internal,}" Sep 10 16:02:55.909124 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:55.909104 2574 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-m4c59" Sep 10 16:02:55.914064 ip-10-0-135-53 kubenswrapper[2574]: E0910 16:02:55.913985 2574 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-135-53.ec2.internal.18d4011cf500d70a\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-135-53.ec2.internal.18d4011cf500d70a default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-135-53.ec2.internal,UID:ip-10-0-135-53.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-135-53.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-135-53.ec2.internal,},FirstTimestamp:2026-09-10 16:02:55.85411457 +0000 UTC m=+0.419318105,LastTimestamp:2026-09-10 16:02:55.855538468 +0000 UTC m=+0.420742004,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-135-53.ec2.internal,}" Sep 10 16:02:55.931245 ip-10-0-135-53 kubenswrapper[2574]: E0910 16:02:55.931185 2574 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-135-53.ec2.internal.18d4011cf5010090\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-135-53.ec2.internal.18d4011cf5010090 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-135-53.ec2.internal,UID:ip-10-0-135-53.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-135-53.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-135-53.ec2.internal,},FirstTimestamp:2026-09-10 16:02:55.8541252 +0000 UTC m=+0.419328735,LastTimestamp:2026-09-10 16:02:55.855547142 +0000 UTC m=+0.420750677,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-135-53.ec2.internal,}" Sep 10 16:02:55.935326 ip-10-0-135-53 kubenswrapper[2574]: E0910 16:02:55.935303 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-53.ec2.internal\" not found" Sep 10 16:02:55.999459 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:55.999350 2574 policy_none.go:49] "None policy: Start" Sep 10 16:02:55.999459 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:55.999393 2574 memory_manager.go:187] "Starting memorymanager" policy="None" Sep 10 16:02:55.999459 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:55.999408 2574 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Sep 10 16:02:56.001714 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:56.001698 2574 policy_none.go:47] "Start" Sep 10 16:02:56.027816 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:56.027797 2574 manager.go:337] "Starting Device Plugin manager" Sep 10 16:02:56.027917 ip-10-0-135-53 kubenswrapper[2574]: E0910 16:02:56.027836 2574 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Sep 10 16:02:56.027917 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:56.027847 2574 server.go:87] "Starting device plugin registration server" Sep 10 16:02:56.028217 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:56.028206 2574 eviction_manager.go:189] "Eviction manager: starting control loop" Sep 10 16:02:56.028282 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:56.028219 2574 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Sep 10 16:02:56.028491 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:56.028464 2574 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Sep 10 16:02:56.028595 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:56.028557 2574 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Sep 10 16:02:56.028595 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:56.028567 2574 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Sep 10 16:02:56.029015 ip-10-0-135-53 kubenswrapper[2574]: E0910 16:02:56.028997 2574 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Sep 10 16:02:56.029106 ip-10-0-135-53 kubenswrapper[2574]: E0910 16:02:56.029044 2574 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-135-53.ec2.internal\" not found" Sep 10 16:02:56.065641 ip-10-0-135-53 kubenswrapper[2574]: E0910 16:02:56.065619 2574 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-135-53.ec2.internal\" not found" node="ip-10-0-135-53.ec2.internal" Sep 10 16:02:56.072555 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:56.072533 2574 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Sep 10 16:02:56.073702 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:56.073681 2574 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Sep 10 16:02:56.073758 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:56.073738 2574 status_manager.go:244] "Starting to sync pod status with apiserver" Sep 10 16:02:56.073808 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:56.073769 2574 kubelet.go:2448] "Starting kubelet main sync loop" Sep 10 16:02:56.073896 ip-10-0-135-53 kubenswrapper[2574]: E0910 16:02:56.073862 2574 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Sep 10 16:02:56.076392 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:56.076374 2574 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Sep 10 16:02:56.128864 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:56.128831 2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 10 16:02:56.131199 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:56.131181 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-53.ec2.internal" event="NodeHasSufficientMemory" Sep 10 16:02:56.131296 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:56.131212 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-53.ec2.internal" event="NodeHasNoDiskPressure" Sep 10 16:02:56.131296 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:56.131223 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-53.ec2.internal" event="NodeHasSufficientPID" Sep 10 16:02:56.131296 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:56.131250 2574 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-135-53.ec2.internal" Sep 10 16:02:56.139736 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:56.139720 2574 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-135-53.ec2.internal" Sep 10 16:02:56.139800 ip-10-0-135-53 kubenswrapper[2574]: E0910 16:02:56.139742 2574 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-135-53.ec2.internal\": node \"ip-10-0-135-53.ec2.internal\" not found" Sep 10 16:02:56.174421 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:56.174393 2574 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-53.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-135-53.ec2.internal"] Sep 10 16:02:56.174511 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:56.174455 2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 10 16:02:56.175354 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:56.175340 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-53.ec2.internal" event="NodeHasSufficientMemory" Sep 10 16:02:56.175420 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:56.175367 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-53.ec2.internal" event="NodeHasNoDiskPressure" Sep 10 16:02:56.175420 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:56.175381 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-53.ec2.internal" event="NodeHasSufficientPID" Sep 10 16:02:56.177812 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:56.177800 2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 10 16:02:56.177964 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:56.177952 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-53.ec2.internal" Sep 10 16:02:56.178002 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:56.177977 2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 10 16:02:56.178596 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:56.178574 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-53.ec2.internal" event="NodeHasSufficientMemory" Sep 10 16:02:56.178596 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:56.178582 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-53.ec2.internal" event="NodeHasSufficientMemory" Sep 10 16:02:56.178596 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:56.178600 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-53.ec2.internal" event="NodeHasNoDiskPressure" Sep 10 16:02:56.178740 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:56.178606 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-53.ec2.internal" event="NodeHasNoDiskPressure" Sep 10 16:02:56.178740 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:56.178610 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-53.ec2.internal" event="NodeHasSufficientPID" Sep 10 16:02:56.178740 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:56.178616 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-53.ec2.internal" event="NodeHasSufficientPID" Sep 10 16:02:56.180813 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:56.180800 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-53.ec2.internal" Sep 10 16:02:56.180861 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:56.180825 2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 10 16:02:56.181561 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:56.181536 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-53.ec2.internal" event="NodeHasSufficientMemory" Sep 10 16:02:56.181649 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:56.181573 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-53.ec2.internal" event="NodeHasNoDiskPressure" Sep 10 16:02:56.181649 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:56.181588 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-53.ec2.internal" event="NodeHasSufficientPID" Sep 10 16:02:56.207008 ip-10-0-135-53 kubenswrapper[2574]: E0910 16:02:56.206986 2574 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-135-53.ec2.internal\" not found" node="ip-10-0-135-53.ec2.internal" Sep 10 16:02:56.208703 ip-10-0-135-53 kubenswrapper[2574]: E0910 16:02:56.208687 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-53.ec2.internal\" not found" Sep 10 16:02:56.211331 ip-10-0-135-53 kubenswrapper[2574]: E0910 16:02:56.211314 2574 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-135-53.ec2.internal\" not found" node="ip-10-0-135-53.ec2.internal" Sep 10 16:02:56.238353 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:56.238325 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/92f8bc2779a28a3d82961ef2df34966b-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-53.ec2.internal\" (UID: \"92f8bc2779a28a3d82961ef2df34966b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-53.ec2.internal" Sep 10 16:02:56.238470 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:56.238355 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/92f8bc2779a28a3d82961ef2df34966b-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-53.ec2.internal\" (UID: \"92f8bc2779a28a3d82961ef2df34966b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-53.ec2.internal" Sep 10 16:02:56.238470 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:56.238377 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/7c67acd93839c8ffd6aac841aa4d9962-config\") pod \"kube-apiserver-proxy-ip-10-0-135-53.ec2.internal\" (UID: \"7c67acd93839c8ffd6aac841aa4d9962\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-53.ec2.internal" Sep 10 16:02:56.309185 ip-10-0-135-53 kubenswrapper[2574]: E0910 16:02:56.309101 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-53.ec2.internal\" not found" Sep 10 16:02:56.339368 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:56.339345 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/92f8bc2779a28a3d82961ef2df34966b-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-53.ec2.internal\" (UID: \"92f8bc2779a28a3d82961ef2df34966b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-53.ec2.internal" Sep 10 16:02:56.339464 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:56.339373 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/92f8bc2779a28a3d82961ef2df34966b-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-53.ec2.internal\" (UID: \"92f8bc2779a28a3d82961ef2df34966b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-53.ec2.internal" Sep 10 16:02:56.339464 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:56.339398 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/7c67acd93839c8ffd6aac841aa4d9962-config\") pod \"kube-apiserver-proxy-ip-10-0-135-53.ec2.internal\" (UID: \"7c67acd93839c8ffd6aac841aa4d9962\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-53.ec2.internal" Sep 10 16:02:56.339561 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:56.339486 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/92f8bc2779a28a3d82961ef2df34966b-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-53.ec2.internal\" (UID: \"92f8bc2779a28a3d82961ef2df34966b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-53.ec2.internal" Sep 10 16:02:56.339561 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:56.339539 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/7c67acd93839c8ffd6aac841aa4d9962-config\") pod \"kube-apiserver-proxy-ip-10-0-135-53.ec2.internal\" (UID: \"7c67acd93839c8ffd6aac841aa4d9962\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-53.ec2.internal" Sep 10 16:02:56.339642 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:56.339582 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/92f8bc2779a28a3d82961ef2df34966b-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-53.ec2.internal\" (UID: \"92f8bc2779a28a3d82961ef2df34966b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-53.ec2.internal" Sep 10 16:02:56.409796 ip-10-0-135-53 kubenswrapper[2574]: E0910 16:02:56.409763 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-53.ec2.internal\" not found" Sep 10 16:02:56.509845 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:56.509811 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-53.ec2.internal" Sep 10 16:02:56.510000 ip-10-0-135-53 kubenswrapper[2574]: E0910 16:02:56.509822 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-53.ec2.internal\" not found" Sep 10 16:02:56.513604 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:56.513572 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-53.ec2.internal" Sep 10 16:02:56.614813 ip-10-0-135-53 kubenswrapper[2574]: E0910 16:02:56.614723 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-53.ec2.internal\" not found" Sep 10 16:02:56.654448 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:56.654422 2574 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Sep 10 16:02:56.715437 ip-10-0-135-53 kubenswrapper[2574]: E0910 16:02:56.715393 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-53.ec2.internal\" not found" Sep 10 16:02:56.762991 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:56.762964 2574 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Sep 10 16:02:56.763487 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:56.763137 2574 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Sep 10 16:02:56.763487 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:56.763152 2574 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Sep 10 16:02:56.816477 ip-10-0-135-53 kubenswrapper[2574]: E0910 16:02:56.816446 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-53.ec2.internal\" not found" Sep 10 16:02:56.916761 ip-10-0-135-53 kubenswrapper[2574]: E0910 16:02:56.916678 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-53.ec2.internal\" not found" Sep 10 16:02:56.918257 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:56.918240 2574 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Sep 10 16:02:56.989843 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:56.989799 2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 10 16:02:56.990961 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:56.990942 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-53.ec2.internal" event="NodeHasSufficientMemory" Sep 10 16:02:56.991092 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:56.990972 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-53.ec2.internal" event="NodeHasNoDiskPressure" Sep 10 16:02:56.991092 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:56.990985 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-53.ec2.internal" event="NodeHasSufficientPID" Sep 10 16:02:56.999726 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:56.999686 2574 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-09 15:57:56 +0000 UTC" deadline="2028-06-21 12:53:41.712648326 +0000 UTC" Sep 10 16:02:56.999726 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:56.999724 2574 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15596h50m44.712928337s" Sep 10 16:02:57.017794 ip-10-0-135-53 kubenswrapper[2574]: E0910 16:02:57.017770 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-53.ec2.internal\" not found" Sep 10 16:02:57.118518 ip-10-0-135-53 kubenswrapper[2574]: E0910 16:02:57.118474 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-53.ec2.internal\" not found" Sep 10 16:02:57.203129 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:57.203054 2574 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Sep 10 16:02:57.236118 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:57.236089 2574 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-53.ec2.internal" Sep 10 16:02:57.240489 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:57.240452 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod92f8bc2779a28a3d82961ef2df34966b.slice/crio-c3ba2495f5fcd25596f42f16a82e30db6047929388246137afb5355fcd1ef5a8 WatchSource:0}: Error finding container c3ba2495f5fcd25596f42f16a82e30db6047929388246137afb5355fcd1ef5a8: Status 404 returned error can't find the container with id c3ba2495f5fcd25596f42f16a82e30db6047929388246137afb5355fcd1ef5a8 Sep 10 16:02:57.242953 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:57.242929 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7c67acd93839c8ffd6aac841aa4d9962.slice/crio-ac73c9a93feac6603b515abd5a140f7ddb5b01f83135fc17b9c7b8351187ffc3 WatchSource:0}: Error finding container ac73c9a93feac6603b515abd5a140f7ddb5b01f83135fc17b9c7b8351187ffc3: Status 404 returned error can't find the container with id ac73c9a93feac6603b515abd5a140f7ddb5b01f83135fc17b9c7b8351187ffc3 Sep 10 16:02:57.245537 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:57.245518 2574 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 10 16:02:57.250650 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:57.250633 2574 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Sep 10 16:02:57.251482 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:57.251462 2574 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-53.ec2.internal" Sep 10 16:02:57.265028 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:57.265007 2574 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Sep 10 16:02:57.815172 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:57.815129 2574 apiserver.go:52] "Watching apiserver" Sep 10 16:02:57.826899 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:57.826871 2574 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Sep 10 16:02:57.828008 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:57.827971 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-53.ec2.internal","openshift-multus/multus-b2tw8","kube-system/global-pull-secret-syncer-pcsbz","openshift-multus/multus-additional-cni-plugins-dh6tv","openshift-multus/network-metrics-daemon-ct85s","openshift-network-diagnostics/network-check-target-vpl4s","openshift-network-operator/iptables-alerter-56mwl","openshift-ovn-kubernetes/ovnkube-node-tmshf","kube-system/konnectivity-agent-7vxsg","kube-system/kube-apiserver-proxy-ip-10-0-135-53.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nhfjm","openshift-cluster-node-tuning-operator/tuned-52tk7","openshift-dns/node-resolver-zb9sj","openshift-image-registry/node-ca-ml9qs"] Sep 10 16:02:57.830737 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:57.830712 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-56mwl" Sep 10 16:02:57.833401 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:57.833104 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-zb9sj" Sep 10 16:02:57.833643 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:57.833620 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-cjf67\"" Sep 10 16:02:57.833762 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:57.833654 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Sep 10 16:02:57.833927 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:57.833906 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Sep 10 16:02:57.834310 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:57.834288 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Sep 10 16:02:57.834449 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:57.834430 2574 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Sep 10 16:02:57.835801 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:57.835781 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pcsbz" Sep 10 16:02:57.835895 ip-10-0-135-53 kubenswrapper[2574]: E0910 16:02:57.835848 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pcsbz" podUID="aa29ebca-e469-4e43-abda-06f75d9c0a11" Sep 10 16:02:57.836107 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:57.836087 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Sep 10 16:02:57.836547 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:57.836378 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Sep 10 16:02:57.836547 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:57.836455 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-h44x4\"" Sep 10 16:02:57.837903 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:57.837884 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-dh6tv" Sep 10 16:02:57.841091 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:57.841071 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Sep 10 16:02:57.841227 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:57.841210 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Sep 10 16:02:57.841405 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:57.841384 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Sep 10 16:02:57.841632 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:57.841612 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Sep 10 16:02:57.841858 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:57.841839 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-hqk4x\"" Sep 10 16:02:57.841940 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:57.841847 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Sep 10 16:02:57.841998 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:57.841970 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ct85s" Sep 10 16:02:57.842067 ip-10-0-135-53 kubenswrapper[2574]: E0910 16:02:57.842043 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ct85s" podUID="cc55b4de-3d22-4d24-bf28-d018afb0e4bc" Sep 10 16:02:57.844438 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:57.844416 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vpl4s" Sep 10 16:02:57.844533 ip-10-0-135-53 kubenswrapper[2574]: E0910 16:02:57.844487 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vpl4s" podUID="fe979f50-1926-4dc6-9830-76ba5781be0b" Sep 10 16:02:57.846769 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:57.846750 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-7vxsg" Sep 10 16:02:57.847730 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:57.847705 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/aa29ebca-e469-4e43-abda-06f75d9c0a11-dbus\") pod \"global-pull-secret-syncer-pcsbz\" (UID: \"aa29ebca-e469-4e43-abda-06f75d9c0a11\") " pod="kube-system/global-pull-secret-syncer-pcsbz" Sep 10 16:02:57.847842 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:57.847745 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/aa29ebca-e469-4e43-abda-06f75d9c0a11-original-pull-secret\") pod \"global-pull-secret-syncer-pcsbz\" (UID: \"aa29ebca-e469-4e43-abda-06f75d9c0a11\") " pod="kube-system/global-pull-secret-syncer-pcsbz" Sep 10 16:02:57.847842 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:57.847772 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/67ce036d-f4ac-4997-984b-6f4c0197f9ef-iptables-alerter-script\") pod \"iptables-alerter-56mwl\" (UID: \"67ce036d-f4ac-4997-984b-6f4c0197f9ef\") " pod="openshift-network-operator/iptables-alerter-56mwl" Sep 10 16:02:57.847842 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:57.847798 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9d57d542-a9e9-4565-940e-7fc04c2a0498-tmp-dir\") pod \"node-resolver-zb9sj\" (UID: \"9d57d542-a9e9-4565-940e-7fc04c2a0498\") " pod="openshift-dns/node-resolver-zb9sj" Sep 10 16:02:57.848004 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:57.847846 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/699bca8d-6865-43af-b415-6ae212a5decb-cnibin\") pod \"multus-additional-cni-plugins-dh6tv\" (UID: \"699bca8d-6865-43af-b415-6ae212a5decb\") " pod="openshift-multus/multus-additional-cni-plugins-dh6tv" Sep 10 16:02:57.848004 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:57.847889 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/699bca8d-6865-43af-b415-6ae212a5decb-cni-binary-copy\") pod \"multus-additional-cni-plugins-dh6tv\" (UID: \"699bca8d-6865-43af-b415-6ae212a5decb\") " pod="openshift-multus/multus-additional-cni-plugins-dh6tv" Sep 10 16:02:57.848004 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:57.847918 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/699bca8d-6865-43af-b415-6ae212a5decb-tuning-conf-dir\") pod \"multus-additional-cni-plugins-dh6tv\" (UID: \"699bca8d-6865-43af-b415-6ae212a5decb\") " pod="openshift-multus/multus-additional-cni-plugins-dh6tv" Sep 10 16:02:57.848004 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:57.847954 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/699bca8d-6865-43af-b415-6ae212a5decb-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-dh6tv\" (UID: \"699bca8d-6865-43af-b415-6ae212a5decb\") " pod="openshift-multus/multus-additional-cni-plugins-dh6tv" Sep 10 16:02:57.848004 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:57.848001 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kf6nl\" (UniqueName: \"kubernetes.io/projected/699bca8d-6865-43af-b415-6ae212a5decb-kube-api-access-kf6nl\") pod \"multus-additional-cni-plugins-dh6tv\" (UID: \"699bca8d-6865-43af-b415-6ae212a5decb\") " pod="openshift-multus/multus-additional-cni-plugins-dh6tv" Sep 10 16:02:57.848269 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:57.848051 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/67ce036d-f4ac-4997-984b-6f4c0197f9ef-host-slash\") pod \"iptables-alerter-56mwl\" (UID: \"67ce036d-f4ac-4997-984b-6f4c0197f9ef\") " pod="openshift-network-operator/iptables-alerter-56mwl" Sep 10 16:02:57.848269 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:57.848113 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f7f5t\" (UniqueName: \"kubernetes.io/projected/67ce036d-f4ac-4997-984b-6f4c0197f9ef-kube-api-access-f7f5t\") pod \"iptables-alerter-56mwl\" (UID: \"67ce036d-f4ac-4997-984b-6f4c0197f9ef\") " pod="openshift-network-operator/iptables-alerter-56mwl" Sep 10 16:02:57.848269 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:57.848174 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bv2ns\" (UniqueName: \"kubernetes.io/projected/9d57d542-a9e9-4565-940e-7fc04c2a0498-kube-api-access-bv2ns\") pod \"node-resolver-zb9sj\" (UID: \"9d57d542-a9e9-4565-940e-7fc04c2a0498\") " pod="openshift-dns/node-resolver-zb9sj" Sep 10 16:02:57.848269 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:57.848204 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/699bca8d-6865-43af-b415-6ae212a5decb-system-cni-dir\") pod \"multus-additional-cni-plugins-dh6tv\" (UID: \"699bca8d-6865-43af-b415-6ae212a5decb\") " pod="openshift-multus/multus-additional-cni-plugins-dh6tv" Sep 10 16:02:57.848269 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:57.848231 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/699bca8d-6865-43af-b415-6ae212a5decb-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-dh6tv\" (UID: \"699bca8d-6865-43af-b415-6ae212a5decb\") " pod="openshift-multus/multus-additional-cni-plugins-dh6tv" Sep 10 16:02:57.848269 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:57.848259 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/9d57d542-a9e9-4565-940e-7fc04c2a0498-hosts-file\") pod \"node-resolver-zb9sj\" (UID: \"9d57d542-a9e9-4565-940e-7fc04c2a0498\") " pod="openshift-dns/node-resolver-zb9sj" Sep 10 16:02:57.848590 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:57.848309 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/aa29ebca-e469-4e43-abda-06f75d9c0a11-kubelet-config\") pod \"global-pull-secret-syncer-pcsbz\" (UID: \"aa29ebca-e469-4e43-abda-06f75d9c0a11\") " pod="kube-system/global-pull-secret-syncer-pcsbz" Sep 10 16:02:57.849313 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:57.849272 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-ml9qs" Sep 10 16:02:57.850142 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:57.850123 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Sep 10 16:02:57.850241 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:57.850156 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Sep 10 16:02:57.850241 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:57.850203 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-hz7jt\"" Sep 10 16:02:57.851838 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:57.851820 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-b2tw8" Sep 10 16:02:57.852205 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:57.852184 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Sep 10 16:02:57.854355 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:57.854296 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-tw2vn\"" Sep 10 16:02:57.854439 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:57.854412 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Sep 10 16:02:57.854597 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:57.854572 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-tmshf" Sep 10 16:02:57.855523 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:57.855502 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Sep 10 16:02:57.857592 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:57.857574 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nhfjm" Sep 10 16:02:57.860517 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:57.860496 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-52tk7" Sep 10 16:02:57.861012 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:57.860989 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Sep 10 16:02:57.861284 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:57.861263 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Sep 10 16:02:57.861396 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:57.861326 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Sep 10 16:02:57.862796 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:57.862727 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Sep 10 16:02:57.862796 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:57.862771 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Sep 10 16:02:57.863098 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:57.863077 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-f8mdj\"" Sep 10 16:02:57.863387 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:57.863367 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-w8hmh\"" Sep 10 16:02:57.863604 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:57.862773 2574 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Sep 10 16:02:57.863974 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:57.863955 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Sep 10 16:02:57.864450 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:57.864426 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Sep 10 16:02:57.864759 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:57.864742 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Sep 10 16:02:57.865427 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:57.865407 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Sep 10 16:02:57.865833 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:57.865811 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Sep 10 16:02:57.865922 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:57.865882 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-sc86q\"" Sep 10 16:02:57.866314 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:57.866294 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-cwkvq\"" Sep 10 16:02:57.866952 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:57.866935 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Sep 10 16:02:57.867043 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:57.866962 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Sep 10 16:02:57.895166 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:57.895141 2574 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-ts5jt" Sep 10 16:02:57.907397 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:57.907371 2574 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-ts5jt" Sep 10 16:02:57.937207 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:57.937177 2574 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Sep 10 16:02:57.948928 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:57.948899 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/699bca8d-6865-43af-b415-6ae212a5decb-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-dh6tv\" (UID: \"699bca8d-6865-43af-b415-6ae212a5decb\") " pod="openshift-multus/multus-additional-cni-plugins-dh6tv" Sep 10 16:02:57.949059 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:57.948948 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/1f645098-0132-49a2-8c0d-6218d9f1d72a-socket-dir\") pod \"aws-ebs-csi-driver-node-nhfjm\" (UID: \"1f645098-0132-49a2-8c0d-6218d9f1d72a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nhfjm" Sep 10 16:02:57.949059 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:57.948980 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/29475c3c-5237-4543-9316-4b2c46989c08-lib-modules\") pod \"tuned-52tk7\" (UID: \"29475c3c-5237-4543-9316-4b2c46989c08\") " pod="openshift-cluster-node-tuning-operator/tuned-52tk7" Sep 10 16:02:57.949059 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:57.949005 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/29475c3c-5237-4543-9316-4b2c46989c08-etc-tuned\") pod \"tuned-52tk7\" (UID: \"29475c3c-5237-4543-9316-4b2c46989c08\") " pod="openshift-cluster-node-tuning-operator/tuned-52tk7" Sep 10 16:02:57.949059 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:57.949031 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/9f57ca5e-844f-4390-a8e5-07abcea64cb2-agent-certs\") pod \"konnectivity-agent-7vxsg\" (UID: \"9f57ca5e-844f-4390-a8e5-07abcea64cb2\") " pod="kube-system/konnectivity-agent-7vxsg" Sep 10 16:02:57.949282 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:57.949061 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/67ce036d-f4ac-4997-984b-6f4c0197f9ef-iptables-alerter-script\") pod \"iptables-alerter-56mwl\" (UID: \"67ce036d-f4ac-4997-984b-6f4c0197f9ef\") " pod="openshift-network-operator/iptables-alerter-56mwl" Sep 10 16:02:57.949282 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:57.949087 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/aeb39a1e-eea5-4a70-b486-cbdcfafdd25a-multus-daemon-config\") pod \"multus-b2tw8\" (UID: \"aeb39a1e-eea5-4a70-b486-cbdcfafdd25a\") " pod="openshift-multus/multus-b2tw8" Sep 10 16:02:57.949282 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:57.949114 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/aeb39a1e-eea5-4a70-b486-cbdcfafdd25a-host-run-multus-certs\") pod \"multus-b2tw8\" (UID: \"aeb39a1e-eea5-4a70-b486-cbdcfafdd25a\") " pod="openshift-multus/multus-b2tw8" Sep 10 16:02:57.949282 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:57.949143 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/1f645098-0132-49a2-8c0d-6218d9f1d72a-sys-fs\") pod \"aws-ebs-csi-driver-node-nhfjm\" (UID: \"1f645098-0132-49a2-8c0d-6218d9f1d72a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nhfjm" Sep 10 16:02:57.949282 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:57.949170 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/699bca8d-6865-43af-b415-6ae212a5decb-cni-binary-copy\") pod \"multus-additional-cni-plugins-dh6tv\" (UID: \"699bca8d-6865-43af-b415-6ae212a5decb\") " pod="openshift-multus/multus-additional-cni-plugins-dh6tv" Sep 10 16:02:57.949282 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:57.949198 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ce502816-6f0c-458c-b83d-bd1488b32d29-run-openvswitch\") pod \"ovnkube-node-tmshf\" (UID: \"ce502816-6f0c-458c-b83d-bd1488b32d29\") " pod="openshift-ovn-kubernetes/ovnkube-node-tmshf" Sep 10 16:02:57.949282 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:57.949224 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/ce502816-6f0c-458c-b83d-bd1488b32d29-ovnkube-script-lib\") pod \"ovnkube-node-tmshf\" (UID: \"ce502816-6f0c-458c-b83d-bd1488b32d29\") " pod="openshift-ovn-kubernetes/ovnkube-node-tmshf" Sep 10 16:02:57.949282 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:57.949250 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/aeb39a1e-eea5-4a70-b486-cbdcfafdd25a-host-var-lib-cni-bin\") pod \"multus-b2tw8\" (UID: \"aeb39a1e-eea5-4a70-b486-cbdcfafdd25a\") " pod="openshift-multus/multus-b2tw8" Sep 10 16:02:57.949282 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:57.949274 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b91acfa6-5fd3-4aba-a679-aa72dc8d2fe2-host\") pod \"node-ca-ml9qs\" (UID: \"b91acfa6-5fd3-4aba-a679-aa72dc8d2fe2\") " pod="openshift-image-registry/node-ca-ml9qs" Sep 10 16:02:57.949759 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:57.949328 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/aa29ebca-e469-4e43-abda-06f75d9c0a11-kubelet-config\") pod \"global-pull-secret-syncer-pcsbz\" (UID: \"aa29ebca-e469-4e43-abda-06f75d9c0a11\") " pod="kube-system/global-pull-secret-syncer-pcsbz" Sep 10 16:02:57.949759 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:57.949355 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/aa29ebca-e469-4e43-abda-06f75d9c0a11-dbus\") pod \"global-pull-secret-syncer-pcsbz\" (UID: \"aa29ebca-e469-4e43-abda-06f75d9c0a11\") " pod="kube-system/global-pull-secret-syncer-pcsbz" Sep 10 16:02:57.949759 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:57.949387 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/aa29ebca-e469-4e43-abda-06f75d9c0a11-original-pull-secret\") pod \"global-pull-secret-syncer-pcsbz\" (UID: \"aa29ebca-e469-4e43-abda-06f75d9c0a11\") " pod="kube-system/global-pull-secret-syncer-pcsbz" Sep 10 16:02:57.949759 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:57.949433 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/1f645098-0132-49a2-8c0d-6218d9f1d72a-device-dir\") pod \"aws-ebs-csi-driver-node-nhfjm\" (UID: \"1f645098-0132-49a2-8c0d-6218d9f1d72a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nhfjm" Sep 10 16:02:57.949759 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:57.949459 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/aeb39a1e-eea5-4a70-b486-cbdcfafdd25a-system-cni-dir\") pod \"multus-b2tw8\" (UID: \"aeb39a1e-eea5-4a70-b486-cbdcfafdd25a\") " pod="openshift-multus/multus-b2tw8" Sep 10 16:02:57.949759 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:57.949483 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/aeb39a1e-eea5-4a70-b486-cbdcfafdd25a-host-run-netns\") pod \"multus-b2tw8\" (UID: \"aeb39a1e-eea5-4a70-b486-cbdcfafdd25a\") " pod="openshift-multus/multus-b2tw8" Sep 10 16:02:57.949759 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:57.949507 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/aeb39a1e-eea5-4a70-b486-cbdcfafdd25a-multus-conf-dir\") pod \"multus-b2tw8\" (UID: \"aeb39a1e-eea5-4a70-b486-cbdcfafdd25a\") " pod="openshift-multus/multus-b2tw8" Sep 10 16:02:57.949759 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:57.949534 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ce502816-6f0c-458c-b83d-bd1488b32d29-host-cni-bin\") pod \"ovnkube-node-tmshf\" (UID: \"ce502816-6f0c-458c-b83d-bd1488b32d29\") " pod="openshift-ovn-kubernetes/ovnkube-node-tmshf" Sep 10 16:02:57.949759 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:57.949558 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/1f645098-0132-49a2-8c0d-6218d9f1d72a-registration-dir\") pod \"aws-ebs-csi-driver-node-nhfjm\" (UID: \"1f645098-0132-49a2-8c0d-6218d9f1d72a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nhfjm" Sep 10 16:02:57.949759 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:57.949585 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m2cgx\" (UniqueName: \"kubernetes.io/projected/1f645098-0132-49a2-8c0d-6218d9f1d72a-kube-api-access-m2cgx\") pod \"aws-ebs-csi-driver-node-nhfjm\" (UID: \"1f645098-0132-49a2-8c0d-6218d9f1d72a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nhfjm" Sep 10 16:02:57.949759 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:57.949609 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/29475c3c-5237-4543-9316-4b2c46989c08-etc-kubernetes\") pod \"tuned-52tk7\" (UID: \"29475c3c-5237-4543-9316-4b2c46989c08\") " pod="openshift-cluster-node-tuning-operator/tuned-52tk7" Sep 10 16:02:57.949759 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:57.949632 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/29475c3c-5237-4543-9316-4b2c46989c08-var-lib-kubelet\") pod \"tuned-52tk7\" (UID: \"29475c3c-5237-4543-9316-4b2c46989c08\") " pod="openshift-cluster-node-tuning-operator/tuned-52tk7" Sep 10 16:02:57.949759 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:57.949665 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/aeb39a1e-eea5-4a70-b486-cbdcfafdd25a-host-var-lib-cni-multus\") pod \"multus-b2tw8\" (UID: \"aeb39a1e-eea5-4a70-b486-cbdcfafdd25a\") " pod="openshift-multus/multus-b2tw8" Sep 10 16:02:57.949759 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:57.949689 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/ce502816-6f0c-458c-b83d-bd1488b32d29-systemd-units\") pod \"ovnkube-node-tmshf\" (UID: \"ce502816-6f0c-458c-b83d-bd1488b32d29\") " pod="openshift-ovn-kubernetes/ovnkube-node-tmshf" Sep 10 16:02:57.949759 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:57.949718 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ce502816-6f0c-458c-b83d-bd1488b32d29-host-run-ovn-kubernetes\") pod \"ovnkube-node-tmshf\" (UID: \"ce502816-6f0c-458c-b83d-bd1488b32d29\") " pod="openshift-ovn-kubernetes/ovnkube-node-tmshf" Sep 10 16:02:57.949759 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:57.949750 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v7296\" (UniqueName: \"kubernetes.io/projected/b91acfa6-5fd3-4aba-a679-aa72dc8d2fe2-kube-api-access-v7296\") pod \"node-ca-ml9qs\" (UID: \"b91acfa6-5fd3-4aba-a679-aa72dc8d2fe2\") " pod="openshift-image-registry/node-ca-ml9qs" Sep 10 16:02:57.950564 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:57.949781 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/699bca8d-6865-43af-b415-6ae212a5decb-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-dh6tv\" (UID: \"699bca8d-6865-43af-b415-6ae212a5decb\") " pod="openshift-multus/multus-additional-cni-plugins-dh6tv" Sep 10 16:02:57.950564 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:57.949859 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/aa29ebca-e469-4e43-abda-06f75d9c0a11-kubelet-config\") pod \"global-pull-secret-syncer-pcsbz\" (UID: \"aa29ebca-e469-4e43-abda-06f75d9c0a11\") " pod="kube-system/global-pull-secret-syncer-pcsbz" Sep 10 16:02:57.950564 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:57.949919 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kf6nl\" (UniqueName: \"kubernetes.io/projected/699bca8d-6865-43af-b415-6ae212a5decb-kube-api-access-kf6nl\") pod \"multus-additional-cni-plugins-dh6tv\" (UID: \"699bca8d-6865-43af-b415-6ae212a5decb\") " pod="openshift-multus/multus-additional-cni-plugins-dh6tv" Sep 10 16:02:57.950564 ip-10-0-135-53 kubenswrapper[2574]: E0910 16:02:57.950023 2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 10 16:02:57.950564 ip-10-0-135-53 kubenswrapper[2574]: E0910 16:02:57.950110 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aa29ebca-e469-4e43-abda-06f75d9c0a11-original-pull-secret podName:aa29ebca-e469-4e43-abda-06f75d9c0a11 nodeName:}" failed. No retries permitted until 2026-09-10 16:02:58.45007375 +0000 UTC m=+3.015277295 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/aa29ebca-e469-4e43-abda-06f75d9c0a11-original-pull-secret") pod "global-pull-secret-syncer-pcsbz" (UID: "aa29ebca-e469-4e43-abda-06f75d9c0a11") : object "kube-system"/"original-pull-secret" not registered Sep 10 16:02:57.950564 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:57.950294 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/ce502816-6f0c-458c-b83d-bd1488b32d29-node-log\") pod \"ovnkube-node-tmshf\" (UID: \"ce502816-6f0c-458c-b83d-bd1488b32d29\") " pod="openshift-ovn-kubernetes/ovnkube-node-tmshf" Sep 10 16:02:57.950564 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:57.950335 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/29475c3c-5237-4543-9316-4b2c46989c08-etc-sysctl-d\") pod \"tuned-52tk7\" (UID: \"29475c3c-5237-4543-9316-4b2c46989c08\") " pod="openshift-cluster-node-tuning-operator/tuned-52tk7" Sep 10 16:02:57.950564 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:57.950404 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cc55b4de-3d22-4d24-bf28-d018afb0e4bc-metrics-certs\") pod \"network-metrics-daemon-ct85s\" (UID: \"cc55b4de-3d22-4d24-bf28-d018afb0e4bc\") " pod="openshift-multus/network-metrics-daemon-ct85s" Sep 10 16:02:57.950564 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:57.950430 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/aeb39a1e-eea5-4a70-b486-cbdcfafdd25a-cnibin\") pod \"multus-b2tw8\" (UID: \"aeb39a1e-eea5-4a70-b486-cbdcfafdd25a\") " pod="openshift-multus/multus-b2tw8" Sep 10 16:02:57.950564 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:57.950456 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ce502816-6f0c-458c-b83d-bd1488b32d29-var-lib-openvswitch\") pod \"ovnkube-node-tmshf\" (UID: \"ce502816-6f0c-458c-b83d-bd1488b32d29\") " pod="openshift-ovn-kubernetes/ovnkube-node-tmshf" Sep 10 16:02:57.950564 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:57.950484 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ce502816-6f0c-458c-b83d-bd1488b32d29-etc-openvswitch\") pod \"ovnkube-node-tmshf\" (UID: \"ce502816-6f0c-458c-b83d-bd1488b32d29\") " pod="openshift-ovn-kubernetes/ovnkube-node-tmshf" Sep 10 16:02:57.951098 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:57.950560 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ce502816-6f0c-458c-b83d-bd1488b32d29-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-tmshf\" (UID: \"ce502816-6f0c-458c-b83d-bd1488b32d29\") " pod="openshift-ovn-kubernetes/ovnkube-node-tmshf" Sep 10 16:02:57.951098 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:57.950592 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/aa29ebca-e469-4e43-abda-06f75d9c0a11-dbus\") pod \"global-pull-secret-syncer-pcsbz\" (UID: \"aa29ebca-e469-4e43-abda-06f75d9c0a11\") " pod="kube-system/global-pull-secret-syncer-pcsbz" Sep 10 16:02:57.951098 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:57.950603 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/aeb39a1e-eea5-4a70-b486-cbdcfafdd25a-host-run-k8s-cni-cncf-io\") pod \"multus-b2tw8\" (UID: \"aeb39a1e-eea5-4a70-b486-cbdcfafdd25a\") " pod="openshift-multus/multus-b2tw8" Sep 10 16:02:57.951098 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:57.950642 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/aeb39a1e-eea5-4a70-b486-cbdcfafdd25a-etc-kubernetes\") pod \"multus-b2tw8\" (UID: \"aeb39a1e-eea5-4a70-b486-cbdcfafdd25a\") " pod="openshift-multus/multus-b2tw8" Sep 10 16:02:57.951098 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:57.950672 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ce502816-6f0c-458c-b83d-bd1488b32d29-host-slash\") pod \"ovnkube-node-tmshf\" (UID: \"ce502816-6f0c-458c-b83d-bd1488b32d29\") " pod="openshift-ovn-kubernetes/ovnkube-node-tmshf" Sep 10 16:02:57.951098 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:57.950730 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/ce502816-6f0c-458c-b83d-bd1488b32d29-log-socket\") pod \"ovnkube-node-tmshf\" (UID: \"ce502816-6f0c-458c-b83d-bd1488b32d29\") " pod="openshift-ovn-kubernetes/ovnkube-node-tmshf" Sep 10 16:02:57.951098 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:57.950757 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/29475c3c-5237-4543-9316-4b2c46989c08-etc-sysctl-conf\") pod \"tuned-52tk7\" (UID: \"29475c3c-5237-4543-9316-4b2c46989c08\") " pod="openshift-cluster-node-tuning-operator/tuned-52tk7" Sep 10 16:02:57.951098 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:57.950784 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/29475c3c-5237-4543-9316-4b2c46989c08-sys\") pod \"tuned-52tk7\" (UID: \"29475c3c-5237-4543-9316-4b2c46989c08\") " pod="openshift-cluster-node-tuning-operator/tuned-52tk7" Sep 10 16:02:57.951098 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:57.950808 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/b91acfa6-5fd3-4aba-a679-aa72dc8d2fe2-serviceca\") pod \"node-ca-ml9qs\" (UID: \"b91acfa6-5fd3-4aba-a679-aa72dc8d2fe2\") " pod="openshift-image-registry/node-ca-ml9qs" Sep 10 16:02:57.951098 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:57.950854 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/699bca8d-6865-43af-b415-6ae212a5decb-cnibin\") pod \"multus-additional-cni-plugins-dh6tv\" (UID: \"699bca8d-6865-43af-b415-6ae212a5decb\") " pod="openshift-multus/multus-additional-cni-plugins-dh6tv" Sep 10 16:02:57.951098 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:57.950884 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/699bca8d-6865-43af-b415-6ae212a5decb-tuning-conf-dir\") pod \"multus-additional-cni-plugins-dh6tv\" (UID: \"699bca8d-6865-43af-b415-6ae212a5decb\") " pod="openshift-multus/multus-additional-cni-plugins-dh6tv" Sep 10 16:02:57.951098 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:57.950960 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/ce502816-6f0c-458c-b83d-bd1488b32d29-ovnkube-config\") pod \"ovnkube-node-tmshf\" (UID: \"ce502816-6f0c-458c-b83d-bd1488b32d29\") " pod="openshift-ovn-kubernetes/ovnkube-node-tmshf" Sep 10 16:02:57.951098 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:57.950992 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/1f645098-0132-49a2-8c0d-6218d9f1d72a-kubelet-dir\") pod \"aws-ebs-csi-driver-node-nhfjm\" (UID: \"1f645098-0132-49a2-8c0d-6218d9f1d72a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nhfjm" Sep 10 16:02:57.951098 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:57.951029 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/29475c3c-5237-4543-9316-4b2c46989c08-etc-sysconfig\") pod \"tuned-52tk7\" (UID: \"29475c3c-5237-4543-9316-4b2c46989c08\") " pod="openshift-cluster-node-tuning-operator/tuned-52tk7" Sep 10 16:02:57.951098 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:57.951054 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/29475c3c-5237-4543-9316-4b2c46989c08-run\") pod \"tuned-52tk7\" (UID: \"29475c3c-5237-4543-9316-4b2c46989c08\") " pod="openshift-cluster-node-tuning-operator/tuned-52tk7" Sep 10 16:02:57.951098 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:57.951056 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/67ce036d-f4ac-4997-984b-6f4c0197f9ef-iptables-alerter-script\") pod \"iptables-alerter-56mwl\" (UID: \"67ce036d-f4ac-4997-984b-6f4c0197f9ef\") " pod="openshift-network-operator/iptables-alerter-56mwl" Sep 10 16:02:57.951098 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:57.951076 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/29475c3c-5237-4543-9316-4b2c46989c08-tmp\") pod \"tuned-52tk7\" (UID: \"29475c3c-5237-4543-9316-4b2c46989c08\") " pod="openshift-cluster-node-tuning-operator/tuned-52tk7" Sep 10 16:02:57.951853 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:57.951102 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/699bca8d-6865-43af-b415-6ae212a5decb-tuning-conf-dir\") pod \"multus-additional-cni-plugins-dh6tv\" (UID: \"699bca8d-6865-43af-b415-6ae212a5decb\") " pod="openshift-multus/multus-additional-cni-plugins-dh6tv" Sep 10 16:02:57.951853 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:57.951108 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f7f5t\" (UniqueName: \"kubernetes.io/projected/67ce036d-f4ac-4997-984b-6f4c0197f9ef-kube-api-access-f7f5t\") pod \"iptables-alerter-56mwl\" (UID: \"67ce036d-f4ac-4997-984b-6f4c0197f9ef\") " pod="openshift-network-operator/iptables-alerter-56mwl" Sep 10 16:02:57.951853 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:57.951158 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/699bca8d-6865-43af-b415-6ae212a5decb-cnibin\") pod \"multus-additional-cni-plugins-dh6tv\" (UID: \"699bca8d-6865-43af-b415-6ae212a5decb\") " pod="openshift-multus/multus-additional-cni-plugins-dh6tv" Sep 10 16:02:57.951853 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:57.951165 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bv2ns\" (UniqueName: \"kubernetes.io/projected/9d57d542-a9e9-4565-940e-7fc04c2a0498-kube-api-access-bv2ns\") pod \"node-resolver-zb9sj\" (UID: \"9d57d542-a9e9-4565-940e-7fc04c2a0498\") " pod="openshift-dns/node-resolver-zb9sj" Sep 10 16:02:57.951853 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:57.951205 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-scjfb\" (UniqueName: \"kubernetes.io/projected/aeb39a1e-eea5-4a70-b486-cbdcfafdd25a-kube-api-access-scjfb\") pod \"multus-b2tw8\" (UID: \"aeb39a1e-eea5-4a70-b486-cbdcfafdd25a\") " pod="openshift-multus/multus-b2tw8" Sep 10 16:02:57.951853 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:57.951255 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ljsln\" (UniqueName: \"kubernetes.io/projected/ce502816-6f0c-458c-b83d-bd1488b32d29-kube-api-access-ljsln\") pod \"ovnkube-node-tmshf\" (UID: \"ce502816-6f0c-458c-b83d-bd1488b32d29\") " pod="openshift-ovn-kubernetes/ovnkube-node-tmshf" Sep 10 16:02:57.951853 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:57.951385 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/1f645098-0132-49a2-8c0d-6218d9f1d72a-etc-selinux\") pod \"aws-ebs-csi-driver-node-nhfjm\" (UID: \"1f645098-0132-49a2-8c0d-6218d9f1d72a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nhfjm" Sep 10 16:02:57.951853 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:57.951419 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hqnp2\" (UniqueName: \"kubernetes.io/projected/29475c3c-5237-4543-9316-4b2c46989c08-kube-api-access-hqnp2\") pod \"tuned-52tk7\" (UID: \"29475c3c-5237-4543-9316-4b2c46989c08\") " pod="openshift-cluster-node-tuning-operator/tuned-52tk7" Sep 10 16:02:57.951853 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:57.951454 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/9d57d542-a9e9-4565-940e-7fc04c2a0498-hosts-file\") pod \"node-resolver-zb9sj\" (UID: \"9d57d542-a9e9-4565-940e-7fc04c2a0498\") " pod="openshift-dns/node-resolver-zb9sj" Sep 10 16:02:57.951853 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:57.951510 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/aeb39a1e-eea5-4a70-b486-cbdcfafdd25a-multus-cni-dir\") pod \"multus-b2tw8\" (UID: \"aeb39a1e-eea5-4a70-b486-cbdcfafdd25a\") " pod="openshift-multus/multus-b2tw8" Sep 10 16:02:57.951853 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:57.951560 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/9d57d542-a9e9-4565-940e-7fc04c2a0498-hosts-file\") pod \"node-resolver-zb9sj\" (UID: \"9d57d542-a9e9-4565-940e-7fc04c2a0498\") " pod="openshift-dns/node-resolver-zb9sj" Sep 10 16:02:57.951853 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:57.951614 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ce502816-6f0c-458c-b83d-bd1488b32d29-host-run-netns\") pod \"ovnkube-node-tmshf\" (UID: \"ce502816-6f0c-458c-b83d-bd1488b32d29\") " pod="openshift-ovn-kubernetes/ovnkube-node-tmshf" Sep 10 16:02:57.951853 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:57.951644 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/ce502816-6f0c-458c-b83d-bd1488b32d29-host-cni-netd\") pod \"ovnkube-node-tmshf\" (UID: \"ce502816-6f0c-458c-b83d-bd1488b32d29\") " pod="openshift-ovn-kubernetes/ovnkube-node-tmshf" Sep 10 16:02:57.951853 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:57.951671 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/ce502816-6f0c-458c-b83d-bd1488b32d29-ovn-node-metrics-cert\") pod \"ovnkube-node-tmshf\" (UID: \"ce502816-6f0c-458c-b83d-bd1488b32d29\") " pod="openshift-ovn-kubernetes/ovnkube-node-tmshf" Sep 10 16:02:57.951853 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:57.951722 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/29475c3c-5237-4543-9316-4b2c46989c08-etc-systemd\") pod \"tuned-52tk7\" (UID: \"29475c3c-5237-4543-9316-4b2c46989c08\") " pod="openshift-cluster-node-tuning-operator/tuned-52tk7" Sep 10 16:02:57.951853 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:57.951766 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4ltrp\" (UniqueName: \"kubernetes.io/projected/cc55b4de-3d22-4d24-bf28-d018afb0e4bc-kube-api-access-4ltrp\") pod \"network-metrics-daemon-ct85s\" (UID: \"cc55b4de-3d22-4d24-bf28-d018afb0e4bc\") " pod="openshift-multus/network-metrics-daemon-ct85s" Sep 10 16:02:57.952667 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:57.951808 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j69hj\" (UniqueName: \"kubernetes.io/projected/fe979f50-1926-4dc6-9830-76ba5781be0b-kube-api-access-j69hj\") pod \"network-check-target-vpl4s\" (UID: \"fe979f50-1926-4dc6-9830-76ba5781be0b\") " pod="openshift-network-diagnostics/network-check-target-vpl4s" Sep 10 16:02:57.952667 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:57.951842 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9d57d542-a9e9-4565-940e-7fc04c2a0498-tmp-dir\") pod \"node-resolver-zb9sj\" (UID: \"9d57d542-a9e9-4565-940e-7fc04c2a0498\") " pod="openshift-dns/node-resolver-zb9sj" Sep 10 16:02:57.952667 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:57.951898 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/aeb39a1e-eea5-4a70-b486-cbdcfafdd25a-host-var-lib-kubelet\") pod \"multus-b2tw8\" (UID: \"aeb39a1e-eea5-4a70-b486-cbdcfafdd25a\") " pod="openshift-multus/multus-b2tw8" Sep 10 16:02:57.952667 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:57.951968 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/ce502816-6f0c-458c-b83d-bd1488b32d29-run-ovn\") pod \"ovnkube-node-tmshf\" (UID: \"ce502816-6f0c-458c-b83d-bd1488b32d29\") " pod="openshift-ovn-kubernetes/ovnkube-node-tmshf" Sep 10 16:02:57.952667 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:57.952000 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/29475c3c-5237-4543-9316-4b2c46989c08-etc-modprobe-d\") pod \"tuned-52tk7\" (UID: \"29475c3c-5237-4543-9316-4b2c46989c08\") " pod="openshift-cluster-node-tuning-operator/tuned-52tk7" Sep 10 16:02:57.952667 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:57.952045 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/29475c3c-5237-4543-9316-4b2c46989c08-host\") pod \"tuned-52tk7\" (UID: \"29475c3c-5237-4543-9316-4b2c46989c08\") " pod="openshift-cluster-node-tuning-operator/tuned-52tk7" Sep 10 16:02:57.952667 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:57.952046 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/699bca8d-6865-43af-b415-6ae212a5decb-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-dh6tv\" (UID: \"699bca8d-6865-43af-b415-6ae212a5decb\") " pod="openshift-multus/multus-additional-cni-plugins-dh6tv" Sep 10 16:02:57.952667 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:57.952071 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/9f57ca5e-844f-4390-a8e5-07abcea64cb2-konnectivity-ca\") pod \"konnectivity-agent-7vxsg\" (UID: \"9f57ca5e-844f-4390-a8e5-07abcea64cb2\") " pod="kube-system/konnectivity-agent-7vxsg" Sep 10 16:02:57.952667 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:57.952115 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/aeb39a1e-eea5-4a70-b486-cbdcfafdd25a-cni-binary-copy\") pod \"multus-b2tw8\" (UID: \"aeb39a1e-eea5-4a70-b486-cbdcfafdd25a\") " pod="openshift-multus/multus-b2tw8" Sep 10 16:02:57.952667 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:57.952163 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/aeb39a1e-eea5-4a70-b486-cbdcfafdd25a-hostroot\") pod \"multus-b2tw8\" (UID: \"aeb39a1e-eea5-4a70-b486-cbdcfafdd25a\") " pod="openshift-multus/multus-b2tw8" Sep 10 16:02:57.952667 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:57.952188 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9d57d542-a9e9-4565-940e-7fc04c2a0498-tmp-dir\") pod \"node-resolver-zb9sj\" (UID: \"9d57d542-a9e9-4565-940e-7fc04c2a0498\") " pod="openshift-dns/node-resolver-zb9sj" Sep 10 16:02:57.952667 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:57.952194 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/ce502816-6f0c-458c-b83d-bd1488b32d29-env-overrides\") pod \"ovnkube-node-tmshf\" (UID: \"ce502816-6f0c-458c-b83d-bd1488b32d29\") " pod="openshift-ovn-kubernetes/ovnkube-node-tmshf" Sep 10 16:02:57.952667 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:57.952251 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/67ce036d-f4ac-4997-984b-6f4c0197f9ef-host-slash\") pod \"iptables-alerter-56mwl\" (UID: \"67ce036d-f4ac-4997-984b-6f4c0197f9ef\") " pod="openshift-network-operator/iptables-alerter-56mwl" Sep 10 16:02:57.952667 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:57.952281 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/ce502816-6f0c-458c-b83d-bd1488b32d29-host-kubelet\") pod \"ovnkube-node-tmshf\" (UID: \"ce502816-6f0c-458c-b83d-bd1488b32d29\") " pod="openshift-ovn-kubernetes/ovnkube-node-tmshf" Sep 10 16:02:57.952667 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:57.952329 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/67ce036d-f4ac-4997-984b-6f4c0197f9ef-host-slash\") pod \"iptables-alerter-56mwl\" (UID: \"67ce036d-f4ac-4997-984b-6f4c0197f9ef\") " pod="openshift-network-operator/iptables-alerter-56mwl" Sep 10 16:02:57.952667 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:57.952336 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/ce502816-6f0c-458c-b83d-bd1488b32d29-run-systemd\") pod \"ovnkube-node-tmshf\" (UID: \"ce502816-6f0c-458c-b83d-bd1488b32d29\") " pod="openshift-ovn-kubernetes/ovnkube-node-tmshf" Sep 10 16:02:57.952667 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:57.952371 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/aeb39a1e-eea5-4a70-b486-cbdcfafdd25a-multus-socket-dir-parent\") pod \"multus-b2tw8\" (UID: \"aeb39a1e-eea5-4a70-b486-cbdcfafdd25a\") " pod="openshift-multus/multus-b2tw8" Sep 10 16:02:57.953579 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:57.952407 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/699bca8d-6865-43af-b415-6ae212a5decb-system-cni-dir\") pod \"multus-additional-cni-plugins-dh6tv\" (UID: \"699bca8d-6865-43af-b415-6ae212a5decb\") " pod="openshift-multus/multus-additional-cni-plugins-dh6tv" Sep 10 16:02:57.953579 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:57.952479 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/699bca8d-6865-43af-b415-6ae212a5decb-system-cni-dir\") pod \"multus-additional-cni-plugins-dh6tv\" (UID: \"699bca8d-6865-43af-b415-6ae212a5decb\") " pod="openshift-multus/multus-additional-cni-plugins-dh6tv" Sep 10 16:02:57.953579 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:57.952604 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/699bca8d-6865-43af-b415-6ae212a5decb-cni-binary-copy\") pod \"multus-additional-cni-plugins-dh6tv\" (UID: \"699bca8d-6865-43af-b415-6ae212a5decb\") " pod="openshift-multus/multus-additional-cni-plugins-dh6tv" Sep 10 16:02:57.953579 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:57.953005 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/699bca8d-6865-43af-b415-6ae212a5decb-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-dh6tv\" (UID: \"699bca8d-6865-43af-b415-6ae212a5decb\") " pod="openshift-multus/multus-additional-cni-plugins-dh6tv" Sep 10 16:02:57.968120 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:57.967770 2574 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Sep 10 16:02:57.974598 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:57.974564 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f7f5t\" (UniqueName: \"kubernetes.io/projected/67ce036d-f4ac-4997-984b-6f4c0197f9ef-kube-api-access-f7f5t\") pod \"iptables-alerter-56mwl\" (UID: \"67ce036d-f4ac-4997-984b-6f4c0197f9ef\") " pod="openshift-network-operator/iptables-alerter-56mwl" Sep 10 16:02:57.975267 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:57.975245 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bv2ns\" (UniqueName: \"kubernetes.io/projected/9d57d542-a9e9-4565-940e-7fc04c2a0498-kube-api-access-bv2ns\") pod \"node-resolver-zb9sj\" (UID: \"9d57d542-a9e9-4565-940e-7fc04c2a0498\") " pod="openshift-dns/node-resolver-zb9sj" Sep 10 16:02:57.976972 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:57.976949 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kf6nl\" (UniqueName: \"kubernetes.io/projected/699bca8d-6865-43af-b415-6ae212a5decb-kube-api-access-kf6nl\") pod \"multus-additional-cni-plugins-dh6tv\" (UID: \"699bca8d-6865-43af-b415-6ae212a5decb\") " pod="openshift-multus/multus-additional-cni-plugins-dh6tv" Sep 10 16:02:58.033437 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:58.033404 2574 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Sep 10 16:02:58.053516 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:58.053484 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/ce502816-6f0c-458c-b83d-bd1488b32d29-run-systemd\") pod \"ovnkube-node-tmshf\" (UID: \"ce502816-6f0c-458c-b83d-bd1488b32d29\") " pod="openshift-ovn-kubernetes/ovnkube-node-tmshf" Sep 10 16:02:58.053681 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:58.053529 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/aeb39a1e-eea5-4a70-b486-cbdcfafdd25a-multus-socket-dir-parent\") pod \"multus-b2tw8\" (UID: \"aeb39a1e-eea5-4a70-b486-cbdcfafdd25a\") " pod="openshift-multus/multus-b2tw8" Sep 10 16:02:58.053681 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:58.053569 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/1f645098-0132-49a2-8c0d-6218d9f1d72a-socket-dir\") pod \"aws-ebs-csi-driver-node-nhfjm\" (UID: \"1f645098-0132-49a2-8c0d-6218d9f1d72a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nhfjm" Sep 10 16:02:58.053681 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:58.053593 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/29475c3c-5237-4543-9316-4b2c46989c08-lib-modules\") pod \"tuned-52tk7\" (UID: \"29475c3c-5237-4543-9316-4b2c46989c08\") " pod="openshift-cluster-node-tuning-operator/tuned-52tk7" Sep 10 16:02:58.053681 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:58.053617 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/29475c3c-5237-4543-9316-4b2c46989c08-etc-tuned\") pod \"tuned-52tk7\" (UID: \"29475c3c-5237-4543-9316-4b2c46989c08\") " pod="openshift-cluster-node-tuning-operator/tuned-52tk7" Sep 10 16:02:58.053681 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:58.053642 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/9f57ca5e-844f-4390-a8e5-07abcea64cb2-agent-certs\") pod \"konnectivity-agent-7vxsg\" (UID: \"9f57ca5e-844f-4390-a8e5-07abcea64cb2\") " pod="kube-system/konnectivity-agent-7vxsg" Sep 10 16:02:58.053940 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:58.053668 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/aeb39a1e-eea5-4a70-b486-cbdcfafdd25a-multus-daemon-config\") pod \"multus-b2tw8\" (UID: \"aeb39a1e-eea5-4a70-b486-cbdcfafdd25a\") " pod="openshift-multus/multus-b2tw8" Sep 10 16:02:58.053940 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:58.053709 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/aeb39a1e-eea5-4a70-b486-cbdcfafdd25a-multus-socket-dir-parent\") pod \"multus-b2tw8\" (UID: \"aeb39a1e-eea5-4a70-b486-cbdcfafdd25a\") " pod="openshift-multus/multus-b2tw8" Sep 10 16:02:58.053940 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:58.053761 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/aeb39a1e-eea5-4a70-b486-cbdcfafdd25a-host-run-multus-certs\") pod \"multus-b2tw8\" (UID: \"aeb39a1e-eea5-4a70-b486-cbdcfafdd25a\") " pod="openshift-multus/multus-b2tw8" Sep 10 16:02:58.053940 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:58.053778 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/29475c3c-5237-4543-9316-4b2c46989c08-lib-modules\") pod \"tuned-52tk7\" (UID: \"29475c3c-5237-4543-9316-4b2c46989c08\") " pod="openshift-cluster-node-tuning-operator/tuned-52tk7" Sep 10 16:02:58.053940 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:58.053788 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/1f645098-0132-49a2-8c0d-6218d9f1d72a-sys-fs\") pod \"aws-ebs-csi-driver-node-nhfjm\" (UID: \"1f645098-0132-49a2-8c0d-6218d9f1d72a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nhfjm" Sep 10 16:02:58.053940 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:58.053788 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/ce502816-6f0c-458c-b83d-bd1488b32d29-run-systemd\") pod \"ovnkube-node-tmshf\" (UID: \"ce502816-6f0c-458c-b83d-bd1488b32d29\") " pod="openshift-ovn-kubernetes/ovnkube-node-tmshf" Sep 10 16:02:58.053940 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:58.053882 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/aeb39a1e-eea5-4a70-b486-cbdcfafdd25a-host-run-multus-certs\") pod \"multus-b2tw8\" (UID: \"aeb39a1e-eea5-4a70-b486-cbdcfafdd25a\") " pod="openshift-multus/multus-b2tw8" Sep 10 16:02:58.054235 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:58.053961 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/1f645098-0132-49a2-8c0d-6218d9f1d72a-socket-dir\") pod \"aws-ebs-csi-driver-node-nhfjm\" (UID: \"1f645098-0132-49a2-8c0d-6218d9f1d72a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nhfjm" Sep 10 16:02:58.054235 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:58.053962 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/1f645098-0132-49a2-8c0d-6218d9f1d72a-sys-fs\") pod \"aws-ebs-csi-driver-node-nhfjm\" (UID: \"1f645098-0132-49a2-8c0d-6218d9f1d72a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nhfjm" Sep 10 16:02:58.054235 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:58.054108 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ce502816-6f0c-458c-b83d-bd1488b32d29-run-openvswitch\") pod \"ovnkube-node-tmshf\" (UID: \"ce502816-6f0c-458c-b83d-bd1488b32d29\") " pod="openshift-ovn-kubernetes/ovnkube-node-tmshf" Sep 10 16:02:58.054235 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:58.054153 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/ce502816-6f0c-458c-b83d-bd1488b32d29-ovnkube-script-lib\") pod \"ovnkube-node-tmshf\" (UID: \"ce502816-6f0c-458c-b83d-bd1488b32d29\") " pod="openshift-ovn-kubernetes/ovnkube-node-tmshf" Sep 10 16:02:58.054235 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:58.054181 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/aeb39a1e-eea5-4a70-b486-cbdcfafdd25a-host-var-lib-cni-bin\") pod \"multus-b2tw8\" (UID: \"aeb39a1e-eea5-4a70-b486-cbdcfafdd25a\") " pod="openshift-multus/multus-b2tw8" Sep 10 16:02:58.054235 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:58.054207 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b91acfa6-5fd3-4aba-a679-aa72dc8d2fe2-host\") pod \"node-ca-ml9qs\" (UID: \"b91acfa6-5fd3-4aba-a679-aa72dc8d2fe2\") " pod="openshift-image-registry/node-ca-ml9qs" Sep 10 16:02:58.054558 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:58.054253 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/1f645098-0132-49a2-8c0d-6218d9f1d72a-device-dir\") pod \"aws-ebs-csi-driver-node-nhfjm\" (UID: \"1f645098-0132-49a2-8c0d-6218d9f1d72a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nhfjm" Sep 10 16:02:58.054558 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:58.054298 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/aeb39a1e-eea5-4a70-b486-cbdcfafdd25a-system-cni-dir\") pod \"multus-b2tw8\" (UID: \"aeb39a1e-eea5-4a70-b486-cbdcfafdd25a\") " pod="openshift-multus/multus-b2tw8" Sep 10 16:02:58.054558 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:58.054325 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/aeb39a1e-eea5-4a70-b486-cbdcfafdd25a-host-run-netns\") pod \"multus-b2tw8\" (UID: \"aeb39a1e-eea5-4a70-b486-cbdcfafdd25a\") " pod="openshift-multus/multus-b2tw8" Sep 10 16:02:58.054558 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:58.054371 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/aeb39a1e-eea5-4a70-b486-cbdcfafdd25a-multus-conf-dir\") pod \"multus-b2tw8\" (UID: \"aeb39a1e-eea5-4a70-b486-cbdcfafdd25a\") " pod="openshift-multus/multus-b2tw8" Sep 10 16:02:58.054558 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:58.054397 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ce502816-6f0c-458c-b83d-bd1488b32d29-host-cni-bin\") pod \"ovnkube-node-tmshf\" (UID: \"ce502816-6f0c-458c-b83d-bd1488b32d29\") " pod="openshift-ovn-kubernetes/ovnkube-node-tmshf" Sep 10 16:02:58.054558 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:58.054423 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/1f645098-0132-49a2-8c0d-6218d9f1d72a-registration-dir\") pod \"aws-ebs-csi-driver-node-nhfjm\" (UID: \"1f645098-0132-49a2-8c0d-6218d9f1d72a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nhfjm" Sep 10 16:02:58.054558 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:58.054451 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m2cgx\" (UniqueName: \"kubernetes.io/projected/1f645098-0132-49a2-8c0d-6218d9f1d72a-kube-api-access-m2cgx\") pod \"aws-ebs-csi-driver-node-nhfjm\" (UID: \"1f645098-0132-49a2-8c0d-6218d9f1d72a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nhfjm" Sep 10 16:02:58.054558 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:58.054477 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/29475c3c-5237-4543-9316-4b2c46989c08-etc-kubernetes\") pod \"tuned-52tk7\" (UID: \"29475c3c-5237-4543-9316-4b2c46989c08\") " pod="openshift-cluster-node-tuning-operator/tuned-52tk7" Sep 10 16:02:58.054558 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:58.054503 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/29475c3c-5237-4543-9316-4b2c46989c08-var-lib-kubelet\") pod \"tuned-52tk7\" (UID: \"29475c3c-5237-4543-9316-4b2c46989c08\") " pod="openshift-cluster-node-tuning-operator/tuned-52tk7" Sep 10 16:02:58.054558 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:58.054530 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/aeb39a1e-eea5-4a70-b486-cbdcfafdd25a-host-var-lib-cni-multus\") pod \"multus-b2tw8\" (UID: \"aeb39a1e-eea5-4a70-b486-cbdcfafdd25a\") " pod="openshift-multus/multus-b2tw8" Sep 10 16:02:58.054558 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:58.054555 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/ce502816-6f0c-458c-b83d-bd1488b32d29-systemd-units\") pod \"ovnkube-node-tmshf\" (UID: \"ce502816-6f0c-458c-b83d-bd1488b32d29\") " pod="openshift-ovn-kubernetes/ovnkube-node-tmshf" Sep 10 16:02:58.055159 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:58.054582 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ce502816-6f0c-458c-b83d-bd1488b32d29-host-run-ovn-kubernetes\") pod \"ovnkube-node-tmshf\" (UID: \"ce502816-6f0c-458c-b83d-bd1488b32d29\") " pod="openshift-ovn-kubernetes/ovnkube-node-tmshf" Sep 10 16:02:58.055159 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:58.054587 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/aeb39a1e-eea5-4a70-b486-cbdcfafdd25a-multus-daemon-config\") pod \"multus-b2tw8\" (UID: \"aeb39a1e-eea5-4a70-b486-cbdcfafdd25a\") " pod="openshift-multus/multus-b2tw8" Sep 10 16:02:58.055159 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:58.054609 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v7296\" (UniqueName: \"kubernetes.io/projected/b91acfa6-5fd3-4aba-a679-aa72dc8d2fe2-kube-api-access-v7296\") pod \"node-ca-ml9qs\" (UID: \"b91acfa6-5fd3-4aba-a679-aa72dc8d2fe2\") " pod="openshift-image-registry/node-ca-ml9qs" Sep 10 16:02:58.055159 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:58.054647 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/ce502816-6f0c-458c-b83d-bd1488b32d29-node-log\") pod \"ovnkube-node-tmshf\" (UID: \"ce502816-6f0c-458c-b83d-bd1488b32d29\") " pod="openshift-ovn-kubernetes/ovnkube-node-tmshf" Sep 10 16:02:58.055159 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:58.054659 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/aeb39a1e-eea5-4a70-b486-cbdcfafdd25a-multus-conf-dir\") pod \"multus-b2tw8\" (UID: \"aeb39a1e-eea5-4a70-b486-cbdcfafdd25a\") " pod="openshift-multus/multus-b2tw8" Sep 10 16:02:58.055159 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:58.054684 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/29475c3c-5237-4543-9316-4b2c46989c08-etc-sysctl-d\") pod \"tuned-52tk7\" (UID: \"29475c3c-5237-4543-9316-4b2c46989c08\") " pod="openshift-cluster-node-tuning-operator/tuned-52tk7" Sep 10 16:02:58.055159 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:58.054715 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cc55b4de-3d22-4d24-bf28-d018afb0e4bc-metrics-certs\") pod \"network-metrics-daemon-ct85s\" (UID: \"cc55b4de-3d22-4d24-bf28-d018afb0e4bc\") " pod="openshift-multus/network-metrics-daemon-ct85s" Sep 10 16:02:58.055159 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:58.054731 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ce502816-6f0c-458c-b83d-bd1488b32d29-run-openvswitch\") pod \"ovnkube-node-tmshf\" (UID: \"ce502816-6f0c-458c-b83d-bd1488b32d29\") " pod="openshift-ovn-kubernetes/ovnkube-node-tmshf" Sep 10 16:02:58.055159 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:58.054740 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/aeb39a1e-eea5-4a70-b486-cbdcfafdd25a-cnibin\") pod \"multus-b2tw8\" (UID: \"aeb39a1e-eea5-4a70-b486-cbdcfafdd25a\") " pod="openshift-multus/multus-b2tw8" Sep 10 16:02:58.055159 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:58.054769 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ce502816-6f0c-458c-b83d-bd1488b32d29-var-lib-openvswitch\") pod \"ovnkube-node-tmshf\" (UID: \"ce502816-6f0c-458c-b83d-bd1488b32d29\") " pod="openshift-ovn-kubernetes/ovnkube-node-tmshf" Sep 10 16:02:58.055159 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:58.054762 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b91acfa6-5fd3-4aba-a679-aa72dc8d2fe2-host\") pod \"node-ca-ml9qs\" (UID: \"b91acfa6-5fd3-4aba-a679-aa72dc8d2fe2\") " pod="openshift-image-registry/node-ca-ml9qs" Sep 10 16:02:58.055159 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:58.054783 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/1f645098-0132-49a2-8c0d-6218d9f1d72a-device-dir\") pod \"aws-ebs-csi-driver-node-nhfjm\" (UID: \"1f645098-0132-49a2-8c0d-6218d9f1d72a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nhfjm" Sep 10 16:02:58.055159 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:58.054795 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ce502816-6f0c-458c-b83d-bd1488b32d29-etc-openvswitch\") pod \"ovnkube-node-tmshf\" (UID: \"ce502816-6f0c-458c-b83d-bd1488b32d29\") " pod="openshift-ovn-kubernetes/ovnkube-node-tmshf" Sep 10 16:02:58.055159 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:58.054825 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ce502816-6f0c-458c-b83d-bd1488b32d29-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-tmshf\" (UID: \"ce502816-6f0c-458c-b83d-bd1488b32d29\") " pod="openshift-ovn-kubernetes/ovnkube-node-tmshf" Sep 10 16:02:58.055159 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:58.054837 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/aeb39a1e-eea5-4a70-b486-cbdcfafdd25a-system-cni-dir\") pod \"multus-b2tw8\" (UID: \"aeb39a1e-eea5-4a70-b486-cbdcfafdd25a\") " pod="openshift-multus/multus-b2tw8" Sep 10 16:02:58.055159 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:58.054856 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/aeb39a1e-eea5-4a70-b486-cbdcfafdd25a-host-run-k8s-cni-cncf-io\") pod \"multus-b2tw8\" (UID: \"aeb39a1e-eea5-4a70-b486-cbdcfafdd25a\") " pod="openshift-multus/multus-b2tw8" Sep 10 16:02:58.055159 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:58.054896 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/aeb39a1e-eea5-4a70-b486-cbdcfafdd25a-etc-kubernetes\") pod \"multus-b2tw8\" (UID: \"aeb39a1e-eea5-4a70-b486-cbdcfafdd25a\") " pod="openshift-multus/multus-b2tw8" Sep 10 16:02:58.055159 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:58.054899 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/aeb39a1e-eea5-4a70-b486-cbdcfafdd25a-host-run-netns\") pod \"multus-b2tw8\" (UID: \"aeb39a1e-eea5-4a70-b486-cbdcfafdd25a\") " pod="openshift-multus/multus-b2tw8" Sep 10 16:02:58.056118 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:58.054922 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ce502816-6f0c-458c-b83d-bd1488b32d29-host-slash\") pod \"ovnkube-node-tmshf\" (UID: \"ce502816-6f0c-458c-b83d-bd1488b32d29\") " pod="openshift-ovn-kubernetes/ovnkube-node-tmshf" Sep 10 16:02:58.056118 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:58.054942 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/ce502816-6f0c-458c-b83d-bd1488b32d29-node-log\") pod \"ovnkube-node-tmshf\" (UID: \"ce502816-6f0c-458c-b83d-bd1488b32d29\") " pod="openshift-ovn-kubernetes/ovnkube-node-tmshf" Sep 10 16:02:58.056118 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:58.054948 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/ce502816-6f0c-458c-b83d-bd1488b32d29-log-socket\") pod \"ovnkube-node-tmshf\" (UID: \"ce502816-6f0c-458c-b83d-bd1488b32d29\") " pod="openshift-ovn-kubernetes/ovnkube-node-tmshf" Sep 10 16:02:58.056118 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:58.054989 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ce502816-6f0c-458c-b83d-bd1488b32d29-host-cni-bin\") pod \"ovnkube-node-tmshf\" (UID: \"ce502816-6f0c-458c-b83d-bd1488b32d29\") " pod="openshift-ovn-kubernetes/ovnkube-node-tmshf" Sep 10 16:02:58.056118 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:58.055008 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/ce502816-6f0c-458c-b83d-bd1488b32d29-log-socket\") pod \"ovnkube-node-tmshf\" (UID: \"ce502816-6f0c-458c-b83d-bd1488b32d29\") " pod="openshift-ovn-kubernetes/ovnkube-node-tmshf" Sep 10 16:02:58.056118 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:58.055072 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/1f645098-0132-49a2-8c0d-6218d9f1d72a-registration-dir\") pod \"aws-ebs-csi-driver-node-nhfjm\" (UID: \"1f645098-0132-49a2-8c0d-6218d9f1d72a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nhfjm" Sep 10 16:02:58.056118 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:58.055119 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/29475c3c-5237-4543-9316-4b2c46989c08-etc-sysctl-d\") pod \"tuned-52tk7\" (UID: \"29475c3c-5237-4543-9316-4b2c46989c08\") " pod="openshift-cluster-node-tuning-operator/tuned-52tk7" Sep 10 16:02:58.056118 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:58.055459 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/29475c3c-5237-4543-9316-4b2c46989c08-etc-kubernetes\") pod \"tuned-52tk7\" (UID: \"29475c3c-5237-4543-9316-4b2c46989c08\") " pod="openshift-cluster-node-tuning-operator/tuned-52tk7" Sep 10 16:02:58.056118 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:58.055489 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/ce502816-6f0c-458c-b83d-bd1488b32d29-ovnkube-script-lib\") pod \"ovnkube-node-tmshf\" (UID: \"ce502816-6f0c-458c-b83d-bd1488b32d29\") " pod="openshift-ovn-kubernetes/ovnkube-node-tmshf" Sep 10 16:02:58.056118 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:58.055526 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/29475c3c-5237-4543-9316-4b2c46989c08-var-lib-kubelet\") pod \"tuned-52tk7\" (UID: \"29475c3c-5237-4543-9316-4b2c46989c08\") " pod="openshift-cluster-node-tuning-operator/tuned-52tk7" Sep 10 16:02:58.056118 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:58.055554 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/aeb39a1e-eea5-4a70-b486-cbdcfafdd25a-host-var-lib-cni-bin\") pod \"multus-b2tw8\" (UID: \"aeb39a1e-eea5-4a70-b486-cbdcfafdd25a\") " pod="openshift-multus/multus-b2tw8" Sep 10 16:02:58.056118 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:58.055574 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/aeb39a1e-eea5-4a70-b486-cbdcfafdd25a-host-var-lib-cni-multus\") pod \"multus-b2tw8\" (UID: \"aeb39a1e-eea5-4a70-b486-cbdcfafdd25a\") " pod="openshift-multus/multus-b2tw8" Sep 10 16:02:58.056118 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:58.055609 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ce502816-6f0c-458c-b83d-bd1488b32d29-host-run-ovn-kubernetes\") pod \"ovnkube-node-tmshf\" (UID: \"ce502816-6f0c-458c-b83d-bd1488b32d29\") " pod="openshift-ovn-kubernetes/ovnkube-node-tmshf" Sep 10 16:02:58.056118 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:58.055659 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/ce502816-6f0c-458c-b83d-bd1488b32d29-systemd-units\") pod \"ovnkube-node-tmshf\" (UID: \"ce502816-6f0c-458c-b83d-bd1488b32d29\") " pod="openshift-ovn-kubernetes/ovnkube-node-tmshf" Sep 10 16:02:58.056118 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:58.055708 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ce502816-6f0c-458c-b83d-bd1488b32d29-etc-openvswitch\") pod \"ovnkube-node-tmshf\" (UID: \"ce502816-6f0c-458c-b83d-bd1488b32d29\") " pod="openshift-ovn-kubernetes/ovnkube-node-tmshf" Sep 10 16:02:58.056118 ip-10-0-135-53 kubenswrapper[2574]: E0910 16:02:58.055800 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 16:02:58.056118 ip-10-0-135-53 kubenswrapper[2574]: E0910 16:02:58.055854 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cc55b4de-3d22-4d24-bf28-d018afb0e4bc-metrics-certs podName:cc55b4de-3d22-4d24-bf28-d018afb0e4bc nodeName:}" failed. No retries permitted until 2026-09-10 16:02:58.555834832 +0000 UTC m=+3.121038371 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cc55b4de-3d22-4d24-bf28-d018afb0e4bc-metrics-certs") pod "network-metrics-daemon-ct85s" (UID: "cc55b4de-3d22-4d24-bf28-d018afb0e4bc") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 16:02:58.056810 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:58.055886 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/29475c3c-5237-4543-9316-4b2c46989c08-etc-sysctl-conf\") pod \"tuned-52tk7\" (UID: \"29475c3c-5237-4543-9316-4b2c46989c08\") " pod="openshift-cluster-node-tuning-operator/tuned-52tk7" Sep 10 16:02:58.056810 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:58.055900 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/aeb39a1e-eea5-4a70-b486-cbdcfafdd25a-cnibin\") pod \"multus-b2tw8\" (UID: \"aeb39a1e-eea5-4a70-b486-cbdcfafdd25a\") " pod="openshift-multus/multus-b2tw8" Sep 10 16:02:58.056810 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:58.055915 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/29475c3c-5237-4543-9316-4b2c46989c08-sys\") pod \"tuned-52tk7\" (UID: \"29475c3c-5237-4543-9316-4b2c46989c08\") " pod="openshift-cluster-node-tuning-operator/tuned-52tk7" Sep 10 16:02:58.056810 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:58.055950 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/b91acfa6-5fd3-4aba-a679-aa72dc8d2fe2-serviceca\") pod \"node-ca-ml9qs\" (UID: \"b91acfa6-5fd3-4aba-a679-aa72dc8d2fe2\") " pod="openshift-image-registry/node-ca-ml9qs" Sep 10 16:02:58.056810 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:58.055958 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/aeb39a1e-eea5-4a70-b486-cbdcfafdd25a-host-run-k8s-cni-cncf-io\") pod \"multus-b2tw8\" (UID: \"aeb39a1e-eea5-4a70-b486-cbdcfafdd25a\") " pod="openshift-multus/multus-b2tw8" Sep 10 16:02:58.056810 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:58.055990 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/ce502816-6f0c-458c-b83d-bd1488b32d29-ovnkube-config\") pod \"ovnkube-node-tmshf\" (UID: \"ce502816-6f0c-458c-b83d-bd1488b32d29\") " pod="openshift-ovn-kubernetes/ovnkube-node-tmshf" Sep 10 16:02:58.056810 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:58.056014 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ce502816-6f0c-458c-b83d-bd1488b32d29-var-lib-openvswitch\") pod \"ovnkube-node-tmshf\" (UID: \"ce502816-6f0c-458c-b83d-bd1488b32d29\") " pod="openshift-ovn-kubernetes/ovnkube-node-tmshf" Sep 10 16:02:58.056810 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:58.056031 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/1f645098-0132-49a2-8c0d-6218d9f1d72a-kubelet-dir\") pod \"aws-ebs-csi-driver-node-nhfjm\" (UID: \"1f645098-0132-49a2-8c0d-6218d9f1d72a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nhfjm" Sep 10 16:02:58.056810 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:58.056056 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/29475c3c-5237-4543-9316-4b2c46989c08-etc-sysconfig\") pod \"tuned-52tk7\" (UID: \"29475c3c-5237-4543-9316-4b2c46989c08\") " pod="openshift-cluster-node-tuning-operator/tuned-52tk7" Sep 10 16:02:58.056810 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:58.056082 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/29475c3c-5237-4543-9316-4b2c46989c08-run\") pod \"tuned-52tk7\" (UID: \"29475c3c-5237-4543-9316-4b2c46989c08\") " pod="openshift-cluster-node-tuning-operator/tuned-52tk7" Sep 10 16:02:58.056810 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:58.056112 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/29475c3c-5237-4543-9316-4b2c46989c08-tmp\") pod \"tuned-52tk7\" (UID: \"29475c3c-5237-4543-9316-4b2c46989c08\") " pod="openshift-cluster-node-tuning-operator/tuned-52tk7" Sep 10 16:02:58.056810 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:58.056137 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-scjfb\" (UniqueName: \"kubernetes.io/projected/aeb39a1e-eea5-4a70-b486-cbdcfafdd25a-kube-api-access-scjfb\") pod \"multus-b2tw8\" (UID: \"aeb39a1e-eea5-4a70-b486-cbdcfafdd25a\") " pod="openshift-multus/multus-b2tw8" Sep 10 16:02:58.056810 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:58.056150 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/29475c3c-5237-4543-9316-4b2c46989c08-etc-sysctl-conf\") pod \"tuned-52tk7\" (UID: \"29475c3c-5237-4543-9316-4b2c46989c08\") " pod="openshift-cluster-node-tuning-operator/tuned-52tk7" Sep 10 16:02:58.056810 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:58.056162 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ljsln\" (UniqueName: \"kubernetes.io/projected/ce502816-6f0c-458c-b83d-bd1488b32d29-kube-api-access-ljsln\") pod \"ovnkube-node-tmshf\" (UID: \"ce502816-6f0c-458c-b83d-bd1488b32d29\") " pod="openshift-ovn-kubernetes/ovnkube-node-tmshf" Sep 10 16:02:58.056810 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:58.056192 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/1f645098-0132-49a2-8c0d-6218d9f1d72a-etc-selinux\") pod \"aws-ebs-csi-driver-node-nhfjm\" (UID: \"1f645098-0132-49a2-8c0d-6218d9f1d72a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nhfjm" Sep 10 16:02:58.056810 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:58.056198 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/29475c3c-5237-4543-9316-4b2c46989c08-sys\") pod \"tuned-52tk7\" (UID: \"29475c3c-5237-4543-9316-4b2c46989c08\") " pod="openshift-cluster-node-tuning-operator/tuned-52tk7" Sep 10 16:02:58.056810 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:58.056218 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hqnp2\" (UniqueName: \"kubernetes.io/projected/29475c3c-5237-4543-9316-4b2c46989c08-kube-api-access-hqnp2\") pod \"tuned-52tk7\" (UID: \"29475c3c-5237-4543-9316-4b2c46989c08\") " pod="openshift-cluster-node-tuning-operator/tuned-52tk7" Sep 10 16:02:58.056810 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:58.056242 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/aeb39a1e-eea5-4a70-b486-cbdcfafdd25a-multus-cni-dir\") pod \"multus-b2tw8\" (UID: \"aeb39a1e-eea5-4a70-b486-cbdcfafdd25a\") " pod="openshift-multus/multus-b2tw8" Sep 10 16:02:58.057525 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:58.056267 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ce502816-6f0c-458c-b83d-bd1488b32d29-host-run-netns\") pod \"ovnkube-node-tmshf\" (UID: \"ce502816-6f0c-458c-b83d-bd1488b32d29\") " pod="openshift-ovn-kubernetes/ovnkube-node-tmshf" Sep 10 16:02:58.057525 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:58.056293 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/ce502816-6f0c-458c-b83d-bd1488b32d29-host-cni-netd\") pod \"ovnkube-node-tmshf\" (UID: \"ce502816-6f0c-458c-b83d-bd1488b32d29\") " pod="openshift-ovn-kubernetes/ovnkube-node-tmshf" Sep 10 16:02:58.057525 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:58.056317 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/ce502816-6f0c-458c-b83d-bd1488b32d29-ovn-node-metrics-cert\") pod \"ovnkube-node-tmshf\" (UID: \"ce502816-6f0c-458c-b83d-bd1488b32d29\") " pod="openshift-ovn-kubernetes/ovnkube-node-tmshf" Sep 10 16:02:58.057525 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:58.056357 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/29475c3c-5237-4543-9316-4b2c46989c08-etc-systemd\") pod \"tuned-52tk7\" (UID: \"29475c3c-5237-4543-9316-4b2c46989c08\") " pod="openshift-cluster-node-tuning-operator/tuned-52tk7" Sep 10 16:02:58.057525 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:58.056391 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4ltrp\" (UniqueName: \"kubernetes.io/projected/cc55b4de-3d22-4d24-bf28-d018afb0e4bc-kube-api-access-4ltrp\") pod \"network-metrics-daemon-ct85s\" (UID: \"cc55b4de-3d22-4d24-bf28-d018afb0e4bc\") " pod="openshift-multus/network-metrics-daemon-ct85s" Sep 10 16:02:58.057525 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:58.056420 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j69hj\" (UniqueName: \"kubernetes.io/projected/fe979f50-1926-4dc6-9830-76ba5781be0b-kube-api-access-j69hj\") pod \"network-check-target-vpl4s\" (UID: \"fe979f50-1926-4dc6-9830-76ba5781be0b\") " pod="openshift-network-diagnostics/network-check-target-vpl4s" Sep 10 16:02:58.057525 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:58.056450 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/aeb39a1e-eea5-4a70-b486-cbdcfafdd25a-host-var-lib-kubelet\") pod \"multus-b2tw8\" (UID: \"aeb39a1e-eea5-4a70-b486-cbdcfafdd25a\") " pod="openshift-multus/multus-b2tw8" Sep 10 16:02:58.057525 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:58.056483 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/ce502816-6f0c-458c-b83d-bd1488b32d29-run-ovn\") pod \"ovnkube-node-tmshf\" (UID: \"ce502816-6f0c-458c-b83d-bd1488b32d29\") " pod="openshift-ovn-kubernetes/ovnkube-node-tmshf" Sep 10 16:02:58.057525 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:58.056508 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/29475c3c-5237-4543-9316-4b2c46989c08-etc-modprobe-d\") pod \"tuned-52tk7\" (UID: \"29475c3c-5237-4543-9316-4b2c46989c08\") " pod="openshift-cluster-node-tuning-operator/tuned-52tk7" Sep 10 16:02:58.057525 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:58.056537 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/29475c3c-5237-4543-9316-4b2c46989c08-host\") pod \"tuned-52tk7\" (UID: \"29475c3c-5237-4543-9316-4b2c46989c08\") " pod="openshift-cluster-node-tuning-operator/tuned-52tk7" Sep 10 16:02:58.057525 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:58.056573 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/9f57ca5e-844f-4390-a8e5-07abcea64cb2-konnectivity-ca\") pod \"konnectivity-agent-7vxsg\" (UID: \"9f57ca5e-844f-4390-a8e5-07abcea64cb2\") " pod="kube-system/konnectivity-agent-7vxsg" Sep 10 16:02:58.057525 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:58.056603 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/aeb39a1e-eea5-4a70-b486-cbdcfafdd25a-cni-binary-copy\") pod \"multus-b2tw8\" (UID: \"aeb39a1e-eea5-4a70-b486-cbdcfafdd25a\") " pod="openshift-multus/multus-b2tw8" Sep 10 16:02:58.057525 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:58.056615 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ce502816-6f0c-458c-b83d-bd1488b32d29-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-tmshf\" (UID: \"ce502816-6f0c-458c-b83d-bd1488b32d29\") " pod="openshift-ovn-kubernetes/ovnkube-node-tmshf" Sep 10 16:02:58.057525 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:58.056630 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/aeb39a1e-eea5-4a70-b486-cbdcfafdd25a-hostroot\") pod \"multus-b2tw8\" (UID: \"aeb39a1e-eea5-4a70-b486-cbdcfafdd25a\") " pod="openshift-multus/multus-b2tw8" Sep 10 16:02:58.057525 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:58.056663 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/ce502816-6f0c-458c-b83d-bd1488b32d29-env-overrides\") pod \"ovnkube-node-tmshf\" (UID: \"ce502816-6f0c-458c-b83d-bd1488b32d29\") " pod="openshift-ovn-kubernetes/ovnkube-node-tmshf" Sep 10 16:02:58.057525 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:58.056693 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/ce502816-6f0c-458c-b83d-bd1488b32d29-host-kubelet\") pod \"ovnkube-node-tmshf\" (UID: \"ce502816-6f0c-458c-b83d-bd1488b32d29\") " pod="openshift-ovn-kubernetes/ovnkube-node-tmshf" Sep 10 16:02:58.057525 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:58.056730 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/aeb39a1e-eea5-4a70-b486-cbdcfafdd25a-etc-kubernetes\") pod \"multus-b2tw8\" (UID: \"aeb39a1e-eea5-4a70-b486-cbdcfafdd25a\") " pod="openshift-multus/multus-b2tw8" Sep 10 16:02:58.058272 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:58.056791 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/ce502816-6f0c-458c-b83d-bd1488b32d29-host-kubelet\") pod \"ovnkube-node-tmshf\" (UID: \"ce502816-6f0c-458c-b83d-bd1488b32d29\") " pod="openshift-ovn-kubernetes/ovnkube-node-tmshf" Sep 10 16:02:58.058272 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:58.056804 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ce502816-6f0c-458c-b83d-bd1488b32d29-host-slash\") pod \"ovnkube-node-tmshf\" (UID: \"ce502816-6f0c-458c-b83d-bd1488b32d29\") " pod="openshift-ovn-kubernetes/ovnkube-node-tmshf" Sep 10 16:02:58.058272 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:58.057073 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/1f645098-0132-49a2-8c0d-6218d9f1d72a-etc-selinux\") pod \"aws-ebs-csi-driver-node-nhfjm\" (UID: \"1f645098-0132-49a2-8c0d-6218d9f1d72a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nhfjm" Sep 10 16:02:58.058272 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:58.057331 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/aeb39a1e-eea5-4a70-b486-cbdcfafdd25a-multus-cni-dir\") pod \"multus-b2tw8\" (UID: \"aeb39a1e-eea5-4a70-b486-cbdcfafdd25a\") " pod="openshift-multus/multus-b2tw8" Sep 10 16:02:58.058272 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:58.057406 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/29475c3c-5237-4543-9316-4b2c46989c08-run\") pod \"tuned-52tk7\" (UID: \"29475c3c-5237-4543-9316-4b2c46989c08\") " pod="openshift-cluster-node-tuning-operator/tuned-52tk7" Sep 10 16:02:58.058272 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:58.057452 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ce502816-6f0c-458c-b83d-bd1488b32d29-host-run-netns\") pod \"ovnkube-node-tmshf\" (UID: \"ce502816-6f0c-458c-b83d-bd1488b32d29\") " pod="openshift-ovn-kubernetes/ovnkube-node-tmshf" Sep 10 16:02:58.058272 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:58.057479 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/ce502816-6f0c-458c-b83d-bd1488b32d29-host-cni-netd\") pod \"ovnkube-node-tmshf\" (UID: \"ce502816-6f0c-458c-b83d-bd1488b32d29\") " pod="openshift-ovn-kubernetes/ovnkube-node-tmshf" Sep 10 16:02:58.058272 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:58.057820 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/aeb39a1e-eea5-4a70-b486-cbdcfafdd25a-host-var-lib-kubelet\") pod \"multus-b2tw8\" (UID: \"aeb39a1e-eea5-4a70-b486-cbdcfafdd25a\") " pod="openshift-multus/multus-b2tw8" Sep 10 16:02:58.058272 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:58.057836 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/29475c3c-5237-4543-9316-4b2c46989c08-etc-modprobe-d\") pod \"tuned-52tk7\" (UID: \"29475c3c-5237-4543-9316-4b2c46989c08\") " pod="openshift-cluster-node-tuning-operator/tuned-52tk7" Sep 10 16:02:58.058272 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:58.057884 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/29475c3c-5237-4543-9316-4b2c46989c08-etc-systemd\") pod \"tuned-52tk7\" (UID: \"29475c3c-5237-4543-9316-4b2c46989c08\") " pod="openshift-cluster-node-tuning-operator/tuned-52tk7" Sep 10 16:02:58.058272 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:58.057912 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/ce502816-6f0c-458c-b83d-bd1488b32d29-run-ovn\") pod \"ovnkube-node-tmshf\" (UID: \"ce502816-6f0c-458c-b83d-bd1488b32d29\") " pod="openshift-ovn-kubernetes/ovnkube-node-tmshf" Sep 10 16:02:58.058272 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:58.057962 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/1f645098-0132-49a2-8c0d-6218d9f1d72a-kubelet-dir\") pod \"aws-ebs-csi-driver-node-nhfjm\" (UID: \"1f645098-0132-49a2-8c0d-6218d9f1d72a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nhfjm" Sep 10 16:02:58.058272 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:58.058057 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/29475c3c-5237-4543-9316-4b2c46989c08-host\") pod \"tuned-52tk7\" (UID: \"29475c3c-5237-4543-9316-4b2c46989c08\") " pod="openshift-cluster-node-tuning-operator/tuned-52tk7" Sep 10 16:02:58.058272 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:58.058118 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/aeb39a1e-eea5-4a70-b486-cbdcfafdd25a-hostroot\") pod \"multus-b2tw8\" (UID: \"aeb39a1e-eea5-4a70-b486-cbdcfafdd25a\") " pod="openshift-multus/multus-b2tw8" Sep 10 16:02:58.058272 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:58.058169 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/29475c3c-5237-4543-9316-4b2c46989c08-etc-sysconfig\") pod \"tuned-52tk7\" (UID: \"29475c3c-5237-4543-9316-4b2c46989c08\") " pod="openshift-cluster-node-tuning-operator/tuned-52tk7" Sep 10 16:02:58.060461 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:58.060435 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/ce502816-6f0c-458c-b83d-bd1488b32d29-ovnkube-config\") pod \"ovnkube-node-tmshf\" (UID: \"ce502816-6f0c-458c-b83d-bd1488b32d29\") " pod="openshift-ovn-kubernetes/ovnkube-node-tmshf" Sep 10 16:02:58.060617 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:58.060592 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/b91acfa6-5fd3-4aba-a679-aa72dc8d2fe2-serviceca\") pod \"node-ca-ml9qs\" (UID: \"b91acfa6-5fd3-4aba-a679-aa72dc8d2fe2\") " pod="openshift-image-registry/node-ca-ml9qs" Sep 10 16:02:58.061661 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:58.061617 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/ce502816-6f0c-458c-b83d-bd1488b32d29-env-overrides\") pod \"ovnkube-node-tmshf\" (UID: \"ce502816-6f0c-458c-b83d-bd1488b32d29\") " pod="openshift-ovn-kubernetes/ovnkube-node-tmshf" Sep 10 16:02:58.062585 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:58.062325 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/9f57ca5e-844f-4390-a8e5-07abcea64cb2-agent-certs\") pod \"konnectivity-agent-7vxsg\" (UID: \"9f57ca5e-844f-4390-a8e5-07abcea64cb2\") " pod="kube-system/konnectivity-agent-7vxsg" Sep 10 16:02:58.062845 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:58.062820 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/aeb39a1e-eea5-4a70-b486-cbdcfafdd25a-cni-binary-copy\") pod \"multus-b2tw8\" (UID: \"aeb39a1e-eea5-4a70-b486-cbdcfafdd25a\") " pod="openshift-multus/multus-b2tw8" Sep 10 16:02:58.063317 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:58.063278 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/9f57ca5e-844f-4390-a8e5-07abcea64cb2-konnectivity-ca\") pod \"konnectivity-agent-7vxsg\" (UID: \"9f57ca5e-844f-4390-a8e5-07abcea64cb2\") " pod="kube-system/konnectivity-agent-7vxsg" Sep 10 16:02:58.063458 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:58.063437 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/29475c3c-5237-4543-9316-4b2c46989c08-etc-tuned\") pod \"tuned-52tk7\" (UID: \"29475c3c-5237-4543-9316-4b2c46989c08\") " pod="openshift-cluster-node-tuning-operator/tuned-52tk7" Sep 10 16:02:58.064609 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:58.064579 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/ce502816-6f0c-458c-b83d-bd1488b32d29-ovn-node-metrics-cert\") pod \"ovnkube-node-tmshf\" (UID: \"ce502816-6f0c-458c-b83d-bd1488b32d29\") " pod="openshift-ovn-kubernetes/ovnkube-node-tmshf" Sep 10 16:02:58.067972 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:58.067918 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/29475c3c-5237-4543-9316-4b2c46989c08-tmp\") pod \"tuned-52tk7\" (UID: \"29475c3c-5237-4543-9316-4b2c46989c08\") " pod="openshift-cluster-node-tuning-operator/tuned-52tk7" Sep 10 16:02:58.070384 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:58.070313 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-scjfb\" (UniqueName: \"kubernetes.io/projected/aeb39a1e-eea5-4a70-b486-cbdcfafdd25a-kube-api-access-scjfb\") pod \"multus-b2tw8\" (UID: \"aeb39a1e-eea5-4a70-b486-cbdcfafdd25a\") " pod="openshift-multus/multus-b2tw8" Sep 10 16:02:58.070932 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:58.070905 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m2cgx\" (UniqueName: \"kubernetes.io/projected/1f645098-0132-49a2-8c0d-6218d9f1d72a-kube-api-access-m2cgx\") pod \"aws-ebs-csi-driver-node-nhfjm\" (UID: \"1f645098-0132-49a2-8c0d-6218d9f1d72a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nhfjm" Sep 10 16:02:58.071449 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:58.071426 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ljsln\" (UniqueName: \"kubernetes.io/projected/ce502816-6f0c-458c-b83d-bd1488b32d29-kube-api-access-ljsln\") pod \"ovnkube-node-tmshf\" (UID: \"ce502816-6f0c-458c-b83d-bd1488b32d29\") " pod="openshift-ovn-kubernetes/ovnkube-node-tmshf" Sep 10 16:02:58.072305 ip-10-0-135-53 kubenswrapper[2574]: E0910 16:02:58.072011 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 10 16:02:58.072305 ip-10-0-135-53 kubenswrapper[2574]: E0910 16:02:58.072043 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 10 16:02:58.072305 ip-10-0-135-53 kubenswrapper[2574]: E0910 16:02:58.072058 2574 projected.go:196] Error preparing data for projected volume kube-api-access-j69hj for pod openshift-network-diagnostics/network-check-target-vpl4s: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 16:02:58.072305 ip-10-0-135-53 kubenswrapper[2574]: E0910 16:02:58.072123 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fe979f50-1926-4dc6-9830-76ba5781be0b-kube-api-access-j69hj podName:fe979f50-1926-4dc6-9830-76ba5781be0b nodeName:}" failed. No retries permitted until 2026-09-10 16:02:58.572102382 +0000 UTC m=+3.137305921 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-j69hj" (UniqueName: "kubernetes.io/projected/fe979f50-1926-4dc6-9830-76ba5781be0b-kube-api-access-j69hj") pod "network-check-target-vpl4s" (UID: "fe979f50-1926-4dc6-9830-76ba5781be0b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 16:02:58.073007 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:58.072982 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hqnp2\" (UniqueName: \"kubernetes.io/projected/29475c3c-5237-4543-9316-4b2c46989c08-kube-api-access-hqnp2\") pod \"tuned-52tk7\" (UID: \"29475c3c-5237-4543-9316-4b2c46989c08\") " pod="openshift-cluster-node-tuning-operator/tuned-52tk7" Sep 10 16:02:58.075719 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:58.075690 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4ltrp\" (UniqueName: \"kubernetes.io/projected/cc55b4de-3d22-4d24-bf28-d018afb0e4bc-kube-api-access-4ltrp\") pod \"network-metrics-daemon-ct85s\" (UID: \"cc55b4de-3d22-4d24-bf28-d018afb0e4bc\") " pod="openshift-multus/network-metrics-daemon-ct85s" Sep 10 16:02:58.076009 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:58.075987 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v7296\" (UniqueName: \"kubernetes.io/projected/b91acfa6-5fd3-4aba-a679-aa72dc8d2fe2-kube-api-access-v7296\") pod \"node-ca-ml9qs\" (UID: \"b91acfa6-5fd3-4aba-a679-aa72dc8d2fe2\") " pod="openshift-image-registry/node-ca-ml9qs" Sep 10 16:02:58.081051 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:58.081000 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-53.ec2.internal" event={"ID":"7c67acd93839c8ffd6aac841aa4d9962","Type":"ContainerStarted","Data":"ac73c9a93feac6603b515abd5a140f7ddb5b01f83135fc17b9c7b8351187ffc3"} Sep 10 16:02:58.083230 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:58.083201 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-53.ec2.internal" event={"ID":"92f8bc2779a28a3d82961ef2df34966b","Type":"ContainerStarted","Data":"c3ba2495f5fcd25596f42f16a82e30db6047929388246137afb5355fcd1ef5a8"} Sep 10 16:02:58.146428 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:58.146392 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-56mwl" Sep 10 16:02:58.153501 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:58.153477 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-zb9sj" Sep 10 16:02:58.160265 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:58.160226 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod67ce036d_f4ac_4997_984b_6f4c0197f9ef.slice/crio-a003e1b33967a699e279d1c43746fd06d3463d2a2ec33c3ad9a73c8090b980ca WatchSource:0}: Error finding container a003e1b33967a699e279d1c43746fd06d3463d2a2ec33c3ad9a73c8090b980ca: Status 404 returned error can't find the container with id a003e1b33967a699e279d1c43746fd06d3463d2a2ec33c3ad9a73c8090b980ca Sep 10 16:02:58.162009 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:58.161902 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-dh6tv" Sep 10 16:02:58.165183 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:58.165149 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9d57d542_a9e9_4565_940e_7fc04c2a0498.slice/crio-3ac06479897c4c8733e69957b0a8fab7a6b35660c7efb443a43143eb871debdc WatchSource:0}: Error finding container 3ac06479897c4c8733e69957b0a8fab7a6b35660c7efb443a43143eb871debdc: Status 404 returned error can't find the container with id 3ac06479897c4c8733e69957b0a8fab7a6b35660c7efb443a43143eb871debdc Sep 10 16:02:58.169328 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:58.169295 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-7vxsg" Sep 10 16:02:58.178646 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:58.178622 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-ml9qs" Sep 10 16:02:58.186101 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:58.186048 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-b2tw8" Sep 10 16:02:58.192965 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:58.192943 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-tmshf" Sep 10 16:02:58.202043 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:58.202018 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nhfjm" Sep 10 16:02:58.208745 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:58.208590 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-52tk7" Sep 10 16:02:58.459333 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:58.459227 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/aa29ebca-e469-4e43-abda-06f75d9c0a11-original-pull-secret\") pod \"global-pull-secret-syncer-pcsbz\" (UID: \"aa29ebca-e469-4e43-abda-06f75d9c0a11\") " pod="kube-system/global-pull-secret-syncer-pcsbz" Sep 10 16:02:58.459501 ip-10-0-135-53 kubenswrapper[2574]: E0910 16:02:58.459418 2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 10 16:02:58.459552 ip-10-0-135-53 kubenswrapper[2574]: E0910 16:02:58.459503 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aa29ebca-e469-4e43-abda-06f75d9c0a11-original-pull-secret podName:aa29ebca-e469-4e43-abda-06f75d9c0a11 nodeName:}" failed. No retries permitted until 2026-09-10 16:02:59.459477857 +0000 UTC m=+4.024681394 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/aa29ebca-e469-4e43-abda-06f75d9c0a11-original-pull-secret") pod "global-pull-secret-syncer-pcsbz" (UID: "aa29ebca-e469-4e43-abda-06f75d9c0a11") : object "kube-system"/"original-pull-secret" not registered Sep 10 16:02:58.559889 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:58.559857 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cc55b4de-3d22-4d24-bf28-d018afb0e4bc-metrics-certs\") pod \"network-metrics-daemon-ct85s\" (UID: \"cc55b4de-3d22-4d24-bf28-d018afb0e4bc\") " pod="openshift-multus/network-metrics-daemon-ct85s" Sep 10 16:02:58.560067 ip-10-0-135-53 kubenswrapper[2574]: E0910 16:02:58.560043 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 16:02:58.560141 ip-10-0-135-53 kubenswrapper[2574]: E0910 16:02:58.560129 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cc55b4de-3d22-4d24-bf28-d018afb0e4bc-metrics-certs podName:cc55b4de-3d22-4d24-bf28-d018afb0e4bc nodeName:}" failed. No retries permitted until 2026-09-10 16:02:59.560107202 +0000 UTC m=+4.125310731 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cc55b4de-3d22-4d24-bf28-d018afb0e4bc-metrics-certs") pod "network-metrics-daemon-ct85s" (UID: "cc55b4de-3d22-4d24-bf28-d018afb0e4bc") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 16:02:58.660565 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:58.660528 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j69hj\" (UniqueName: \"kubernetes.io/projected/fe979f50-1926-4dc6-9830-76ba5781be0b-kube-api-access-j69hj\") pod \"network-check-target-vpl4s\" (UID: \"fe979f50-1926-4dc6-9830-76ba5781be0b\") " pod="openshift-network-diagnostics/network-check-target-vpl4s" Sep 10 16:02:58.660725 ip-10-0-135-53 kubenswrapper[2574]: E0910 16:02:58.660674 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 10 16:02:58.660725 ip-10-0-135-53 kubenswrapper[2574]: E0910 16:02:58.660694 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 10 16:02:58.660725 ip-10-0-135-53 kubenswrapper[2574]: E0910 16:02:58.660705 2574 projected.go:196] Error preparing data for projected volume kube-api-access-j69hj for pod openshift-network-diagnostics/network-check-target-vpl4s: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 16:02:58.660887 ip-10-0-135-53 kubenswrapper[2574]: E0910 16:02:58.660762 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fe979f50-1926-4dc6-9830-76ba5781be0b-kube-api-access-j69hj podName:fe979f50-1926-4dc6-9830-76ba5781be0b nodeName:}" failed. No retries permitted until 2026-09-10 16:02:59.660745391 +0000 UTC m=+4.225948916 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-j69hj" (UniqueName: "kubernetes.io/projected/fe979f50-1926-4dc6-9830-76ba5781be0b-kube-api-access-j69hj") pod "network-check-target-vpl4s" (UID: "fe979f50-1926-4dc6-9830-76ba5781be0b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 16:02:58.890054 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:58.889974 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod699bca8d_6865_43af_b415_6ae212a5decb.slice/crio-8c189be38296bb5d8347ad5859d0a910f354630bbffe107046ff82bff7a2ab4e WatchSource:0}: Error finding container 8c189be38296bb5d8347ad5859d0a910f354630bbffe107046ff82bff7a2ab4e: Status 404 returned error can't find the container with id 8c189be38296bb5d8347ad5859d0a910f354630bbffe107046ff82bff7a2ab4e Sep 10 16:02:58.911086 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:58.911057 2574 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-09 15:57:58 +0000 UTC" deadline="2028-05-29 18:05:02.016155402 +0000 UTC" Sep 10 16:02:58.911086 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:58.911085 2574 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15050h2m3.105073897s" Sep 10 16:02:59.074656 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:59.074557 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vpl4s" Sep 10 16:02:59.074656 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:59.074598 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ct85s" Sep 10 16:02:59.074938 ip-10-0-135-53 kubenswrapper[2574]: E0910 16:02:59.074671 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vpl4s" podUID="fe979f50-1926-4dc6-9830-76ba5781be0b" Sep 10 16:02:59.075127 ip-10-0-135-53 kubenswrapper[2574]: E0910 16:02:59.075090 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ct85s" podUID="cc55b4de-3d22-4d24-bf28-d018afb0e4bc" Sep 10 16:02:59.086069 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:59.086038 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dh6tv" event={"ID":"699bca8d-6865-43af-b415-6ae212a5decb","Type":"ContainerStarted","Data":"8c189be38296bb5d8347ad5859d0a910f354630bbffe107046ff82bff7a2ab4e"} Sep 10 16:02:59.087420 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:59.087388 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-zb9sj" event={"ID":"9d57d542-a9e9-4565-940e-7fc04c2a0498","Type":"ContainerStarted","Data":"3ac06479897c4c8733e69957b0a8fab7a6b35660c7efb443a43143eb871debdc"} Sep 10 16:02:59.088833 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:59.088801 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-56mwl" event={"ID":"67ce036d-f4ac-4997-984b-6f4c0197f9ef","Type":"ContainerStarted","Data":"a003e1b33967a699e279d1c43746fd06d3463d2a2ec33c3ad9a73c8090b980ca"} Sep 10 16:02:59.338103 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:59.338074 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9f57ca5e_844f_4390_a8e5_07abcea64cb2.slice/crio-2416a763cc0ff3fec600f48435f8fa3b99d5f140f8161de0f9ebf394ff6d4980 WatchSource:0}: Error finding container 2416a763cc0ff3fec600f48435f8fa3b99d5f140f8161de0f9ebf394ff6d4980: Status 404 returned error can't find the container with id 2416a763cc0ff3fec600f48435f8fa3b99d5f140f8161de0f9ebf394ff6d4980 Sep 10 16:02:59.338947 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:59.338922 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod29475c3c_5237_4543_9316_4b2c46989c08.slice/crio-a99515cec66a78c7c1f8288449f2d041b61923a2d690047a62ed941943610cc1 WatchSource:0}: Error finding container a99515cec66a78c7c1f8288449f2d041b61923a2d690047a62ed941943610cc1: Status 404 returned error can't find the container with id a99515cec66a78c7c1f8288449f2d041b61923a2d690047a62ed941943610cc1 Sep 10 16:02:59.340372 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:59.340336 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podce502816_6f0c_458c_b83d_bd1488b32d29.slice/crio-3f57ade0df93ba82856bdf8697f72289ce1eb9eddbcce1d7e1563320dd256c41 WatchSource:0}: Error finding container 3f57ade0df93ba82856bdf8697f72289ce1eb9eddbcce1d7e1563320dd256c41: Status 404 returned error can't find the container with id 3f57ade0df93ba82856bdf8697f72289ce1eb9eddbcce1d7e1563320dd256c41 Sep 10 16:02:59.343664 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:59.343397 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaeb39a1e_eea5_4a70_b486_cbdcfafdd25a.slice/crio-13fc7911c987eac5c6c7808ca90e45c868be4ebc967aed95359736025633e113 WatchSource:0}: Error finding container 13fc7911c987eac5c6c7808ca90e45c868be4ebc967aed95359736025633e113: Status 404 returned error can't find the container with id 13fc7911c987eac5c6c7808ca90e45c868be4ebc967aed95359736025633e113 Sep 10 16:02:59.346216 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:59.345924 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb91acfa6_5fd3_4aba_a679_aa72dc8d2fe2.slice/crio-1dba9697f7e9a0ec44fee465aff4157d68a1d755d3d88994f04e9e20ab73411b WatchSource:0}: Error finding container 1dba9697f7e9a0ec44fee465aff4157d68a1d755d3d88994f04e9e20ab73411b: Status 404 returned error can't find the container with id 1dba9697f7e9a0ec44fee465aff4157d68a1d755d3d88994f04e9e20ab73411b Sep 10 16:02:59.346777 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:02:59.346753 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1f645098_0132_49a2_8c0d_6218d9f1d72a.slice/crio-d251bfb7b700c7cc2de0371a8db53d5574717e77d7983aa5f042008bdab91070 WatchSource:0}: Error finding container d251bfb7b700c7cc2de0371a8db53d5574717e77d7983aa5f042008bdab91070: Status 404 returned error can't find the container with id d251bfb7b700c7cc2de0371a8db53d5574717e77d7983aa5f042008bdab91070 Sep 10 16:02:59.466739 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:59.466703 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/aa29ebca-e469-4e43-abda-06f75d9c0a11-original-pull-secret\") pod \"global-pull-secret-syncer-pcsbz\" (UID: \"aa29ebca-e469-4e43-abda-06f75d9c0a11\") " pod="kube-system/global-pull-secret-syncer-pcsbz" Sep 10 16:02:59.466896 ip-10-0-135-53 kubenswrapper[2574]: E0910 16:02:59.466849 2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 10 16:02:59.466964 ip-10-0-135-53 kubenswrapper[2574]: E0910 16:02:59.466920 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aa29ebca-e469-4e43-abda-06f75d9c0a11-original-pull-secret podName:aa29ebca-e469-4e43-abda-06f75d9c0a11 nodeName:}" failed. No retries permitted until 2026-09-10 16:03:01.466900457 +0000 UTC m=+6.032103998 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/aa29ebca-e469-4e43-abda-06f75d9c0a11-original-pull-secret") pod "global-pull-secret-syncer-pcsbz" (UID: "aa29ebca-e469-4e43-abda-06f75d9c0a11") : object "kube-system"/"original-pull-secret" not registered Sep 10 16:02:59.568110 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:59.568045 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cc55b4de-3d22-4d24-bf28-d018afb0e4bc-metrics-certs\") pod \"network-metrics-daemon-ct85s\" (UID: \"cc55b4de-3d22-4d24-bf28-d018afb0e4bc\") " pod="openshift-multus/network-metrics-daemon-ct85s" Sep 10 16:02:59.568334 ip-10-0-135-53 kubenswrapper[2574]: E0910 16:02:59.568231 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 16:02:59.568408 ip-10-0-135-53 kubenswrapper[2574]: E0910 16:02:59.568349 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cc55b4de-3d22-4d24-bf28-d018afb0e4bc-metrics-certs podName:cc55b4de-3d22-4d24-bf28-d018afb0e4bc nodeName:}" failed. No retries permitted until 2026-09-10 16:03:01.568325791 +0000 UTC m=+6.133529332 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cc55b4de-3d22-4d24-bf28-d018afb0e4bc-metrics-certs") pod "network-metrics-daemon-ct85s" (UID: "cc55b4de-3d22-4d24-bf28-d018afb0e4bc") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 16:02:59.646439 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:59.646408 2574 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Sep 10 16:02:59.669904 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:59.669872 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j69hj\" (UniqueName: \"kubernetes.io/projected/fe979f50-1926-4dc6-9830-76ba5781be0b-kube-api-access-j69hj\") pod \"network-check-target-vpl4s\" (UID: \"fe979f50-1926-4dc6-9830-76ba5781be0b\") " pod="openshift-network-diagnostics/network-check-target-vpl4s" Sep 10 16:02:59.675152 ip-10-0-135-53 kubenswrapper[2574]: E0910 16:02:59.670968 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 10 16:02:59.675152 ip-10-0-135-53 kubenswrapper[2574]: E0910 16:02:59.671000 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 10 16:02:59.675152 ip-10-0-135-53 kubenswrapper[2574]: E0910 16:02:59.671023 2574 projected.go:196] Error preparing data for projected volume kube-api-access-j69hj for pod openshift-network-diagnostics/network-check-target-vpl4s: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 16:02:59.675152 ip-10-0-135-53 kubenswrapper[2574]: E0910 16:02:59.671098 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fe979f50-1926-4dc6-9830-76ba5781be0b-kube-api-access-j69hj podName:fe979f50-1926-4dc6-9830-76ba5781be0b nodeName:}" failed. No retries permitted until 2026-09-10 16:03:01.671068939 +0000 UTC m=+6.236272468 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-j69hj" (UniqueName: "kubernetes.io/projected/fe979f50-1926-4dc6-9830-76ba5781be0b-kube-api-access-j69hj") pod "network-check-target-vpl4s" (UID: "fe979f50-1926-4dc6-9830-76ba5781be0b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 16:02:59.912276 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:59.912154 2574 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-09 15:57:58 +0000 UTC" deadline="2028-02-11 01:16:39.068037002 +0000 UTC" Sep 10 16:02:59.912276 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:02:59.912224 2574 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12441h13m39.155818055s" Sep 10 16:03:00.076996 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:00.076518 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pcsbz" Sep 10 16:03:00.076996 ip-10-0-135-53 kubenswrapper[2574]: E0910 16:03:00.076650 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pcsbz" podUID="aa29ebca-e469-4e43-abda-06f75d9c0a11" Sep 10 16:03:00.093522 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:00.093443 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-52tk7" event={"ID":"29475c3c-5237-4543-9316-4b2c46989c08","Type":"ContainerStarted","Data":"a99515cec66a78c7c1f8288449f2d041b61923a2d690047a62ed941943610cc1"} Sep 10 16:03:00.095711 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:00.095633 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-ml9qs" event={"ID":"b91acfa6-5fd3-4aba-a679-aa72dc8d2fe2","Type":"ContainerStarted","Data":"1dba9697f7e9a0ec44fee465aff4157d68a1d755d3d88994f04e9e20ab73411b"} Sep 10 16:03:00.097888 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:00.097813 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-b2tw8" event={"ID":"aeb39a1e-eea5-4a70-b486-cbdcfafdd25a","Type":"ContainerStarted","Data":"13fc7911c987eac5c6c7808ca90e45c868be4ebc967aed95359736025633e113"} Sep 10 16:03:00.100132 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:00.100006 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tmshf" event={"ID":"ce502816-6f0c-458c-b83d-bd1488b32d29","Type":"ContainerStarted","Data":"3f57ade0df93ba82856bdf8697f72289ce1eb9eddbcce1d7e1563320dd256c41"} Sep 10 16:03:00.106320 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:00.106247 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-7vxsg" event={"ID":"9f57ca5e-844f-4390-a8e5-07abcea64cb2","Type":"ContainerStarted","Data":"2416a763cc0ff3fec600f48435f8fa3b99d5f140f8161de0f9ebf394ff6d4980"} Sep 10 16:03:00.111088 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:00.111061 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-53.ec2.internal" event={"ID":"7c67acd93839c8ffd6aac841aa4d9962","Type":"ContainerStarted","Data":"1cf2f69913d9ad54b6a45b2c9293d7574f74f6e4e9c67305c944b6bf49174110"} Sep 10 16:03:00.115738 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:00.115710 2574 generic.go:356] "Generic (PLEG): container finished" podID="92f8bc2779a28a3d82961ef2df34966b" containerID="e37519c0a2392e3fdacf385ddccc53297499fc06423926222c42309798568bef" exitCode=0 Sep 10 16:03:00.115826 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:00.115785 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-53.ec2.internal" event={"ID":"92f8bc2779a28a3d82961ef2df34966b","Type":"ContainerDied","Data":"e37519c0a2392e3fdacf385ddccc53297499fc06423926222c42309798568bef"} Sep 10 16:03:00.123079 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:00.123056 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nhfjm" event={"ID":"1f645098-0132-49a2-8c0d-6218d9f1d72a","Type":"ContainerStarted","Data":"d251bfb7b700c7cc2de0371a8db53d5574717e77d7983aa5f042008bdab91070"} Sep 10 16:03:00.133142 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:00.132641 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-53.ec2.internal" podStartSLOduration=3.132623376 podStartE2EDuration="3.132623376s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 16:02:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 16:03:00.132088845 +0000 UTC m=+4.697292390" watchObservedRunningTime="2026-09-10 16:03:00.132623376 +0000 UTC m=+4.697826920" Sep 10 16:03:01.075897 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:01.074894 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vpl4s" Sep 10 16:03:01.075897 ip-10-0-135-53 kubenswrapper[2574]: E0910 16:03:01.075020 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vpl4s" podUID="fe979f50-1926-4dc6-9830-76ba5781be0b" Sep 10 16:03:01.075897 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:01.075699 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ct85s" Sep 10 16:03:01.075897 ip-10-0-135-53 kubenswrapper[2574]: E0910 16:03:01.075809 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ct85s" podUID="cc55b4de-3d22-4d24-bf28-d018afb0e4bc" Sep 10 16:03:01.487192 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:01.487051 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/aa29ebca-e469-4e43-abda-06f75d9c0a11-original-pull-secret\") pod \"global-pull-secret-syncer-pcsbz\" (UID: \"aa29ebca-e469-4e43-abda-06f75d9c0a11\") " pod="kube-system/global-pull-secret-syncer-pcsbz" Sep 10 16:03:01.487391 ip-10-0-135-53 kubenswrapper[2574]: E0910 16:03:01.487240 2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 10 16:03:01.487391 ip-10-0-135-53 kubenswrapper[2574]: E0910 16:03:01.487344 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aa29ebca-e469-4e43-abda-06f75d9c0a11-original-pull-secret podName:aa29ebca-e469-4e43-abda-06f75d9c0a11 nodeName:}" failed. No retries permitted until 2026-09-10 16:03:05.487319572 +0000 UTC m=+10.052523119 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/aa29ebca-e469-4e43-abda-06f75d9c0a11-original-pull-secret") pod "global-pull-secret-syncer-pcsbz" (UID: "aa29ebca-e469-4e43-abda-06f75d9c0a11") : object "kube-system"/"original-pull-secret" not registered Sep 10 16:03:01.588429 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:01.588386 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cc55b4de-3d22-4d24-bf28-d018afb0e4bc-metrics-certs\") pod \"network-metrics-daemon-ct85s\" (UID: \"cc55b4de-3d22-4d24-bf28-d018afb0e4bc\") " pod="openshift-multus/network-metrics-daemon-ct85s" Sep 10 16:03:01.588599 ip-10-0-135-53 kubenswrapper[2574]: E0910 16:03:01.588569 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 16:03:01.588678 ip-10-0-135-53 kubenswrapper[2574]: E0910 16:03:01.588640 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cc55b4de-3d22-4d24-bf28-d018afb0e4bc-metrics-certs podName:cc55b4de-3d22-4d24-bf28-d018afb0e4bc nodeName:}" failed. No retries permitted until 2026-09-10 16:03:05.588621075 +0000 UTC m=+10.153824610 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cc55b4de-3d22-4d24-bf28-d018afb0e4bc-metrics-certs") pod "network-metrics-daemon-ct85s" (UID: "cc55b4de-3d22-4d24-bf28-d018afb0e4bc") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 16:03:01.689415 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:01.689371 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j69hj\" (UniqueName: \"kubernetes.io/projected/fe979f50-1926-4dc6-9830-76ba5781be0b-kube-api-access-j69hj\") pod \"network-check-target-vpl4s\" (UID: \"fe979f50-1926-4dc6-9830-76ba5781be0b\") " pod="openshift-network-diagnostics/network-check-target-vpl4s" Sep 10 16:03:01.689651 ip-10-0-135-53 kubenswrapper[2574]: E0910 16:03:01.689618 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 10 16:03:01.689651 ip-10-0-135-53 kubenswrapper[2574]: E0910 16:03:01.689640 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 10 16:03:01.689651 ip-10-0-135-53 kubenswrapper[2574]: E0910 16:03:01.689653 2574 projected.go:196] Error preparing data for projected volume kube-api-access-j69hj for pod openshift-network-diagnostics/network-check-target-vpl4s: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 16:03:01.689854 ip-10-0-135-53 kubenswrapper[2574]: E0910 16:03:01.689712 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fe979f50-1926-4dc6-9830-76ba5781be0b-kube-api-access-j69hj podName:fe979f50-1926-4dc6-9830-76ba5781be0b nodeName:}" failed. No retries permitted until 2026-09-10 16:03:05.689694229 +0000 UTC m=+10.254897755 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-j69hj" (UniqueName: "kubernetes.io/projected/fe979f50-1926-4dc6-9830-76ba5781be0b-kube-api-access-j69hj") pod "network-check-target-vpl4s" (UID: "fe979f50-1926-4dc6-9830-76ba5781be0b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 16:03:02.074489 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:02.074362 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pcsbz" Sep 10 16:03:02.074677 ip-10-0-135-53 kubenswrapper[2574]: E0910 16:03:02.074503 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pcsbz" podUID="aa29ebca-e469-4e43-abda-06f75d9c0a11" Sep 10 16:03:03.074955 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:03.074883 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vpl4s" Sep 10 16:03:03.075448 ip-10-0-135-53 kubenswrapper[2574]: E0910 16:03:03.074998 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vpl4s" podUID="fe979f50-1926-4dc6-9830-76ba5781be0b" Sep 10 16:03:03.075448 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:03.075037 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ct85s" Sep 10 16:03:03.075448 ip-10-0-135-53 kubenswrapper[2574]: E0910 16:03:03.075174 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ct85s" podUID="cc55b4de-3d22-4d24-bf28-d018afb0e4bc" Sep 10 16:03:04.074562 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:04.074069 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pcsbz" Sep 10 16:03:04.074562 ip-10-0-135-53 kubenswrapper[2574]: E0910 16:03:04.074204 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pcsbz" podUID="aa29ebca-e469-4e43-abda-06f75d9c0a11" Sep 10 16:03:05.074970 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:05.074692 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ct85s" Sep 10 16:03:05.075534 ip-10-0-135-53 kubenswrapper[2574]: E0910 16:03:05.075038 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ct85s" podUID="cc55b4de-3d22-4d24-bf28-d018afb0e4bc" Sep 10 16:03:05.075534 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:05.074693 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vpl4s" Sep 10 16:03:05.075534 ip-10-0-135-53 kubenswrapper[2574]: E0910 16:03:05.075483 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vpl4s" podUID="fe979f50-1926-4dc6-9830-76ba5781be0b" Sep 10 16:03:05.138454 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:05.138169 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-ml9qs" event={"ID":"b91acfa6-5fd3-4aba-a679-aa72dc8d2fe2","Type":"ContainerStarted","Data":"53b8212cc908f7ad10fd3699e9e2e0cfc572bcf459eb6acf6ff469a76c1d0121"} Sep 10 16:03:05.140473 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:05.140431 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-7vxsg" event={"ID":"9f57ca5e-844f-4390-a8e5-07abcea64cb2","Type":"ContainerStarted","Data":"532d531c993a3251acc63484bf18564a32af60d2ad98da21beca03a65933f21c"} Sep 10 16:03:05.143697 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:05.143642 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-53.ec2.internal" event={"ID":"92f8bc2779a28a3d82961ef2df34966b","Type":"ContainerStarted","Data":"c97682081cdaa7c379fab312e70ff3637c96bbd9caed3e314d4bff345c358ee0"} Sep 10 16:03:05.147030 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:05.147000 2574 generic.go:356] "Generic (PLEG): container finished" podID="699bca8d-6865-43af-b415-6ae212a5decb" containerID="2e1385de5215f2b8dde0ac077bb3dce005b5e651ae16b9ff5fdeebeb00345e9b" exitCode=0 Sep 10 16:03:05.147123 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:05.147085 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dh6tv" event={"ID":"699bca8d-6865-43af-b415-6ae212a5decb","Type":"ContainerDied","Data":"2e1385de5215f2b8dde0ac077bb3dce005b5e651ae16b9ff5fdeebeb00345e9b"} Sep 10 16:03:05.150777 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:05.150756 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nhfjm" event={"ID":"1f645098-0132-49a2-8c0d-6218d9f1d72a","Type":"ContainerStarted","Data":"9baedef6b91be2fc15565b652c18aeb97383ee551f18faee5fc1240ae3926aa0"} Sep 10 16:03:05.153204 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:05.153179 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-zb9sj" event={"ID":"9d57d542-a9e9-4565-940e-7fc04c2a0498","Type":"ContainerStarted","Data":"8d6ec91344a6b474e818fbd393a0f681e5fb1e786814fe0774856d7feb4a2b14"} Sep 10 16:03:05.188659 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:05.188600 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-ml9qs" podStartSLOduration=4.179533669 podStartE2EDuration="9.1885764s" totalImagesPullingTime="5.009042731s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 16:02:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 16:03:05.160536426 +0000 UTC m=+9.725739972" watchObservedRunningTime="2026-09-10 16:03:05.1885764 +0000 UTC m=+9.753779945" Sep 10 16:03:05.218239 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:05.217312 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-7vxsg" podStartSLOduration=4.169460813 podStartE2EDuration="9.217289879s" totalImagesPullingTime="5.047829066s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 16:02:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 16:03:05.189317749 +0000 UTC m=+9.754521308" watchObservedRunningTime="2026-09-10 16:03:05.217289879 +0000 UTC m=+9.782493438" Sep 10 16:03:05.243731 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:05.243671 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-53.ec2.internal" podStartSLOduration=8.243649045 podStartE2EDuration="8.243649045s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 16:02:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 16:03:05.217919603 +0000 UTC m=+9.783123147" watchObservedRunningTime="2026-09-10 16:03:05.243649045 +0000 UTC m=+9.808852590" Sep 10 16:03:05.278608 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:05.278550 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-zb9sj" podStartSLOduration=3.065667169 podStartE2EDuration="9.278528865s" totalImagesPullingTime="6.212861696s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 16:02:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 16:03:05.244546197 +0000 UTC m=+9.809749771" watchObservedRunningTime="2026-09-10 16:03:05.278528865 +0000 UTC m=+9.843732425" Sep 10 16:03:05.522454 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:05.522230 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/aa29ebca-e469-4e43-abda-06f75d9c0a11-original-pull-secret\") pod \"global-pull-secret-syncer-pcsbz\" (UID: \"aa29ebca-e469-4e43-abda-06f75d9c0a11\") " pod="kube-system/global-pull-secret-syncer-pcsbz" Sep 10 16:03:05.522454 ip-10-0-135-53 kubenswrapper[2574]: E0910 16:03:05.522441 2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 10 16:03:05.522677 ip-10-0-135-53 kubenswrapper[2574]: E0910 16:03:05.522500 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aa29ebca-e469-4e43-abda-06f75d9c0a11-original-pull-secret podName:aa29ebca-e469-4e43-abda-06f75d9c0a11 nodeName:}" failed. No retries permitted until 2026-09-10 16:03:13.522481425 +0000 UTC m=+18.087684952 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/aa29ebca-e469-4e43-abda-06f75d9c0a11-original-pull-secret") pod "global-pull-secret-syncer-pcsbz" (UID: "aa29ebca-e469-4e43-abda-06f75d9c0a11") : object "kube-system"/"original-pull-secret" not registered Sep 10 16:03:05.623112 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:05.623031 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cc55b4de-3d22-4d24-bf28-d018afb0e4bc-metrics-certs\") pod \"network-metrics-daemon-ct85s\" (UID: \"cc55b4de-3d22-4d24-bf28-d018afb0e4bc\") " pod="openshift-multus/network-metrics-daemon-ct85s" Sep 10 16:03:05.623333 ip-10-0-135-53 kubenswrapper[2574]: E0910 16:03:05.623209 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 16:03:05.623333 ip-10-0-135-53 kubenswrapper[2574]: E0910 16:03:05.623299 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cc55b4de-3d22-4d24-bf28-d018afb0e4bc-metrics-certs podName:cc55b4de-3d22-4d24-bf28-d018afb0e4bc nodeName:}" failed. No retries permitted until 2026-09-10 16:03:13.6232819 +0000 UTC m=+18.188485425 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cc55b4de-3d22-4d24-bf28-d018afb0e4bc-metrics-certs") pod "network-metrics-daemon-ct85s" (UID: "cc55b4de-3d22-4d24-bf28-d018afb0e4bc") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 16:03:05.724037 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:05.723952 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j69hj\" (UniqueName: \"kubernetes.io/projected/fe979f50-1926-4dc6-9830-76ba5781be0b-kube-api-access-j69hj\") pod \"network-check-target-vpl4s\" (UID: \"fe979f50-1926-4dc6-9830-76ba5781be0b\") " pod="openshift-network-diagnostics/network-check-target-vpl4s" Sep 10 16:03:05.724181 ip-10-0-135-53 kubenswrapper[2574]: E0910 16:03:05.724124 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 10 16:03:05.724181 ip-10-0-135-53 kubenswrapper[2574]: E0910 16:03:05.724147 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 10 16:03:05.724181 ip-10-0-135-53 kubenswrapper[2574]: E0910 16:03:05.724160 2574 projected.go:196] Error preparing data for projected volume kube-api-access-j69hj for pod openshift-network-diagnostics/network-check-target-vpl4s: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 16:03:05.724326 ip-10-0-135-53 kubenswrapper[2574]: E0910 16:03:05.724220 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fe979f50-1926-4dc6-9830-76ba5781be0b-kube-api-access-j69hj podName:fe979f50-1926-4dc6-9830-76ba5781be0b nodeName:}" failed. No retries permitted until 2026-09-10 16:03:13.72420181 +0000 UTC m=+18.289405337 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-j69hj" (UniqueName: "kubernetes.io/projected/fe979f50-1926-4dc6-9830-76ba5781be0b-kube-api-access-j69hj") pod "network-check-target-vpl4s" (UID: "fe979f50-1926-4dc6-9830-76ba5781be0b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 16:03:06.076054 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:06.075692 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pcsbz" Sep 10 16:03:06.076054 ip-10-0-135-53 kubenswrapper[2574]: E0910 16:03:06.075776 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pcsbz" podUID="aa29ebca-e469-4e43-abda-06f75d9c0a11" Sep 10 16:03:06.157947 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:06.157909 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-56mwl" event={"ID":"67ce036d-f4ac-4997-984b-6f4c0197f9ef","Type":"ContainerStarted","Data":"c4d17dcdf5259ed63fa599b4e07a051f5714335cae12e7991ff3359da836d1c7"} Sep 10 16:03:06.176999 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:06.176836 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-56mwl" podStartSLOduration=3.959368375 podStartE2EDuration="10.17681434s" totalImagesPullingTime="6.217445965s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 16:02:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 16:03:06.176149957 +0000 UTC m=+10.741353526" watchObservedRunningTime="2026-09-10 16:03:06.17681434 +0000 UTC m=+10.742017886" Sep 10 16:03:07.074888 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:07.074849 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ct85s" Sep 10 16:03:07.074888 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:07.074882 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vpl4s" Sep 10 16:03:07.075120 ip-10-0-135-53 kubenswrapper[2574]: E0910 16:03:07.074996 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ct85s" podUID="cc55b4de-3d22-4d24-bf28-d018afb0e4bc" Sep 10 16:03:07.075120 ip-10-0-135-53 kubenswrapper[2574]: E0910 16:03:07.075103 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vpl4s" podUID="fe979f50-1926-4dc6-9830-76ba5781be0b" Sep 10 16:03:08.074098 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:08.074058 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pcsbz" Sep 10 16:03:08.074541 ip-10-0-135-53 kubenswrapper[2574]: E0910 16:03:08.074210 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pcsbz" podUID="aa29ebca-e469-4e43-abda-06f75d9c0a11" Sep 10 16:03:08.395736 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:08.395642 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-7vxsg" Sep 10 16:03:08.396376 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:08.396358 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-7vxsg" Sep 10 16:03:09.074534 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:09.074467 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vpl4s" Sep 10 16:03:09.074534 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:09.074504 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ct85s" Sep 10 16:03:09.075128 ip-10-0-135-53 kubenswrapper[2574]: E0910 16:03:09.074602 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vpl4s" podUID="fe979f50-1926-4dc6-9830-76ba5781be0b" Sep 10 16:03:09.075128 ip-10-0-135-53 kubenswrapper[2574]: E0910 16:03:09.074742 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ct85s" podUID="cc55b4de-3d22-4d24-bf28-d018afb0e4bc" Sep 10 16:03:10.074685 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:10.074639 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pcsbz" Sep 10 16:03:10.075053 ip-10-0-135-53 kubenswrapper[2574]: E0910 16:03:10.074772 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pcsbz" podUID="aa29ebca-e469-4e43-abda-06f75d9c0a11" Sep 10 16:03:11.074641 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:11.074604 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vpl4s" Sep 10 16:03:11.074838 ip-10-0-135-53 kubenswrapper[2574]: E0910 16:03:11.074749 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vpl4s" podUID="fe979f50-1926-4dc6-9830-76ba5781be0b" Sep 10 16:03:11.074838 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:11.074773 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ct85s" Sep 10 16:03:11.075230 ip-10-0-135-53 kubenswrapper[2574]: E0910 16:03:11.074864 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ct85s" podUID="cc55b4de-3d22-4d24-bf28-d018afb0e4bc" Sep 10 16:03:12.074779 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:12.074737 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pcsbz" Sep 10 16:03:12.074950 ip-10-0-135-53 kubenswrapper[2574]: E0910 16:03:12.074874 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pcsbz" podUID="aa29ebca-e469-4e43-abda-06f75d9c0a11" Sep 10 16:03:13.074722 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:13.074691 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ct85s" Sep 10 16:03:13.074923 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:13.074690 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vpl4s" Sep 10 16:03:13.074923 ip-10-0-135-53 kubenswrapper[2574]: E0910 16:03:13.074803 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ct85s" podUID="cc55b4de-3d22-4d24-bf28-d018afb0e4bc" Sep 10 16:03:13.074923 ip-10-0-135-53 kubenswrapper[2574]: E0910 16:03:13.074863 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vpl4s" podUID="fe979f50-1926-4dc6-9830-76ba5781be0b" Sep 10 16:03:13.586128 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:13.586100 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/aa29ebca-e469-4e43-abda-06f75d9c0a11-original-pull-secret\") pod \"global-pull-secret-syncer-pcsbz\" (UID: \"aa29ebca-e469-4e43-abda-06f75d9c0a11\") " pod="kube-system/global-pull-secret-syncer-pcsbz" Sep 10 16:03:13.586399 ip-10-0-135-53 kubenswrapper[2574]: E0910 16:03:13.586221 2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 10 16:03:13.586399 ip-10-0-135-53 kubenswrapper[2574]: E0910 16:03:13.586314 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aa29ebca-e469-4e43-abda-06f75d9c0a11-original-pull-secret podName:aa29ebca-e469-4e43-abda-06f75d9c0a11 nodeName:}" failed. No retries permitted until 2026-09-10 16:03:29.586293641 +0000 UTC m=+34.151497177 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/aa29ebca-e469-4e43-abda-06f75d9c0a11-original-pull-secret") pod "global-pull-secret-syncer-pcsbz" (UID: "aa29ebca-e469-4e43-abda-06f75d9c0a11") : object "kube-system"/"original-pull-secret" not registered Sep 10 16:03:13.687153 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:13.687124 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cc55b4de-3d22-4d24-bf28-d018afb0e4bc-metrics-certs\") pod \"network-metrics-daemon-ct85s\" (UID: \"cc55b4de-3d22-4d24-bf28-d018afb0e4bc\") " pod="openshift-multus/network-metrics-daemon-ct85s" Sep 10 16:03:13.687317 ip-10-0-135-53 kubenswrapper[2574]: E0910 16:03:13.687250 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 16:03:13.687317 ip-10-0-135-53 kubenswrapper[2574]: E0910 16:03:13.687311 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cc55b4de-3d22-4d24-bf28-d018afb0e4bc-metrics-certs podName:cc55b4de-3d22-4d24-bf28-d018afb0e4bc nodeName:}" failed. No retries permitted until 2026-09-10 16:03:29.687296906 +0000 UTC m=+34.252500428 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cc55b4de-3d22-4d24-bf28-d018afb0e4bc-metrics-certs") pod "network-metrics-daemon-ct85s" (UID: "cc55b4de-3d22-4d24-bf28-d018afb0e4bc") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 16:03:13.788124 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:13.788092 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j69hj\" (UniqueName: \"kubernetes.io/projected/fe979f50-1926-4dc6-9830-76ba5781be0b-kube-api-access-j69hj\") pod \"network-check-target-vpl4s\" (UID: \"fe979f50-1926-4dc6-9830-76ba5781be0b\") " pod="openshift-network-diagnostics/network-check-target-vpl4s" Sep 10 16:03:13.788288 ip-10-0-135-53 kubenswrapper[2574]: E0910 16:03:13.788227 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 10 16:03:13.788288 ip-10-0-135-53 kubenswrapper[2574]: E0910 16:03:13.788243 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 10 16:03:13.788288 ip-10-0-135-53 kubenswrapper[2574]: E0910 16:03:13.788251 2574 projected.go:196] Error preparing data for projected volume kube-api-access-j69hj for pod openshift-network-diagnostics/network-check-target-vpl4s: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 16:03:13.788411 ip-10-0-135-53 kubenswrapper[2574]: E0910 16:03:13.788316 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fe979f50-1926-4dc6-9830-76ba5781be0b-kube-api-access-j69hj podName:fe979f50-1926-4dc6-9830-76ba5781be0b nodeName:}" failed. No retries permitted until 2026-09-10 16:03:29.788302802 +0000 UTC m=+34.353506324 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-j69hj" (UniqueName: "kubernetes.io/projected/fe979f50-1926-4dc6-9830-76ba5781be0b-kube-api-access-j69hj") pod "network-check-target-vpl4s" (UID: "fe979f50-1926-4dc6-9830-76ba5781be0b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 16:03:14.074528 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:14.074451 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pcsbz" Sep 10 16:03:14.074672 ip-10-0-135-53 kubenswrapper[2574]: E0910 16:03:14.074594 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pcsbz" podUID="aa29ebca-e469-4e43-abda-06f75d9c0a11" Sep 10 16:03:15.073992 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:15.073952 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vpl4s" Sep 10 16:03:15.073992 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:15.073992 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ct85s" Sep 10 16:03:15.074491 ip-10-0-135-53 kubenswrapper[2574]: E0910 16:03:15.074094 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vpl4s" podUID="fe979f50-1926-4dc6-9830-76ba5781be0b" Sep 10 16:03:15.074491 ip-10-0-135-53 kubenswrapper[2574]: E0910 16:03:15.074257 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ct85s" podUID="cc55b4de-3d22-4d24-bf28-d018afb0e4bc" Sep 10 16:03:16.075274 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:16.075225 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pcsbz" Sep 10 16:03:16.075660 ip-10-0-135-53 kubenswrapper[2574]: E0910 16:03:16.075362 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pcsbz" podUID="aa29ebca-e469-4e43-abda-06f75d9c0a11" Sep 10 16:03:17.074199 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:17.074156 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ct85s" Sep 10 16:03:17.074376 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:17.074156 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vpl4s" Sep 10 16:03:17.074376 ip-10-0-135-53 kubenswrapper[2574]: E0910 16:03:17.074304 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ct85s" podUID="cc55b4de-3d22-4d24-bf28-d018afb0e4bc" Sep 10 16:03:17.074376 ip-10-0-135-53 kubenswrapper[2574]: E0910 16:03:17.074343 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vpl4s" podUID="fe979f50-1926-4dc6-9830-76ba5781be0b" Sep 10 16:03:18.074809 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:18.074772 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pcsbz" Sep 10 16:03:18.075232 ip-10-0-135-53 kubenswrapper[2574]: E0910 16:03:18.074911 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pcsbz" podUID="aa29ebca-e469-4e43-abda-06f75d9c0a11" Sep 10 16:03:19.058865 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:19.058829 2574 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Sep 10 16:03:19.074681 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:19.074654 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vpl4s" Sep 10 16:03:19.074792 ip-10-0-135-53 kubenswrapper[2574]: E0910 16:03:19.074775 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vpl4s" podUID="fe979f50-1926-4dc6-9830-76ba5781be0b" Sep 10 16:03:19.074851 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:19.074834 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ct85s" Sep 10 16:03:19.075373 ip-10-0-135-53 kubenswrapper[2574]: E0910 16:03:19.074913 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ct85s" podUID="cc55b4de-3d22-4d24-bf28-d018afb0e4bc" Sep 10 16:03:19.188304 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:19.188030 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-b2tw8" event={"ID":"aeb39a1e-eea5-4a70-b486-cbdcfafdd25a","Type":"ContainerStarted","Data":"5628f465e0ef89b58b1a119b7082b90db154288ac938c583b69b142137c435cc"} Sep 10 16:03:19.191574 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:19.191488 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tmshf" event={"ID":"ce502816-6f0c-458c-b83d-bd1488b32d29","Type":"ContainerStarted","Data":"9ef7f20540eec66e5f75b7d26ad64cdd22007fee18e5a92f68f24e3539f0bb32"} Sep 10 16:03:19.191574 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:19.191559 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tmshf" event={"ID":"ce502816-6f0c-458c-b83d-bd1488b32d29","Type":"ContainerStarted","Data":"198a702e132868fe260c379ed390ec229699d91e170ed6257eb9042fc49156c5"} Sep 10 16:03:19.193626 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:19.193596 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dh6tv" event={"ID":"699bca8d-6865-43af-b415-6ae212a5decb","Type":"ContainerStarted","Data":"1ddeada1f0c809637a62eaf277465a5566a2461eca3bd28d713462e8decd6030"} Sep 10 16:03:19.195805 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:19.195776 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nhfjm" event={"ID":"1f645098-0132-49a2-8c0d-6218d9f1d72a","Type":"ContainerStarted","Data":"ca80054b1bb801a3ce48c436e748277b791a821acf8bacc04e7485fcf31565dd"} Sep 10 16:03:19.197682 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:19.197655 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-52tk7" event={"ID":"29475c3c-5237-4543-9316-4b2c46989c08","Type":"ContainerStarted","Data":"7371b0862442788cf2dcf2d82134e466b10428e0f045f639b52133c3e1ac7a66"} Sep 10 16:03:19.233872 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:19.233827 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-b2tw8" podStartSLOduration=3.627989397 podStartE2EDuration="23.233811857s" totalImagesPullingTime="19.60582246s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 16:02:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 16:03:19.230649593 +0000 UTC m=+23.795853138" watchObservedRunningTime="2026-09-10 16:03:19.233811857 +0000 UTC m=+23.799015402" Sep 10 16:03:19.435802 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:19.435724 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vxsg_9f57ca5e-844f-4390-a8e5-07abcea64cb2/konnectivity-agent/0.log" limit=1024 Sep 10 16:03:19.552775 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:19.552737 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vxsg_9f57ca5e-844f-4390-a8e5-07abcea64cb2/konnectivity-agent/0.log" limit=1024 Sep 10 16:03:20.042997 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:20.042879 2574 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-10T16:03:19.058847047Z","UUID":"01cf7f72-b39c-4d9d-9c16-e7fa907cd0d0","Handler":null,"Name":"","Endpoint":""} Sep 10 16:03:20.044596 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:20.044575 2574 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Sep 10 16:03:20.044727 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:20.044609 2574 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Sep 10 16:03:20.074967 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:20.074931 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pcsbz" Sep 10 16:03:20.075741 ip-10-0-135-53 kubenswrapper[2574]: E0910 16:03:20.075133 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pcsbz" podUID="aa29ebca-e469-4e43-abda-06f75d9c0a11" Sep 10 16:03:20.203634 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:20.203595 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tmshf" event={"ID":"ce502816-6f0c-458c-b83d-bd1488b32d29","Type":"ContainerStarted","Data":"57f94c5ac97817cead18599f3b669453277f3533852e47150f48fb874ddaedad"} Sep 10 16:03:20.203810 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:20.203689 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tmshf" event={"ID":"ce502816-6f0c-458c-b83d-bd1488b32d29","Type":"ContainerStarted","Data":"c2290c51a7b5535d53548fa5f83eaf279f401fc65af91fdcbf0d443466497975"} Sep 10 16:03:20.203810 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:20.203743 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tmshf" event={"ID":"ce502816-6f0c-458c-b83d-bd1488b32d29","Type":"ContainerStarted","Data":"00fd83eb93aa52d100e96e9f241dd85046a9b1cd5050cc1728535cfe42b157e5"} Sep 10 16:03:20.203810 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:20.203775 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tmshf" event={"ID":"ce502816-6f0c-458c-b83d-bd1488b32d29","Type":"ContainerStarted","Data":"1cbb11d05e831934bf1e22181ca0eeda325727cc41c65405582981b83f1315ad"} Sep 10 16:03:20.205703 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:20.205676 2574 generic.go:356] "Generic (PLEG): container finished" podID="699bca8d-6865-43af-b415-6ae212a5decb" containerID="1ddeada1f0c809637a62eaf277465a5566a2461eca3bd28d713462e8decd6030" exitCode=0 Sep 10 16:03:20.205830 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:20.205769 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dh6tv" event={"ID":"699bca8d-6865-43af-b415-6ae212a5decb","Type":"ContainerDied","Data":"1ddeada1f0c809637a62eaf277465a5566a2461eca3bd28d713462e8decd6030"} Sep 10 16:03:20.231668 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:20.231614 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-52tk7" podStartSLOduration=4.65676302 podStartE2EDuration="24.231595725s" totalImagesPullingTime="19.574832705s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 16:02:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 16:03:19.28916176 +0000 UTC m=+23.854365306" watchObservedRunningTime="2026-09-10 16:03:20.231595725 +0000 UTC m=+24.796799287" Sep 10 16:03:21.074916 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:21.074839 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vpl4s" Sep 10 16:03:21.075081 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:21.074840 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ct85s" Sep 10 16:03:21.075081 ip-10-0-135-53 kubenswrapper[2574]: E0910 16:03:21.075055 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ct85s" podUID="cc55b4de-3d22-4d24-bf28-d018afb0e4bc" Sep 10 16:03:21.075081 ip-10-0-135-53 kubenswrapper[2574]: E0910 16:03:21.074940 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vpl4s" podUID="fe979f50-1926-4dc6-9830-76ba5781be0b" Sep 10 16:03:21.210730 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:21.210705 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nhfjm" event={"ID":"1f645098-0132-49a2-8c0d-6218d9f1d72a","Type":"ContainerStarted","Data":"536a6300f45a6d6b8fad626736f5b858f3fcb18dfecb9abf5d279ceac054702d"} Sep 10 16:03:21.231428 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:21.231313 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nhfjm" podStartSLOduration=4.362488145 podStartE2EDuration="25.231294109s" totalImagesPullingTime="20.868805964s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 16:02:56 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 16:03:21.230700219 +0000 UTC m=+25.795903763" watchObservedRunningTime="2026-09-10 16:03:21.231294109 +0000 UTC m=+25.796497654" Sep 10 16:03:22.074228 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:22.074189 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pcsbz" Sep 10 16:03:22.074470 ip-10-0-135-53 kubenswrapper[2574]: E0910 16:03:22.074326 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pcsbz" podUID="aa29ebca-e469-4e43-abda-06f75d9c0a11" Sep 10 16:03:22.097662 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:22.097630 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vxsg_9f57ca5e-844f-4390-a8e5-07abcea64cb2/konnectivity-agent/0.log" limit=1024 Sep 10 16:03:22.197745 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:22.197710 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vxsg_9f57ca5e-844f-4390-a8e5-07abcea64cb2/konnectivity-agent/0.log" limit=1024 Sep 10 16:03:22.215613 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:22.215585 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tmshf" event={"ID":"ce502816-6f0c-458c-b83d-bd1488b32d29","Type":"ContainerStarted","Data":"6edb2b4fc779905e354c17c7677c6f1ee99f2f7780fc52ce5dbb3a71a48747b0"} Sep 10 16:03:22.217610 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:22.217587 2574 generic.go:356] "Generic (PLEG): container finished" podID="699bca8d-6865-43af-b415-6ae212a5decb" containerID="a511882ffd5ee5a2518f10bb327977d40cd2496d7a8720dffcf64a5d7c4ebdc8" exitCode=0 Sep 10 16:03:22.217712 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:22.217667 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dh6tv" event={"ID":"699bca8d-6865-43af-b415-6ae212a5decb","Type":"ContainerDied","Data":"a511882ffd5ee5a2518f10bb327977d40cd2496d7a8720dffcf64a5d7c4ebdc8"} Sep 10 16:03:22.287203 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:22.287174 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vxsg_9f57ca5e-844f-4390-a8e5-07abcea64cb2/konnectivity-agent/0.log" limit=1024 Sep 10 16:03:22.638840 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:22.638804 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vxsg_9f57ca5e-844f-4390-a8e5-07abcea64cb2/konnectivity-agent/0.log" limit=1024 Sep 10 16:03:22.692109 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:22.692080 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vxsg_9f57ca5e-844f-4390-a8e5-07abcea64cb2/konnectivity-agent/0.log" limit=1024 Sep 10 16:03:23.073994 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:23.073968 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vpl4s" Sep 10 16:03:23.074118 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:23.073995 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ct85s" Sep 10 16:03:23.074181 ip-10-0-135-53 kubenswrapper[2574]: E0910 16:03:23.074142 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vpl4s" podUID="fe979f50-1926-4dc6-9830-76ba5781be0b" Sep 10 16:03:23.074252 ip-10-0-135-53 kubenswrapper[2574]: E0910 16:03:23.074231 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ct85s" podUID="cc55b4de-3d22-4d24-bf28-d018afb0e4bc" Sep 10 16:03:23.221858 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:23.221823 2574 generic.go:356] "Generic (PLEG): container finished" podID="699bca8d-6865-43af-b415-6ae212a5decb" containerID="449c9e7f929f2ef3521ced72a6bcc792650f2cf2e84526ce3660e83497b53061" exitCode=0 Sep 10 16:03:23.222243 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:23.221869 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dh6tv" event={"ID":"699bca8d-6865-43af-b415-6ae212a5decb","Type":"ContainerDied","Data":"449c9e7f929f2ef3521ced72a6bcc792650f2cf2e84526ce3660e83497b53061"} Sep 10 16:03:23.858904 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:23.858682 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vxsg_9f57ca5e-844f-4390-a8e5-07abcea64cb2/konnectivity-agent/0.log" limit=1024 Sep 10 16:03:24.074046 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:24.074010 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pcsbz" Sep 10 16:03:24.074252 ip-10-0-135-53 kubenswrapper[2574]: E0910 16:03:24.074156 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pcsbz" podUID="aa29ebca-e469-4e43-abda-06f75d9c0a11" Sep 10 16:03:24.228784 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:24.228704 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tmshf" event={"ID":"ce502816-6f0c-458c-b83d-bd1488b32d29","Type":"ContainerStarted","Data":"9cb19289075c45c94f045371b9516ac062c4a86695fbd8a4870cc53ccac73419"} Sep 10 16:03:24.229216 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:24.228986 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-tmshf" Sep 10 16:03:24.229216 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:24.229078 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-tmshf" Sep 10 16:03:24.246918 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:24.246891 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-tmshf" Sep 10 16:03:24.256541 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:24.256487 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-tmshf" podStartSLOduration=8.641866519 podStartE2EDuration="28.256464722s" totalImagesPullingTime="19.614598203s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 16:02:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 16:03:24.2558456 +0000 UTC m=+28.821049145" watchObservedRunningTime="2026-09-10 16:03:24.256464722 +0000 UTC m=+28.821668265" Sep 10 16:03:25.075010 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:25.074973 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ct85s" Sep 10 16:03:25.075173 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:25.075017 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vpl4s" Sep 10 16:03:25.075173 ip-10-0-135-53 kubenswrapper[2574]: E0910 16:03:25.075117 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ct85s" podUID="cc55b4de-3d22-4d24-bf28-d018afb0e4bc" Sep 10 16:03:25.075348 ip-10-0-135-53 kubenswrapper[2574]: E0910 16:03:25.075252 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vpl4s" podUID="fe979f50-1926-4dc6-9830-76ba5781be0b" Sep 10 16:03:25.232244 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:25.232157 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-tmshf" Sep 10 16:03:25.250535 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:25.250506 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-tmshf" Sep 10 16:03:25.518828 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:25.518754 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-ct85s"] Sep 10 16:03:25.518988 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:25.518893 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ct85s" Sep 10 16:03:25.519048 ip-10-0-135-53 kubenswrapper[2574]: E0910 16:03:25.519021 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ct85s" podUID="cc55b4de-3d22-4d24-bf28-d018afb0e4bc" Sep 10 16:03:25.523080 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:25.523050 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-vpl4s"] Sep 10 16:03:25.523226 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:25.523167 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vpl4s" Sep 10 16:03:25.523226 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:25.523181 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-pcsbz"] Sep 10 16:03:25.523351 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:25.523314 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pcsbz" Sep 10 16:03:25.523351 ip-10-0-135-53 kubenswrapper[2574]: E0910 16:03:25.523308 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vpl4s" podUID="fe979f50-1926-4dc6-9830-76ba5781be0b" Sep 10 16:03:25.523458 ip-10-0-135-53 kubenswrapper[2574]: E0910 16:03:25.523408 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pcsbz" podUID="aa29ebca-e469-4e43-abda-06f75d9c0a11" Sep 10 16:03:25.977728 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:25.977653 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vxsg_9f57ca5e-844f-4390-a8e5-07abcea64cb2/konnectivity-agent/0.log" limit=1024 Sep 10 16:03:26.129295 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:26.129252 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vxsg_9f57ca5e-844f-4390-a8e5-07abcea64cb2/konnectivity-agent/0.log" limit=1024 Sep 10 16:03:26.266287 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:26.266194 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vxsg_9f57ca5e-844f-4390-a8e5-07abcea64cb2/konnectivity-agent/0.log" limit=1024 Sep 10 16:03:26.362134 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:26.362095 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vxsg_9f57ca5e-844f-4390-a8e5-07abcea64cb2/konnectivity-agent/0.log" limit=1024 Sep 10 16:03:26.563477 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:26.563399 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vxsg_9f57ca5e-844f-4390-a8e5-07abcea64cb2/konnectivity-agent/0.log" limit=1024 Sep 10 16:03:26.763113 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:26.763078 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vxsg_9f57ca5e-844f-4390-a8e5-07abcea64cb2/konnectivity-agent/0.log" limit=1024 Sep 10 16:03:26.956338 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:26.956245 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-7vxsg" Sep 10 16:03:26.956501 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:26.956442 2574 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Sep 10 16:03:26.956967 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:26.956939 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-7vxsg" Sep 10 16:03:27.032721 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:27.032678 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vxsg_9f57ca5e-844f-4390-a8e5-07abcea64cb2/konnectivity-agent/0.log" limit=1024 Sep 10 16:03:27.074798 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:27.074759 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pcsbz" Sep 10 16:03:27.074798 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:27.074788 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ct85s" Sep 10 16:03:27.075003 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:27.074759 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vpl4s" Sep 10 16:03:27.075003 ip-10-0-135-53 kubenswrapper[2574]: E0910 16:03:27.074930 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pcsbz" podUID="aa29ebca-e469-4e43-abda-06f75d9c0a11" Sep 10 16:03:27.075458 ip-10-0-135-53 kubenswrapper[2574]: E0910 16:03:27.075418 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ct85s" podUID="cc55b4de-3d22-4d24-bf28-d018afb0e4bc" Sep 10 16:03:27.075590 ip-10-0-135-53 kubenswrapper[2574]: E0910 16:03:27.075502 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vpl4s" podUID="fe979f50-1926-4dc6-9830-76ba5781be0b" Sep 10 16:03:27.133975 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:27.133928 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vxsg_9f57ca5e-844f-4390-a8e5-07abcea64cb2/konnectivity-agent/0.log" limit=1024 Sep 10 16:03:27.577815 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:27.577775 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vxsg_9f57ca5e-844f-4390-a8e5-07abcea64cb2/konnectivity-agent/0.log" limit=1024 Sep 10 16:03:27.637588 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:27.637559 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vxsg_9f57ca5e-844f-4390-a8e5-07abcea64cb2/konnectivity-agent/0.log" limit=1024 Sep 10 16:03:28.241980 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:28.241697 2574 generic.go:356] "Generic (PLEG): container finished" podID="699bca8d-6865-43af-b415-6ae212a5decb" containerID="908fc3e1a5eb11de4045dbd9af0956c878a3338be8e8ed36d602daa0c17f51a7" exitCode=0 Sep 10 16:03:28.241980 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:28.241778 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dh6tv" event={"ID":"699bca8d-6865-43af-b415-6ae212a5decb","Type":"ContainerDied","Data":"908fc3e1a5eb11de4045dbd9af0956c878a3338be8e8ed36d602daa0c17f51a7"} Sep 10 16:03:29.074189 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:29.074148 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vpl4s" Sep 10 16:03:29.074643 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:29.074256 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pcsbz" Sep 10 16:03:29.074643 ip-10-0-135-53 kubenswrapper[2574]: E0910 16:03:29.074257 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vpl4s" podUID="fe979f50-1926-4dc6-9830-76ba5781be0b" Sep 10 16:03:29.074643 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:29.074279 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ct85s" Sep 10 16:03:29.074643 ip-10-0-135-53 kubenswrapper[2574]: E0910 16:03:29.074371 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pcsbz" podUID="aa29ebca-e469-4e43-abda-06f75d9c0a11" Sep 10 16:03:29.074643 ip-10-0-135-53 kubenswrapper[2574]: E0910 16:03:29.074484 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ct85s" podUID="cc55b4de-3d22-4d24-bf28-d018afb0e4bc" Sep 10 16:03:29.246797 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:29.246764 2574 generic.go:356] "Generic (PLEG): container finished" podID="699bca8d-6865-43af-b415-6ae212a5decb" containerID="cbe69811f42d8bdcb2d588ff0d57f53bd5418afa5dbdace30a3165df9a098480" exitCode=0 Sep 10 16:03:29.246966 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:29.246841 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dh6tv" event={"ID":"699bca8d-6865-43af-b415-6ae212a5decb","Type":"ContainerDied","Data":"cbe69811f42d8bdcb2d588ff0d57f53bd5418afa5dbdace30a3165df9a098480"} Sep 10 16:03:29.605688 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:29.605597 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/aa29ebca-e469-4e43-abda-06f75d9c0a11-original-pull-secret\") pod \"global-pull-secret-syncer-pcsbz\" (UID: \"aa29ebca-e469-4e43-abda-06f75d9c0a11\") " pod="kube-system/global-pull-secret-syncer-pcsbz" Sep 10 16:03:29.605820 ip-10-0-135-53 kubenswrapper[2574]: E0910 16:03:29.605735 2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 10 16:03:29.605820 ip-10-0-135-53 kubenswrapper[2574]: E0910 16:03:29.605797 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aa29ebca-e469-4e43-abda-06f75d9c0a11-original-pull-secret podName:aa29ebca-e469-4e43-abda-06f75d9c0a11 nodeName:}" failed. No retries permitted until 2026-09-10 16:04:01.605780545 +0000 UTC m=+66.170984086 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/aa29ebca-e469-4e43-abda-06f75d9c0a11-original-pull-secret") pod "global-pull-secret-syncer-pcsbz" (UID: "aa29ebca-e469-4e43-abda-06f75d9c0a11") : object "kube-system"/"original-pull-secret" not registered Sep 10 16:03:29.706099 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:29.706068 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cc55b4de-3d22-4d24-bf28-d018afb0e4bc-metrics-certs\") pod \"network-metrics-daemon-ct85s\" (UID: \"cc55b4de-3d22-4d24-bf28-d018afb0e4bc\") " pod="openshift-multus/network-metrics-daemon-ct85s" Sep 10 16:03:29.706295 ip-10-0-135-53 kubenswrapper[2574]: E0910 16:03:29.706255 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 16:03:29.706376 ip-10-0-135-53 kubenswrapper[2574]: E0910 16:03:29.706363 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cc55b4de-3d22-4d24-bf28-d018afb0e4bc-metrics-certs podName:cc55b4de-3d22-4d24-bf28-d018afb0e4bc nodeName:}" failed. No retries permitted until 2026-09-10 16:04:01.706340185 +0000 UTC m=+66.271543731 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cc55b4de-3d22-4d24-bf28-d018afb0e4bc-metrics-certs") pod "network-metrics-daemon-ct85s" (UID: "cc55b4de-3d22-4d24-bf28-d018afb0e4bc") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 10 16:03:29.807451 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:29.807407 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j69hj\" (UniqueName: \"kubernetes.io/projected/fe979f50-1926-4dc6-9830-76ba5781be0b-kube-api-access-j69hj\") pod \"network-check-target-vpl4s\" (UID: \"fe979f50-1926-4dc6-9830-76ba5781be0b\") " pod="openshift-network-diagnostics/network-check-target-vpl4s" Sep 10 16:03:29.807618 ip-10-0-135-53 kubenswrapper[2574]: E0910 16:03:29.807583 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 10 16:03:29.807618 ip-10-0-135-53 kubenswrapper[2574]: E0910 16:03:29.807605 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 10 16:03:29.807618 ip-10-0-135-53 kubenswrapper[2574]: E0910 16:03:29.807615 2574 projected.go:196] Error preparing data for projected volume kube-api-access-j69hj for pod openshift-network-diagnostics/network-check-target-vpl4s: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 16:03:29.807712 ip-10-0-135-53 kubenswrapper[2574]: E0910 16:03:29.807667 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fe979f50-1926-4dc6-9830-76ba5781be0b-kube-api-access-j69hj podName:fe979f50-1926-4dc6-9830-76ba5781be0b nodeName:}" failed. No retries permitted until 2026-09-10 16:04:01.80765336 +0000 UTC m=+66.372856881 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-j69hj" (UniqueName: "kubernetes.io/projected/fe979f50-1926-4dc6-9830-76ba5781be0b-kube-api-access-j69hj") pod "network-check-target-vpl4s" (UID: "fe979f50-1926-4dc6-9830-76ba5781be0b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 10 16:03:30.252137 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:30.252094 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dh6tv" event={"ID":"699bca8d-6865-43af-b415-6ae212a5decb","Type":"ContainerStarted","Data":"b32a36a8c51dde897912a3f35bd314bdb9e88f7cfd375133cc1236d516d357f0"} Sep 10 16:03:30.275923 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:30.275862 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-dh6tv" podStartSLOduration=8.42652991 podStartE2EDuration="34.275845023s" totalImagesPullingTime="25.849315113s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 16:02:56 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 16:03:30.27532763 +0000 UTC m=+34.840531174" watchObservedRunningTime="2026-09-10 16:03:30.275845023 +0000 UTC m=+34.841048559" Sep 10 16:03:30.500357 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:30.500326 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vxsg_9f57ca5e-844f-4390-a8e5-07abcea64cb2/konnectivity-agent/0.log" limit=1024 Sep 10 16:03:30.680318 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:30.680227 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vxsg_9f57ca5e-844f-4390-a8e5-07abcea64cb2/konnectivity-agent/0.log" limit=1024 Sep 10 16:03:31.074970 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:31.074876 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ct85s" Sep 10 16:03:31.074970 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:31.074914 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vpl4s" Sep 10 16:03:31.074970 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:31.074877 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pcsbz" Sep 10 16:03:31.075390 ip-10-0-135-53 kubenswrapper[2574]: E0910 16:03:31.075009 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ct85s" podUID="cc55b4de-3d22-4d24-bf28-d018afb0e4bc" Sep 10 16:03:31.075390 ip-10-0-135-53 kubenswrapper[2574]: E0910 16:03:31.075058 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pcsbz" podUID="aa29ebca-e469-4e43-abda-06f75d9c0a11" Sep 10 16:03:31.075390 ip-10-0-135-53 kubenswrapper[2574]: E0910 16:03:31.075123 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vpl4s" podUID="fe979f50-1926-4dc6-9830-76ba5781be0b" Sep 10 16:03:31.764178 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:31.764149 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-53.ec2.internal" event="NodeReady" Sep 10 16:03:31.764550 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:31.764285 2574 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Sep 10 16:03:31.816642 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:31.816606 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-2w5j8"] Sep 10 16:03:31.838143 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:31.838111 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-vq7kx"] Sep 10 16:03:31.838351 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:31.838285 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-2w5j8" Sep 10 16:03:31.841146 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:31.841120 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Sep 10 16:03:31.841397 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:31.841379 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Sep 10 16:03:31.841555 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:31.841484 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-tj7w7\"" Sep 10 16:03:31.841602 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:31.841587 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Sep 10 16:03:31.860276 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:31.860233 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-2w5j8"] Sep 10 16:03:31.860416 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:31.860349 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-vq7kx" Sep 10 16:03:31.860416 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:31.860388 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-vq7kx"] Sep 10 16:03:31.864811 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:31.864788 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Sep 10 16:03:31.864955 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:31.864792 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Sep 10 16:03:31.864955 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:31.864849 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-snhng\"" Sep 10 16:03:31.921966 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:31.921869 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ddcrs\" (UniqueName: \"kubernetes.io/projected/5c9960fa-cf35-42ce-ba26-e4dd86985aa0-kube-api-access-ddcrs\") pod \"ingress-canary-2w5j8\" (UID: \"5c9960fa-cf35-42ce-ba26-e4dd86985aa0\") " pod="openshift-ingress-canary/ingress-canary-2w5j8" Sep 10 16:03:31.921966 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:31.921926 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5c9960fa-cf35-42ce-ba26-e4dd86985aa0-cert\") pod \"ingress-canary-2w5j8\" (UID: \"5c9960fa-cf35-42ce-ba26-e4dd86985aa0\") " pod="openshift-ingress-canary/ingress-canary-2w5j8" Sep 10 16:03:32.022928 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:32.022896 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4e31247f-e7e8-4d9b-b3ed-0c18d36131e8-tmp-dir\") pod \"dns-default-vq7kx\" (UID: \"4e31247f-e7e8-4d9b-b3ed-0c18d36131e8\") " pod="openshift-dns/dns-default-vq7kx" Sep 10 16:03:32.022928 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:32.022933 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ddcrs\" (UniqueName: \"kubernetes.io/projected/5c9960fa-cf35-42ce-ba26-e4dd86985aa0-kube-api-access-ddcrs\") pod \"ingress-canary-2w5j8\" (UID: \"5c9960fa-cf35-42ce-ba26-e4dd86985aa0\") " pod="openshift-ingress-canary/ingress-canary-2w5j8" Sep 10 16:03:32.023154 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:32.022969 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5c9960fa-cf35-42ce-ba26-e4dd86985aa0-cert\") pod \"ingress-canary-2w5j8\" (UID: \"5c9960fa-cf35-42ce-ba26-e4dd86985aa0\") " pod="openshift-ingress-canary/ingress-canary-2w5j8" Sep 10 16:03:32.023154 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:32.023020 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4e31247f-e7e8-4d9b-b3ed-0c18d36131e8-metrics-tls\") pod \"dns-default-vq7kx\" (UID: \"4e31247f-e7e8-4d9b-b3ed-0c18d36131e8\") " pod="openshift-dns/dns-default-vq7kx" Sep 10 16:03:32.023154 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:32.023066 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6ljmw\" (UniqueName: \"kubernetes.io/projected/4e31247f-e7e8-4d9b-b3ed-0c18d36131e8-kube-api-access-6ljmw\") pod \"dns-default-vq7kx\" (UID: \"4e31247f-e7e8-4d9b-b3ed-0c18d36131e8\") " pod="openshift-dns/dns-default-vq7kx" Sep 10 16:03:32.023333 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:32.023199 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/4e31247f-e7e8-4d9b-b3ed-0c18d36131e8-config-volume\") pod \"dns-default-vq7kx\" (UID: \"4e31247f-e7e8-4d9b-b3ed-0c18d36131e8\") " pod="openshift-dns/dns-default-vq7kx" Sep 10 16:03:32.027546 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:32.027427 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5c9960fa-cf35-42ce-ba26-e4dd86985aa0-cert\") pod \"ingress-canary-2w5j8\" (UID: \"5c9960fa-cf35-42ce-ba26-e4dd86985aa0\") " pod="openshift-ingress-canary/ingress-canary-2w5j8" Sep 10 16:03:32.032519 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:32.032499 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ddcrs\" (UniqueName: \"kubernetes.io/projected/5c9960fa-cf35-42ce-ba26-e4dd86985aa0-kube-api-access-ddcrs\") pod \"ingress-canary-2w5j8\" (UID: \"5c9960fa-cf35-42ce-ba26-e4dd86985aa0\") " pod="openshift-ingress-canary/ingress-canary-2w5j8" Sep 10 16:03:32.124165 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:32.124128 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4e31247f-e7e8-4d9b-b3ed-0c18d36131e8-metrics-tls\") pod \"dns-default-vq7kx\" (UID: \"4e31247f-e7e8-4d9b-b3ed-0c18d36131e8\") " pod="openshift-dns/dns-default-vq7kx" Sep 10 16:03:32.124165 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:32.124163 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6ljmw\" (UniqueName: \"kubernetes.io/projected/4e31247f-e7e8-4d9b-b3ed-0c18d36131e8-kube-api-access-6ljmw\") pod \"dns-default-vq7kx\" (UID: \"4e31247f-e7e8-4d9b-b3ed-0c18d36131e8\") " pod="openshift-dns/dns-default-vq7kx" Sep 10 16:03:32.124427 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:32.124191 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/4e31247f-e7e8-4d9b-b3ed-0c18d36131e8-config-volume\") pod \"dns-default-vq7kx\" (UID: \"4e31247f-e7e8-4d9b-b3ed-0c18d36131e8\") " pod="openshift-dns/dns-default-vq7kx" Sep 10 16:03:32.124427 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:32.124228 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4e31247f-e7e8-4d9b-b3ed-0c18d36131e8-tmp-dir\") pod \"dns-default-vq7kx\" (UID: \"4e31247f-e7e8-4d9b-b3ed-0c18d36131e8\") " pod="openshift-dns/dns-default-vq7kx" Sep 10 16:03:32.124427 ip-10-0-135-53 kubenswrapper[2574]: E0910 16:03:32.124295 2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 10 16:03:32.124427 ip-10-0-135-53 kubenswrapper[2574]: E0910 16:03:32.124355 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4e31247f-e7e8-4d9b-b3ed-0c18d36131e8-metrics-tls podName:4e31247f-e7e8-4d9b-b3ed-0c18d36131e8 nodeName:}" failed. No retries permitted until 2026-09-10 16:03:32.624340238 +0000 UTC m=+37.189543764 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4e31247f-e7e8-4d9b-b3ed-0c18d36131e8-metrics-tls") pod "dns-default-vq7kx" (UID: "4e31247f-e7e8-4d9b-b3ed-0c18d36131e8") : secret "dns-default-metrics-tls" not found Sep 10 16:03:32.124634 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:32.124561 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4e31247f-e7e8-4d9b-b3ed-0c18d36131e8-tmp-dir\") pod \"dns-default-vq7kx\" (UID: \"4e31247f-e7e8-4d9b-b3ed-0c18d36131e8\") " pod="openshift-dns/dns-default-vq7kx" Sep 10 16:03:32.124892 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:32.124867 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/4e31247f-e7e8-4d9b-b3ed-0c18d36131e8-config-volume\") pod \"dns-default-vq7kx\" (UID: \"4e31247f-e7e8-4d9b-b3ed-0c18d36131e8\") " pod="openshift-dns/dns-default-vq7kx" Sep 10 16:03:32.132956 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:32.132937 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6ljmw\" (UniqueName: \"kubernetes.io/projected/4e31247f-e7e8-4d9b-b3ed-0c18d36131e8-kube-api-access-6ljmw\") pod \"dns-default-vq7kx\" (UID: \"4e31247f-e7e8-4d9b-b3ed-0c18d36131e8\") " pod="openshift-dns/dns-default-vq7kx" Sep 10 16:03:32.147429 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:32.147404 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-2w5j8" Sep 10 16:03:32.456739 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:32.456668 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-2w5j8"] Sep 10 16:03:32.460135 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:03:32.460108 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5c9960fa_cf35_42ce_ba26_e4dd86985aa0.slice/crio-4c64c1d8811ac5704ee380aa230b3658d398a34501bad0dc9613ea96186932ef WatchSource:0}: Error finding container 4c64c1d8811ac5704ee380aa230b3658d398a34501bad0dc9613ea96186932ef: Status 404 returned error can't find the container with id 4c64c1d8811ac5704ee380aa230b3658d398a34501bad0dc9613ea96186932ef Sep 10 16:03:32.628550 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:32.628514 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4e31247f-e7e8-4d9b-b3ed-0c18d36131e8-metrics-tls\") pod \"dns-default-vq7kx\" (UID: \"4e31247f-e7e8-4d9b-b3ed-0c18d36131e8\") " pod="openshift-dns/dns-default-vq7kx" Sep 10 16:03:32.628727 ip-10-0-135-53 kubenswrapper[2574]: E0910 16:03:32.628667 2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 10 16:03:32.628773 ip-10-0-135-53 kubenswrapper[2574]: E0910 16:03:32.628736 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4e31247f-e7e8-4d9b-b3ed-0c18d36131e8-metrics-tls podName:4e31247f-e7e8-4d9b-b3ed-0c18d36131e8 nodeName:}" failed. No retries permitted until 2026-09-10 16:03:33.628720888 +0000 UTC m=+38.193924411 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4e31247f-e7e8-4d9b-b3ed-0c18d36131e8-metrics-tls") pod "dns-default-vq7kx" (UID: "4e31247f-e7e8-4d9b-b3ed-0c18d36131e8") : secret "dns-default-metrics-tls" not found Sep 10 16:03:33.074739 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:33.074701 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vpl4s" Sep 10 16:03:33.075405 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:33.074702 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ct85s" Sep 10 16:03:33.075405 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:33.074701 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pcsbz" Sep 10 16:03:33.078714 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:33.078694 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Sep 10 16:03:33.078714 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:33.078703 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Sep 10 16:03:33.078905 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:33.078707 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-x4mwj\"" Sep 10 16:03:33.078905 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:33.078741 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-wstvg\"" Sep 10 16:03:33.078905 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:33.078696 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Sep 10 16:03:33.078905 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:33.078773 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Sep 10 16:03:33.260358 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:33.260314 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-2w5j8" event={"ID":"5c9960fa-cf35-42ce-ba26-e4dd86985aa0","Type":"ContainerStarted","Data":"4c64c1d8811ac5704ee380aa230b3658d398a34501bad0dc9613ea96186932ef"} Sep 10 16:03:33.635057 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:33.635020 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4e31247f-e7e8-4d9b-b3ed-0c18d36131e8-metrics-tls\") pod \"dns-default-vq7kx\" (UID: \"4e31247f-e7e8-4d9b-b3ed-0c18d36131e8\") " pod="openshift-dns/dns-default-vq7kx" Sep 10 16:03:33.635254 ip-10-0-135-53 kubenswrapper[2574]: E0910 16:03:33.635156 2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 10 16:03:33.635254 ip-10-0-135-53 kubenswrapper[2574]: E0910 16:03:33.635235 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4e31247f-e7e8-4d9b-b3ed-0c18d36131e8-metrics-tls podName:4e31247f-e7e8-4d9b-b3ed-0c18d36131e8 nodeName:}" failed. No retries permitted until 2026-09-10 16:03:35.635216089 +0000 UTC m=+40.200419610 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4e31247f-e7e8-4d9b-b3ed-0c18d36131e8-metrics-tls") pod "dns-default-vq7kx" (UID: "4e31247f-e7e8-4d9b-b3ed-0c18d36131e8") : secret "dns-default-metrics-tls" not found Sep 10 16:03:35.652416 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:35.652133 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4e31247f-e7e8-4d9b-b3ed-0c18d36131e8-metrics-tls\") pod \"dns-default-vq7kx\" (UID: \"4e31247f-e7e8-4d9b-b3ed-0c18d36131e8\") " pod="openshift-dns/dns-default-vq7kx" Sep 10 16:03:35.652416 ip-10-0-135-53 kubenswrapper[2574]: E0910 16:03:35.652308 2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 10 16:03:35.652920 ip-10-0-135-53 kubenswrapper[2574]: E0910 16:03:35.652474 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4e31247f-e7e8-4d9b-b3ed-0c18d36131e8-metrics-tls podName:4e31247f-e7e8-4d9b-b3ed-0c18d36131e8 nodeName:}" failed. No retries permitted until 2026-09-10 16:03:39.652458554 +0000 UTC m=+44.217662094 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4e31247f-e7e8-4d9b-b3ed-0c18d36131e8-metrics-tls") pod "dns-default-vq7kx" (UID: "4e31247f-e7e8-4d9b-b3ed-0c18d36131e8") : secret "dns-default-metrics-tls" not found Sep 10 16:03:36.269113 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:36.269082 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-2w5j8" event={"ID":"5c9960fa-cf35-42ce-ba26-e4dd86985aa0","Type":"ContainerStarted","Data":"1da4365b3bc5230a6923ee69927ba345d68f33e4a235cf76f626a4eed79677e9"} Sep 10 16:03:36.290386 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:36.290334 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-2w5j8" podStartSLOduration=2.535107064 podStartE2EDuration="5.290317244s" totalImagesPullingTime="2.75521018s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 16:03:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 16:03:36.289071827 +0000 UTC m=+40.854275370" watchObservedRunningTime="2026-09-10 16:03:36.290317244 +0000 UTC m=+40.855520785" Sep 10 16:03:37.482363 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:37.482335 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vxsg_9f57ca5e-844f-4390-a8e5-07abcea64cb2/konnectivity-agent/0.log" limit=1024 Sep 10 16:03:37.962277 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:37.962242 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vxsg_9f57ca5e-844f-4390-a8e5-07abcea64cb2/konnectivity-agent/0.log" limit=1024 Sep 10 16:03:39.682157 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:39.682118 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4e31247f-e7e8-4d9b-b3ed-0c18d36131e8-metrics-tls\") pod \"dns-default-vq7kx\" (UID: \"4e31247f-e7e8-4d9b-b3ed-0c18d36131e8\") " pod="openshift-dns/dns-default-vq7kx" Sep 10 16:03:39.682547 ip-10-0-135-53 kubenswrapper[2574]: E0910 16:03:39.682231 2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 10 16:03:39.682547 ip-10-0-135-53 kubenswrapper[2574]: E0910 16:03:39.682296 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4e31247f-e7e8-4d9b-b3ed-0c18d36131e8-metrics-tls podName:4e31247f-e7e8-4d9b-b3ed-0c18d36131e8 nodeName:}" failed. No retries permitted until 2026-09-10 16:03:47.682283648 +0000 UTC m=+52.247487183 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4e31247f-e7e8-4d9b-b3ed-0c18d36131e8-metrics-tls") pod "dns-default-vq7kx" (UID: "4e31247f-e7e8-4d9b-b3ed-0c18d36131e8") : secret "dns-default-metrics-tls" not found Sep 10 16:03:45.092542 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:45.092509 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vxsg_9f57ca5e-844f-4390-a8e5-07abcea64cb2/konnectivity-agent/0.log" limit=1024 Sep 10 16:03:45.192967 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:45.192937 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vxsg_9f57ca5e-844f-4390-a8e5-07abcea64cb2/konnectivity-agent/0.log" limit=1024 Sep 10 16:03:45.548088 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:45.548057 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-685456655f-5xms5"] Sep 10 16:03:45.590496 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:45.590466 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-68nz2"] Sep 10 16:03:45.590646 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:45.590590 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-685456655f-5xms5" Sep 10 16:03:45.594193 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:45.594172 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-865q6\"" Sep 10 16:03:45.603901 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:45.603880 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-685456655f-5xms5"] Sep 10 16:03:45.603985 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:45.603911 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-68nz2"] Sep 10 16:03:45.604019 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:45.603985 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-68nz2" Sep 10 16:03:45.606652 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:45.606635 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Sep 10 16:03:45.607100 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:45.607080 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Sep 10 16:03:45.607175 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:45.607158 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-qssxz\"" Sep 10 16:03:45.607213 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:45.607086 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Sep 10 16:03:45.664074 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:45.664043 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-7x4lr"] Sep 10 16:03:45.687426 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:45.687396 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-85b454874b-frshx"] Sep 10 16:03:45.687566 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:45.687517 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-7x4lr" Sep 10 16:03:45.690056 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:45.690023 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Sep 10 16:03:45.690056 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:45.690027 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-d278k\"" Sep 10 16:03:45.690056 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:45.690050 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Sep 10 16:03:45.711499 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:45.711476 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6cdcc96965-9rfn8"] Sep 10 16:03:45.711613 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:45.711600 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-85b454874b-frshx" Sep 10 16:03:45.713939 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:45.713905 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Sep 10 16:03:45.714088 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:45.713981 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Sep 10 16:03:45.714088 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:45.713988 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Sep 10 16:03:45.714240 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:45.714225 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-h2j49\"" Sep 10 16:03:45.714461 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:45.714438 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Sep 10 16:03:45.719839 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:45.719818 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Sep 10 16:03:45.726643 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:45.726602 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5dqz5\" (UniqueName: \"kubernetes.io/projected/b005b666-7f33-4203-ac69-4d1fe658441c-kube-api-access-5dqz5\") pod \"cluster-samples-operator-7cdcfcf76c-68nz2\" (UID: \"b005b666-7f33-4203-ac69-4d1fe658441c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-68nz2" Sep 10 16:03:45.726643 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:45.726636 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/b005b666-7f33-4203-ac69-4d1fe658441c-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-68nz2\" (UID: \"b005b666-7f33-4203-ac69-4d1fe658441c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-68nz2" Sep 10 16:03:45.726766 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:45.726687 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r5h5p\" (UniqueName: \"kubernetes.io/projected/63650af5-b34c-4d6b-8e44-faeb135d57bc-kube-api-access-r5h5p\") pod \"network-check-source-685456655f-5xms5\" (UID: \"63650af5-b34c-4d6b-8e44-faeb135d57bc\") " pod="openshift-network-diagnostics/network-check-source-685456655f-5xms5" Sep 10 16:03:45.735616 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:45.735599 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-64969f7776-5mx24"] Sep 10 16:03:45.735706 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:45.735665 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-9rfn8" Sep 10 16:03:45.739352 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:45.739335 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Sep 10 16:03:45.739494 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:45.739479 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Sep 10 16:03:45.740420 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:45.740396 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-7dctc\"" Sep 10 16:03:45.740520 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:45.740426 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Sep 10 16:03:45.740520 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:45.740465 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Sep 10 16:03:45.759750 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:45.759729 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-64969f7776-5mx24" Sep 10 16:03:45.759750 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:45.759732 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-7x4lr"] Sep 10 16:03:45.759898 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:45.759784 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6cdcc96965-9rfn8"] Sep 10 16:03:45.759898 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:45.759810 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-64969f7776-5mx24"] Sep 10 16:03:45.759898 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:45.759828 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-85b454874b-frshx"] Sep 10 16:03:45.762077 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:45.762059 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Sep 10 16:03:45.762252 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:45.762237 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Sep 10 16:03:45.762457 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:45.762438 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Sep 10 16:03:45.762558 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:45.762545 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Sep 10 16:03:45.762613 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:45.762545 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Sep 10 16:03:45.762613 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:45.762552 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Sep 10 16:03:45.762717 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:45.762682 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-zvhdr\"" Sep 10 16:03:45.820825 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:45.820725 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vxsg_9f57ca5e-844f-4390-a8e5-07abcea64cb2/konnectivity-agent/0.log" limit=1024 Sep 10 16:03:45.827750 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:45.827729 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/9baedfdd-1384-4da1-b9c0-58dea49d3ae0-config\") pod \"console-operator-85b454874b-frshx\" (UID: \"9baedfdd-1384-4da1-b9c0-58dea49d3ae0\") " pod="openshift-console-operator/console-operator-85b454874b-frshx" Sep 10 16:03:45.827853 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:45.827777 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5dqz5\" (UniqueName: \"kubernetes.io/projected/b005b666-7f33-4203-ac69-4d1fe658441c-kube-api-access-5dqz5\") pod \"cluster-samples-operator-7cdcfcf76c-68nz2\" (UID: \"b005b666-7f33-4203-ac69-4d1fe658441c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-68nz2" Sep 10 16:03:45.827853 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:45.827809 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n6tk6\" (UniqueName: \"kubernetes.io/projected/72fae279-5890-4638-9eed-a984b82cf0b5-kube-api-access-n6tk6\") pod \"volume-data-source-validator-695c895bd6-7x4lr\" (UID: \"72fae279-5890-4638-9eed-a984b82cf0b5\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-7x4lr" Sep 10 16:03:45.827977 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:45.827848 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/b005b666-7f33-4203-ac69-4d1fe658441c-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-68nz2\" (UID: \"b005b666-7f33-4203-ac69-4d1fe658441c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-68nz2" Sep 10 16:03:45.827977 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:45.827889 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9baedfdd-1384-4da1-b9c0-58dea49d3ae0-trusted-ca\") pod \"console-operator-85b454874b-frshx\" (UID: \"9baedfdd-1384-4da1-b9c0-58dea49d3ae0\") " pod="openshift-console-operator/console-operator-85b454874b-frshx" Sep 10 16:03:45.827977 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:45.827913 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6s6hl\" (UniqueName: \"kubernetes.io/projected/9baedfdd-1384-4da1-b9c0-58dea49d3ae0-kube-api-access-6s6hl\") pod \"console-operator-85b454874b-frshx\" (UID: \"9baedfdd-1384-4da1-b9c0-58dea49d3ae0\") " pod="openshift-console-operator/console-operator-85b454874b-frshx" Sep 10 16:03:45.827977 ip-10-0-135-53 kubenswrapper[2574]: E0910 16:03:45.827946 2574 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Sep 10 16:03:45.828119 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:45.827992 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r5h5p\" (UniqueName: \"kubernetes.io/projected/63650af5-b34c-4d6b-8e44-faeb135d57bc-kube-api-access-r5h5p\") pod \"network-check-source-685456655f-5xms5\" (UID: \"63650af5-b34c-4d6b-8e44-faeb135d57bc\") " pod="openshift-network-diagnostics/network-check-source-685456655f-5xms5" Sep 10 16:03:45.828119 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:45.828031 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/9baedfdd-1384-4da1-b9c0-58dea49d3ae0-serving-cert\") pod \"console-operator-85b454874b-frshx\" (UID: \"9baedfdd-1384-4da1-b9c0-58dea49d3ae0\") " pod="openshift-console-operator/console-operator-85b454874b-frshx" Sep 10 16:03:45.828119 ip-10-0-135-53 kubenswrapper[2574]: E0910 16:03:45.828081 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b005b666-7f33-4203-ac69-4d1fe658441c-samples-operator-tls podName:b005b666-7f33-4203-ac69-4d1fe658441c nodeName:}" failed. No retries permitted until 2026-09-10 16:03:46.328065148 +0000 UTC m=+50.893268670 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/b005b666-7f33-4203-ac69-4d1fe658441c-samples-operator-tls") pod "cluster-samples-operator-7cdcfcf76c-68nz2" (UID: "b005b666-7f33-4203-ac69-4d1fe658441c") : secret "samples-operator-tls" not found Sep 10 16:03:45.837303 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:45.837281 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5dqz5\" (UniqueName: \"kubernetes.io/projected/b005b666-7f33-4203-ac69-4d1fe658441c-kube-api-access-5dqz5\") pod \"cluster-samples-operator-7cdcfcf76c-68nz2\" (UID: \"b005b666-7f33-4203-ac69-4d1fe658441c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-68nz2" Sep 10 16:03:45.837407 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:45.837328 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r5h5p\" (UniqueName: \"kubernetes.io/projected/63650af5-b34c-4d6b-8e44-faeb135d57bc-kube-api-access-r5h5p\") pod \"network-check-source-685456655f-5xms5\" (UID: \"63650af5-b34c-4d6b-8e44-faeb135d57bc\") " pod="openshift-network-diagnostics/network-check-source-685456655f-5xms5" Sep 10 16:03:45.899099 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:45.899063 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-685456655f-5xms5" Sep 10 16:03:45.929109 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:45.929080 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n6tk6\" (UniqueName: \"kubernetes.io/projected/72fae279-5890-4638-9eed-a984b82cf0b5-kube-api-access-n6tk6\") pod \"volume-data-source-validator-695c895bd6-7x4lr\" (UID: \"72fae279-5890-4638-9eed-a984b82cf0b5\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-7x4lr" Sep 10 16:03:45.929235 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:45.929123 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-54vrs\" (UniqueName: \"kubernetes.io/projected/6e9a2956-c6be-44d6-b063-e8134e21bc27-kube-api-access-54vrs\") pod \"router-default-64969f7776-5mx24\" (UID: \"6e9a2956-c6be-44d6-b063-e8134e21bc27\") " pod="openshift-ingress/router-default-64969f7776-5mx24" Sep 10 16:03:45.929235 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:45.929164 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/6e9a2956-c6be-44d6-b063-e8134e21bc27-stats-auth\") pod \"router-default-64969f7776-5mx24\" (UID: \"6e9a2956-c6be-44d6-b063-e8134e21bc27\") " pod="openshift-ingress/router-default-64969f7776-5mx24" Sep 10 16:03:45.929235 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:45.929192 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6e9a2956-c6be-44d6-b063-e8134e21bc27-service-ca-bundle\") pod \"router-default-64969f7776-5mx24\" (UID: \"6e9a2956-c6be-44d6-b063-e8134e21bc27\") " pod="openshift-ingress/router-default-64969f7776-5mx24" Sep 10 16:03:45.929385 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:45.929272 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9baedfdd-1384-4da1-b9c0-58dea49d3ae0-trusted-ca\") pod \"console-operator-85b454874b-frshx\" (UID: \"9baedfdd-1384-4da1-b9c0-58dea49d3ae0\") " pod="openshift-console-operator/console-operator-85b454874b-frshx" Sep 10 16:03:45.929385 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:45.929320 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6s6hl\" (UniqueName: \"kubernetes.io/projected/9baedfdd-1384-4da1-b9c0-58dea49d3ae0-kube-api-access-6s6hl\") pod \"console-operator-85b454874b-frshx\" (UID: \"9baedfdd-1384-4da1-b9c0-58dea49d3ae0\") " pod="openshift-console-operator/console-operator-85b454874b-frshx" Sep 10 16:03:45.929385 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:45.929374 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d8zsf\" (UniqueName: \"kubernetes.io/projected/e3e9b71b-d2dc-483e-a5fa-5a5054914933-kube-api-access-d8zsf\") pod \"cluster-monitoring-operator-6cdcc96965-9rfn8\" (UID: \"e3e9b71b-d2dc-483e-a5fa-5a5054914933\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-9rfn8" Sep 10 16:03:45.929503 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:45.929418 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/e3e9b71b-d2dc-483e-a5fa-5a5054914933-telemetry-config\") pod \"cluster-monitoring-operator-6cdcc96965-9rfn8\" (UID: \"e3e9b71b-d2dc-483e-a5fa-5a5054914933\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-9rfn8" Sep 10 16:03:45.929503 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:45.929440 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/6e9a2956-c6be-44d6-b063-e8134e21bc27-default-certificate\") pod \"router-default-64969f7776-5mx24\" (UID: \"6e9a2956-c6be-44d6-b063-e8134e21bc27\") " pod="openshift-ingress/router-default-64969f7776-5mx24" Sep 10 16:03:45.929503 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:45.929466 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/9baedfdd-1384-4da1-b9c0-58dea49d3ae0-serving-cert\") pod \"console-operator-85b454874b-frshx\" (UID: \"9baedfdd-1384-4da1-b9c0-58dea49d3ae0\") " pod="openshift-console-operator/console-operator-85b454874b-frshx" Sep 10 16:03:45.929617 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:45.929537 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/e3e9b71b-d2dc-483e-a5fa-5a5054914933-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-9rfn8\" (UID: \"e3e9b71b-d2dc-483e-a5fa-5a5054914933\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-9rfn8" Sep 10 16:03:45.929617 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:45.929576 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/9baedfdd-1384-4da1-b9c0-58dea49d3ae0-config\") pod \"console-operator-85b454874b-frshx\" (UID: \"9baedfdd-1384-4da1-b9c0-58dea49d3ae0\") " pod="openshift-console-operator/console-operator-85b454874b-frshx" Sep 10 16:03:45.929617 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:45.929605 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6e9a2956-c6be-44d6-b063-e8134e21bc27-metrics-certs\") pod \"router-default-64969f7776-5mx24\" (UID: \"6e9a2956-c6be-44d6-b063-e8134e21bc27\") " pod="openshift-ingress/router-default-64969f7776-5mx24" Sep 10 16:03:45.930117 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:45.930093 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/9baedfdd-1384-4da1-b9c0-58dea49d3ae0-config\") pod \"console-operator-85b454874b-frshx\" (UID: \"9baedfdd-1384-4da1-b9c0-58dea49d3ae0\") " pod="openshift-console-operator/console-operator-85b454874b-frshx" Sep 10 16:03:45.930207 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:45.930132 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9baedfdd-1384-4da1-b9c0-58dea49d3ae0-trusted-ca\") pod \"console-operator-85b454874b-frshx\" (UID: \"9baedfdd-1384-4da1-b9c0-58dea49d3ae0\") " pod="openshift-console-operator/console-operator-85b454874b-frshx" Sep 10 16:03:45.931629 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:45.931606 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/9baedfdd-1384-4da1-b9c0-58dea49d3ae0-serving-cert\") pod \"console-operator-85b454874b-frshx\" (UID: \"9baedfdd-1384-4da1-b9c0-58dea49d3ae0\") " pod="openshift-console-operator/console-operator-85b454874b-frshx" Sep 10 16:03:45.940467 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:45.940445 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vxsg_9f57ca5e-844f-4390-a8e5-07abcea64cb2/konnectivity-agent/0.log" limit=1024 Sep 10 16:03:45.947386 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:45.947360 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6s6hl\" (UniqueName: \"kubernetes.io/projected/9baedfdd-1384-4da1-b9c0-58dea49d3ae0-kube-api-access-6s6hl\") pod \"console-operator-85b454874b-frshx\" (UID: \"9baedfdd-1384-4da1-b9c0-58dea49d3ae0\") " pod="openshift-console-operator/console-operator-85b454874b-frshx" Sep 10 16:03:45.947717 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:45.947697 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n6tk6\" (UniqueName: \"kubernetes.io/projected/72fae279-5890-4638-9eed-a984b82cf0b5-kube-api-access-n6tk6\") pod \"volume-data-source-validator-695c895bd6-7x4lr\" (UID: \"72fae279-5890-4638-9eed-a984b82cf0b5\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-7x4lr" Sep 10 16:03:45.996898 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:45.996860 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-7x4lr" Sep 10 16:03:46.020055 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:46.020023 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-85b454874b-frshx" Sep 10 16:03:46.030295 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:46.030249 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6e9a2956-c6be-44d6-b063-e8134e21bc27-service-ca-bundle\") pod \"router-default-64969f7776-5mx24\" (UID: \"6e9a2956-c6be-44d6-b063-e8134e21bc27\") " pod="openshift-ingress/router-default-64969f7776-5mx24" Sep 10 16:03:46.030419 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:46.030340 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d8zsf\" (UniqueName: \"kubernetes.io/projected/e3e9b71b-d2dc-483e-a5fa-5a5054914933-kube-api-access-d8zsf\") pod \"cluster-monitoring-operator-6cdcc96965-9rfn8\" (UID: \"e3e9b71b-d2dc-483e-a5fa-5a5054914933\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-9rfn8" Sep 10 16:03:46.030419 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:46.030387 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/e3e9b71b-d2dc-483e-a5fa-5a5054914933-telemetry-config\") pod \"cluster-monitoring-operator-6cdcc96965-9rfn8\" (UID: \"e3e9b71b-d2dc-483e-a5fa-5a5054914933\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-9rfn8" Sep 10 16:03:46.030419 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:46.030410 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/6e9a2956-c6be-44d6-b063-e8134e21bc27-default-certificate\") pod \"router-default-64969f7776-5mx24\" (UID: \"6e9a2956-c6be-44d6-b063-e8134e21bc27\") " pod="openshift-ingress/router-default-64969f7776-5mx24" Sep 10 16:03:46.030564 ip-10-0-135-53 kubenswrapper[2574]: E0910 16:03:46.030445 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6e9a2956-c6be-44d6-b063-e8134e21bc27-service-ca-bundle podName:6e9a2956-c6be-44d6-b063-e8134e21bc27 nodeName:}" failed. No retries permitted until 2026-09-10 16:03:46.530424619 +0000 UTC m=+51.095628160 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/6e9a2956-c6be-44d6-b063-e8134e21bc27-service-ca-bundle") pod "router-default-64969f7776-5mx24" (UID: "6e9a2956-c6be-44d6-b063-e8134e21bc27") : configmap references non-existent config key: service-ca.crt Sep 10 16:03:46.030564 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:46.030484 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/e3e9b71b-d2dc-483e-a5fa-5a5054914933-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-9rfn8\" (UID: \"e3e9b71b-d2dc-483e-a5fa-5a5054914933\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-9rfn8" Sep 10 16:03:46.030564 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:46.030515 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6e9a2956-c6be-44d6-b063-e8134e21bc27-metrics-certs\") pod \"router-default-64969f7776-5mx24\" (UID: \"6e9a2956-c6be-44d6-b063-e8134e21bc27\") " pod="openshift-ingress/router-default-64969f7776-5mx24" Sep 10 16:03:46.030729 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:46.030570 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-54vrs\" (UniqueName: \"kubernetes.io/projected/6e9a2956-c6be-44d6-b063-e8134e21bc27-kube-api-access-54vrs\") pod \"router-default-64969f7776-5mx24\" (UID: \"6e9a2956-c6be-44d6-b063-e8134e21bc27\") " pod="openshift-ingress/router-default-64969f7776-5mx24" Sep 10 16:03:46.030729 ip-10-0-135-53 kubenswrapper[2574]: E0910 16:03:46.030586 2574 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Sep 10 16:03:46.030729 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:46.030613 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/6e9a2956-c6be-44d6-b063-e8134e21bc27-stats-auth\") pod \"router-default-64969f7776-5mx24\" (UID: \"6e9a2956-c6be-44d6-b063-e8134e21bc27\") " pod="openshift-ingress/router-default-64969f7776-5mx24" Sep 10 16:03:46.030729 ip-10-0-135-53 kubenswrapper[2574]: E0910 16:03:46.030648 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e3e9b71b-d2dc-483e-a5fa-5a5054914933-cluster-monitoring-operator-tls podName:e3e9b71b-d2dc-483e-a5fa-5a5054914933 nodeName:}" failed. No retries permitted until 2026-09-10 16:03:46.530631083 +0000 UTC m=+51.095834617 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/e3e9b71b-d2dc-483e-a5fa-5a5054914933-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cdcc96965-9rfn8" (UID: "e3e9b71b-d2dc-483e-a5fa-5a5054914933") : secret "cluster-monitoring-operator-tls" not found Sep 10 16:03:46.030729 ip-10-0-135-53 kubenswrapper[2574]: E0910 16:03:46.030674 2574 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Sep 10 16:03:46.031044 ip-10-0-135-53 kubenswrapper[2574]: E0910 16:03:46.030754 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6e9a2956-c6be-44d6-b063-e8134e21bc27-metrics-certs podName:6e9a2956-c6be-44d6-b063-e8134e21bc27 nodeName:}" failed. No retries permitted until 2026-09-10 16:03:46.530736243 +0000 UTC m=+51.095939783 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6e9a2956-c6be-44d6-b063-e8134e21bc27-metrics-certs") pod "router-default-64969f7776-5mx24" (UID: "6e9a2956-c6be-44d6-b063-e8134e21bc27") : secret "router-metrics-certs-default" not found Sep 10 16:03:46.031194 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:46.031173 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/e3e9b71b-d2dc-483e-a5fa-5a5054914933-telemetry-config\") pod \"cluster-monitoring-operator-6cdcc96965-9rfn8\" (UID: \"e3e9b71b-d2dc-483e-a5fa-5a5054914933\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-9rfn8" Sep 10 16:03:46.032968 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:46.032944 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/6e9a2956-c6be-44d6-b063-e8134e21bc27-default-certificate\") pod \"router-default-64969f7776-5mx24\" (UID: \"6e9a2956-c6be-44d6-b063-e8134e21bc27\") " pod="openshift-ingress/router-default-64969f7776-5mx24" Sep 10 16:03:46.033192 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:46.033173 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/6e9a2956-c6be-44d6-b063-e8134e21bc27-stats-auth\") pod \"router-default-64969f7776-5mx24\" (UID: \"6e9a2956-c6be-44d6-b063-e8134e21bc27\") " pod="openshift-ingress/router-default-64969f7776-5mx24" Sep 10 16:03:46.041278 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:46.041239 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d8zsf\" (UniqueName: \"kubernetes.io/projected/e3e9b71b-d2dc-483e-a5fa-5a5054914933-kube-api-access-d8zsf\") pod \"cluster-monitoring-operator-6cdcc96965-9rfn8\" (UID: \"e3e9b71b-d2dc-483e-a5fa-5a5054914933\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-9rfn8" Sep 10 16:03:46.041490 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:46.041473 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-54vrs\" (UniqueName: \"kubernetes.io/projected/6e9a2956-c6be-44d6-b063-e8134e21bc27-kube-api-access-54vrs\") pod \"router-default-64969f7776-5mx24\" (UID: \"6e9a2956-c6be-44d6-b063-e8134e21bc27\") " pod="openshift-ingress/router-default-64969f7776-5mx24" Sep 10 16:03:46.193459 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:46.193381 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-685456655f-5xms5"] Sep 10 16:03:46.196333 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:03:46.196299 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod63650af5_b34c_4d6b_8e44_faeb135d57bc.slice/crio-941e55e617753fbaf9ddae23808b560374a1be9e2de98e55512bc0640d989b2f WatchSource:0}: Error finding container 941e55e617753fbaf9ddae23808b560374a1be9e2de98e55512bc0640d989b2f: Status 404 returned error can't find the container with id 941e55e617753fbaf9ddae23808b560374a1be9e2de98e55512bc0640d989b2f Sep 10 16:03:46.293105 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:46.293065 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-685456655f-5xms5" event={"ID":"63650af5-b34c-4d6b-8e44-faeb135d57bc","Type":"ContainerStarted","Data":"941e55e617753fbaf9ddae23808b560374a1be9e2de98e55512bc0640d989b2f"} Sep 10 16:03:46.300225 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:46.300196 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-7x4lr"] Sep 10 16:03:46.303148 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:03:46.303123 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod72fae279_5890_4638_9eed_a984b82cf0b5.slice/crio-df9c51b1e9fa3f0a9feeeab9f11337fbd5484d4b3edecc29d0b0c7b56925be01 WatchSource:0}: Error finding container df9c51b1e9fa3f0a9feeeab9f11337fbd5484d4b3edecc29d0b0c7b56925be01: Status 404 returned error can't find the container with id df9c51b1e9fa3f0a9feeeab9f11337fbd5484d4b3edecc29d0b0c7b56925be01 Sep 10 16:03:46.332613 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:46.332538 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-85b454874b-frshx"] Sep 10 16:03:46.332835 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:46.332820 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/b005b666-7f33-4203-ac69-4d1fe658441c-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-68nz2\" (UID: \"b005b666-7f33-4203-ac69-4d1fe658441c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-68nz2" Sep 10 16:03:46.333028 ip-10-0-135-53 kubenswrapper[2574]: E0910 16:03:46.333008 2574 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Sep 10 16:03:46.333089 ip-10-0-135-53 kubenswrapper[2574]: E0910 16:03:46.333079 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b005b666-7f33-4203-ac69-4d1fe658441c-samples-operator-tls podName:b005b666-7f33-4203-ac69-4d1fe658441c nodeName:}" failed. No retries permitted until 2026-09-10 16:03:47.333065463 +0000 UTC m=+51.898268984 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/b005b666-7f33-4203-ac69-4d1fe658441c-samples-operator-tls") pod "cluster-samples-operator-7cdcfcf76c-68nz2" (UID: "b005b666-7f33-4203-ac69-4d1fe658441c") : secret "samples-operator-tls" not found Sep 10 16:03:46.335802 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:03:46.335784 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9baedfdd_1384_4da1_b9c0_58dea49d3ae0.slice/crio-9cf642dd48dc1630f8e04cbc0a3cec2cf9416f4b9b988b8b8b0ff36f71da77a1 WatchSource:0}: Error finding container 9cf642dd48dc1630f8e04cbc0a3cec2cf9416f4b9b988b8b8b0ff36f71da77a1: Status 404 returned error can't find the container with id 9cf642dd48dc1630f8e04cbc0a3cec2cf9416f4b9b988b8b8b0ff36f71da77a1 Sep 10 16:03:46.534507 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:46.534467 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6e9a2956-c6be-44d6-b063-e8134e21bc27-service-ca-bundle\") pod \"router-default-64969f7776-5mx24\" (UID: \"6e9a2956-c6be-44d6-b063-e8134e21bc27\") " pod="openshift-ingress/router-default-64969f7776-5mx24" Sep 10 16:03:46.534681 ip-10-0-135-53 kubenswrapper[2574]: E0910 16:03:46.534650 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6e9a2956-c6be-44d6-b063-e8134e21bc27-service-ca-bundle podName:6e9a2956-c6be-44d6-b063-e8134e21bc27 nodeName:}" failed. No retries permitted until 2026-09-10 16:03:47.534632956 +0000 UTC m=+52.099836483 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/6e9a2956-c6be-44d6-b063-e8134e21bc27-service-ca-bundle") pod "router-default-64969f7776-5mx24" (UID: "6e9a2956-c6be-44d6-b063-e8134e21bc27") : configmap references non-existent config key: service-ca.crt Sep 10 16:03:46.534742 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:46.534677 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/e3e9b71b-d2dc-483e-a5fa-5a5054914933-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-9rfn8\" (UID: \"e3e9b71b-d2dc-483e-a5fa-5a5054914933\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-9rfn8" Sep 10 16:03:46.534742 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:46.534706 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6e9a2956-c6be-44d6-b063-e8134e21bc27-metrics-certs\") pod \"router-default-64969f7776-5mx24\" (UID: \"6e9a2956-c6be-44d6-b063-e8134e21bc27\") " pod="openshift-ingress/router-default-64969f7776-5mx24" Sep 10 16:03:46.534842 ip-10-0-135-53 kubenswrapper[2574]: E0910 16:03:46.534777 2574 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Sep 10 16:03:46.534842 ip-10-0-135-53 kubenswrapper[2574]: E0910 16:03:46.534798 2574 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Sep 10 16:03:46.534842 ip-10-0-135-53 kubenswrapper[2574]: E0910 16:03:46.534837 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e3e9b71b-d2dc-483e-a5fa-5a5054914933-cluster-monitoring-operator-tls podName:e3e9b71b-d2dc-483e-a5fa-5a5054914933 nodeName:}" failed. No retries permitted until 2026-09-10 16:03:47.534824137 +0000 UTC m=+52.100027678 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/e3e9b71b-d2dc-483e-a5fa-5a5054914933-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cdcc96965-9rfn8" (UID: "e3e9b71b-d2dc-483e-a5fa-5a5054914933") : secret "cluster-monitoring-operator-tls" not found Sep 10 16:03:46.534978 ip-10-0-135-53 kubenswrapper[2574]: E0910 16:03:46.534850 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6e9a2956-c6be-44d6-b063-e8134e21bc27-metrics-certs podName:6e9a2956-c6be-44d6-b063-e8134e21bc27 nodeName:}" failed. No retries permitted until 2026-09-10 16:03:47.534844465 +0000 UTC m=+52.100047986 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6e9a2956-c6be-44d6-b063-e8134e21bc27-metrics-certs") pod "router-default-64969f7776-5mx24" (UID: "6e9a2956-c6be-44d6-b063-e8134e21bc27") : secret "router-metrics-certs-default" not found Sep 10 16:03:47.181044 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:47.181003 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-565b4cb7c8-5dx8p"] Sep 10 16:03:47.194578 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:47.194493 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-565b4cb7c8-5dx8p" Sep 10 16:03:47.196692 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:47.196662 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-565b4cb7c8-5dx8p"] Sep 10 16:03:47.197824 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:47.197766 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Sep 10 16:03:47.197824 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:47.197792 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Sep 10 16:03:47.198173 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:47.197992 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-8xcjl\"" Sep 10 16:03:47.199373 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:47.199114 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Sep 10 16:03:47.203732 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:47.203707 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Sep 10 16:03:47.241364 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:47.241314 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/79ab48bc-9994-4510-a3fa-6579e7dcf721-bound-sa-token\") pod \"image-registry-565b4cb7c8-5dx8p\" (UID: \"79ab48bc-9994-4510-a3fa-6579e7dcf721\") " pod="openshift-image-registry/image-registry-565b4cb7c8-5dx8p" Sep 10 16:03:47.241364 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:47.241362 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/79ab48bc-9994-4510-a3fa-6579e7dcf721-registry-certificates\") pod \"image-registry-565b4cb7c8-5dx8p\" (UID: \"79ab48bc-9994-4510-a3fa-6579e7dcf721\") " pod="openshift-image-registry/image-registry-565b4cb7c8-5dx8p" Sep 10 16:03:47.241623 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:47.241449 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jqdh5\" (UniqueName: \"kubernetes.io/projected/79ab48bc-9994-4510-a3fa-6579e7dcf721-kube-api-access-jqdh5\") pod \"image-registry-565b4cb7c8-5dx8p\" (UID: \"79ab48bc-9994-4510-a3fa-6579e7dcf721\") " pod="openshift-image-registry/image-registry-565b4cb7c8-5dx8p" Sep 10 16:03:47.241623 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:47.241502 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/79ab48bc-9994-4510-a3fa-6579e7dcf721-trusted-ca\") pod \"image-registry-565b4cb7c8-5dx8p\" (UID: \"79ab48bc-9994-4510-a3fa-6579e7dcf721\") " pod="openshift-image-registry/image-registry-565b4cb7c8-5dx8p" Sep 10 16:03:47.241623 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:47.241559 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/79ab48bc-9994-4510-a3fa-6579e7dcf721-installation-pull-secrets\") pod \"image-registry-565b4cb7c8-5dx8p\" (UID: \"79ab48bc-9994-4510-a3fa-6579e7dcf721\") " pod="openshift-image-registry/image-registry-565b4cb7c8-5dx8p" Sep 10 16:03:47.241768 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:47.241626 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/79ab48bc-9994-4510-a3fa-6579e7dcf721-image-registry-private-configuration\") pod \"image-registry-565b4cb7c8-5dx8p\" (UID: \"79ab48bc-9994-4510-a3fa-6579e7dcf721\") " pod="openshift-image-registry/image-registry-565b4cb7c8-5dx8p" Sep 10 16:03:47.241768 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:47.241650 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/79ab48bc-9994-4510-a3fa-6579e7dcf721-ca-trust-extracted\") pod \"image-registry-565b4cb7c8-5dx8p\" (UID: \"79ab48bc-9994-4510-a3fa-6579e7dcf721\") " pod="openshift-image-registry/image-registry-565b4cb7c8-5dx8p" Sep 10 16:03:47.241865 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:47.241779 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/79ab48bc-9994-4510-a3fa-6579e7dcf721-registry-tls\") pod \"image-registry-565b4cb7c8-5dx8p\" (UID: \"79ab48bc-9994-4510-a3fa-6579e7dcf721\") " pod="openshift-image-registry/image-registry-565b4cb7c8-5dx8p" Sep 10 16:03:47.296862 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:47.296820 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-85b454874b-frshx" event={"ID":"9baedfdd-1384-4da1-b9c0-58dea49d3ae0","Type":"ContainerStarted","Data":"9cf642dd48dc1630f8e04cbc0a3cec2cf9416f4b9b988b8b8b0ff36f71da77a1"} Sep 10 16:03:47.298132 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:47.298108 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-7x4lr" event={"ID":"72fae279-5890-4638-9eed-a984b82cf0b5","Type":"ContainerStarted","Data":"df9c51b1e9fa3f0a9feeeab9f11337fbd5484d4b3edecc29d0b0c7b56925be01"} Sep 10 16:03:47.342886 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:47.342852 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/b005b666-7f33-4203-ac69-4d1fe658441c-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-68nz2\" (UID: \"b005b666-7f33-4203-ac69-4d1fe658441c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-68nz2" Sep 10 16:03:47.343049 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:47.342900 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jqdh5\" (UniqueName: \"kubernetes.io/projected/79ab48bc-9994-4510-a3fa-6579e7dcf721-kube-api-access-jqdh5\") pod \"image-registry-565b4cb7c8-5dx8p\" (UID: \"79ab48bc-9994-4510-a3fa-6579e7dcf721\") " pod="openshift-image-registry/image-registry-565b4cb7c8-5dx8p" Sep 10 16:03:47.343049 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:47.342942 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/79ab48bc-9994-4510-a3fa-6579e7dcf721-trusted-ca\") pod \"image-registry-565b4cb7c8-5dx8p\" (UID: \"79ab48bc-9994-4510-a3fa-6579e7dcf721\") " pod="openshift-image-registry/image-registry-565b4cb7c8-5dx8p" Sep 10 16:03:47.343049 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:47.342994 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/79ab48bc-9994-4510-a3fa-6579e7dcf721-installation-pull-secrets\") pod \"image-registry-565b4cb7c8-5dx8p\" (UID: \"79ab48bc-9994-4510-a3fa-6579e7dcf721\") " pod="openshift-image-registry/image-registry-565b4cb7c8-5dx8p" Sep 10 16:03:47.343049 ip-10-0-135-53 kubenswrapper[2574]: E0910 16:03:47.343015 2574 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Sep 10 16:03:47.343286 ip-10-0-135-53 kubenswrapper[2574]: E0910 16:03:47.343096 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b005b666-7f33-4203-ac69-4d1fe658441c-samples-operator-tls podName:b005b666-7f33-4203-ac69-4d1fe658441c nodeName:}" failed. No retries permitted until 2026-09-10 16:03:49.343075566 +0000 UTC m=+53.908279112 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/b005b666-7f33-4203-ac69-4d1fe658441c-samples-operator-tls") pod "cluster-samples-operator-7cdcfcf76c-68nz2" (UID: "b005b666-7f33-4203-ac69-4d1fe658441c") : secret "samples-operator-tls" not found Sep 10 16:03:47.343385 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:47.343360 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/79ab48bc-9994-4510-a3fa-6579e7dcf721-image-registry-private-configuration\") pod \"image-registry-565b4cb7c8-5dx8p\" (UID: \"79ab48bc-9994-4510-a3fa-6579e7dcf721\") " pod="openshift-image-registry/image-registry-565b4cb7c8-5dx8p" Sep 10 16:03:47.343442 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:47.343396 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/79ab48bc-9994-4510-a3fa-6579e7dcf721-ca-trust-extracted\") pod \"image-registry-565b4cb7c8-5dx8p\" (UID: \"79ab48bc-9994-4510-a3fa-6579e7dcf721\") " pod="openshift-image-registry/image-registry-565b4cb7c8-5dx8p" Sep 10 16:03:47.343544 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:47.343525 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/79ab48bc-9994-4510-a3fa-6579e7dcf721-registry-tls\") pod \"image-registry-565b4cb7c8-5dx8p\" (UID: \"79ab48bc-9994-4510-a3fa-6579e7dcf721\") " pod="openshift-image-registry/image-registry-565b4cb7c8-5dx8p" Sep 10 16:03:47.343614 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:47.343585 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/79ab48bc-9994-4510-a3fa-6579e7dcf721-bound-sa-token\") pod \"image-registry-565b4cb7c8-5dx8p\" (UID: \"79ab48bc-9994-4510-a3fa-6579e7dcf721\") " pod="openshift-image-registry/image-registry-565b4cb7c8-5dx8p" Sep 10 16:03:47.343667 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:47.343614 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/79ab48bc-9994-4510-a3fa-6579e7dcf721-registry-certificates\") pod \"image-registry-565b4cb7c8-5dx8p\" (UID: \"79ab48bc-9994-4510-a3fa-6579e7dcf721\") " pod="openshift-image-registry/image-registry-565b4cb7c8-5dx8p" Sep 10 16:03:47.344032 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:47.344005 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/79ab48bc-9994-4510-a3fa-6579e7dcf721-ca-trust-extracted\") pod \"image-registry-565b4cb7c8-5dx8p\" (UID: \"79ab48bc-9994-4510-a3fa-6579e7dcf721\") " pod="openshift-image-registry/image-registry-565b4cb7c8-5dx8p" Sep 10 16:03:47.344178 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:47.344155 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/79ab48bc-9994-4510-a3fa-6579e7dcf721-registry-certificates\") pod \"image-registry-565b4cb7c8-5dx8p\" (UID: \"79ab48bc-9994-4510-a3fa-6579e7dcf721\") " pod="openshift-image-registry/image-registry-565b4cb7c8-5dx8p" Sep 10 16:03:47.344240 ip-10-0-135-53 kubenswrapper[2574]: E0910 16:03:47.344214 2574 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 10 16:03:47.344240 ip-10-0-135-53 kubenswrapper[2574]: E0910 16:03:47.344233 2574 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-565b4cb7c8-5dx8p: secret "image-registry-tls" not found Sep 10 16:03:47.344375 ip-10-0-135-53 kubenswrapper[2574]: E0910 16:03:47.344312 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/79ab48bc-9994-4510-a3fa-6579e7dcf721-registry-tls podName:79ab48bc-9994-4510-a3fa-6579e7dcf721 nodeName:}" failed. No retries permitted until 2026-09-10 16:03:47.844294936 +0000 UTC m=+52.409498466 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/79ab48bc-9994-4510-a3fa-6579e7dcf721-registry-tls") pod "image-registry-565b4cb7c8-5dx8p" (UID: "79ab48bc-9994-4510-a3fa-6579e7dcf721") : secret "image-registry-tls" not found Sep 10 16:03:47.344375 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:47.344345 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/79ab48bc-9994-4510-a3fa-6579e7dcf721-trusted-ca\") pod \"image-registry-565b4cb7c8-5dx8p\" (UID: \"79ab48bc-9994-4510-a3fa-6579e7dcf721\") " pod="openshift-image-registry/image-registry-565b4cb7c8-5dx8p" Sep 10 16:03:47.345888 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:47.345864 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/79ab48bc-9994-4510-a3fa-6579e7dcf721-installation-pull-secrets\") pod \"image-registry-565b4cb7c8-5dx8p\" (UID: \"79ab48bc-9994-4510-a3fa-6579e7dcf721\") " pod="openshift-image-registry/image-registry-565b4cb7c8-5dx8p" Sep 10 16:03:47.346493 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:47.346472 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/79ab48bc-9994-4510-a3fa-6579e7dcf721-image-registry-private-configuration\") pod \"image-registry-565b4cb7c8-5dx8p\" (UID: \"79ab48bc-9994-4510-a3fa-6579e7dcf721\") " pod="openshift-image-registry/image-registry-565b4cb7c8-5dx8p" Sep 10 16:03:47.352038 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:47.351932 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jqdh5\" (UniqueName: \"kubernetes.io/projected/79ab48bc-9994-4510-a3fa-6579e7dcf721-kube-api-access-jqdh5\") pod \"image-registry-565b4cb7c8-5dx8p\" (UID: \"79ab48bc-9994-4510-a3fa-6579e7dcf721\") " pod="openshift-image-registry/image-registry-565b4cb7c8-5dx8p" Sep 10 16:03:47.353922 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:47.353887 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/79ab48bc-9994-4510-a3fa-6579e7dcf721-bound-sa-token\") pod \"image-registry-565b4cb7c8-5dx8p\" (UID: \"79ab48bc-9994-4510-a3fa-6579e7dcf721\") " pod="openshift-image-registry/image-registry-565b4cb7c8-5dx8p" Sep 10 16:03:47.544786 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:47.544739 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/e3e9b71b-d2dc-483e-a5fa-5a5054914933-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-9rfn8\" (UID: \"e3e9b71b-d2dc-483e-a5fa-5a5054914933\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-9rfn8" Sep 10 16:03:47.544981 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:47.544822 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6e9a2956-c6be-44d6-b063-e8134e21bc27-service-ca-bundle\") pod \"router-default-64969f7776-5mx24\" (UID: \"6e9a2956-c6be-44d6-b063-e8134e21bc27\") " pod="openshift-ingress/router-default-64969f7776-5mx24" Sep 10 16:03:47.544981 ip-10-0-135-53 kubenswrapper[2574]: E0910 16:03:47.544946 2574 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Sep 10 16:03:47.545102 ip-10-0-135-53 kubenswrapper[2574]: E0910 16:03:47.544953 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6e9a2956-c6be-44d6-b063-e8134e21bc27-service-ca-bundle podName:6e9a2956-c6be-44d6-b063-e8134e21bc27 nodeName:}" failed. No retries permitted until 2026-09-10 16:03:49.544934301 +0000 UTC m=+54.110137828 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/6e9a2956-c6be-44d6-b063-e8134e21bc27-service-ca-bundle") pod "router-default-64969f7776-5mx24" (UID: "6e9a2956-c6be-44d6-b063-e8134e21bc27") : configmap references non-existent config key: service-ca.crt Sep 10 16:03:47.545102 ip-10-0-135-53 kubenswrapper[2574]: E0910 16:03:47.545024 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e3e9b71b-d2dc-483e-a5fa-5a5054914933-cluster-monitoring-operator-tls podName:e3e9b71b-d2dc-483e-a5fa-5a5054914933 nodeName:}" failed. No retries permitted until 2026-09-10 16:03:49.545005862 +0000 UTC m=+54.110209384 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/e3e9b71b-d2dc-483e-a5fa-5a5054914933-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cdcc96965-9rfn8" (UID: "e3e9b71b-d2dc-483e-a5fa-5a5054914933") : secret "cluster-monitoring-operator-tls" not found Sep 10 16:03:47.545214 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:47.545122 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6e9a2956-c6be-44d6-b063-e8134e21bc27-metrics-certs\") pod \"router-default-64969f7776-5mx24\" (UID: \"6e9a2956-c6be-44d6-b063-e8134e21bc27\") " pod="openshift-ingress/router-default-64969f7776-5mx24" Sep 10 16:03:47.545292 ip-10-0-135-53 kubenswrapper[2574]: E0910 16:03:47.545232 2574 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Sep 10 16:03:47.545392 ip-10-0-135-53 kubenswrapper[2574]: E0910 16:03:47.545351 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6e9a2956-c6be-44d6-b063-e8134e21bc27-metrics-certs podName:6e9a2956-c6be-44d6-b063-e8134e21bc27 nodeName:}" failed. No retries permitted until 2026-09-10 16:03:49.545257689 +0000 UTC m=+54.110461227 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6e9a2956-c6be-44d6-b063-e8134e21bc27-metrics-certs") pod "router-default-64969f7776-5mx24" (UID: "6e9a2956-c6be-44d6-b063-e8134e21bc27") : secret "router-metrics-certs-default" not found Sep 10 16:03:47.746919 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:47.746886 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4e31247f-e7e8-4d9b-b3ed-0c18d36131e8-metrics-tls\") pod \"dns-default-vq7kx\" (UID: \"4e31247f-e7e8-4d9b-b3ed-0c18d36131e8\") " pod="openshift-dns/dns-default-vq7kx" Sep 10 16:03:47.747038 ip-10-0-135-53 kubenswrapper[2574]: E0910 16:03:47.747007 2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 10 16:03:47.747106 ip-10-0-135-53 kubenswrapper[2574]: E0910 16:03:47.747072 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4e31247f-e7e8-4d9b-b3ed-0c18d36131e8-metrics-tls podName:4e31247f-e7e8-4d9b-b3ed-0c18d36131e8 nodeName:}" failed. No retries permitted until 2026-09-10 16:04:03.747053984 +0000 UTC m=+68.312257511 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4e31247f-e7e8-4d9b-b3ed-0c18d36131e8-metrics-tls") pod "dns-default-vq7kx" (UID: "4e31247f-e7e8-4d9b-b3ed-0c18d36131e8") : secret "dns-default-metrics-tls" not found Sep 10 16:03:47.847832 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:47.847735 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/79ab48bc-9994-4510-a3fa-6579e7dcf721-registry-tls\") pod \"image-registry-565b4cb7c8-5dx8p\" (UID: \"79ab48bc-9994-4510-a3fa-6579e7dcf721\") " pod="openshift-image-registry/image-registry-565b4cb7c8-5dx8p" Sep 10 16:03:47.848126 ip-10-0-135-53 kubenswrapper[2574]: E0910 16:03:47.847996 2574 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 10 16:03:47.848126 ip-10-0-135-53 kubenswrapper[2574]: E0910 16:03:47.848012 2574 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-565b4cb7c8-5dx8p: secret "image-registry-tls" not found Sep 10 16:03:47.848126 ip-10-0-135-53 kubenswrapper[2574]: E0910 16:03:47.848059 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/79ab48bc-9994-4510-a3fa-6579e7dcf721-registry-tls podName:79ab48bc-9994-4510-a3fa-6579e7dcf721 nodeName:}" failed. No retries permitted until 2026-09-10 16:03:48.848046527 +0000 UTC m=+53.413250048 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/79ab48bc-9994-4510-a3fa-6579e7dcf721-registry-tls") pod "image-registry-565b4cb7c8-5dx8p" (UID: "79ab48bc-9994-4510-a3fa-6579e7dcf721") : secret "image-registry-tls" not found Sep 10 16:03:48.303030 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:48.302987 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-7x4lr" event={"ID":"72fae279-5890-4638-9eed-a984b82cf0b5","Type":"ContainerStarted","Data":"db749d09f5557d56701cbcf23ebfc65b5a685967fe2aede9b62c633ca470a9b6"} Sep 10 16:03:48.320386 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:48.320332 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-7x4lr" podStartSLOduration=1.964014623 podStartE2EDuration="3.320311256s" totalImagesPullingTime="1.356296633s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 16:03:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 16:03:48.319796924 +0000 UTC m=+52.885000470" watchObservedRunningTime="2026-09-10 16:03:48.320311256 +0000 UTC m=+52.885514815" Sep 10 16:03:48.858029 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:48.857986 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/79ab48bc-9994-4510-a3fa-6579e7dcf721-registry-tls\") pod \"image-registry-565b4cb7c8-5dx8p\" (UID: \"79ab48bc-9994-4510-a3fa-6579e7dcf721\") " pod="openshift-image-registry/image-registry-565b4cb7c8-5dx8p" Sep 10 16:03:48.858224 ip-10-0-135-53 kubenswrapper[2574]: E0910 16:03:48.858199 2574 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 10 16:03:48.858282 ip-10-0-135-53 kubenswrapper[2574]: E0910 16:03:48.858230 2574 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-565b4cb7c8-5dx8p: secret "image-registry-tls" not found Sep 10 16:03:48.858388 ip-10-0-135-53 kubenswrapper[2574]: E0910 16:03:48.858374 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/79ab48bc-9994-4510-a3fa-6579e7dcf721-registry-tls podName:79ab48bc-9994-4510-a3fa-6579e7dcf721 nodeName:}" failed. No retries permitted until 2026-09-10 16:03:50.858350464 +0000 UTC m=+55.423554006 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/79ab48bc-9994-4510-a3fa-6579e7dcf721-registry-tls") pod "image-registry-565b4cb7c8-5dx8p" (UID: "79ab48bc-9994-4510-a3fa-6579e7dcf721") : secret "image-registry-tls" not found Sep 10 16:03:49.363120 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:49.363079 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/b005b666-7f33-4203-ac69-4d1fe658441c-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-68nz2\" (UID: \"b005b666-7f33-4203-ac69-4d1fe658441c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-68nz2" Sep 10 16:03:49.363697 ip-10-0-135-53 kubenswrapper[2574]: E0910 16:03:49.363211 2574 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Sep 10 16:03:49.363697 ip-10-0-135-53 kubenswrapper[2574]: E0910 16:03:49.363293 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b005b666-7f33-4203-ac69-4d1fe658441c-samples-operator-tls podName:b005b666-7f33-4203-ac69-4d1fe658441c nodeName:}" failed. No retries permitted until 2026-09-10 16:03:53.363259034 +0000 UTC m=+57.928462575 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/b005b666-7f33-4203-ac69-4d1fe658441c-samples-operator-tls") pod "cluster-samples-operator-7cdcfcf76c-68nz2" (UID: "b005b666-7f33-4203-ac69-4d1fe658441c") : secret "samples-operator-tls" not found Sep 10 16:03:49.564240 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:49.564186 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6e9a2956-c6be-44d6-b063-e8134e21bc27-service-ca-bundle\") pod \"router-default-64969f7776-5mx24\" (UID: \"6e9a2956-c6be-44d6-b063-e8134e21bc27\") " pod="openshift-ingress/router-default-64969f7776-5mx24" Sep 10 16:03:49.564457 ip-10-0-135-53 kubenswrapper[2574]: E0910 16:03:49.564404 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6e9a2956-c6be-44d6-b063-e8134e21bc27-service-ca-bundle podName:6e9a2956-c6be-44d6-b063-e8134e21bc27 nodeName:}" failed. No retries permitted until 2026-09-10 16:03:53.564381635 +0000 UTC m=+58.129585181 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/6e9a2956-c6be-44d6-b063-e8134e21bc27-service-ca-bundle") pod "router-default-64969f7776-5mx24" (UID: "6e9a2956-c6be-44d6-b063-e8134e21bc27") : configmap references non-existent config key: service-ca.crt Sep 10 16:03:49.564540 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:49.564461 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6e9a2956-c6be-44d6-b063-e8134e21bc27-metrics-certs\") pod \"router-default-64969f7776-5mx24\" (UID: \"6e9a2956-c6be-44d6-b063-e8134e21bc27\") " pod="openshift-ingress/router-default-64969f7776-5mx24" Sep 10 16:03:49.564593 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:49.564563 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/e3e9b71b-d2dc-483e-a5fa-5a5054914933-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-9rfn8\" (UID: \"e3e9b71b-d2dc-483e-a5fa-5a5054914933\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-9rfn8" Sep 10 16:03:49.564661 ip-10-0-135-53 kubenswrapper[2574]: E0910 16:03:49.564639 2574 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Sep 10 16:03:49.564710 ip-10-0-135-53 kubenswrapper[2574]: E0910 16:03:49.564693 2574 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Sep 10 16:03:49.564748 ip-10-0-135-53 kubenswrapper[2574]: E0910 16:03:49.564705 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6e9a2956-c6be-44d6-b063-e8134e21bc27-metrics-certs podName:6e9a2956-c6be-44d6-b063-e8134e21bc27 nodeName:}" failed. No retries permitted until 2026-09-10 16:03:53.564689151 +0000 UTC m=+58.129892698 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6e9a2956-c6be-44d6-b063-e8134e21bc27-metrics-certs") pod "router-default-64969f7776-5mx24" (UID: "6e9a2956-c6be-44d6-b063-e8134e21bc27") : secret "router-metrics-certs-default" not found Sep 10 16:03:49.564804 ip-10-0-135-53 kubenswrapper[2574]: E0910 16:03:49.564753 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e3e9b71b-d2dc-483e-a5fa-5a5054914933-cluster-monitoring-operator-tls podName:e3e9b71b-d2dc-483e-a5fa-5a5054914933 nodeName:}" failed. No retries permitted until 2026-09-10 16:03:53.564741118 +0000 UTC m=+58.129944643 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/e3e9b71b-d2dc-483e-a5fa-5a5054914933-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cdcc96965-9rfn8" (UID: "e3e9b71b-d2dc-483e-a5fa-5a5054914933") : secret "cluster-monitoring-operator-tls" not found Sep 10 16:03:50.309794 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:50.309757 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-685456655f-5xms5" event={"ID":"63650af5-b34c-4d6b-8e44-faeb135d57bc","Type":"ContainerStarted","Data":"f6acef44a17ac98088e1513a4714b02a3104527f2be76b59abff879ea492a1e2"} Sep 10 16:03:50.311347 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:50.311328 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-frshx_9baedfdd-1384-4da1-b9c0-58dea49d3ae0/console-operator/0.log" Sep 10 16:03:50.311451 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:50.311364 2574 generic.go:356] "Generic (PLEG): container finished" podID="9baedfdd-1384-4da1-b9c0-58dea49d3ae0" containerID="574c0ebdb4c4488a5646f84edcc0827a6a1a468fcd824c4c5b678eb289044548" exitCode=255 Sep 10 16:03:50.311451 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:50.311396 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-85b454874b-frshx" event={"ID":"9baedfdd-1384-4da1-b9c0-58dea49d3ae0","Type":"ContainerDied","Data":"574c0ebdb4c4488a5646f84edcc0827a6a1a468fcd824c4c5b678eb289044548"} Sep 10 16:03:50.311594 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:50.311581 2574 scope.go:117] "RemoveContainer" containerID="574c0ebdb4c4488a5646f84edcc0827a6a1a468fcd824c4c5b678eb289044548" Sep 10 16:03:50.326386 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:50.326347 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-685456655f-5xms5" podStartSLOduration=1.693544116 podStartE2EDuration="5.326331254s" totalImagesPullingTime="3.632787138s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 16:03:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 16:03:50.325569108 +0000 UTC m=+54.890772673" watchObservedRunningTime="2026-09-10 16:03:50.326331254 +0000 UTC m=+54.891534799" Sep 10 16:03:50.875569 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:50.875523 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/79ab48bc-9994-4510-a3fa-6579e7dcf721-registry-tls\") pod \"image-registry-565b4cb7c8-5dx8p\" (UID: \"79ab48bc-9994-4510-a3fa-6579e7dcf721\") " pod="openshift-image-registry/image-registry-565b4cb7c8-5dx8p" Sep 10 16:03:50.875947 ip-10-0-135-53 kubenswrapper[2574]: E0910 16:03:50.875680 2574 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 10 16:03:50.875947 ip-10-0-135-53 kubenswrapper[2574]: E0910 16:03:50.875701 2574 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-565b4cb7c8-5dx8p: secret "image-registry-tls" not found Sep 10 16:03:50.875947 ip-10-0-135-53 kubenswrapper[2574]: E0910 16:03:50.875767 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/79ab48bc-9994-4510-a3fa-6579e7dcf721-registry-tls podName:79ab48bc-9994-4510-a3fa-6579e7dcf721 nodeName:}" failed. No retries permitted until 2026-09-10 16:03:54.875751663 +0000 UTC m=+59.440955185 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/79ab48bc-9994-4510-a3fa-6579e7dcf721-registry-tls") pod "image-registry-565b4cb7c8-5dx8p" (UID: "79ab48bc-9994-4510-a3fa-6579e7dcf721") : secret "image-registry-tls" not found Sep 10 16:03:51.315872 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:51.315838 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-frshx_9baedfdd-1384-4da1-b9c0-58dea49d3ae0/console-operator/1.log" Sep 10 16:03:51.316244 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:51.316228 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-frshx_9baedfdd-1384-4da1-b9c0-58dea49d3ae0/console-operator/0.log" Sep 10 16:03:51.316314 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:51.316283 2574 generic.go:356] "Generic (PLEG): container finished" podID="9baedfdd-1384-4da1-b9c0-58dea49d3ae0" containerID="9a4bdcb4eab3d0ba70e7a3ed324c183e2c5bef36c0bb57389905d099f71e56b7" exitCode=255 Sep 10 16:03:51.316402 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:51.316380 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-85b454874b-frshx" event={"ID":"9baedfdd-1384-4da1-b9c0-58dea49d3ae0","Type":"ContainerDied","Data":"9a4bdcb4eab3d0ba70e7a3ed324c183e2c5bef36c0bb57389905d099f71e56b7"} Sep 10 16:03:51.316462 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:51.316450 2574 scope.go:117] "RemoveContainer" containerID="574c0ebdb4c4488a5646f84edcc0827a6a1a468fcd824c4c5b678eb289044548" Sep 10 16:03:51.316734 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:51.316686 2574 scope.go:117] "RemoveContainer" containerID="9a4bdcb4eab3d0ba70e7a3ed324c183e2c5bef36c0bb57389905d099f71e56b7" Sep 10 16:03:51.316899 ip-10-0-135-53 kubenswrapper[2574]: E0910 16:03:51.316882 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-85b454874b-frshx_openshift-console-operator(9baedfdd-1384-4da1-b9c0-58dea49d3ae0)\"" pod="openshift-console-operator/console-operator-85b454874b-frshx" podUID="9baedfdd-1384-4da1-b9c0-58dea49d3ae0" Sep 10 16:03:51.432838 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:51.432805 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-z5t9x"] Sep 10 16:03:51.437120 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:51.437097 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-z5t9x" Sep 10 16:03:51.443815 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:51.443796 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Sep 10 16:03:51.443996 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:51.443977 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-ng9sv\"" Sep 10 16:03:51.444062 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:51.444039 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Sep 10 16:03:51.444062 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:51.444041 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Sep 10 16:03:51.444142 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:51.444044 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Sep 10 16:03:51.456213 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:51.456187 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-z5t9x"] Sep 10 16:03:51.480164 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:51.480135 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7d8d33a6-8125-4b39-b396-5ac74e34703e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-z5t9x\" (UID: \"7d8d33a6-8125-4b39-b396-5ac74e34703e\") " pod="openshift-insights/insights-runtime-extractor-z5t9x" Sep 10 16:03:51.480322 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:51.480180 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/7d8d33a6-8125-4b39-b396-5ac74e34703e-crio-socket\") pod \"insights-runtime-extractor-z5t9x\" (UID: \"7d8d33a6-8125-4b39-b396-5ac74e34703e\") " pod="openshift-insights/insights-runtime-extractor-z5t9x" Sep 10 16:03:51.480322 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:51.480209 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/7d8d33a6-8125-4b39-b396-5ac74e34703e-data-volume\") pod \"insights-runtime-extractor-z5t9x\" (UID: \"7d8d33a6-8125-4b39-b396-5ac74e34703e\") " pod="openshift-insights/insights-runtime-extractor-z5t9x" Sep 10 16:03:51.480397 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:51.480351 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7d8d33a6-8125-4b39-b396-5ac74e34703e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-z5t9x\" (UID: \"7d8d33a6-8125-4b39-b396-5ac74e34703e\") " pod="openshift-insights/insights-runtime-extractor-z5t9x" Sep 10 16:03:51.480428 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:51.480394 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g7vps\" (UniqueName: \"kubernetes.io/projected/7d8d33a6-8125-4b39-b396-5ac74e34703e-kube-api-access-g7vps\") pod \"insights-runtime-extractor-z5t9x\" (UID: \"7d8d33a6-8125-4b39-b396-5ac74e34703e\") " pod="openshift-insights/insights-runtime-extractor-z5t9x" Sep 10 16:03:51.581257 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:51.581168 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/7d8d33a6-8125-4b39-b396-5ac74e34703e-crio-socket\") pod \"insights-runtime-extractor-z5t9x\" (UID: \"7d8d33a6-8125-4b39-b396-5ac74e34703e\") " pod="openshift-insights/insights-runtime-extractor-z5t9x" Sep 10 16:03:51.581257 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:51.581217 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/7d8d33a6-8125-4b39-b396-5ac74e34703e-data-volume\") pod \"insights-runtime-extractor-z5t9x\" (UID: \"7d8d33a6-8125-4b39-b396-5ac74e34703e\") " pod="openshift-insights/insights-runtime-extractor-z5t9x" Sep 10 16:03:51.581459 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:51.581329 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7d8d33a6-8125-4b39-b396-5ac74e34703e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-z5t9x\" (UID: \"7d8d33a6-8125-4b39-b396-5ac74e34703e\") " pod="openshift-insights/insights-runtime-extractor-z5t9x" Sep 10 16:03:51.581459 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:51.581335 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/7d8d33a6-8125-4b39-b396-5ac74e34703e-crio-socket\") pod \"insights-runtime-extractor-z5t9x\" (UID: \"7d8d33a6-8125-4b39-b396-5ac74e34703e\") " pod="openshift-insights/insights-runtime-extractor-z5t9x" Sep 10 16:03:51.581459 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:51.581363 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g7vps\" (UniqueName: \"kubernetes.io/projected/7d8d33a6-8125-4b39-b396-5ac74e34703e-kube-api-access-g7vps\") pod \"insights-runtime-extractor-z5t9x\" (UID: \"7d8d33a6-8125-4b39-b396-5ac74e34703e\") " pod="openshift-insights/insights-runtime-extractor-z5t9x" Sep 10 16:03:51.581459 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:51.581425 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7d8d33a6-8125-4b39-b396-5ac74e34703e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-z5t9x\" (UID: \"7d8d33a6-8125-4b39-b396-5ac74e34703e\") " pod="openshift-insights/insights-runtime-extractor-z5t9x" Sep 10 16:03:51.581642 ip-10-0-135-53 kubenswrapper[2574]: E0910 16:03:51.581471 2574 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 10 16:03:51.581642 ip-10-0-135-53 kubenswrapper[2574]: E0910 16:03:51.581554 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7d8d33a6-8125-4b39-b396-5ac74e34703e-kube-rbac-proxy-cm podName:7d8d33a6-8125-4b39-b396-5ac74e34703e nodeName:}" failed. No retries permitted until 2026-09-10 16:03:52.081526928 +0000 UTC m=+56.646730470 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/7d8d33a6-8125-4b39-b396-5ac74e34703e-kube-rbac-proxy-cm") pod "insights-runtime-extractor-z5t9x" (UID: "7d8d33a6-8125-4b39-b396-5ac74e34703e") : configmap "kube-rbac-proxy" not found Sep 10 16:03:51.581642 ip-10-0-135-53 kubenswrapper[2574]: E0910 16:03:51.581555 2574 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 10 16:03:51.581642 ip-10-0-135-53 kubenswrapper[2574]: E0910 16:03:51.581607 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7d8d33a6-8125-4b39-b396-5ac74e34703e-insights-runtime-extractor-tls podName:7d8d33a6-8125-4b39-b396-5ac74e34703e nodeName:}" failed. No retries permitted until 2026-09-10 16:03:52.081591602 +0000 UTC m=+56.646795125 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/7d8d33a6-8125-4b39-b396-5ac74e34703e-insights-runtime-extractor-tls") pod "insights-runtime-extractor-z5t9x" (UID: "7d8d33a6-8125-4b39-b396-5ac74e34703e") : secret "insights-runtime-extractor-tls" not found Sep 10 16:03:51.581642 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:51.581636 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/7d8d33a6-8125-4b39-b396-5ac74e34703e-data-volume\") pod \"insights-runtime-extractor-z5t9x\" (UID: \"7d8d33a6-8125-4b39-b396-5ac74e34703e\") " pod="openshift-insights/insights-runtime-extractor-z5t9x" Sep 10 16:03:51.591203 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:51.591171 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g7vps\" (UniqueName: \"kubernetes.io/projected/7d8d33a6-8125-4b39-b396-5ac74e34703e-kube-api-access-g7vps\") pod \"insights-runtime-extractor-z5t9x\" (UID: \"7d8d33a6-8125-4b39-b396-5ac74e34703e\") " pod="openshift-insights/insights-runtime-extractor-z5t9x" Sep 10 16:03:52.083822 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:52.083785 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7d8d33a6-8125-4b39-b396-5ac74e34703e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-z5t9x\" (UID: \"7d8d33a6-8125-4b39-b396-5ac74e34703e\") " pod="openshift-insights/insights-runtime-extractor-z5t9x" Sep 10 16:03:52.084208 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:52.083856 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7d8d33a6-8125-4b39-b396-5ac74e34703e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-z5t9x\" (UID: \"7d8d33a6-8125-4b39-b396-5ac74e34703e\") " pod="openshift-insights/insights-runtime-extractor-z5t9x" Sep 10 16:03:52.084208 ip-10-0-135-53 kubenswrapper[2574]: E0910 16:03:52.083898 2574 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 10 16:03:52.084208 ip-10-0-135-53 kubenswrapper[2574]: E0910 16:03:52.083959 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7d8d33a6-8125-4b39-b396-5ac74e34703e-kube-rbac-proxy-cm podName:7d8d33a6-8125-4b39-b396-5ac74e34703e nodeName:}" failed. No retries permitted until 2026-09-10 16:03:53.08394345 +0000 UTC m=+57.649146972 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/7d8d33a6-8125-4b39-b396-5ac74e34703e-kube-rbac-proxy-cm") pod "insights-runtime-extractor-z5t9x" (UID: "7d8d33a6-8125-4b39-b396-5ac74e34703e") : configmap "kube-rbac-proxy" not found Sep 10 16:03:52.084208 ip-10-0-135-53 kubenswrapper[2574]: E0910 16:03:52.084004 2574 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 10 16:03:52.084208 ip-10-0-135-53 kubenswrapper[2574]: E0910 16:03:52.084073 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7d8d33a6-8125-4b39-b396-5ac74e34703e-insights-runtime-extractor-tls podName:7d8d33a6-8125-4b39-b396-5ac74e34703e nodeName:}" failed. No retries permitted until 2026-09-10 16:03:53.084057955 +0000 UTC m=+57.649261499 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/7d8d33a6-8125-4b39-b396-5ac74e34703e-insights-runtime-extractor-tls") pod "insights-runtime-extractor-z5t9x" (UID: "7d8d33a6-8125-4b39-b396-5ac74e34703e") : secret "insights-runtime-extractor-tls" not found Sep 10 16:03:52.320722 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:52.320694 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-frshx_9baedfdd-1384-4da1-b9c0-58dea49d3ae0/console-operator/1.log" Sep 10 16:03:52.321013 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:52.320997 2574 scope.go:117] "RemoveContainer" containerID="9a4bdcb4eab3d0ba70e7a3ed324c183e2c5bef36c0bb57389905d099f71e56b7" Sep 10 16:03:52.321160 ip-10-0-135-53 kubenswrapper[2574]: E0910 16:03:52.321143 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-85b454874b-frshx_openshift-console-operator(9baedfdd-1384-4da1-b9c0-58dea49d3ae0)\"" pod="openshift-console-operator/console-operator-85b454874b-frshx" podUID="9baedfdd-1384-4da1-b9c0-58dea49d3ae0" Sep 10 16:03:53.091551 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:53.091513 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7d8d33a6-8125-4b39-b396-5ac74e34703e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-z5t9x\" (UID: \"7d8d33a6-8125-4b39-b396-5ac74e34703e\") " pod="openshift-insights/insights-runtime-extractor-z5t9x" Sep 10 16:03:53.092030 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:53.091629 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7d8d33a6-8125-4b39-b396-5ac74e34703e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-z5t9x\" (UID: \"7d8d33a6-8125-4b39-b396-5ac74e34703e\") " pod="openshift-insights/insights-runtime-extractor-z5t9x" Sep 10 16:03:53.092030 ip-10-0-135-53 kubenswrapper[2574]: E0910 16:03:53.091699 2574 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 10 16:03:53.092030 ip-10-0-135-53 kubenswrapper[2574]: E0910 16:03:53.091711 2574 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 10 16:03:53.092030 ip-10-0-135-53 kubenswrapper[2574]: E0910 16:03:53.091788 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7d8d33a6-8125-4b39-b396-5ac74e34703e-insights-runtime-extractor-tls podName:7d8d33a6-8125-4b39-b396-5ac74e34703e nodeName:}" failed. No retries permitted until 2026-09-10 16:03:55.091764777 +0000 UTC m=+59.656968316 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/7d8d33a6-8125-4b39-b396-5ac74e34703e-insights-runtime-extractor-tls") pod "insights-runtime-extractor-z5t9x" (UID: "7d8d33a6-8125-4b39-b396-5ac74e34703e") : secret "insights-runtime-extractor-tls" not found Sep 10 16:03:53.092030 ip-10-0-135-53 kubenswrapper[2574]: E0910 16:03:53.091820 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7d8d33a6-8125-4b39-b396-5ac74e34703e-kube-rbac-proxy-cm podName:7d8d33a6-8125-4b39-b396-5ac74e34703e nodeName:}" failed. No retries permitted until 2026-09-10 16:03:55.091807893 +0000 UTC m=+59.657011415 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/7d8d33a6-8125-4b39-b396-5ac74e34703e-kube-rbac-proxy-cm") pod "insights-runtime-extractor-z5t9x" (UID: "7d8d33a6-8125-4b39-b396-5ac74e34703e") : configmap "kube-rbac-proxy" not found Sep 10 16:03:53.393715 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:53.393625 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/b005b666-7f33-4203-ac69-4d1fe658441c-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-68nz2\" (UID: \"b005b666-7f33-4203-ac69-4d1fe658441c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-68nz2" Sep 10 16:03:53.393864 ip-10-0-135-53 kubenswrapper[2574]: E0910 16:03:53.393759 2574 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Sep 10 16:03:53.393864 ip-10-0-135-53 kubenswrapper[2574]: E0910 16:03:53.393825 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b005b666-7f33-4203-ac69-4d1fe658441c-samples-operator-tls podName:b005b666-7f33-4203-ac69-4d1fe658441c nodeName:}" failed. No retries permitted until 2026-09-10 16:04:01.393811295 +0000 UTC m=+65.959014835 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/b005b666-7f33-4203-ac69-4d1fe658441c-samples-operator-tls") pod "cluster-samples-operator-7cdcfcf76c-68nz2" (UID: "b005b666-7f33-4203-ac69-4d1fe658441c") : secret "samples-operator-tls" not found Sep 10 16:03:53.596192 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:53.596144 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6e9a2956-c6be-44d6-b063-e8134e21bc27-service-ca-bundle\") pod \"router-default-64969f7776-5mx24\" (UID: \"6e9a2956-c6be-44d6-b063-e8134e21bc27\") " pod="openshift-ingress/router-default-64969f7776-5mx24" Sep 10 16:03:53.596381 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:53.596241 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6e9a2956-c6be-44d6-b063-e8134e21bc27-metrics-certs\") pod \"router-default-64969f7776-5mx24\" (UID: \"6e9a2956-c6be-44d6-b063-e8134e21bc27\") " pod="openshift-ingress/router-default-64969f7776-5mx24" Sep 10 16:03:53.596381 ip-10-0-135-53 kubenswrapper[2574]: E0910 16:03:53.596323 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6e9a2956-c6be-44d6-b063-e8134e21bc27-service-ca-bundle podName:6e9a2956-c6be-44d6-b063-e8134e21bc27 nodeName:}" failed. No retries permitted until 2026-09-10 16:04:01.59630243 +0000 UTC m=+66.161505966 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/6e9a2956-c6be-44d6-b063-e8134e21bc27-service-ca-bundle") pod "router-default-64969f7776-5mx24" (UID: "6e9a2956-c6be-44d6-b063-e8134e21bc27") : configmap references non-existent config key: service-ca.crt Sep 10 16:03:53.596381 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:53.596354 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/e3e9b71b-d2dc-483e-a5fa-5a5054914933-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-9rfn8\" (UID: \"e3e9b71b-d2dc-483e-a5fa-5a5054914933\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-9rfn8" Sep 10 16:03:53.596490 ip-10-0-135-53 kubenswrapper[2574]: E0910 16:03:53.596378 2574 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Sep 10 16:03:53.596490 ip-10-0-135-53 kubenswrapper[2574]: E0910 16:03:53.596422 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6e9a2956-c6be-44d6-b063-e8134e21bc27-metrics-certs podName:6e9a2956-c6be-44d6-b063-e8134e21bc27 nodeName:}" failed. No retries permitted until 2026-09-10 16:04:01.596411596 +0000 UTC m=+66.161615144 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6e9a2956-c6be-44d6-b063-e8134e21bc27-metrics-certs") pod "router-default-64969f7776-5mx24" (UID: "6e9a2956-c6be-44d6-b063-e8134e21bc27") : secret "router-metrics-certs-default" not found Sep 10 16:03:53.596490 ip-10-0-135-53 kubenswrapper[2574]: E0910 16:03:53.596463 2574 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Sep 10 16:03:53.596578 ip-10-0-135-53 kubenswrapper[2574]: E0910 16:03:53.596499 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e3e9b71b-d2dc-483e-a5fa-5a5054914933-cluster-monitoring-operator-tls podName:e3e9b71b-d2dc-483e-a5fa-5a5054914933 nodeName:}" failed. No retries permitted until 2026-09-10 16:04:01.596487306 +0000 UTC m=+66.161690843 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/e3e9b71b-d2dc-483e-a5fa-5a5054914933-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cdcc96965-9rfn8" (UID: "e3e9b71b-d2dc-483e-a5fa-5a5054914933") : secret "cluster-monitoring-operator-tls" not found Sep 10 16:03:53.990610 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:53.990533 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-zb9sj_9d57d542-a9e9-4565-940e-7fc04c2a0498/dns-node-resolver/0.log" Sep 10 16:03:54.907303 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:54.907245 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/79ab48bc-9994-4510-a3fa-6579e7dcf721-registry-tls\") pod \"image-registry-565b4cb7c8-5dx8p\" (UID: \"79ab48bc-9994-4510-a3fa-6579e7dcf721\") " pod="openshift-image-registry/image-registry-565b4cb7c8-5dx8p" Sep 10 16:03:54.907650 ip-10-0-135-53 kubenswrapper[2574]: E0910 16:03:54.907400 2574 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 10 16:03:54.907650 ip-10-0-135-53 kubenswrapper[2574]: E0910 16:03:54.907419 2574 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-565b4cb7c8-5dx8p: secret "image-registry-tls" not found Sep 10 16:03:54.907650 ip-10-0-135-53 kubenswrapper[2574]: E0910 16:03:54.907473 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/79ab48bc-9994-4510-a3fa-6579e7dcf721-registry-tls podName:79ab48bc-9994-4510-a3fa-6579e7dcf721 nodeName:}" failed. No retries permitted until 2026-09-10 16:04:02.907458548 +0000 UTC m=+67.472662070 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/79ab48bc-9994-4510-a3fa-6579e7dcf721-registry-tls") pod "image-registry-565b4cb7c8-5dx8p" (UID: "79ab48bc-9994-4510-a3fa-6579e7dcf721") : secret "image-registry-tls" not found Sep 10 16:03:54.990060 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:54.990034 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-ml9qs_b91acfa6-5fd3-4aba-a679-aa72dc8d2fe2/node-ca/0.log" Sep 10 16:03:55.109570 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:55.109518 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7d8d33a6-8125-4b39-b396-5ac74e34703e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-z5t9x\" (UID: \"7d8d33a6-8125-4b39-b396-5ac74e34703e\") " pod="openshift-insights/insights-runtime-extractor-z5t9x" Sep 10 16:03:55.109737 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:55.109650 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7d8d33a6-8125-4b39-b396-5ac74e34703e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-z5t9x\" (UID: \"7d8d33a6-8125-4b39-b396-5ac74e34703e\") " pod="openshift-insights/insights-runtime-extractor-z5t9x" Sep 10 16:03:55.109737 ip-10-0-135-53 kubenswrapper[2574]: E0910 16:03:55.109670 2574 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 10 16:03:55.109737 ip-10-0-135-53 kubenswrapper[2574]: E0910 16:03:55.109729 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7d8d33a6-8125-4b39-b396-5ac74e34703e-insights-runtime-extractor-tls podName:7d8d33a6-8125-4b39-b396-5ac74e34703e nodeName:}" failed. No retries permitted until 2026-09-10 16:03:59.109714785 +0000 UTC m=+63.674918312 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/7d8d33a6-8125-4b39-b396-5ac74e34703e-insights-runtime-extractor-tls") pod "insights-runtime-extractor-z5t9x" (UID: "7d8d33a6-8125-4b39-b396-5ac74e34703e") : secret "insights-runtime-extractor-tls" not found Sep 10 16:03:55.109737 ip-10-0-135-53 kubenswrapper[2574]: E0910 16:03:55.109733 2574 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 10 16:03:55.109870 ip-10-0-135-53 kubenswrapper[2574]: E0910 16:03:55.109772 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7d8d33a6-8125-4b39-b396-5ac74e34703e-kube-rbac-proxy-cm podName:7d8d33a6-8125-4b39-b396-5ac74e34703e nodeName:}" failed. No retries permitted until 2026-09-10 16:03:59.10976156 +0000 UTC m=+63.674965095 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/7d8d33a6-8125-4b39-b396-5ac74e34703e-kube-rbac-proxy-cm") pod "insights-runtime-extractor-z5t9x" (UID: "7d8d33a6-8125-4b39-b396-5ac74e34703e") : configmap "kube-rbac-proxy" not found Sep 10 16:03:55.389719 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:55.389689 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-2w5j8_5c9960fa-cf35-42ce-ba26-e4dd86985aa0/serve-healthcheck-canary/0.log" Sep 10 16:03:56.020222 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:56.020167 2574 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-85b454874b-frshx" Sep 10 16:03:56.020705 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:56.020295 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-85b454874b-frshx" Sep 10 16:03:56.020767 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:56.020719 2574 scope.go:117] "RemoveContainer" containerID="9a4bdcb4eab3d0ba70e7a3ed324c183e2c5bef36c0bb57389905d099f71e56b7" Sep 10 16:03:56.020914 ip-10-0-135-53 kubenswrapper[2574]: E0910 16:03:56.020888 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-85b454874b-frshx_openshift-console-operator(9baedfdd-1384-4da1-b9c0-58dea49d3ae0)\"" pod="openshift-console-operator/console-operator-85b454874b-frshx" podUID="9baedfdd-1384-4da1-b9c0-58dea49d3ae0" Sep 10 16:03:57.246041 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:57.246011 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-tmshf" Sep 10 16:03:59.147574 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:59.147536 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7d8d33a6-8125-4b39-b396-5ac74e34703e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-z5t9x\" (UID: \"7d8d33a6-8125-4b39-b396-5ac74e34703e\") " pod="openshift-insights/insights-runtime-extractor-z5t9x" Sep 10 16:03:59.147955 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:03:59.147603 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7d8d33a6-8125-4b39-b396-5ac74e34703e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-z5t9x\" (UID: \"7d8d33a6-8125-4b39-b396-5ac74e34703e\") " pod="openshift-insights/insights-runtime-extractor-z5t9x" Sep 10 16:03:59.147955 ip-10-0-135-53 kubenswrapper[2574]: E0910 16:03:59.147665 2574 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 10 16:03:59.147955 ip-10-0-135-53 kubenswrapper[2574]: E0910 16:03:59.147700 2574 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 10 16:03:59.147955 ip-10-0-135-53 kubenswrapper[2574]: E0910 16:03:59.147739 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7d8d33a6-8125-4b39-b396-5ac74e34703e-kube-rbac-proxy-cm podName:7d8d33a6-8125-4b39-b396-5ac74e34703e nodeName:}" failed. No retries permitted until 2026-09-10 16:04:07.147724387 +0000 UTC m=+71.712927909 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/7d8d33a6-8125-4b39-b396-5ac74e34703e-kube-rbac-proxy-cm") pod "insights-runtime-extractor-z5t9x" (UID: "7d8d33a6-8125-4b39-b396-5ac74e34703e") : configmap "kube-rbac-proxy" not found Sep 10 16:03:59.147955 ip-10-0-135-53 kubenswrapper[2574]: E0910 16:03:59.147753 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7d8d33a6-8125-4b39-b396-5ac74e34703e-insights-runtime-extractor-tls podName:7d8d33a6-8125-4b39-b396-5ac74e34703e nodeName:}" failed. No retries permitted until 2026-09-10 16:04:07.147747196 +0000 UTC m=+71.712950718 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/7d8d33a6-8125-4b39-b396-5ac74e34703e-insights-runtime-extractor-tls") pod "insights-runtime-extractor-z5t9x" (UID: "7d8d33a6-8125-4b39-b396-5ac74e34703e") : secret "insights-runtime-extractor-tls" not found Sep 10 16:04:01.466352 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:04:01.466311 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/b005b666-7f33-4203-ac69-4d1fe658441c-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-68nz2\" (UID: \"b005b666-7f33-4203-ac69-4d1fe658441c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-68nz2" Sep 10 16:04:01.468726 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:04:01.468699 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/b005b666-7f33-4203-ac69-4d1fe658441c-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-68nz2\" (UID: \"b005b666-7f33-4203-ac69-4d1fe658441c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-68nz2" Sep 10 16:04:01.514115 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:04:01.514081 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-qssxz\"" Sep 10 16:04:01.522201 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:04:01.522179 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-68nz2" Sep 10 16:04:01.668334 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:04:01.668290 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6e9a2956-c6be-44d6-b063-e8134e21bc27-service-ca-bundle\") pod \"router-default-64969f7776-5mx24\" (UID: \"6e9a2956-c6be-44d6-b063-e8134e21bc27\") " pod="openshift-ingress/router-default-64969f7776-5mx24" Sep 10 16:04:01.668334 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:04:01.668337 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/aa29ebca-e469-4e43-abda-06f75d9c0a11-original-pull-secret\") pod \"global-pull-secret-syncer-pcsbz\" (UID: \"aa29ebca-e469-4e43-abda-06f75d9c0a11\") " pod="kube-system/global-pull-secret-syncer-pcsbz" Sep 10 16:04:01.668585 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:04:01.668416 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6e9a2956-c6be-44d6-b063-e8134e21bc27-metrics-certs\") pod \"router-default-64969f7776-5mx24\" (UID: \"6e9a2956-c6be-44d6-b063-e8134e21bc27\") " pod="openshift-ingress/router-default-64969f7776-5mx24" Sep 10 16:04:01.668585 ip-10-0-135-53 kubenswrapper[2574]: E0910 16:04:01.668443 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6e9a2956-c6be-44d6-b063-e8134e21bc27-service-ca-bundle podName:6e9a2956-c6be-44d6-b063-e8134e21bc27 nodeName:}" failed. No retries permitted until 2026-09-10 16:04:17.668426874 +0000 UTC m=+82.233630396 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/6e9a2956-c6be-44d6-b063-e8134e21bc27-service-ca-bundle") pod "router-default-64969f7776-5mx24" (UID: "6e9a2956-c6be-44d6-b063-e8134e21bc27") : configmap references non-existent config key: service-ca.crt Sep 10 16:04:01.668585 ip-10-0-135-53 kubenswrapper[2574]: E0910 16:04:01.668502 2574 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Sep 10 16:04:01.668585 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:04:01.668538 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/e3e9b71b-d2dc-483e-a5fa-5a5054914933-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-9rfn8\" (UID: \"e3e9b71b-d2dc-483e-a5fa-5a5054914933\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-9rfn8" Sep 10 16:04:01.668585 ip-10-0-135-53 kubenswrapper[2574]: E0910 16:04:01.668551 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6e9a2956-c6be-44d6-b063-e8134e21bc27-metrics-certs podName:6e9a2956-c6be-44d6-b063-e8134e21bc27 nodeName:}" failed. No retries permitted until 2026-09-10 16:04:17.668535885 +0000 UTC m=+82.233739433 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6e9a2956-c6be-44d6-b063-e8134e21bc27-metrics-certs") pod "router-default-64969f7776-5mx24" (UID: "6e9a2956-c6be-44d6-b063-e8134e21bc27") : secret "router-metrics-certs-default" not found Sep 10 16:04:01.668768 ip-10-0-135-53 kubenswrapper[2574]: E0910 16:04:01.668616 2574 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Sep 10 16:04:01.668768 ip-10-0-135-53 kubenswrapper[2574]: E0910 16:04:01.668672 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e3e9b71b-d2dc-483e-a5fa-5a5054914933-cluster-monitoring-operator-tls podName:e3e9b71b-d2dc-483e-a5fa-5a5054914933 nodeName:}" failed. No retries permitted until 2026-09-10 16:04:17.668657391 +0000 UTC m=+82.233860943 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/e3e9b71b-d2dc-483e-a5fa-5a5054914933-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cdcc96965-9rfn8" (UID: "e3e9b71b-d2dc-483e-a5fa-5a5054914933") : secret "cluster-monitoring-operator-tls" not found Sep 10 16:04:01.670949 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:04:01.670929 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Sep 10 16:04:01.681794 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:04:01.681762 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/aa29ebca-e469-4e43-abda-06f75d9c0a11-original-pull-secret\") pod \"global-pull-secret-syncer-pcsbz\" (UID: \"aa29ebca-e469-4e43-abda-06f75d9c0a11\") " pod="kube-system/global-pull-secret-syncer-pcsbz" Sep 10 16:04:01.769074 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:04:01.769046 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cc55b4de-3d22-4d24-bf28-d018afb0e4bc-metrics-certs\") pod \"network-metrics-daemon-ct85s\" (UID: \"cc55b4de-3d22-4d24-bf28-d018afb0e4bc\") " pod="openshift-multus/network-metrics-daemon-ct85s" Sep 10 16:04:01.772089 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:04:01.772055 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Sep 10 16:04:01.779623 ip-10-0-135-53 kubenswrapper[2574]: E0910 16:04:01.779593 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Sep 10 16:04:01.779773 ip-10-0-135-53 kubenswrapper[2574]: E0910 16:04:01.779684 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cc55b4de-3d22-4d24-bf28-d018afb0e4bc-metrics-certs podName:cc55b4de-3d22-4d24-bf28-d018afb0e4bc nodeName:}" failed. No retries permitted until 2026-09-10 16:05:05.779660487 +0000 UTC m=+130.344864027 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cc55b4de-3d22-4d24-bf28-d018afb0e4bc-metrics-certs") pod "network-metrics-daemon-ct85s" (UID: "cc55b4de-3d22-4d24-bf28-d018afb0e4bc") : secret "metrics-daemon-secret" not found Sep 10 16:04:01.796283 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:04:01.796238 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-68nz2"] Sep 10 16:04:01.870070 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:04:01.870029 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j69hj\" (UniqueName: \"kubernetes.io/projected/fe979f50-1926-4dc6-9830-76ba5781be0b-kube-api-access-j69hj\") pod \"network-check-target-vpl4s\" (UID: \"fe979f50-1926-4dc6-9830-76ba5781be0b\") " pod="openshift-network-diagnostics/network-check-target-vpl4s" Sep 10 16:04:01.872529 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:04:01.872501 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j69hj\" (UniqueName: \"kubernetes.io/projected/fe979f50-1926-4dc6-9830-76ba5781be0b-kube-api-access-j69hj\") pod \"network-check-target-vpl4s\" (UID: \"fe979f50-1926-4dc6-9830-76ba5781be0b\") " pod="openshift-network-diagnostics/network-check-target-vpl4s" Sep 10 16:04:01.888042 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:04:01.888015 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-x4mwj\"" Sep 10 16:04:01.895248 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:04:01.895218 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pcsbz" Sep 10 16:04:01.896300 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:04:01.896286 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vpl4s" Sep 10 16:04:02.168073 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:04:02.168037 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-pcsbz"] Sep 10 16:04:02.170373 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:04:02.170350 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaa29ebca_e469_4e43_abda_06f75d9c0a11.slice/crio-5f2b0b9bcda4db5513e8fcec4d3d8c26520cb574414f937e78dd941e873ca833 WatchSource:0}: Error finding container 5f2b0b9bcda4db5513e8fcec4d3d8c26520cb574414f937e78dd941e873ca833: Status 404 returned error can't find the container with id 5f2b0b9bcda4db5513e8fcec4d3d8c26520cb574414f937e78dd941e873ca833 Sep 10 16:04:02.178374 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:04:02.178315 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-vpl4s"] Sep 10 16:04:02.180728 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:04:02.180706 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfe979f50_1926_4dc6_9830_76ba5781be0b.slice/crio-594d40ed399bd09acb366eeb5798218d97d0b67598eeea08405a790fa00e422e WatchSource:0}: Error finding container 594d40ed399bd09acb366eeb5798218d97d0b67598eeea08405a790fa00e422e: Status 404 returned error can't find the container with id 594d40ed399bd09acb366eeb5798218d97d0b67598eeea08405a790fa00e422e Sep 10 16:04:02.345993 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:04:02.345956 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-vpl4s" event={"ID":"fe979f50-1926-4dc6-9830-76ba5781be0b","Type":"ContainerStarted","Data":"166f9472b7e75dc83edea28b6f6ad28d13122bb92adfaed52efb54262f19e68f"} Sep 10 16:04:02.346150 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:04:02.346006 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-vpl4s" event={"ID":"fe979f50-1926-4dc6-9830-76ba5781be0b","Type":"ContainerStarted","Data":"594d40ed399bd09acb366eeb5798218d97d0b67598eeea08405a790fa00e422e"} Sep 10 16:04:02.346150 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:04:02.346084 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-vpl4s" Sep 10 16:04:02.347166 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:04:02.347145 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-68nz2" event={"ID":"b005b666-7f33-4203-ac69-4d1fe658441c","Type":"ContainerStarted","Data":"cc5c1880794b4add9094bd6bb37ef73826316915827d06a2f44e7f0da3db920b"} Sep 10 16:04:02.348245 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:04:02.348223 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-pcsbz" event={"ID":"aa29ebca-e469-4e43-abda-06f75d9c0a11","Type":"ContainerStarted","Data":"5f2b0b9bcda4db5513e8fcec4d3d8c26520cb574414f937e78dd941e873ca833"} Sep 10 16:04:02.979830 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:04:02.979725 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/79ab48bc-9994-4510-a3fa-6579e7dcf721-registry-tls\") pod \"image-registry-565b4cb7c8-5dx8p\" (UID: \"79ab48bc-9994-4510-a3fa-6579e7dcf721\") " pod="openshift-image-registry/image-registry-565b4cb7c8-5dx8p" Sep 10 16:04:02.982548 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:04:02.982499 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/79ab48bc-9994-4510-a3fa-6579e7dcf721-registry-tls\") pod \"image-registry-565b4cb7c8-5dx8p\" (UID: \"79ab48bc-9994-4510-a3fa-6579e7dcf721\") " pod="openshift-image-registry/image-registry-565b4cb7c8-5dx8p" Sep 10 16:04:03.111500 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:04:03.111461 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-8xcjl\"" Sep 10 16:04:03.119795 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:04:03.119762 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-565b4cb7c8-5dx8p" Sep 10 16:04:03.397532 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:04:03.397472 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-vpl4s" podStartSLOduration=67.3974449 podStartE2EDuration="1m7.3974449s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 16:02:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 16:04:02.362651405 +0000 UTC m=+66.927854948" watchObservedRunningTime="2026-09-10 16:04:03.3974449 +0000 UTC m=+67.962648445" Sep 10 16:04:03.398357 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:04:03.398336 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-565b4cb7c8-5dx8p"] Sep 10 16:04:03.608464 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:04:03.608433 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod79ab48bc_9994_4510_a3fa_6579e7dcf721.slice/crio-373f42f84df6ddca5e3f15ecb4c94ddd18799611ce36412a9c85dfc2fc8231d8 WatchSource:0}: Error finding container 373f42f84df6ddca5e3f15ecb4c94ddd18799611ce36412a9c85dfc2fc8231d8: Status 404 returned error can't find the container with id 373f42f84df6ddca5e3f15ecb4c94ddd18799611ce36412a9c85dfc2fc8231d8 Sep 10 16:04:03.789784 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:04:03.789696 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4e31247f-e7e8-4d9b-b3ed-0c18d36131e8-metrics-tls\") pod \"dns-default-vq7kx\" (UID: \"4e31247f-e7e8-4d9b-b3ed-0c18d36131e8\") " pod="openshift-dns/dns-default-vq7kx" Sep 10 16:04:03.792431 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:04:03.792404 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4e31247f-e7e8-4d9b-b3ed-0c18d36131e8-metrics-tls\") pod \"dns-default-vq7kx\" (UID: \"4e31247f-e7e8-4d9b-b3ed-0c18d36131e8\") " pod="openshift-dns/dns-default-vq7kx" Sep 10 16:04:03.971304 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:04:03.971213 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-snhng\"" Sep 10 16:04:03.979395 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:04:03.979376 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-vq7kx" Sep 10 16:04:04.256045 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:04:04.255591 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-vq7kx"] Sep 10 16:04:04.258413 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:04:04.258381 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4e31247f_e7e8_4d9b_b3ed_0c18d36131e8.slice/crio-9df69f26f7f3b26f9f5d0507fedd38d552f2f5ee252d1cd1c4bca3f051da4366 WatchSource:0}: Error finding container 9df69f26f7f3b26f9f5d0507fedd38d552f2f5ee252d1cd1c4bca3f051da4366: Status 404 returned error can't find the container with id 9df69f26f7f3b26f9f5d0507fedd38d552f2f5ee252d1cd1c4bca3f051da4366 Sep 10 16:04:04.356654 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:04:04.356612 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-vq7kx" event={"ID":"4e31247f-e7e8-4d9b-b3ed-0c18d36131e8","Type":"ContainerStarted","Data":"9df69f26f7f3b26f9f5d0507fedd38d552f2f5ee252d1cd1c4bca3f051da4366"} Sep 10 16:04:04.358382 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:04:04.358351 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-565b4cb7c8-5dx8p" event={"ID":"79ab48bc-9994-4510-a3fa-6579e7dcf721","Type":"ContainerStarted","Data":"47d2b0700bf3292ae89e1d0f3c495f87ab283cccd3d3fde8e67ab9e4b447fb89"} Sep 10 16:04:04.358507 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:04:04.358401 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-565b4cb7c8-5dx8p" event={"ID":"79ab48bc-9994-4510-a3fa-6579e7dcf721","Type":"ContainerStarted","Data":"373f42f84df6ddca5e3f15ecb4c94ddd18799611ce36412a9c85dfc2fc8231d8"} Sep 10 16:04:04.358507 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:04:04.358475 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-565b4cb7c8-5dx8p" Sep 10 16:04:04.360381 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:04:04.360361 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-68nz2" event={"ID":"b005b666-7f33-4203-ac69-4d1fe658441c","Type":"ContainerStarted","Data":"0605b48711dc68eeedd9cdb324dd2fc93cfbfad2e01fdaf0215acef86e1689e4"} Sep 10 16:04:04.360484 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:04:04.360396 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-68nz2" event={"ID":"b005b666-7f33-4203-ac69-4d1fe658441c","Type":"ContainerStarted","Data":"0725ba21d89ba1abdea18dd85e9c3e7156942bcb73a7cb258a079303f5f994cd"} Sep 10 16:04:04.381858 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:04:04.381811 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-565b4cb7c8-5dx8p" podStartSLOduration=17.381794955 podStartE2EDuration="17.381794955s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 16:03:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 16:04:04.381642569 +0000 UTC m=+68.946846113" watchObservedRunningTime="2026-09-10 16:04:04.381794955 +0000 UTC m=+68.946998496" Sep 10 16:04:04.396568 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:04:04.396515 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-68nz2" podStartSLOduration=17.577753448 podStartE2EDuration="19.396502435s" totalImagesPullingTime="1.818748987s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 16:03:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 16:04:04.396187579 +0000 UTC m=+68.961391124" watchObservedRunningTime="2026-09-10 16:04:04.396502435 +0000 UTC m=+68.961705974" Sep 10 16:04:07.222314 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:04:07.222247 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7d8d33a6-8125-4b39-b396-5ac74e34703e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-z5t9x\" (UID: \"7d8d33a6-8125-4b39-b396-5ac74e34703e\") " pod="openshift-insights/insights-runtime-extractor-z5t9x" Sep 10 16:04:07.222761 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:04:07.222347 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7d8d33a6-8125-4b39-b396-5ac74e34703e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-z5t9x\" (UID: \"7d8d33a6-8125-4b39-b396-5ac74e34703e\") " pod="openshift-insights/insights-runtime-extractor-z5t9x" Sep 10 16:04:07.223323 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:04:07.223247 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7d8d33a6-8125-4b39-b396-5ac74e34703e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-z5t9x\" (UID: \"7d8d33a6-8125-4b39-b396-5ac74e34703e\") " pod="openshift-insights/insights-runtime-extractor-z5t9x" Sep 10 16:04:07.225166 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:04:07.225143 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7d8d33a6-8125-4b39-b396-5ac74e34703e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-z5t9x\" (UID: \"7d8d33a6-8125-4b39-b396-5ac74e34703e\") " pod="openshift-insights/insights-runtime-extractor-z5t9x" Sep 10 16:04:07.348388 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:04:07.348346 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-ng9sv\"" Sep 10 16:04:07.356534 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:04:07.356503 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-z5t9x" Sep 10 16:04:08.060080 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:04:08.059868 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-z5t9x"] Sep 10 16:04:08.063653 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:04:08.063612 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7d8d33a6_8125_4b39_b396_5ac74e34703e.slice/crio-a53fc7c4ec769290995cfb18acce038e682f61898c8ac45086851183cb413450 WatchSource:0}: Error finding container a53fc7c4ec769290995cfb18acce038e682f61898c8ac45086851183cb413450: Status 404 returned error can't find the container with id a53fc7c4ec769290995cfb18acce038e682f61898c8ac45086851183cb413450 Sep 10 16:04:08.074345 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:04:08.074319 2574 scope.go:117] "RemoveContainer" containerID="9a4bdcb4eab3d0ba70e7a3ed324c183e2c5bef36c0bb57389905d099f71e56b7" Sep 10 16:04:08.376993 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:04:08.376918 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-frshx_9baedfdd-1384-4da1-b9c0-58dea49d3ae0/console-operator/1.log" Sep 10 16:04:08.377424 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:04:08.377014 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-85b454874b-frshx" event={"ID":"9baedfdd-1384-4da1-b9c0-58dea49d3ae0","Type":"ContainerStarted","Data":"b4ff349f966ba40b49b9ffd05fb3fdd1d04a825e2b24473d86af6c1e3e55d5a2"} Sep 10 16:04:08.377424 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:04:08.377322 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-85b454874b-frshx" Sep 10 16:04:08.379029 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:04:08.379004 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-vq7kx" event={"ID":"4e31247f-e7e8-4d9b-b3ed-0c18d36131e8","Type":"ContainerStarted","Data":"134b5f6ebd585f4f1c07312ea28aefb5e80b2b85617a679d02d459829846710c"} Sep 10 16:04:08.379160 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:04:08.379050 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-vq7kx" event={"ID":"4e31247f-e7e8-4d9b-b3ed-0c18d36131e8","Type":"ContainerStarted","Data":"2fa7b0e00c1f44290519ae9ca92c11a5c3a6b56f7d5676d992f575fbfc43cbb5"} Sep 10 16:04:08.379160 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:04:08.379081 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-vq7kx" Sep 10 16:04:08.380601 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:04:08.380577 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-z5t9x" event={"ID":"7d8d33a6-8125-4b39-b396-5ac74e34703e","Type":"ContainerStarted","Data":"3ba7721fdf5d873d03b6e442cd8990f1c00da9cde695d281d29f8fed727a06e3"} Sep 10 16:04:08.380704 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:04:08.380627 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-z5t9x" event={"ID":"7d8d33a6-8125-4b39-b396-5ac74e34703e","Type":"ContainerStarted","Data":"a53fc7c4ec769290995cfb18acce038e682f61898c8ac45086851183cb413450"} Sep 10 16:04:08.381958 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:04:08.381938 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-pcsbz" event={"ID":"aa29ebca-e469-4e43-abda-06f75d9c0a11","Type":"ContainerStarted","Data":"6ee06db33412f3837f31dea18a9fb00feca360a3746db1160786699644e82c2c"} Sep 10 16:04:08.394993 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:04:08.394954 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-85b454874b-frshx" podStartSLOduration=19.909702971 podStartE2EDuration="23.394940231s" totalImagesPullingTime="3.48523726s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 16:03:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 16:04:08.394369803 +0000 UTC m=+72.959573347" watchObservedRunningTime="2026-09-10 16:04:08.394940231 +0000 UTC m=+72.960143817" Sep 10 16:04:08.410066 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:04:08.410016 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-pcsbz" podStartSLOduration=66.794738364 podStartE2EDuration="1m12.410002036s" totalImagesPullingTime="5.615263672s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 16:02:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 16:04:08.409436407 +0000 UTC m=+72.974639952" watchObservedRunningTime="2026-09-10 16:04:08.410002036 +0000 UTC m=+72.975205580" Sep 10 16:04:08.426637 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:04:08.426594 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-vq7kx" podStartSLOduration=33.900482917 podStartE2EDuration="37.426579984s" totalImagesPullingTime="3.526097067s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 16:03:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 16:04:08.425567886 +0000 UTC m=+72.990771429" watchObservedRunningTime="2026-09-10 16:04:08.426579984 +0000 UTC m=+72.991783527" Sep 10 16:04:09.314960 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:04:09.314861 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-85b454874b-frshx" Sep 10 16:04:09.388898 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:04:09.388851 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-z5t9x" event={"ID":"7d8d33a6-8125-4b39-b396-5ac74e34703e","Type":"ContainerStarted","Data":"9e3e02cc81e7ea310bb1394a140f9980dbe1acfb1e0d423497eb22d880880df7"} Sep 10 16:04:10.394547 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:04:10.394511 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-z5t9x" event={"ID":"7d8d33a6-8125-4b39-b396-5ac74e34703e","Type":"ContainerStarted","Data":"5b8396a7bb2389b428d1243c5cad28578fe2e620ef4bf08bf9ca4071808705a6"} Sep 10 16:04:10.414236 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:04:10.414144 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-z5t9x" podStartSLOduration=17.457952314 podStartE2EDuration="19.414128085s" totalImagesPullingTime="1.956175771s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 16:03:51 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 16:04:10.412918951 +0000 UTC m=+74.978122523" watchObservedRunningTime="2026-09-10 16:04:10.414128085 +0000 UTC m=+74.979331629" Sep 10 16:04:13.379697 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:04:13.379645 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-79977f9844-mc2tj"] Sep 10 16:04:13.383156 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:04:13.383133 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-76c7d77d64-hzwjn"] Sep 10 16:04:13.383284 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:04:13.383249 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-79977f9844-mc2tj" Sep 10 16:04:13.385934 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:04:13.385917 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-76c7d77d64-hzwjn" Sep 10 16:04:13.387082 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:04:13.387060 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Sep 10 16:04:13.387187 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:04:13.387060 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Sep 10 16:04:13.387758 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:04:13.387740 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-4smdr\"" Sep 10 16:04:13.389561 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:04:13.389540 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Sep 10 16:04:13.390022 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:04:13.390005 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\"" Sep 10 16:04:13.390133 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:04:13.390109 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Sep 10 16:04:13.390203 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:04:13.390185 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Sep 10 16:04:13.405462 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:04:13.405436 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-79977f9844-mc2tj"] Sep 10 16:04:13.452737 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:04:13.452709 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-76c7d77d64-hzwjn"] Sep 10 16:04:13.454165 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:04:13.454143 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-565b4cb7c8-5dx8p"] Sep 10 16:04:13.478099 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:04:13.478064 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/58faae2f-2dda-4150-a768-42e3e47ac3f8-klusterlet-config\") pod \"klusterlet-addon-workmgr-76c7d77d64-hzwjn\" (UID: \"58faae2f-2dda-4150-a768-42e3e47ac3f8\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-76c7d77d64-hzwjn" Sep 10 16:04:13.478099 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:04:13.478102 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/cd37132d-a266-4224-a64d-85abbb9cf070-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-mc2tj\" (UID: \"cd37132d-a266-4224-a64d-85abbb9cf070\") " pod="openshift-network-console/networking-console-plugin-79977f9844-mc2tj" Sep 10 16:04:13.478334 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:04:13.478144 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vxtpw\" (UniqueName: \"kubernetes.io/projected/58faae2f-2dda-4150-a768-42e3e47ac3f8-kube-api-access-vxtpw\") pod \"klusterlet-addon-workmgr-76c7d77d64-hzwjn\" (UID: \"58faae2f-2dda-4150-a768-42e3e47ac3f8\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-76c7d77d64-hzwjn" Sep 10 16:04:13.478334 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:04:13.478219 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/58faae2f-2dda-4150-a768-42e3e47ac3f8-tmp\") pod \"klusterlet-addon-workmgr-76c7d77d64-hzwjn\" (UID: \"58faae2f-2dda-4150-a768-42e3e47ac3f8\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-76c7d77d64-hzwjn" Sep 10 16:04:13.478334 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:04:13.478276 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/cd37132d-a266-4224-a64d-85abbb9cf070-nginx-conf\") pod \"networking-console-plugin-79977f9844-mc2tj\" (UID: \"cd37132d-a266-4224-a64d-85abbb9cf070\") " pod="openshift-network-console/networking-console-plugin-79977f9844-mc2tj" Sep 10 16:04:13.510242 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:04:13.510213 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-85d98c998f-kj4z4"] Sep 10 16:04:13.513299 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:04:13.513285 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-85d98c998f-kj4z4" Sep 10 16:04:13.516571 ip-10-0-135-53 kubenswrapper[2574]: E0910 16:04:13.516532 2574 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"kube-root-ca.crt\" is forbidden: User \"system:node:ip-10-0-135-53.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"openshift-console\": no relationship found between node 'ip-10-0-135-53.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" Sep 10 16:04:13.516571 ip-10-0-135-53 kubenswrapper[2574]: E0910 16:04:13.516549 2574 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"default-dockercfg-6st2v\" is forbidden: User \"system:node:ip-10-0-135-53.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-console\": no relationship found between node 'ip-10-0-135-53.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-console\"/\"default-dockercfg-6st2v\"" type="*v1.Secret" Sep 10 16:04:13.516767 ip-10-0-135-53 kubenswrapper[2574]: E0910 16:04:13.516745 2574 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"openshift-service-ca.crt\" is forbidden: User \"system:node:ip-10-0-135-53.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"openshift-console\": no relationship found between node 'ip-10-0-135-53.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap" Sep 10 16:04:13.547976 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:04:13.547946 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-85d98c998f-kj4z4"] Sep 10 16:04:13.579110 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:04:13.579077 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/58faae2f-2dda-4150-a768-42e3e47ac3f8-klusterlet-config\") pod \"klusterlet-addon-workmgr-76c7d77d64-hzwjn\" (UID: \"58faae2f-2dda-4150-a768-42e3e47ac3f8\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-76c7d77d64-hzwjn" Sep 10 16:04:13.579292 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:04:13.579114 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/cd37132d-a266-4224-a64d-85abbb9cf070-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-mc2tj\" (UID: \"cd37132d-a266-4224-a64d-85abbb9cf070\") " pod="openshift-network-console/networking-console-plugin-79977f9844-mc2tj" Sep 10 16:04:13.579292 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:04:13.579250 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jj7lr\" (UniqueName: \"kubernetes.io/projected/97b740c1-94b8-45e8-8f20-41b915f7f2d8-kube-api-access-jj7lr\") pod \"downloads-85d98c998f-kj4z4\" (UID: \"97b740c1-94b8-45e8-8f20-41b915f7f2d8\") " pod="openshift-console/downloads-85d98c998f-kj4z4" Sep 10 16:04:13.579419 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:04:13.579363 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vxtpw\" (UniqueName: \"kubernetes.io/projected/58faae2f-2dda-4150-a768-42e3e47ac3f8-kube-api-access-vxtpw\") pod \"klusterlet-addon-workmgr-76c7d77d64-hzwjn\" (UID: \"58faae2f-2dda-4150-a768-42e3e47ac3f8\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-76c7d77d64-hzwjn" Sep 10 16:04:13.579477 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:04:13.579430 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/58faae2f-2dda-4150-a768-42e3e47ac3f8-tmp\") pod \"klusterlet-addon-workmgr-76c7d77d64-hzwjn\" (UID: \"58faae2f-2dda-4150-a768-42e3e47ac3f8\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-76c7d77d64-hzwjn" Sep 10 16:04:13.579477 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:04:13.579466 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/cd37132d-a266-4224-a64d-85abbb9cf070-nginx-conf\") pod \"networking-console-plugin-79977f9844-mc2tj\" (UID: \"cd37132d-a266-4224-a64d-85abbb9cf070\") " pod="openshift-network-console/networking-console-plugin-79977f9844-mc2tj" Sep 10 16:04:13.579807 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:04:13.579784 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/58faae2f-2dda-4150-a768-42e3e47ac3f8-tmp\") pod \"klusterlet-addon-workmgr-76c7d77d64-hzwjn\" (UID: \"58faae2f-2dda-4150-a768-42e3e47ac3f8\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-76c7d77d64-hzwjn" Sep 10 16:04:13.580057 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:04:13.580037 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/cd37132d-a266-4224-a64d-85abbb9cf070-nginx-conf\") pod \"networking-console-plugin-79977f9844-mc2tj\" (UID: \"cd37132d-a266-4224-a64d-85abbb9cf070\") " pod="openshift-network-console/networking-console-plugin-79977f9844-mc2tj" Sep 10 16:04:13.581554 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:04:13.581533 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/cd37132d-a266-4224-a64d-85abbb9cf070-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-mc2tj\" (UID: \"cd37132d-a266-4224-a64d-85abbb9cf070\") " pod="openshift-network-console/networking-console-plugin-79977f9844-mc2tj" Sep 10 16:04:13.581716 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:04:13.581700 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/58faae2f-2dda-4150-a768-42e3e47ac3f8-klusterlet-config\") pod \"klusterlet-addon-workmgr-76c7d77d64-hzwjn\" (UID: \"58faae2f-2dda-4150-a768-42e3e47ac3f8\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-76c7d77d64-hzwjn" Sep 10 16:04:13.595319 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:04:13.595288 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vxtpw\" (UniqueName: \"kubernetes.io/projected/58faae2f-2dda-4150-a768-42e3e47ac3f8-kube-api-access-vxtpw\") pod \"klusterlet-addon-workmgr-76c7d77d64-hzwjn\" (UID: \"58faae2f-2dda-4150-a768-42e3e47ac3f8\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-76c7d77d64-hzwjn" Sep 10 16:04:13.608333 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:04:13.608305 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-dd4774968-lbkkv"] Sep 10 16:04:13.611567 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:04:13.611552 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-dd4774968-lbkkv" Sep 10 16:04:13.626399 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:04:13.626377 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-dd4774968-lbkkv"] Sep 10 16:04:13.680695 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:04:13.680598 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w2gvf\" (UniqueName: \"kubernetes.io/projected/ef90b6b0-bfd5-4424-8eb7-7600b3fc10a8-kube-api-access-w2gvf\") pod \"image-registry-dd4774968-lbkkv\" (UID: \"ef90b6b0-bfd5-4424-8eb7-7600b3fc10a8\") " pod="openshift-image-registry/image-registry-dd4774968-lbkkv" Sep 10 16:04:13.680695 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:04:13.680647 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ef90b6b0-bfd5-4424-8eb7-7600b3fc10a8-image-registry-private-configuration\") pod \"image-registry-dd4774968-lbkkv\" (UID: \"ef90b6b0-bfd5-4424-8eb7-7600b3fc10a8\") " pod="openshift-image-registry/image-registry-dd4774968-lbkkv" Sep 10 16:04:13.680930 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:04:13.680729 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ef90b6b0-bfd5-4424-8eb7-7600b3fc10a8-registry-certificates\") pod \"image-registry-dd4774968-lbkkv\" (UID: \"ef90b6b0-bfd5-4424-8eb7-7600b3fc10a8\") " pod="openshift-image-registry/image-registry-dd4774968-lbkkv" Sep 10 16:04:13.680930 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:04:13.680782 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ef90b6b0-bfd5-4424-8eb7-7600b3fc10a8-trusted-ca\") pod \"image-registry-dd4774968-lbkkv\" (UID: \"ef90b6b0-bfd5-4424-8eb7-7600b3fc10a8\") " pod="openshift-image-registry/image-registry-dd4774968-lbkkv" Sep 10 16:04:13.680930 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:04:13.680820 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ef90b6b0-bfd5-4424-8eb7-7600b3fc10a8-registry-tls\") pod \"image-registry-dd4774968-lbkkv\" (UID: \"ef90b6b0-bfd5-4424-8eb7-7600b3fc10a8\") " pod="openshift-image-registry/image-registry-dd4774968-lbkkv" Sep 10 16:04:13.680930 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:04:13.680879 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ef90b6b0-bfd5-4424-8eb7-7600b3fc10a8-installation-pull-secrets\") pod \"image-registry-dd4774968-lbkkv\" (UID: \"ef90b6b0-bfd5-4424-8eb7-7600b3fc10a8\") " pod="openshift-image-registry/image-registry-dd4774968-lbkkv" Sep 10 16:04:13.680930 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:04:13.680908 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ef90b6b0-bfd5-4424-8eb7-7600b3fc10a8-bound-sa-token\") pod \"image-registry-dd4774968-lbkkv\" (UID: \"ef90b6b0-bfd5-4424-8eb7-7600b3fc10a8\") " pod="openshift-image-registry/image-registry-dd4774968-lbkkv" Sep 10 16:04:13.681098 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:04:13.680966 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jj7lr\" (UniqueName: \"kubernetes.io/projected/97b740c1-94b8-45e8-8f20-41b915f7f2d8-kube-api-access-jj7lr\") pod \"downloads-85d98c998f-kj4z4\" (UID: \"97b740c1-94b8-45e8-8f20-41b915f7f2d8\") " pod="openshift-console/downloads-85d98c998f-kj4z4" Sep 10 16:04:13.681098 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:04:13.680993 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ef90b6b0-bfd5-4424-8eb7-7600b3fc10a8-ca-trust-extracted\") pod \"image-registry-dd4774968-lbkkv\" (UID: \"ef90b6b0-bfd5-4424-8eb7-7600b3fc10a8\") " pod="openshift-image-registry/image-registry-dd4774968-lbkkv" Sep 10 16:04:13.694056 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:04:13.694030 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-79977f9844-mc2tj" Sep 10 16:04:13.699222 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:04:13.699204 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-76c7d77d64-hzwjn" Sep 10 16:04:13.782292 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:04:13.782245 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ef90b6b0-bfd5-4424-8eb7-7600b3fc10a8-installation-pull-secrets\") pod \"image-registry-dd4774968-lbkkv\" (UID: \"ef90b6b0-bfd5-4424-8eb7-7600b3fc10a8\") " pod="openshift-image-registry/image-registry-dd4774968-lbkkv" Sep 10 16:04:13.782432 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:04:13.782302 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ef90b6b0-bfd5-4424-8eb7-7600b3fc10a8-bound-sa-token\") pod \"image-registry-dd4774968-lbkkv\" (UID: \"ef90b6b0-bfd5-4424-8eb7-7600b3fc10a8\") " pod="openshift-image-registry/image-registry-dd4774968-lbkkv" Sep 10 16:04:13.782432 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:04:13.782358 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ef90b6b0-bfd5-4424-8eb7-7600b3fc10a8-ca-trust-extracted\") pod \"image-registry-dd4774968-lbkkv\" (UID: \"ef90b6b0-bfd5-4424-8eb7-7600b3fc10a8\") " pod="openshift-image-registry/image-registry-dd4774968-lbkkv" Sep 10 16:04:13.782432 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:04:13.782395 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w2gvf\" (UniqueName: \"kubernetes.io/projected/ef90b6b0-bfd5-4424-8eb7-7600b3fc10a8-kube-api-access-w2gvf\") pod \"image-registry-dd4774968-lbkkv\" (UID: \"ef90b6b0-bfd5-4424-8eb7-7600b3fc10a8\") " pod="openshift-image-registry/image-registry-dd4774968-lbkkv" Sep 10 16:04:13.782525 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:04:13.782436 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ef90b6b0-bfd5-4424-8eb7-7600b3fc10a8-image-registry-private-configuration\") pod \"image-registry-dd4774968-lbkkv\" (UID: \"ef90b6b0-bfd5-4424-8eb7-7600b3fc10a8\") " pod="openshift-image-registry/image-registry-dd4774968-lbkkv" Sep 10 16:04:13.782525 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:04:13.782491 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ef90b6b0-bfd5-4424-8eb7-7600b3fc10a8-registry-certificates\") pod \"image-registry-dd4774968-lbkkv\" (UID: \"ef90b6b0-bfd5-4424-8eb7-7600b3fc10a8\") " pod="openshift-image-registry/image-registry-dd4774968-lbkkv" Sep 10 16:04:13.782584 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:04:13.782521 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ef90b6b0-bfd5-4424-8eb7-7600b3fc10a8-trusted-ca\") pod \"image-registry-dd4774968-lbkkv\" (UID: \"ef90b6b0-bfd5-4424-8eb7-7600b3fc10a8\") " pod="openshift-image-registry/image-registry-dd4774968-lbkkv" Sep 10 16:04:13.782584 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:04:13.782555 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ef90b6b0-bfd5-4424-8eb7-7600b3fc10a8-registry-tls\") pod \"image-registry-dd4774968-lbkkv\" (UID: \"ef90b6b0-bfd5-4424-8eb7-7600b3fc10a8\") " pod="openshift-image-registry/image-registry-dd4774968-lbkkv" Sep 10 16:04:13.783012 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:04:13.782984 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ef90b6b0-bfd5-4424-8eb7-7600b3fc10a8-ca-trust-extracted\") pod \"image-registry-dd4774968-lbkkv\" (UID: \"ef90b6b0-bfd5-4424-8eb7-7600b3fc10a8\") " pod="openshift-image-registry/image-registry-dd4774968-lbkkv" Sep 10 16:04:13.783632 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:04:13.783592 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ef90b6b0-bfd5-4424-8eb7-7600b3fc10a8-registry-certificates\") pod \"image-registry-dd4774968-lbkkv\" (UID: \"ef90b6b0-bfd5-4424-8eb7-7600b3fc10a8\") " pod="openshift-image-registry/image-registry-dd4774968-lbkkv" Sep 10 16:04:13.784459 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:04:13.783955 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ef90b6b0-bfd5-4424-8eb7-7600b3fc10a8-trusted-ca\") pod \"image-registry-dd4774968-lbkkv\" (UID: \"ef90b6b0-bfd5-4424-8eb7-7600b3fc10a8\") " pod="openshift-image-registry/image-registry-dd4774968-lbkkv" Sep 10 16:04:13.785846 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:04:13.785824 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ef90b6b0-bfd5-4424-8eb7-7600b3fc10a8-registry-tls\") pod \"image-registry-dd4774968-lbkkv\" (UID: \"ef90b6b0-bfd5-4424-8eb7-7600b3fc10a8\") " pod="openshift-image-registry/image-registry-dd4774968-lbkkv" Sep 10 16:04:13.785966 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:04:13.785944 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ef90b6b0-bfd5-4424-8eb7-7600b3fc10a8-image-registry-private-configuration\") pod \"image-registry-dd4774968-lbkkv\" (UID: \"ef90b6b0-bfd5-4424-8eb7-7600b3fc10a8\") " pod="openshift-image-registry/image-registry-dd4774968-lbkkv" Sep 10 16:04:13.786016 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:04:13.785995 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ef90b6b0-bfd5-4424-8eb7-7600b3fc10a8-installation-pull-secrets\") pod \"image-registry-dd4774968-lbkkv\" (UID: \"ef90b6b0-bfd5-4424-8eb7-7600b3fc10a8\") " pod="openshift-image-registry/image-registry-dd4774968-lbkkv" Sep 10 16:04:13.791960 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:04:13.791931 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ef90b6b0-bfd5-4424-8eb7-7600b3fc10a8-bound-sa-token\") pod \"image-registry-dd4774968-lbkkv\" (UID: \"ef90b6b0-bfd5-4424-8eb7-7600b3fc10a8\") " pod="openshift-image-registry/image-registry-dd4774968-lbkkv" Sep 10 16:04:13.792150 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:04:13.792133 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w2gvf\" (UniqueName: \"kubernetes.io/projected/ef90b6b0-bfd5-4424-8eb7-7600b3fc10a8-kube-api-access-w2gvf\") pod \"image-registry-dd4774968-lbkkv\" (UID: \"ef90b6b0-bfd5-4424-8eb7-7600b3fc10a8\") " pod="openshift-image-registry/image-registry-dd4774968-lbkkv" Sep 10 16:04:13.920109 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:04:13.920075 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-dd4774968-lbkkv" Sep 10 16:04:13.966056 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:04:13.966027 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-79977f9844-mc2tj"] Sep 10 16:04:13.970918 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:04:13.970895 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-76c7d77d64-hzwjn"] Sep 10 16:04:13.971198 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:04:13.971173 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcd37132d_a266_4224_a64d_85abbb9cf070.slice/crio-71afcc70477f4d37932f16ff3a296297b5a86a3eacaf5b990a68b5a492ef682f WatchSource:0}: Error finding container 71afcc70477f4d37932f16ff3a296297b5a86a3eacaf5b990a68b5a492ef682f: Status 404 returned error can't find the container with id 71afcc70477f4d37932f16ff3a296297b5a86a3eacaf5b990a68b5a492ef682f Sep 10 16:04:13.973863 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:04:13.973714 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod58faae2f_2dda_4150_a768_42e3e47ac3f8.slice/crio-04609f5721f44f49df35b1acc6c2b144778cb597ac29a7b31240097a6a473255 WatchSource:0}: Error finding container 04609f5721f44f49df35b1acc6c2b144778cb597ac29a7b31240097a6a473255: Status 404 returned error can't find the container with id 04609f5721f44f49df35b1acc6c2b144778cb597ac29a7b31240097a6a473255 Sep 10 16:04:14.202466 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:04:14.202441 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-dd4774968-lbkkv"] Sep 10 16:04:14.204639 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:04:14.204611 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podef90b6b0_bfd5_4424_8eb7_7600b3fc10a8.slice/crio-4354f33ff9000fa8f9561e5976e831e90707d534213c40a31699ce11c5bb0e63 WatchSource:0}: Error finding container 4354f33ff9000fa8f9561e5976e831e90707d534213c40a31699ce11c5bb0e63: Status 404 returned error can't find the container with id 4354f33ff9000fa8f9561e5976e831e90707d534213c40a31699ce11c5bb0e63 Sep 10 16:04:14.410003 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:04:14.409962 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-dd4774968-lbkkv" event={"ID":"ef90b6b0-bfd5-4424-8eb7-7600b3fc10a8","Type":"ContainerStarted","Data":"ef76b22e7afa20ae2060845b6345e4390e5e3e9f3ea66bf78ce2bfc544d01cd1"} Sep 10 16:04:14.410440 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:04:14.410033 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-dd4774968-lbkkv" Sep 10 16:04:14.410440 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:04:14.410056 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-dd4774968-lbkkv" event={"ID":"ef90b6b0-bfd5-4424-8eb7-7600b3fc10a8","Type":"ContainerStarted","Data":"4354f33ff9000fa8f9561e5976e831e90707d534213c40a31699ce11c5bb0e63"} Sep 10 16:04:14.411877 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:04:14.411847 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-76c7d77d64-hzwjn" event={"ID":"58faae2f-2dda-4150-a768-42e3e47ac3f8","Type":"ContainerStarted","Data":"04609f5721f44f49df35b1acc6c2b144778cb597ac29a7b31240097a6a473255"} Sep 10 16:04:14.413199 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:04:14.413177 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-79977f9844-mc2tj" event={"ID":"cd37132d-a266-4224-a64d-85abbb9cf070","Type":"ContainerStarted","Data":"71afcc70477f4d37932f16ff3a296297b5a86a3eacaf5b990a68b5a492ef682f"} Sep 10 16:04:14.431663 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:04:14.431610 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-dd4774968-lbkkv" podStartSLOduration=1.431594489 podStartE2EDuration="1.431594489s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 16:04:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 16:04:14.430151418 +0000 UTC m=+78.995354999" watchObservedRunningTime="2026-09-10 16:04:14.431594489 +0000 UTC m=+78.996798033" Sep 10 16:04:14.651582 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:04:14.651543 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-6st2v\"" Sep 10 16:04:14.691485 ip-10-0-135-53 kubenswrapper[2574]: E0910 16:04:14.691451 2574 projected.go:291] Couldn't get configMap openshift-console/kube-root-ca.crt: failed to sync configmap cache: timed out waiting for the condition Sep 10 16:04:14.734372 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:04:14.734341 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Sep 10 16:04:14.741875 ip-10-0-135-53 kubenswrapper[2574]: E0910 16:04:14.741833 2574 projected.go:196] Error preparing data for projected volume kube-api-access-jj7lr for pod openshift-console/downloads-85d98c998f-kj4z4: failed to sync configmap cache: timed out waiting for the condition Sep 10 16:04:14.742014 ip-10-0-135-53 kubenswrapper[2574]: E0910 16:04:14.741919 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/97b740c1-94b8-45e8-8f20-41b915f7f2d8-kube-api-access-jj7lr podName:97b740c1-94b8-45e8-8f20-41b915f7f2d8 nodeName:}" failed. No retries permitted until 2026-09-10 16:04:15.24189815 +0000 UTC m=+79.807101687 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-jj7lr" (UniqueName: "kubernetes.io/projected/97b740c1-94b8-45e8-8f20-41b915f7f2d8-kube-api-access-jj7lr") pod "downloads-85d98c998f-kj4z4" (UID: "97b740c1-94b8-45e8-8f20-41b915f7f2d8") : failed to sync configmap cache: timed out waiting for the condition Sep 10 16:04:14.876227 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:04:14.876196 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Sep 10 16:04:15.296570 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:04:15.296520 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jj7lr\" (UniqueName: \"kubernetes.io/projected/97b740c1-94b8-45e8-8f20-41b915f7f2d8-kube-api-access-jj7lr\") pod \"downloads-85d98c998f-kj4z4\" (UID: \"97b740c1-94b8-45e8-8f20-41b915f7f2d8\") " pod="openshift-console/downloads-85d98c998f-kj4z4" Sep 10 16:04:15.301487 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:04:15.301457 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jj7lr\" (UniqueName: \"kubernetes.io/projected/97b740c1-94b8-45e8-8f20-41b915f7f2d8-kube-api-access-jj7lr\") pod \"downloads-85d98c998f-kj4z4\" (UID: \"97b740c1-94b8-45e8-8f20-41b915f7f2d8\") " pod="openshift-console/downloads-85d98c998f-kj4z4" Sep 10 16:04:15.322081 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:04:15.322047 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-85d98c998f-kj4z4" Sep 10 16:04:15.420925 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:04:15.420337 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-79977f9844-mc2tj" event={"ID":"cd37132d-a266-4224-a64d-85abbb9cf070","Type":"ContainerStarted","Data":"d8beb35611faad7a57aa55d2e437bc7312d485164707d684b99efb2d0686d81e"} Sep 10 16:04:15.438127 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:04:15.438069 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-79977f9844-mc2tj" podStartSLOduration=1.407915811 podStartE2EDuration="2.438047831s" totalImagesPullingTime="1.03013202s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 16:04:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 16:04:15.435764136 +0000 UTC m=+80.000967679" watchObservedRunningTime="2026-09-10 16:04:15.438047831 +0000 UTC m=+80.003251377" Sep 10 16:04:15.608967 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:04:15.608843 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-85d98c998f-kj4z4"] Sep 10 16:04:15.613753 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:04:15.613720 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod97b740c1_94b8_45e8_8f20_41b915f7f2d8.slice/crio-fe6bcbf9b31e83431cb64a8dd577ea91159e25b7e1f0b996f83586ebbb17dc2d WatchSource:0}: Error finding container fe6bcbf9b31e83431cb64a8dd577ea91159e25b7e1f0b996f83586ebbb17dc2d: Status 404 returned error can't find the container with id fe6bcbf9b31e83431cb64a8dd577ea91159e25b7e1f0b996f83586ebbb17dc2d Sep 10 16:04:16.426398 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:04:16.426358 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-85d98c998f-kj4z4" event={"ID":"97b740c1-94b8-45e8-8f20-41b915f7f2d8","Type":"ContainerStarted","Data":"fe6bcbf9b31e83431cb64a8dd577ea91159e25b7e1f0b996f83586ebbb17dc2d"} Sep 10 16:04:17.719951 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:04:17.719906 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6e9a2956-c6be-44d6-b063-e8134e21bc27-metrics-certs\") pod \"router-default-64969f7776-5mx24\" (UID: \"6e9a2956-c6be-44d6-b063-e8134e21bc27\") " pod="openshift-ingress/router-default-64969f7776-5mx24" Sep 10 16:04:17.720441 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:04:17.720018 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/e3e9b71b-d2dc-483e-a5fa-5a5054914933-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-9rfn8\" (UID: \"e3e9b71b-d2dc-483e-a5fa-5a5054914933\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-9rfn8" Sep 10 16:04:17.720441 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:04:17.720068 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6e9a2956-c6be-44d6-b063-e8134e21bc27-service-ca-bundle\") pod \"router-default-64969f7776-5mx24\" (UID: \"6e9a2956-c6be-44d6-b063-e8134e21bc27\") " pod="openshift-ingress/router-default-64969f7776-5mx24" Sep 10 16:04:17.720780 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:04:17.720749 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6e9a2956-c6be-44d6-b063-e8134e21bc27-service-ca-bundle\") pod \"router-default-64969f7776-5mx24\" (UID: \"6e9a2956-c6be-44d6-b063-e8134e21bc27\") " pod="openshift-ingress/router-default-64969f7776-5mx24" Sep 10 16:04:17.723164 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:04:17.723135 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6e9a2956-c6be-44d6-b063-e8134e21bc27-metrics-certs\") pod \"router-default-64969f7776-5mx24\" (UID: \"6e9a2956-c6be-44d6-b063-e8134e21bc27\") " pod="openshift-ingress/router-default-64969f7776-5mx24" Sep 10 16:04:17.723904 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:04:17.723877 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/e3e9b71b-d2dc-483e-a5fa-5a5054914933-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-9rfn8\" (UID: \"e3e9b71b-d2dc-483e-a5fa-5a5054914933\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-9rfn8" Sep 10 16:04:17.845698 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:04:17.845660 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-7dctc\"" Sep 10 16:04:17.853817 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:04:17.853772 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-9rfn8" Sep 10 16:04:17.871035 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:04:17.871005 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-zvhdr\"" Sep 10 16:04:17.879373 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:04:17.879322 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-64969f7776-5mx24" Sep 10 16:04:18.391414 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:04:18.391339 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-vq7kx" Sep 10 16:04:18.431033 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:04:18.430990 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6cdcc96965-9rfn8"] Sep 10 16:04:18.434243 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:04:18.434206 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode3e9b71b_d2dc_483e_a5fa_5a5054914933.slice/crio-1433b6af7265a26e673edeaa578f0b74cc0925b13242747a367d60995a63afca WatchSource:0}: Error finding container 1433b6af7265a26e673edeaa578f0b74cc0925b13242747a367d60995a63afca: Status 404 returned error can't find the container with id 1433b6af7265a26e673edeaa578f0b74cc0925b13242747a367d60995a63afca Sep 10 16:04:18.438435 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:04:18.438393 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-76c7d77d64-hzwjn" event={"ID":"58faae2f-2dda-4150-a768-42e3e47ac3f8","Type":"ContainerStarted","Data":"b0e3040b5084a726ab7e35bac0e580b683f8a8b94c45f3620e080393f6584f71"} Sep 10 16:04:18.438542 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:04:18.438454 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-76c7d77d64-hzwjn" Sep 10 16:04:18.440991 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:04:18.440971 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-76c7d77d64-hzwjn" Sep 10 16:04:18.445322 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:04:18.445300 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-64969f7776-5mx24"] Sep 10 16:04:18.447715 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:04:18.447687 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6e9a2956_c6be_44d6_b063_e8134e21bc27.slice/crio-5e0c2946caf6ce8a9cc3f7fd2e3430b705a8aa9790276724b02e9eedc4b3d4f0 WatchSource:0}: Error finding container 5e0c2946caf6ce8a9cc3f7fd2e3430b705a8aa9790276724b02e9eedc4b3d4f0: Status 404 returned error can't find the container with id 5e0c2946caf6ce8a9cc3f7fd2e3430b705a8aa9790276724b02e9eedc4b3d4f0 Sep 10 16:04:18.497569 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:04:18.497519 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-76c7d77d64-hzwjn" podStartSLOduration=1.265842293 podStartE2EDuration="5.497498129s" totalImagesPullingTime="4.231655836s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 16:04:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 16:04:18.496892425 +0000 UTC m=+83.062095991" watchObservedRunningTime="2026-09-10 16:04:18.497498129 +0000 UTC m=+83.062701673" Sep 10 16:04:19.445772 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:04:19.445518 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-64969f7776-5mx24" event={"ID":"6e9a2956-c6be-44d6-b063-e8134e21bc27","Type":"ContainerStarted","Data":"c16ba2e6e4d21d29a8f0cc12e75d869cf664baa611ffa765af62d9c01f9d96c8"} Sep 10 16:04:19.445772 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:04:19.445578 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-64969f7776-5mx24" event={"ID":"6e9a2956-c6be-44d6-b063-e8134e21bc27","Type":"ContainerStarted","Data":"5e0c2946caf6ce8a9cc3f7fd2e3430b705a8aa9790276724b02e9eedc4b3d4f0"} Sep 10 16:04:19.447411 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:04:19.447379 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-9rfn8" event={"ID":"e3e9b71b-d2dc-483e-a5fa-5a5054914933","Type":"ContainerStarted","Data":"1433b6af7265a26e673edeaa578f0b74cc0925b13242747a367d60995a63afca"} Sep 10 16:04:19.467618 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:04:19.467573 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-64969f7776-5mx24" podStartSLOduration=34.467556809 podStartE2EDuration="34.467556809s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 16:03:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 16:04:19.466587842 +0000 UTC m=+84.031791387" watchObservedRunningTime="2026-09-10 16:04:19.467556809 +0000 UTC m=+84.032760346" Sep 10 16:04:19.879611 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:04:19.879573 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-64969f7776-5mx24" Sep 10 16:04:19.883171 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:04:19.883145 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-64969f7776-5mx24" Sep 10 16:04:20.455221 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:04:20.455070 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-9rfn8" event={"ID":"e3e9b71b-d2dc-483e-a5fa-5a5054914933","Type":"ContainerStarted","Data":"13538a7d4a1ec91b71dfd2a99ff20564a15e7cbf1a5621c6a003ea67372431fc"} Sep 10 16:04:20.455752 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:04:20.455694 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-64969f7776-5mx24" Sep 10 16:04:20.458069 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:04:20.457320 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-64969f7776-5mx24" Sep 10 16:04:20.476825 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:04:20.476771 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-9rfn8" podStartSLOduration=33.669113742 podStartE2EDuration="35.476759114s" totalImagesPullingTime="1.807645372s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 16:03:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 16:04:20.476078454 +0000 UTC m=+85.041281999" watchObservedRunningTime="2026-09-10 16:04:20.476759114 +0000 UTC m=+85.041962728" Sep 10 16:04:23.460362 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:04:23.460323 2574 patch_prober.go:28] interesting pod/image-registry-565b4cb7c8-5dx8p container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Sep 10 16:04:23.460742 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:04:23.460380 2574 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-565b4cb7c8-5dx8p" podUID="79ab48bc-9994-4510-a3fa-6579e7dcf721" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Sep 10 16:04:32.417973 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:04:32.417937 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-lgqgv"] Sep 10 16:04:32.426576 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:04:32.426546 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-lgqgv" Sep 10 16:04:32.429649 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:04:32.429623 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-h8l7j\"" Sep 10 16:04:32.429924 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:04:32.429706 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Sep 10 16:04:32.430131 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:04:32.430116 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Sep 10 16:04:32.430573 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:04:32.430553 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Sep 10 16:04:32.430573 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:04:32.430569 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Sep 10 16:04:32.445658 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:04:32.445631 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3dcd2d32-6126-4ae9-bf52-e762874b2a05-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-lgqgv\" (UID: \"3dcd2d32-6126-4ae9-bf52-e762874b2a05\") " pod="openshift-monitoring/node-exporter-lgqgv" Sep 10 16:04:32.445794 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:04:32.445776 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/3dcd2d32-6126-4ae9-bf52-e762874b2a05-node-exporter-wtmp\") pod \"node-exporter-lgqgv\" (UID: \"3dcd2d32-6126-4ae9-bf52-e762874b2a05\") " pod="openshift-monitoring/node-exporter-lgqgv" Sep 10 16:04:32.445871 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:04:32.445818 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3dcd2d32-6126-4ae9-bf52-e762874b2a05-sys\") pod \"node-exporter-lgqgv\" (UID: \"3dcd2d32-6126-4ae9-bf52-e762874b2a05\") " pod="openshift-monitoring/node-exporter-lgqgv" Sep 10 16:04:32.445871 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:04:32.445861 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/3dcd2d32-6126-4ae9-bf52-e762874b2a05-node-exporter-tls\") pod \"node-exporter-lgqgv\" (UID: \"3dcd2d32-6126-4ae9-bf52-e762874b2a05\") " pod="openshift-monitoring/node-exporter-lgqgv" Sep 10 16:04:32.445985 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:04:32.445886 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3dcd2d32-6126-4ae9-bf52-e762874b2a05-metrics-client-ca\") pod \"node-exporter-lgqgv\" (UID: \"3dcd2d32-6126-4ae9-bf52-e762874b2a05\") " pod="openshift-monitoring/node-exporter-lgqgv" Sep 10 16:04:32.445985 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:04:32.445905 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k4f69\" (UniqueName: \"kubernetes.io/projected/3dcd2d32-6126-4ae9-bf52-e762874b2a05-kube-api-access-k4f69\") pod \"node-exporter-lgqgv\" (UID: \"3dcd2d32-6126-4ae9-bf52-e762874b2a05\") " pod="openshift-monitoring/node-exporter-lgqgv" Sep 10 16:04:32.445985 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:04:32.445927 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/3dcd2d32-6126-4ae9-bf52-e762874b2a05-node-exporter-accelerators-collector-config\") pod \"node-exporter-lgqgv\" (UID: \"3dcd2d32-6126-4ae9-bf52-e762874b2a05\") " pod="openshift-monitoring/node-exporter-lgqgv" Sep 10 16:04:32.446122 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:04:32.445998 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/3dcd2d32-6126-4ae9-bf52-e762874b2a05-root\") pod \"node-exporter-lgqgv\" (UID: \"3dcd2d32-6126-4ae9-bf52-e762874b2a05\") " pod="openshift-monitoring/node-exporter-lgqgv" Sep 10 16:04:32.446122 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:04:32.446042 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/3dcd2d32-6126-4ae9-bf52-e762874b2a05-node-exporter-textfile\") pod \"node-exporter-lgqgv\" (UID: \"3dcd2d32-6126-4ae9-bf52-e762874b2a05\") " pod="openshift-monitoring/node-exporter-lgqgv" Sep 10 16:04:32.547340 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:04:32.547299 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3dcd2d32-6126-4ae9-bf52-e762874b2a05-metrics-client-ca\") pod \"node-exporter-lgqgv\" (UID: \"3dcd2d32-6126-4ae9-bf52-e762874b2a05\") " pod="openshift-monitoring/node-exporter-lgqgv" Sep 10 16:04:32.547340 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:04:32.547340 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k4f69\" (UniqueName: \"kubernetes.io/projected/3dcd2d32-6126-4ae9-bf52-e762874b2a05-kube-api-access-k4f69\") pod \"node-exporter-lgqgv\" (UID: \"3dcd2d32-6126-4ae9-bf52-e762874b2a05\") " pod="openshift-monitoring/node-exporter-lgqgv" Sep 10 16:04:32.547577 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:04:32.547395 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/3dcd2d32-6126-4ae9-bf52-e762874b2a05-node-exporter-accelerators-collector-config\") pod \"node-exporter-lgqgv\" (UID: \"3dcd2d32-6126-4ae9-bf52-e762874b2a05\") " pod="openshift-monitoring/node-exporter-lgqgv" Sep 10 16:04:32.547577 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:04:32.547436 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/3dcd2d32-6126-4ae9-bf52-e762874b2a05-root\") pod \"node-exporter-lgqgv\" (UID: \"3dcd2d32-6126-4ae9-bf52-e762874b2a05\") " pod="openshift-monitoring/node-exporter-lgqgv" Sep 10 16:04:32.547577 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:04:32.547464 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/3dcd2d32-6126-4ae9-bf52-e762874b2a05-node-exporter-textfile\") pod \"node-exporter-lgqgv\" (UID: \"3dcd2d32-6126-4ae9-bf52-e762874b2a05\") " pod="openshift-monitoring/node-exporter-lgqgv" Sep 10 16:04:32.547577 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:04:32.547508 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3dcd2d32-6126-4ae9-bf52-e762874b2a05-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-lgqgv\" (UID: \"3dcd2d32-6126-4ae9-bf52-e762874b2a05\") " pod="openshift-monitoring/node-exporter-lgqgv" Sep 10 16:04:32.547577 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:04:32.547514 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/3dcd2d32-6126-4ae9-bf52-e762874b2a05-root\") pod \"node-exporter-lgqgv\" (UID: \"3dcd2d32-6126-4ae9-bf52-e762874b2a05\") " pod="openshift-monitoring/node-exporter-lgqgv" Sep 10 16:04:32.547838 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:04:32.547602 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/3dcd2d32-6126-4ae9-bf52-e762874b2a05-node-exporter-wtmp\") pod \"node-exporter-lgqgv\" (UID: \"3dcd2d32-6126-4ae9-bf52-e762874b2a05\") " pod="openshift-monitoring/node-exporter-lgqgv" Sep 10 16:04:32.547838 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:04:32.547641 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3dcd2d32-6126-4ae9-bf52-e762874b2a05-sys\") pod \"node-exporter-lgqgv\" (UID: \"3dcd2d32-6126-4ae9-bf52-e762874b2a05\") " pod="openshift-monitoring/node-exporter-lgqgv" Sep 10 16:04:32.547838 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:04:32.547685 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/3dcd2d32-6126-4ae9-bf52-e762874b2a05-node-exporter-tls\") pod \"node-exporter-lgqgv\" (UID: \"3dcd2d32-6126-4ae9-bf52-e762874b2a05\") " pod="openshift-monitoring/node-exporter-lgqgv" Sep 10 16:04:32.547838 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:04:32.547757 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/3dcd2d32-6126-4ae9-bf52-e762874b2a05-node-exporter-wtmp\") pod \"node-exporter-lgqgv\" (UID: \"3dcd2d32-6126-4ae9-bf52-e762874b2a05\") " pod="openshift-monitoring/node-exporter-lgqgv" Sep 10 16:04:32.547838 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:04:32.547790 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3dcd2d32-6126-4ae9-bf52-e762874b2a05-sys\") pod \"node-exporter-lgqgv\" (UID: \"3dcd2d32-6126-4ae9-bf52-e762874b2a05\") " pod="openshift-monitoring/node-exporter-lgqgv" Sep 10 16:04:32.547838 ip-10-0-135-53 kubenswrapper[2574]: E0910 16:04:32.547793 2574 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Sep 10 16:04:32.548136 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:04:32.547797 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/3dcd2d32-6126-4ae9-bf52-e762874b2a05-node-exporter-textfile\") pod \"node-exporter-lgqgv\" (UID: \"3dcd2d32-6126-4ae9-bf52-e762874b2a05\") " pod="openshift-monitoring/node-exporter-lgqgv" Sep 10 16:04:32.548136 ip-10-0-135-53 kubenswrapper[2574]: E0910 16:04:32.547874 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3dcd2d32-6126-4ae9-bf52-e762874b2a05-node-exporter-tls podName:3dcd2d32-6126-4ae9-bf52-e762874b2a05 nodeName:}" failed. No retries permitted until 2026-09-10 16:04:33.047852131 +0000 UTC m=+97.613055658 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/3dcd2d32-6126-4ae9-bf52-e762874b2a05-node-exporter-tls") pod "node-exporter-lgqgv" (UID: "3dcd2d32-6126-4ae9-bf52-e762874b2a05") : secret "node-exporter-tls" not found Sep 10 16:04:32.548136 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:04:32.547980 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3dcd2d32-6126-4ae9-bf52-e762874b2a05-metrics-client-ca\") pod \"node-exporter-lgqgv\" (UID: \"3dcd2d32-6126-4ae9-bf52-e762874b2a05\") " pod="openshift-monitoring/node-exporter-lgqgv" Sep 10 16:04:32.548136 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:04:32.548110 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/3dcd2d32-6126-4ae9-bf52-e762874b2a05-node-exporter-accelerators-collector-config\") pod \"node-exporter-lgqgv\" (UID: \"3dcd2d32-6126-4ae9-bf52-e762874b2a05\") " pod="openshift-monitoring/node-exporter-lgqgv" Sep 10 16:04:32.550182 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:04:32.550161 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3dcd2d32-6126-4ae9-bf52-e762874b2a05-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-lgqgv\" (UID: \"3dcd2d32-6126-4ae9-bf52-e762874b2a05\") " pod="openshift-monitoring/node-exporter-lgqgv" Sep 10 16:04:32.560545 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:04:32.560522 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k4f69\" (UniqueName: \"kubernetes.io/projected/3dcd2d32-6126-4ae9-bf52-e762874b2a05-kube-api-access-k4f69\") pod \"node-exporter-lgqgv\" (UID: \"3dcd2d32-6126-4ae9-bf52-e762874b2a05\") " pod="openshift-monitoring/node-exporter-lgqgv" Sep 10 16:04:33.051503 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:04:33.051462 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/3dcd2d32-6126-4ae9-bf52-e762874b2a05-node-exporter-tls\") pod \"node-exporter-lgqgv\" (UID: \"3dcd2d32-6126-4ae9-bf52-e762874b2a05\") " pod="openshift-monitoring/node-exporter-lgqgv" Sep 10 16:04:33.053755 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:04:33.053727 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/3dcd2d32-6126-4ae9-bf52-e762874b2a05-node-exporter-tls\") pod \"node-exporter-lgqgv\" (UID: \"3dcd2d32-6126-4ae9-bf52-e762874b2a05\") " pod="openshift-monitoring/node-exporter-lgqgv" Sep 10 16:04:33.338676 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:04:33.338452 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-lgqgv" Sep 10 16:04:33.353189 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:04:33.353158 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3dcd2d32_6126_4ae9_bf52_e762874b2a05.slice/crio-be7f7f79d60439c91ee7157a48fb1702fa8b2a46cf9bf1165f73ece06281e4b6 WatchSource:0}: Error finding container be7f7f79d60439c91ee7157a48fb1702fa8b2a46cf9bf1165f73ece06281e4b6: Status 404 returned error can't find the container with id be7f7f79d60439c91ee7157a48fb1702fa8b2a46cf9bf1165f73ece06281e4b6 Sep 10 16:04:33.354087 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:04:33.354046 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-vpl4s" Sep 10 16:04:33.463224 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:04:33.463139 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-565b4cb7c8-5dx8p" Sep 10 16:04:33.514386 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:04:33.514344 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-85d98c998f-kj4z4" event={"ID":"97b740c1-94b8-45e8-8f20-41b915f7f2d8","Type":"ContainerStarted","Data":"6035140e4cdee323026332e2f0e2a58b10cc9394de68953da9288a7a93db10b7"} Sep 10 16:04:33.515314 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:04:33.515216 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-85d98c998f-kj4z4" Sep 10 16:04:33.517335 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:04:33.517238 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-lgqgv" event={"ID":"3dcd2d32-6126-4ae9-bf52-e762874b2a05","Type":"ContainerStarted","Data":"be7f7f79d60439c91ee7157a48fb1702fa8b2a46cf9bf1165f73ece06281e4b6"} Sep 10 16:04:33.526425 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:04:33.526381 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-85d98c998f-kj4z4" Sep 10 16:04:33.532886 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:04:33.532798 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-85d98c998f-kj4z4" podStartSLOduration=3.034523902 podStartE2EDuration="20.532778196s" totalImagesPullingTime="17.498254294s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 16:04:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 16:04:33.531285416 +0000 UTC m=+98.096488952" watchObservedRunningTime="2026-09-10 16:04:33.532778196 +0000 UTC m=+98.097981752" Sep 10 16:04:35.427014 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:04:35.426926 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-dd4774968-lbkkv" Sep 10 16:04:36.532369 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:04:36.532326 2574 generic.go:356] "Generic (PLEG): container finished" podID="3dcd2d32-6126-4ae9-bf52-e762874b2a05" containerID="662fadd7e99b40389626b506022aaf838a14a3d1097104afe637dacb68d279f4" exitCode=0 Sep 10 16:04:36.532802 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:04:36.532419 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-lgqgv" event={"ID":"3dcd2d32-6126-4ae9-bf52-e762874b2a05","Type":"ContainerDied","Data":"662fadd7e99b40389626b506022aaf838a14a3d1097104afe637dacb68d279f4"} Sep 10 16:04:37.540466 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:04:37.540427 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-lgqgv" event={"ID":"3dcd2d32-6126-4ae9-bf52-e762874b2a05","Type":"ContainerStarted","Data":"adef2fda3a556042e1f8db429e9bee6b4d5c452dc07a6a813ac967ea850e93c3"} Sep 10 16:04:37.540896 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:04:37.540493 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-lgqgv" event={"ID":"3dcd2d32-6126-4ae9-bf52-e762874b2a05","Type":"ContainerStarted","Data":"224e928a2cd64096b0d60801e44048acd9a488d958570c0736cf13ceea036cf9"} Sep 10 16:04:37.576578 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:04:37.576504 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-lgqgv" podStartSLOduration=2.58287689 podStartE2EDuration="5.576485395s" totalImagesPullingTime="2.905117116s" totalInitContainerRuntime="88.491389ms" isStatefulPod=true podCreationTimestamp="2026-09-10 16:04:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 16:04:37.575342924 +0000 UTC m=+102.140546471" watchObservedRunningTime="2026-09-10 16:04:37.576485395 +0000 UTC m=+102.141688939" Sep 10 16:04:38.473453 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:04:38.473387 2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-565b4cb7c8-5dx8p" podUID="79ab48bc-9994-4510-a3fa-6579e7dcf721" containerName="registry" containerID="cri-o://47d2b0700bf3292ae89e1d0f3c495f87ab283cccd3d3fde8e67ab9e4b447fb89" gracePeriod=30 Sep 10 16:04:38.776471 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:04:38.776438 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-565b4cb7c8-5dx8p" Sep 10 16:04:38.802303 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:04:38.802247 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jqdh5\" (UniqueName: \"kubernetes.io/projected/79ab48bc-9994-4510-a3fa-6579e7dcf721-kube-api-access-jqdh5\") pod \"79ab48bc-9994-4510-a3fa-6579e7dcf721\" (UID: \"79ab48bc-9994-4510-a3fa-6579e7dcf721\") " Sep 10 16:04:38.802473 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:04:38.802332 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/79ab48bc-9994-4510-a3fa-6579e7dcf721-trusted-ca\") pod \"79ab48bc-9994-4510-a3fa-6579e7dcf721\" (UID: \"79ab48bc-9994-4510-a3fa-6579e7dcf721\") " Sep 10 16:04:38.802473 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:04:38.802394 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/79ab48bc-9994-4510-a3fa-6579e7dcf721-bound-sa-token\") pod \"79ab48bc-9994-4510-a3fa-6579e7dcf721\" (UID: \"79ab48bc-9994-4510-a3fa-6579e7dcf721\") " Sep 10 16:04:38.802473 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:04:38.802431 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/79ab48bc-9994-4510-a3fa-6579e7dcf721-image-registry-private-configuration\") pod \"79ab48bc-9994-4510-a3fa-6579e7dcf721\" (UID: \"79ab48bc-9994-4510-a3fa-6579e7dcf721\") " Sep 10 16:04:38.802641 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:04:38.802473 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/79ab48bc-9994-4510-a3fa-6579e7dcf721-registry-tls\") pod \"79ab48bc-9994-4510-a3fa-6579e7dcf721\" (UID: \"79ab48bc-9994-4510-a3fa-6579e7dcf721\") " Sep 10 16:04:38.802641 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:04:38.802505 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/79ab48bc-9994-4510-a3fa-6579e7dcf721-registry-certificates\") pod \"79ab48bc-9994-4510-a3fa-6579e7dcf721\" (UID: \"79ab48bc-9994-4510-a3fa-6579e7dcf721\") " Sep 10 16:04:38.802641 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:04:38.802534 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/79ab48bc-9994-4510-a3fa-6579e7dcf721-installation-pull-secrets\") pod \"79ab48bc-9994-4510-a3fa-6579e7dcf721\" (UID: \"79ab48bc-9994-4510-a3fa-6579e7dcf721\") " Sep 10 16:04:38.802641 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:04:38.802564 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/79ab48bc-9994-4510-a3fa-6579e7dcf721-ca-trust-extracted\") pod \"79ab48bc-9994-4510-a3fa-6579e7dcf721\" (UID: \"79ab48bc-9994-4510-a3fa-6579e7dcf721\") " Sep 10 16:04:38.802829 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:04:38.802758 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/79ab48bc-9994-4510-a3fa-6579e7dcf721-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "79ab48bc-9994-4510-a3fa-6579e7dcf721" (UID: "79ab48bc-9994-4510-a3fa-6579e7dcf721"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 10 16:04:38.807595 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:04:38.807543 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/79ab48bc-9994-4510-a3fa-6579e7dcf721-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "79ab48bc-9994-4510-a3fa-6579e7dcf721" (UID: "79ab48bc-9994-4510-a3fa-6579e7dcf721"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 10 16:04:38.809872 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:04:38.809838 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/79ab48bc-9994-4510-a3fa-6579e7dcf721-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "79ab48bc-9994-4510-a3fa-6579e7dcf721" (UID: "79ab48bc-9994-4510-a3fa-6579e7dcf721"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 10 16:04:38.810020 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:04:38.809992 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/79ab48bc-9994-4510-a3fa-6579e7dcf721-kube-api-access-jqdh5" (OuterVolumeSpecName: "kube-api-access-jqdh5") pod "79ab48bc-9994-4510-a3fa-6579e7dcf721" (UID: "79ab48bc-9994-4510-a3fa-6579e7dcf721"). InnerVolumeSpecName "kube-api-access-jqdh5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 16:04:38.810090 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:04:38.810039 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/79ab48bc-9994-4510-a3fa-6579e7dcf721-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "79ab48bc-9994-4510-a3fa-6579e7dcf721" (UID: "79ab48bc-9994-4510-a3fa-6579e7dcf721"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 16:04:38.810234 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:04:38.810176 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/79ab48bc-9994-4510-a3fa-6579e7dcf721-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "79ab48bc-9994-4510-a3fa-6579e7dcf721" (UID: "79ab48bc-9994-4510-a3fa-6579e7dcf721"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 16:04:38.811258 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:04:38.811227 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/79ab48bc-9994-4510-a3fa-6579e7dcf721-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "79ab48bc-9994-4510-a3fa-6579e7dcf721" (UID: "79ab48bc-9994-4510-a3fa-6579e7dcf721"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 10 16:04:38.819032 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:04:38.818995 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/79ab48bc-9994-4510-a3fa-6579e7dcf721-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "79ab48bc-9994-4510-a3fa-6579e7dcf721" (UID: "79ab48bc-9994-4510-a3fa-6579e7dcf721"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 10 16:04:38.903532 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:04:38.903492 2574 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/79ab48bc-9994-4510-a3fa-6579e7dcf721-bound-sa-token\") on node \"ip-10-0-135-53.ec2.internal\" DevicePath \"\"" Sep 10 16:04:38.903532 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:04:38.903527 2574 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/79ab48bc-9994-4510-a3fa-6579e7dcf721-image-registry-private-configuration\") on node \"ip-10-0-135-53.ec2.internal\" DevicePath \"\"" Sep 10 16:04:38.903532 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:04:38.903538 2574 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/79ab48bc-9994-4510-a3fa-6579e7dcf721-registry-tls\") on node \"ip-10-0-135-53.ec2.internal\" DevicePath \"\"" Sep 10 16:04:38.903764 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:04:38.903553 2574 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/79ab48bc-9994-4510-a3fa-6579e7dcf721-registry-certificates\") on node \"ip-10-0-135-53.ec2.internal\" DevicePath \"\"" Sep 10 16:04:38.903764 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:04:38.903568 2574 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/79ab48bc-9994-4510-a3fa-6579e7dcf721-installation-pull-secrets\") on node \"ip-10-0-135-53.ec2.internal\" DevicePath \"\"" Sep 10 16:04:38.903764 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:04:38.903581 2574 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/79ab48bc-9994-4510-a3fa-6579e7dcf721-ca-trust-extracted\") on node \"ip-10-0-135-53.ec2.internal\" DevicePath \"\"" Sep 10 16:04:38.903764 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:04:38.903593 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jqdh5\" (UniqueName: \"kubernetes.io/projected/79ab48bc-9994-4510-a3fa-6579e7dcf721-kube-api-access-jqdh5\") on node \"ip-10-0-135-53.ec2.internal\" DevicePath \"\"" Sep 10 16:04:38.903764 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:04:38.903606 2574 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/79ab48bc-9994-4510-a3fa-6579e7dcf721-trusted-ca\") on node \"ip-10-0-135-53.ec2.internal\" DevicePath \"\"" Sep 10 16:04:39.550495 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:04:39.550450 2574 generic.go:356] "Generic (PLEG): container finished" podID="79ab48bc-9994-4510-a3fa-6579e7dcf721" containerID="47d2b0700bf3292ae89e1d0f3c495f87ab283cccd3d3fde8e67ab9e4b447fb89" exitCode=0 Sep 10 16:04:39.550780 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:04:39.550499 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-565b4cb7c8-5dx8p" Sep 10 16:04:39.550780 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:04:39.550536 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-565b4cb7c8-5dx8p" event={"ID":"79ab48bc-9994-4510-a3fa-6579e7dcf721","Type":"ContainerDied","Data":"47d2b0700bf3292ae89e1d0f3c495f87ab283cccd3d3fde8e67ab9e4b447fb89"} Sep 10 16:04:39.550780 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:04:39.550596 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-565b4cb7c8-5dx8p" event={"ID":"79ab48bc-9994-4510-a3fa-6579e7dcf721","Type":"ContainerDied","Data":"373f42f84df6ddca5e3f15ecb4c94ddd18799611ce36412a9c85dfc2fc8231d8"} Sep 10 16:04:39.550780 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:04:39.550629 2574 scope.go:117] "RemoveContainer" containerID="47d2b0700bf3292ae89e1d0f3c495f87ab283cccd3d3fde8e67ab9e4b447fb89" Sep 10 16:04:39.560719 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:04:39.560572 2574 scope.go:117] "RemoveContainer" containerID="47d2b0700bf3292ae89e1d0f3c495f87ab283cccd3d3fde8e67ab9e4b447fb89" Sep 10 16:04:39.560994 ip-10-0-135-53 kubenswrapper[2574]: E0910 16:04:39.560964 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"47d2b0700bf3292ae89e1d0f3c495f87ab283cccd3d3fde8e67ab9e4b447fb89\": container with ID starting with 47d2b0700bf3292ae89e1d0f3c495f87ab283cccd3d3fde8e67ab9e4b447fb89 not found: ID does not exist" containerID="47d2b0700bf3292ae89e1d0f3c495f87ab283cccd3d3fde8e67ab9e4b447fb89" Sep 10 16:04:39.561078 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:04:39.561000 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"47d2b0700bf3292ae89e1d0f3c495f87ab283cccd3d3fde8e67ab9e4b447fb89"} err="failed to get container status \"47d2b0700bf3292ae89e1d0f3c495f87ab283cccd3d3fde8e67ab9e4b447fb89\": rpc error: code = NotFound desc = could not find container \"47d2b0700bf3292ae89e1d0f3c495f87ab283cccd3d3fde8e67ab9e4b447fb89\": container with ID starting with 47d2b0700bf3292ae89e1d0f3c495f87ab283cccd3d3fde8e67ab9e4b447fb89 not found: ID does not exist" Sep 10 16:04:39.575890 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:04:39.575854 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-565b4cb7c8-5dx8p"] Sep 10 16:04:39.578857 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:04:39.578827 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-565b4cb7c8-5dx8p"] Sep 10 16:04:40.080417 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:04:40.080378 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="79ab48bc-9994-4510-a3fa-6579e7dcf721" path="/var/lib/kubelet/pods/79ab48bc-9994-4510-a3fa-6579e7dcf721/volumes" Sep 10 16:05:05.826313 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:05:05.826251 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cc55b4de-3d22-4d24-bf28-d018afb0e4bc-metrics-certs\") pod \"network-metrics-daemon-ct85s\" (UID: \"cc55b4de-3d22-4d24-bf28-d018afb0e4bc\") " pod="openshift-multus/network-metrics-daemon-ct85s" Sep 10 16:05:05.828538 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:05:05.828518 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cc55b4de-3d22-4d24-bf28-d018afb0e4bc-metrics-certs\") pod \"network-metrics-daemon-ct85s\" (UID: \"cc55b4de-3d22-4d24-bf28-d018afb0e4bc\") " pod="openshift-multus/network-metrics-daemon-ct85s" Sep 10 16:05:06.093294 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:05:06.093195 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-wstvg\"" Sep 10 16:05:06.101342 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:05:06.101321 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ct85s" Sep 10 16:05:06.401132 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:05:06.401055 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-ct85s"] Sep 10 16:05:06.403889 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:05:06.403854 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcc55b4de_3d22_4d24_bf28_d018afb0e4bc.slice/crio-5c987f575e2327abf1883e95a57e567cb59f9277ae0c1462b55792e403cd4a77 WatchSource:0}: Error finding container 5c987f575e2327abf1883e95a57e567cb59f9277ae0c1462b55792e403cd4a77: Status 404 returned error can't find the container with id 5c987f575e2327abf1883e95a57e567cb59f9277ae0c1462b55792e403cd4a77 Sep 10 16:05:06.648891 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:05:06.648853 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-ct85s" event={"ID":"cc55b4de-3d22-4d24-bf28-d018afb0e4bc","Type":"ContainerStarted","Data":"5c987f575e2327abf1883e95a57e567cb59f9277ae0c1462b55792e403cd4a77"} Sep 10 16:05:08.657435 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:05:08.657347 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-ct85s" event={"ID":"cc55b4de-3d22-4d24-bf28-d018afb0e4bc","Type":"ContainerStarted","Data":"6a98eaa726899b6e2042c693b0df2145fe5995358f7e3df063215bfd75eb46af"} Sep 10 16:05:08.657435 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:05:08.657405 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-ct85s" event={"ID":"cc55b4de-3d22-4d24-bf28-d018afb0e4bc","Type":"ContainerStarted","Data":"2ec0916d77b456618084adf1fc13efbaa170f3a511069b00efdd87056d7374a8"} Sep 10 16:05:08.672835 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:05:08.672785 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-ct85s" podStartSLOduration=131.013932177 podStartE2EDuration="2m12.672770222s" totalImagesPullingTime="1.658838045s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 16:02:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 16:05:08.672047782 +0000 UTC m=+133.237251342" watchObservedRunningTime="2026-09-10 16:05:08.672770222 +0000 UTC m=+133.237973811" Sep 10 16:07:12.797294 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:07:12.797247 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540rcg6f"] Sep 10 16:07:12.797753 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:07:12.797520 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="79ab48bc-9994-4510-a3fa-6579e7dcf721" containerName="registry" Sep 10 16:07:12.797753 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:07:12.797533 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="79ab48bc-9994-4510-a3fa-6579e7dcf721" containerName="registry" Sep 10 16:07:12.797753 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:07:12.797580 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="79ab48bc-9994-4510-a3fa-6579e7dcf721" containerName="registry" Sep 10 16:07:12.800493 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:07:12.800475 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540rcg6f" Sep 10 16:07:12.803176 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:07:12.803137 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Sep 10 16:07:12.804156 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:07:12.804141 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-fn6b2\"" Sep 10 16:07:12.804247 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:07:12.804178 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Sep 10 16:07:12.810088 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:07:12.810065 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540rcg6f"] Sep 10 16:07:12.877744 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:07:12.877713 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f2dcf220-8ab1-4139-bb7b-a74594bb0477-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540rcg6f\" (UID: \"f2dcf220-8ab1-4139-bb7b-a74594bb0477\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540rcg6f" Sep 10 16:07:12.877910 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:07:12.877756 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f2dcf220-8ab1-4139-bb7b-a74594bb0477-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540rcg6f\" (UID: \"f2dcf220-8ab1-4139-bb7b-a74594bb0477\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540rcg6f" Sep 10 16:07:12.877910 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:07:12.877785 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lxlhg\" (UniqueName: \"kubernetes.io/projected/f2dcf220-8ab1-4139-bb7b-a74594bb0477-kube-api-access-lxlhg\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540rcg6f\" (UID: \"f2dcf220-8ab1-4139-bb7b-a74594bb0477\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540rcg6f" Sep 10 16:07:12.978831 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:07:12.978800 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f2dcf220-8ab1-4139-bb7b-a74594bb0477-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540rcg6f\" (UID: \"f2dcf220-8ab1-4139-bb7b-a74594bb0477\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540rcg6f" Sep 10 16:07:12.979021 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:07:12.978836 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lxlhg\" (UniqueName: \"kubernetes.io/projected/f2dcf220-8ab1-4139-bb7b-a74594bb0477-kube-api-access-lxlhg\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540rcg6f\" (UID: \"f2dcf220-8ab1-4139-bb7b-a74594bb0477\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540rcg6f" Sep 10 16:07:12.979021 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:07:12.978901 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f2dcf220-8ab1-4139-bb7b-a74594bb0477-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540rcg6f\" (UID: \"f2dcf220-8ab1-4139-bb7b-a74594bb0477\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540rcg6f" Sep 10 16:07:12.979287 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:07:12.979238 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f2dcf220-8ab1-4139-bb7b-a74594bb0477-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540rcg6f\" (UID: \"f2dcf220-8ab1-4139-bb7b-a74594bb0477\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540rcg6f" Sep 10 16:07:12.979363 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:07:12.979251 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f2dcf220-8ab1-4139-bb7b-a74594bb0477-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540rcg6f\" (UID: \"f2dcf220-8ab1-4139-bb7b-a74594bb0477\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540rcg6f" Sep 10 16:07:12.987916 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:07:12.987892 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lxlhg\" (UniqueName: \"kubernetes.io/projected/f2dcf220-8ab1-4139-bb7b-a74594bb0477-kube-api-access-lxlhg\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540rcg6f\" (UID: \"f2dcf220-8ab1-4139-bb7b-a74594bb0477\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540rcg6f" Sep 10 16:07:13.109039 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:07:13.108952 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540rcg6f" Sep 10 16:07:13.377002 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:07:13.376980 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540rcg6f"] Sep 10 16:07:13.378963 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:07:13.378937 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf2dcf220_8ab1_4139_bb7b_a74594bb0477.slice/crio-cf0e42fc39c79204a6e81eb406937ccaa3a6006452f5602f888f4a5a10dbbb28 WatchSource:0}: Error finding container cf0e42fc39c79204a6e81eb406937ccaa3a6006452f5602f888f4a5a10dbbb28: Status 404 returned error can't find the container with id cf0e42fc39c79204a6e81eb406937ccaa3a6006452f5602f888f4a5a10dbbb28 Sep 10 16:07:14.097337 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:07:14.097294 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540rcg6f" event={"ID":"f2dcf220-8ab1-4139-bb7b-a74594bb0477","Type":"ContainerStarted","Data":"cf0e42fc39c79204a6e81eb406937ccaa3a6006452f5602f888f4a5a10dbbb28"} Sep 10 16:07:19.119441 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:07:19.119343 2574 generic.go:356] "Generic (PLEG): container finished" podID="f2dcf220-8ab1-4139-bb7b-a74594bb0477" containerID="3b91ac3f1da36c66cf6a23add8187f2400f66da2b20ffad9003064476b46e057" exitCode=0 Sep 10 16:07:19.119860 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:07:19.119440 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540rcg6f" event={"ID":"f2dcf220-8ab1-4139-bb7b-a74594bb0477","Type":"ContainerDied","Data":"3b91ac3f1da36c66cf6a23add8187f2400f66da2b20ffad9003064476b46e057"} Sep 10 16:07:22.131763 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:07:22.131721 2574 generic.go:356] "Generic (PLEG): container finished" podID="f2dcf220-8ab1-4139-bb7b-a74594bb0477" containerID="237d7d16a50272d9b19b30f046bba95befcc3add7c27f8e6538f1520cf9b6b0f" exitCode=0 Sep 10 16:07:22.132135 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:07:22.131779 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540rcg6f" event={"ID":"f2dcf220-8ab1-4139-bb7b-a74594bb0477","Type":"ContainerDied","Data":"237d7d16a50272d9b19b30f046bba95befcc3add7c27f8e6538f1520cf9b6b0f"} Sep 10 16:07:30.166495 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:07:30.166463 2574 generic.go:356] "Generic (PLEG): container finished" podID="f2dcf220-8ab1-4139-bb7b-a74594bb0477" containerID="d15e71dd298f4a965a02d38616a88e05cbb4e9204aa8eb51a7b11a4c50f270af" exitCode=0 Sep 10 16:07:30.166844 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:07:30.166509 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540rcg6f" event={"ID":"f2dcf220-8ab1-4139-bb7b-a74594bb0477","Type":"ContainerDied","Data":"d15e71dd298f4a965a02d38616a88e05cbb4e9204aa8eb51a7b11a4c50f270af"} Sep 10 16:07:31.289202 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:07:31.289175 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540rcg6f" Sep 10 16:07:31.438730 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:07:31.438643 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f2dcf220-8ab1-4139-bb7b-a74594bb0477-util\") pod \"f2dcf220-8ab1-4139-bb7b-a74594bb0477\" (UID: \"f2dcf220-8ab1-4139-bb7b-a74594bb0477\") " Sep 10 16:07:31.438730 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:07:31.438697 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lxlhg\" (UniqueName: \"kubernetes.io/projected/f2dcf220-8ab1-4139-bb7b-a74594bb0477-kube-api-access-lxlhg\") pod \"f2dcf220-8ab1-4139-bb7b-a74594bb0477\" (UID: \"f2dcf220-8ab1-4139-bb7b-a74594bb0477\") " Sep 10 16:07:31.438960 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:07:31.438761 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f2dcf220-8ab1-4139-bb7b-a74594bb0477-bundle\") pod \"f2dcf220-8ab1-4139-bb7b-a74594bb0477\" (UID: \"f2dcf220-8ab1-4139-bb7b-a74594bb0477\") " Sep 10 16:07:31.439406 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:07:31.439382 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f2dcf220-8ab1-4139-bb7b-a74594bb0477-bundle" (OuterVolumeSpecName: "bundle") pod "f2dcf220-8ab1-4139-bb7b-a74594bb0477" (UID: "f2dcf220-8ab1-4139-bb7b-a74594bb0477"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 10 16:07:31.440952 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:07:31.440922 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f2dcf220-8ab1-4139-bb7b-a74594bb0477-kube-api-access-lxlhg" (OuterVolumeSpecName: "kube-api-access-lxlhg") pod "f2dcf220-8ab1-4139-bb7b-a74594bb0477" (UID: "f2dcf220-8ab1-4139-bb7b-a74594bb0477"). InnerVolumeSpecName "kube-api-access-lxlhg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 16:07:31.442829 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:07:31.442805 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f2dcf220-8ab1-4139-bb7b-a74594bb0477-util" (OuterVolumeSpecName: "util") pod "f2dcf220-8ab1-4139-bb7b-a74594bb0477" (UID: "f2dcf220-8ab1-4139-bb7b-a74594bb0477"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 10 16:07:31.540077 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:07:31.540046 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lxlhg\" (UniqueName: \"kubernetes.io/projected/f2dcf220-8ab1-4139-bb7b-a74594bb0477-kube-api-access-lxlhg\") on node \"ip-10-0-135-53.ec2.internal\" DevicePath \"\"" Sep 10 16:07:31.540077 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:07:31.540072 2574 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f2dcf220-8ab1-4139-bb7b-a74594bb0477-bundle\") on node \"ip-10-0-135-53.ec2.internal\" DevicePath \"\"" Sep 10 16:07:31.540077 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:07:31.540081 2574 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f2dcf220-8ab1-4139-bb7b-a74594bb0477-util\") on node \"ip-10-0-135-53.ec2.internal\" DevicePath \"\"" Sep 10 16:07:32.174580 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:07:32.174551 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540rcg6f" Sep 10 16:07:32.174729 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:07:32.174555 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540rcg6f" event={"ID":"f2dcf220-8ab1-4139-bb7b-a74594bb0477","Type":"ContainerDied","Data":"cf0e42fc39c79204a6e81eb406937ccaa3a6006452f5602f888f4a5a10dbbb28"} Sep 10 16:07:32.174729 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:07:32.174669 2574 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="cf0e42fc39c79204a6e81eb406937ccaa3a6006452f5602f888f4a5a10dbbb28" Sep 10 16:07:35.814954 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:07:35.814916 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-chnk4"] Sep 10 16:07:35.815335 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:07:35.815202 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f2dcf220-8ab1-4139-bb7b-a74594bb0477" containerName="util" Sep 10 16:07:35.815335 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:07:35.815214 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="f2dcf220-8ab1-4139-bb7b-a74594bb0477" containerName="util" Sep 10 16:07:35.815335 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:07:35.815221 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f2dcf220-8ab1-4139-bb7b-a74594bb0477" containerName="extract" Sep 10 16:07:35.815335 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:07:35.815227 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="f2dcf220-8ab1-4139-bb7b-a74594bb0477" containerName="extract" Sep 10 16:07:35.815335 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:07:35.815241 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f2dcf220-8ab1-4139-bb7b-a74594bb0477" containerName="pull" Sep 10 16:07:35.815335 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:07:35.815248 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="f2dcf220-8ab1-4139-bb7b-a74594bb0477" containerName="pull" Sep 10 16:07:35.815335 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:07:35.815304 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="f2dcf220-8ab1-4139-bb7b-a74594bb0477" containerName="extract" Sep 10 16:07:35.818768 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:07:35.818752 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-chnk4" Sep 10 16:07:35.821436 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:07:35.821417 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-7v492\"" Sep 10 16:07:35.821714 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:07:35.821698 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Sep 10 16:07:35.821746 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:07:35.821715 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Sep 10 16:07:35.831395 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:07:35.831362 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-chnk4"] Sep 10 16:07:35.974594 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:07:35.974557 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2km86\" (UniqueName: \"kubernetes.io/projected/aea05ce0-4493-4a7c-a37b-9eb6cc43a8a0-kube-api-access-2km86\") pod \"cert-manager-operator-controller-manager-55c444bf86-chnk4\" (UID: \"aea05ce0-4493-4a7c-a37b-9eb6cc43a8a0\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-chnk4" Sep 10 16:07:35.974594 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:07:35.974597 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/aea05ce0-4493-4a7c-a37b-9eb6cc43a8a0-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-chnk4\" (UID: \"aea05ce0-4493-4a7c-a37b-9eb6cc43a8a0\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-chnk4" Sep 10 16:07:36.075474 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:07:36.075371 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2km86\" (UniqueName: \"kubernetes.io/projected/aea05ce0-4493-4a7c-a37b-9eb6cc43a8a0-kube-api-access-2km86\") pod \"cert-manager-operator-controller-manager-55c444bf86-chnk4\" (UID: \"aea05ce0-4493-4a7c-a37b-9eb6cc43a8a0\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-chnk4" Sep 10 16:07:36.075474 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:07:36.075424 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/aea05ce0-4493-4a7c-a37b-9eb6cc43a8a0-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-chnk4\" (UID: \"aea05ce0-4493-4a7c-a37b-9eb6cc43a8a0\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-chnk4" Sep 10 16:07:36.075832 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:07:36.075810 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/aea05ce0-4493-4a7c-a37b-9eb6cc43a8a0-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-chnk4\" (UID: \"aea05ce0-4493-4a7c-a37b-9eb6cc43a8a0\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-chnk4" Sep 10 16:07:36.084159 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:07:36.084129 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2km86\" (UniqueName: \"kubernetes.io/projected/aea05ce0-4493-4a7c-a37b-9eb6cc43a8a0-kube-api-access-2km86\") pod \"cert-manager-operator-controller-manager-55c444bf86-chnk4\" (UID: \"aea05ce0-4493-4a7c-a37b-9eb6cc43a8a0\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-chnk4" Sep 10 16:07:36.127679 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:07:36.127648 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-chnk4" Sep 10 16:07:36.404645 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:07:36.404617 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-chnk4"] Sep 10 16:07:36.406476 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:07:36.406444 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaea05ce0_4493_4a7c_a37b_9eb6cc43a8a0.slice/crio-6daf1af89ad4faa7c13f85a205eb419b2f11b04f16b77cefe13687a6180fa5d8 WatchSource:0}: Error finding container 6daf1af89ad4faa7c13f85a205eb419b2f11b04f16b77cefe13687a6180fa5d8: Status 404 returned error can't find the container with id 6daf1af89ad4faa7c13f85a205eb419b2f11b04f16b77cefe13687a6180fa5d8 Sep 10 16:07:37.196515 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:07:37.196472 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-chnk4" event={"ID":"aea05ce0-4493-4a7c-a37b-9eb6cc43a8a0","Type":"ContainerStarted","Data":"6daf1af89ad4faa7c13f85a205eb419b2f11b04f16b77cefe13687a6180fa5d8"} Sep 10 16:07:38.201728 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:07:38.201690 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-chnk4" event={"ID":"aea05ce0-4493-4a7c-a37b-9eb6cc43a8a0","Type":"ContainerStarted","Data":"6dd0e971071d8de98e2d4528f9bd9b164c0282cf0ba8e1e0f076477c61543cb3"} Sep 10 16:07:38.251729 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:07:38.251675 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-chnk4" podStartSLOduration=1.5815428219999998 podStartE2EDuration="3.251656711s" totalImagesPullingTime="1.670113889s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 16:07:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 16:07:38.243460014 +0000 UTC m=+282.808663569" watchObservedRunningTime="2026-09-10 16:07:38.251656711 +0000 UTC m=+282.816860252" Sep 10 16:07:39.465619 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:07:39.465587 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fd48qp"] Sep 10 16:07:39.469197 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:07:39.469178 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fd48qp" Sep 10 16:07:39.471822 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:07:39.471791 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Sep 10 16:07:39.472966 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:07:39.472947 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Sep 10 16:07:39.473051 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:07:39.473033 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-fn6b2\"" Sep 10 16:07:39.478717 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:07:39.478699 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fd48qp"] Sep 10 16:07:39.604603 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:07:39.604567 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/372f8c1c-6af8-43ae-8b18-11496bb93645-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fd48qp\" (UID: \"372f8c1c-6af8-43ae-8b18-11496bb93645\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fd48qp" Sep 10 16:07:39.604779 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:07:39.604621 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2hzlc\" (UniqueName: \"kubernetes.io/projected/372f8c1c-6af8-43ae-8b18-11496bb93645-kube-api-access-2hzlc\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fd48qp\" (UID: \"372f8c1c-6af8-43ae-8b18-11496bb93645\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fd48qp" Sep 10 16:07:39.604779 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:07:39.604654 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/372f8c1c-6af8-43ae-8b18-11496bb93645-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fd48qp\" (UID: \"372f8c1c-6af8-43ae-8b18-11496bb93645\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fd48qp" Sep 10 16:07:39.705576 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:07:39.705534 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2hzlc\" (UniqueName: \"kubernetes.io/projected/372f8c1c-6af8-43ae-8b18-11496bb93645-kube-api-access-2hzlc\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fd48qp\" (UID: \"372f8c1c-6af8-43ae-8b18-11496bb93645\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fd48qp" Sep 10 16:07:39.705576 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:07:39.705580 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/372f8c1c-6af8-43ae-8b18-11496bb93645-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fd48qp\" (UID: \"372f8c1c-6af8-43ae-8b18-11496bb93645\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fd48qp" Sep 10 16:07:39.705819 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:07:39.705649 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/372f8c1c-6af8-43ae-8b18-11496bb93645-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fd48qp\" (UID: \"372f8c1c-6af8-43ae-8b18-11496bb93645\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fd48qp" Sep 10 16:07:39.706038 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:07:39.706012 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/372f8c1c-6af8-43ae-8b18-11496bb93645-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fd48qp\" (UID: \"372f8c1c-6af8-43ae-8b18-11496bb93645\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fd48qp" Sep 10 16:07:39.706113 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:07:39.706039 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/372f8c1c-6af8-43ae-8b18-11496bb93645-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fd48qp\" (UID: \"372f8c1c-6af8-43ae-8b18-11496bb93645\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fd48qp" Sep 10 16:07:39.718659 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:07:39.718596 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2hzlc\" (UniqueName: \"kubernetes.io/projected/372f8c1c-6af8-43ae-8b18-11496bb93645-kube-api-access-2hzlc\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fd48qp\" (UID: \"372f8c1c-6af8-43ae-8b18-11496bb93645\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fd48qp" Sep 10 16:07:39.777714 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:07:39.777675 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fd48qp" Sep 10 16:07:40.046315 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:07:40.046287 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fd48qp"] Sep 10 16:07:40.048681 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:07:40.048655 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod372f8c1c_6af8_43ae_8b18_11496bb93645.slice/crio-5f8c07255ddad194a580544656346bc7de24669eab23f107960315f971162853 WatchSource:0}: Error finding container 5f8c07255ddad194a580544656346bc7de24669eab23f107960315f971162853: Status 404 returned error can't find the container with id 5f8c07255ddad194a580544656346bc7de24669eab23f107960315f971162853 Sep 10 16:07:40.211445 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:07:40.211413 2574 generic.go:356] "Generic (PLEG): container finished" podID="372f8c1c-6af8-43ae-8b18-11496bb93645" containerID="67a18dc36b4a44979f598595311c2174a357b956b2740709b4d3678d289cb306" exitCode=0 Sep 10 16:07:40.211594 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:07:40.211502 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fd48qp" event={"ID":"372f8c1c-6af8-43ae-8b18-11496bb93645","Type":"ContainerDied","Data":"67a18dc36b4a44979f598595311c2174a357b956b2740709b4d3678d289cb306"} Sep 10 16:07:40.211594 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:07:40.211559 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fd48qp" event={"ID":"372f8c1c-6af8-43ae-8b18-11496bb93645","Type":"ContainerStarted","Data":"5f8c07255ddad194a580544656346bc7de24669eab23f107960315f971162853"} Sep 10 16:07:43.225433 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:07:43.225394 2574 generic.go:356] "Generic (PLEG): container finished" podID="372f8c1c-6af8-43ae-8b18-11496bb93645" containerID="71fff9083db57dc129559d49433ea100923e068db28173e5d64999fea1be718d" exitCode=0 Sep 10 16:07:43.225825 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:07:43.225480 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fd48qp" event={"ID":"372f8c1c-6af8-43ae-8b18-11496bb93645","Type":"ContainerDied","Data":"71fff9083db57dc129559d49433ea100923e068db28173e5d64999fea1be718d"} Sep 10 16:07:44.232146 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:07:44.232107 2574 generic.go:356] "Generic (PLEG): container finished" podID="372f8c1c-6af8-43ae-8b18-11496bb93645" containerID="38ee447271733fa3d2aad1110df295df6442cfee46d9d07d50d2db2e0f5876db" exitCode=0 Sep 10 16:07:44.232679 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:07:44.232190 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fd48qp" event={"ID":"372f8c1c-6af8-43ae-8b18-11496bb93645","Type":"ContainerDied","Data":"38ee447271733fa3d2aad1110df295df6442cfee46d9d07d50d2db2e0f5876db"} Sep 10 16:07:45.363240 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:07:45.363216 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fd48qp" Sep 10 16:07:45.451756 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:07:45.451721 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2hzlc\" (UniqueName: \"kubernetes.io/projected/372f8c1c-6af8-43ae-8b18-11496bb93645-kube-api-access-2hzlc\") pod \"372f8c1c-6af8-43ae-8b18-11496bb93645\" (UID: \"372f8c1c-6af8-43ae-8b18-11496bb93645\") " Sep 10 16:07:45.451936 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:07:45.451775 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/372f8c1c-6af8-43ae-8b18-11496bb93645-bundle\") pod \"372f8c1c-6af8-43ae-8b18-11496bb93645\" (UID: \"372f8c1c-6af8-43ae-8b18-11496bb93645\") " Sep 10 16:07:45.451936 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:07:45.451848 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/372f8c1c-6af8-43ae-8b18-11496bb93645-util\") pod \"372f8c1c-6af8-43ae-8b18-11496bb93645\" (UID: \"372f8c1c-6af8-43ae-8b18-11496bb93645\") " Sep 10 16:07:45.452189 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:07:45.452153 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/372f8c1c-6af8-43ae-8b18-11496bb93645-bundle" (OuterVolumeSpecName: "bundle") pod "372f8c1c-6af8-43ae-8b18-11496bb93645" (UID: "372f8c1c-6af8-43ae-8b18-11496bb93645"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 10 16:07:45.453762 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:07:45.453738 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/372f8c1c-6af8-43ae-8b18-11496bb93645-kube-api-access-2hzlc" (OuterVolumeSpecName: "kube-api-access-2hzlc") pod "372f8c1c-6af8-43ae-8b18-11496bb93645" (UID: "372f8c1c-6af8-43ae-8b18-11496bb93645"). InnerVolumeSpecName "kube-api-access-2hzlc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 16:07:45.456479 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:07:45.456438 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/372f8c1c-6af8-43ae-8b18-11496bb93645-util" (OuterVolumeSpecName: "util") pod "372f8c1c-6af8-43ae-8b18-11496bb93645" (UID: "372f8c1c-6af8-43ae-8b18-11496bb93645"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 10 16:07:45.553328 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:07:45.553296 2574 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/372f8c1c-6af8-43ae-8b18-11496bb93645-bundle\") on node \"ip-10-0-135-53.ec2.internal\" DevicePath \"\"" Sep 10 16:07:45.553328 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:07:45.553325 2574 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/372f8c1c-6af8-43ae-8b18-11496bb93645-util\") on node \"ip-10-0-135-53.ec2.internal\" DevicePath \"\"" Sep 10 16:07:45.553571 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:07:45.553336 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2hzlc\" (UniqueName: \"kubernetes.io/projected/372f8c1c-6af8-43ae-8b18-11496bb93645-kube-api-access-2hzlc\") on node \"ip-10-0-135-53.ec2.internal\" DevicePath \"\"" Sep 10 16:07:46.241469 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:07:46.241439 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fd48qp" Sep 10 16:07:46.241626 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:07:46.241434 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fd48qp" event={"ID":"372f8c1c-6af8-43ae-8b18-11496bb93645","Type":"ContainerDied","Data":"5f8c07255ddad194a580544656346bc7de24669eab23f107960315f971162853"} Sep 10 16:07:46.241626 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:07:46.241559 2574 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5f8c07255ddad194a580544656346bc7de24669eab23f107960315f971162853" Sep 10 16:07:49.875444 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:07:49.875407 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-frzsd"] Sep 10 16:07:49.875808 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:07:49.875698 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="372f8c1c-6af8-43ae-8b18-11496bb93645" containerName="util" Sep 10 16:07:49.875808 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:07:49.875709 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="372f8c1c-6af8-43ae-8b18-11496bb93645" containerName="util" Sep 10 16:07:49.875808 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:07:49.875726 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="372f8c1c-6af8-43ae-8b18-11496bb93645" containerName="pull" Sep 10 16:07:49.875808 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:07:49.875731 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="372f8c1c-6af8-43ae-8b18-11496bb93645" containerName="pull" Sep 10 16:07:49.875808 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:07:49.875740 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="372f8c1c-6af8-43ae-8b18-11496bb93645" containerName="extract" Sep 10 16:07:49.875808 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:07:49.875746 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="372f8c1c-6af8-43ae-8b18-11496bb93645" containerName="extract" Sep 10 16:07:49.875808 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:07:49.875802 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="372f8c1c-6af8-43ae-8b18-11496bb93645" containerName="extract" Sep 10 16:07:49.878538 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:07:49.878521 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-frzsd" Sep 10 16:07:49.881248 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:07:49.881225 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Sep 10 16:07:49.882210 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:07:49.882193 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-txsxd\"" Sep 10 16:07:49.882318 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:07:49.882198 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Sep 10 16:07:49.886602 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:07:49.886580 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-frzsd"] Sep 10 16:07:49.985403 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:07:49.985371 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7nsfk\" (UniqueName: \"kubernetes.io/projected/8ebb6d13-b322-46ed-bce8-9d6137fe8afc-kube-api-access-7nsfk\") pod \"openshift-lws-operator-fd8ccff4c-frzsd\" (UID: \"8ebb6d13-b322-46ed-bce8-9d6137fe8afc\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-frzsd" Sep 10 16:07:49.985561 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:07:49.985420 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8ebb6d13-b322-46ed-bce8-9d6137fe8afc-tmp\") pod \"openshift-lws-operator-fd8ccff4c-frzsd\" (UID: \"8ebb6d13-b322-46ed-bce8-9d6137fe8afc\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-frzsd" Sep 10 16:07:50.086481 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:07:50.086448 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8ebb6d13-b322-46ed-bce8-9d6137fe8afc-tmp\") pod \"openshift-lws-operator-fd8ccff4c-frzsd\" (UID: \"8ebb6d13-b322-46ed-bce8-9d6137fe8afc\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-frzsd" Sep 10 16:07:50.086660 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:07:50.086509 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7nsfk\" (UniqueName: \"kubernetes.io/projected/8ebb6d13-b322-46ed-bce8-9d6137fe8afc-kube-api-access-7nsfk\") pod \"openshift-lws-operator-fd8ccff4c-frzsd\" (UID: \"8ebb6d13-b322-46ed-bce8-9d6137fe8afc\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-frzsd" Sep 10 16:07:50.086867 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:07:50.086845 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8ebb6d13-b322-46ed-bce8-9d6137fe8afc-tmp\") pod \"openshift-lws-operator-fd8ccff4c-frzsd\" (UID: \"8ebb6d13-b322-46ed-bce8-9d6137fe8afc\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-frzsd" Sep 10 16:07:50.097832 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:07:50.097804 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7nsfk\" (UniqueName: \"kubernetes.io/projected/8ebb6d13-b322-46ed-bce8-9d6137fe8afc-kube-api-access-7nsfk\") pod \"openshift-lws-operator-fd8ccff4c-frzsd\" (UID: \"8ebb6d13-b322-46ed-bce8-9d6137fe8afc\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-frzsd" Sep 10 16:07:50.196438 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:07:50.196352 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-frzsd" Sep 10 16:07:50.467509 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:07:50.467484 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-frzsd"] Sep 10 16:07:50.469516 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:07:50.469483 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8ebb6d13_b322_46ed_bce8_9d6137fe8afc.slice/crio-ff969253277e4fbe0141d9329d36b7b8d902b7519a084b044e15ca3ed09d3cf5 WatchSource:0}: Error finding container ff969253277e4fbe0141d9329d36b7b8d902b7519a084b044e15ca3ed09d3cf5: Status 404 returned error can't find the container with id ff969253277e4fbe0141d9329d36b7b8d902b7519a084b044e15ca3ed09d3cf5 Sep 10 16:07:51.267025 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:07:51.266988 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-frzsd" event={"ID":"8ebb6d13-b322-46ed-bce8-9d6137fe8afc","Type":"ContainerStarted","Data":"ff969253277e4fbe0141d9329d36b7b8d902b7519a084b044e15ca3ed09d3cf5"} Sep 10 16:07:53.277047 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:07:53.277010 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-frzsd" event={"ID":"8ebb6d13-b322-46ed-bce8-9d6137fe8afc","Type":"ContainerStarted","Data":"34277cae3fae870be805752c3e8726588d9683ffc406c8fe4d625d699dbd910c"} Sep 10 16:07:53.295521 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:07:53.295466 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-frzsd" podStartSLOduration=2.487779472 podStartE2EDuration="4.295449387s" totalImagesPullingTime="1.807669915s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 16:07:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 16:07:53.294158268 +0000 UTC m=+297.859361816" watchObservedRunningTime="2026-09-10 16:07:53.295449387 +0000 UTC m=+297.860652941" Sep 10 16:07:55.846465 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:07:55.846434 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-frshx_9baedfdd-1384-4da1-b9c0-58dea49d3ae0/console-operator/1.log" Sep 10 16:07:55.849479 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:07:55.849458 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-frshx_9baedfdd-1384-4da1-b9c0-58dea49d3ae0/console-operator/1.log" Sep 10 16:07:55.861959 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:07:55.861932 2574 kubelet.go:1648] "Image garbage collection succeeded" Sep 10 16:07:57.454281 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:07:57.454239 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhkx25"] Sep 10 16:07:57.470253 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:07:57.470218 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhkx25"] Sep 10 16:07:57.470360 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:07:57.470341 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhkx25" Sep 10 16:07:57.473188 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:07:57.473170 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Sep 10 16:07:57.473321 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:07:57.473250 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Sep 10 16:07:57.474366 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:07:57.474348 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-fn6b2\"" Sep 10 16:07:57.647600 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:07:57.647559 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r2psq\" (UniqueName: \"kubernetes.io/projected/da9b029f-0e15-4790-b2b6-62036231beb2-kube-api-access-r2psq\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhkx25\" (UID: \"da9b029f-0e15-4790-b2b6-62036231beb2\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhkx25" Sep 10 16:07:57.647600 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:07:57.647607 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/da9b029f-0e15-4790-b2b6-62036231beb2-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhkx25\" (UID: \"da9b029f-0e15-4790-b2b6-62036231beb2\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhkx25" Sep 10 16:07:57.647843 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:07:57.647714 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/da9b029f-0e15-4790-b2b6-62036231beb2-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhkx25\" (UID: \"da9b029f-0e15-4790-b2b6-62036231beb2\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhkx25" Sep 10 16:07:57.748976 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:07:57.748881 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/da9b029f-0e15-4790-b2b6-62036231beb2-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhkx25\" (UID: \"da9b029f-0e15-4790-b2b6-62036231beb2\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhkx25" Sep 10 16:07:57.748976 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:07:57.748949 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r2psq\" (UniqueName: \"kubernetes.io/projected/da9b029f-0e15-4790-b2b6-62036231beb2-kube-api-access-r2psq\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhkx25\" (UID: \"da9b029f-0e15-4790-b2b6-62036231beb2\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhkx25" Sep 10 16:07:57.748976 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:07:57.748977 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/da9b029f-0e15-4790-b2b6-62036231beb2-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhkx25\" (UID: \"da9b029f-0e15-4790-b2b6-62036231beb2\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhkx25" Sep 10 16:07:57.749376 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:07:57.749352 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/da9b029f-0e15-4790-b2b6-62036231beb2-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhkx25\" (UID: \"da9b029f-0e15-4790-b2b6-62036231beb2\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhkx25" Sep 10 16:07:57.749450 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:07:57.749384 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/da9b029f-0e15-4790-b2b6-62036231beb2-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhkx25\" (UID: \"da9b029f-0e15-4790-b2b6-62036231beb2\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhkx25" Sep 10 16:07:57.757687 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:07:57.757659 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r2psq\" (UniqueName: \"kubernetes.io/projected/da9b029f-0e15-4790-b2b6-62036231beb2-kube-api-access-r2psq\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhkx25\" (UID: \"da9b029f-0e15-4790-b2b6-62036231beb2\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhkx25" Sep 10 16:07:57.779597 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:07:57.779572 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhkx25" Sep 10 16:07:58.062234 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:07:58.062207 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhkx25"] Sep 10 16:07:58.064652 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:07:58.064624 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podda9b029f_0e15_4790_b2b6_62036231beb2.slice/crio-c3aa2702aa251f556f3828404dda62c1170449b1090c7f1c71574a62b3df2711 WatchSource:0}: Error finding container c3aa2702aa251f556f3828404dda62c1170449b1090c7f1c71574a62b3df2711: Status 404 returned error can't find the container with id c3aa2702aa251f556f3828404dda62c1170449b1090c7f1c71574a62b3df2711 Sep 10 16:07:58.297355 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:07:58.297325 2574 generic.go:356] "Generic (PLEG): container finished" podID="da9b029f-0e15-4790-b2b6-62036231beb2" containerID="dbef5114e525b23e76971b8ebfcbcad5c76694cbfb7ca4715e8f7646540a9739" exitCode=0 Sep 10 16:07:58.297533 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:07:58.297408 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhkx25" event={"ID":"da9b029f-0e15-4790-b2b6-62036231beb2","Type":"ContainerDied","Data":"dbef5114e525b23e76971b8ebfcbcad5c76694cbfb7ca4715e8f7646540a9739"} Sep 10 16:07:58.297533 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:07:58.297466 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhkx25" event={"ID":"da9b029f-0e15-4790-b2b6-62036231beb2","Type":"ContainerStarted","Data":"c3aa2702aa251f556f3828404dda62c1170449b1090c7f1c71574a62b3df2711"} Sep 10 16:07:58.297861 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:07:58.297846 2574 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 10 16:07:59.308387 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:07:59.308294 2574 generic.go:356] "Generic (PLEG): container finished" podID="da9b029f-0e15-4790-b2b6-62036231beb2" containerID="a54b18bede38ef4593733f34814086536bee82d00281911a3eecf5d92993d55c" exitCode=0 Sep 10 16:07:59.308746 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:07:59.308390 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhkx25" event={"ID":"da9b029f-0e15-4790-b2b6-62036231beb2","Type":"ContainerDied","Data":"a54b18bede38ef4593733f34814086536bee82d00281911a3eecf5d92993d55c"} Sep 10 16:08:00.314819 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:08:00.314784 2574 generic.go:356] "Generic (PLEG): container finished" podID="da9b029f-0e15-4790-b2b6-62036231beb2" containerID="10cf4f88e1b7c36f8aaeec092c5d5e8a8a302b00bf1e58c775774236715eebc0" exitCode=0 Sep 10 16:08:00.315217 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:08:00.314883 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhkx25" event={"ID":"da9b029f-0e15-4790-b2b6-62036231beb2","Type":"ContainerDied","Data":"10cf4f88e1b7c36f8aaeec092c5d5e8a8a302b00bf1e58c775774236715eebc0"} Sep 10 16:08:01.444698 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:08:01.444673 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhkx25" Sep 10 16:08:01.474045 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:08:01.474009 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r2psq\" (UniqueName: \"kubernetes.io/projected/da9b029f-0e15-4790-b2b6-62036231beb2-kube-api-access-r2psq\") pod \"da9b029f-0e15-4790-b2b6-62036231beb2\" (UID: \"da9b029f-0e15-4790-b2b6-62036231beb2\") " Sep 10 16:08:01.474202 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:08:01.474057 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/da9b029f-0e15-4790-b2b6-62036231beb2-util\") pod \"da9b029f-0e15-4790-b2b6-62036231beb2\" (UID: \"da9b029f-0e15-4790-b2b6-62036231beb2\") " Sep 10 16:08:01.474202 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:08:01.474112 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/da9b029f-0e15-4790-b2b6-62036231beb2-bundle\") pod \"da9b029f-0e15-4790-b2b6-62036231beb2\" (UID: \"da9b029f-0e15-4790-b2b6-62036231beb2\") " Sep 10 16:08:01.474944 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:08:01.474912 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/da9b029f-0e15-4790-b2b6-62036231beb2-bundle" (OuterVolumeSpecName: "bundle") pod "da9b029f-0e15-4790-b2b6-62036231beb2" (UID: "da9b029f-0e15-4790-b2b6-62036231beb2"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 10 16:08:01.476284 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:08:01.476245 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/da9b029f-0e15-4790-b2b6-62036231beb2-kube-api-access-r2psq" (OuterVolumeSpecName: "kube-api-access-r2psq") pod "da9b029f-0e15-4790-b2b6-62036231beb2" (UID: "da9b029f-0e15-4790-b2b6-62036231beb2"). InnerVolumeSpecName "kube-api-access-r2psq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 16:08:01.480158 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:08:01.480128 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/da9b029f-0e15-4790-b2b6-62036231beb2-util" (OuterVolumeSpecName: "util") pod "da9b029f-0e15-4790-b2b6-62036231beb2" (UID: "da9b029f-0e15-4790-b2b6-62036231beb2"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 10 16:08:01.574718 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:08:01.574628 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r2psq\" (UniqueName: \"kubernetes.io/projected/da9b029f-0e15-4790-b2b6-62036231beb2-kube-api-access-r2psq\") on node \"ip-10-0-135-53.ec2.internal\" DevicePath \"\"" Sep 10 16:08:01.574718 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:08:01.574660 2574 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/da9b029f-0e15-4790-b2b6-62036231beb2-util\") on node \"ip-10-0-135-53.ec2.internal\" DevicePath \"\"" Sep 10 16:08:01.574718 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:08:01.574671 2574 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/da9b029f-0e15-4790-b2b6-62036231beb2-bundle\") on node \"ip-10-0-135-53.ec2.internal\" DevicePath \"\"" Sep 10 16:08:02.324906 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:08:02.324877 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhkx25" Sep 10 16:08:02.324906 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:08:02.324899 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afhkx25" event={"ID":"da9b029f-0e15-4790-b2b6-62036231beb2","Type":"ContainerDied","Data":"c3aa2702aa251f556f3828404dda62c1170449b1090c7f1c71574a62b3df2711"} Sep 10 16:08:02.325102 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:08:02.324940 2574 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c3aa2702aa251f556f3828404dda62c1170449b1090c7f1c71574a62b3df2711" Sep 10 16:08:09.151455 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:08:09.151417 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0xmjsk"] Sep 10 16:08:09.151824 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:08:09.151686 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="da9b029f-0e15-4790-b2b6-62036231beb2" containerName="extract" Sep 10 16:08:09.151824 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:08:09.151697 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="da9b029f-0e15-4790-b2b6-62036231beb2" containerName="extract" Sep 10 16:08:09.151824 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:08:09.151710 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="da9b029f-0e15-4790-b2b6-62036231beb2" containerName="pull" Sep 10 16:08:09.151824 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:08:09.151716 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="da9b029f-0e15-4790-b2b6-62036231beb2" containerName="pull" Sep 10 16:08:09.151824 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:08:09.151727 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="da9b029f-0e15-4790-b2b6-62036231beb2" containerName="util" Sep 10 16:08:09.151824 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:08:09.151733 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="da9b029f-0e15-4790-b2b6-62036231beb2" containerName="util" Sep 10 16:08:09.151824 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:08:09.151785 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="da9b029f-0e15-4790-b2b6-62036231beb2" containerName="extract" Sep 10 16:08:09.154970 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:08:09.154953 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0xmjsk" Sep 10 16:08:09.157677 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:08:09.157637 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-fn6b2\"" Sep 10 16:08:09.157840 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:08:09.157821 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Sep 10 16:08:09.158634 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:08:09.158617 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Sep 10 16:08:09.169307 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:08:09.169284 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0xmjsk"] Sep 10 16:08:09.230008 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:08:09.229968 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/16b40f38-3769-44c9-962d-5668b7b791a9-util\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0xmjsk\" (UID: \"16b40f38-3769-44c9-962d-5668b7b791a9\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0xmjsk" Sep 10 16:08:09.230157 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:08:09.230038 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/16b40f38-3769-44c9-962d-5668b7b791a9-bundle\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0xmjsk\" (UID: \"16b40f38-3769-44c9-962d-5668b7b791a9\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0xmjsk" Sep 10 16:08:09.230157 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:08:09.230097 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c4s4t\" (UniqueName: \"kubernetes.io/projected/16b40f38-3769-44c9-962d-5668b7b791a9-kube-api-access-c4s4t\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0xmjsk\" (UID: \"16b40f38-3769-44c9-962d-5668b7b791a9\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0xmjsk" Sep 10 16:08:09.330631 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:08:09.330582 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/16b40f38-3769-44c9-962d-5668b7b791a9-bundle\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0xmjsk\" (UID: \"16b40f38-3769-44c9-962d-5668b7b791a9\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0xmjsk" Sep 10 16:08:09.330631 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:08:09.330645 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c4s4t\" (UniqueName: \"kubernetes.io/projected/16b40f38-3769-44c9-962d-5668b7b791a9-kube-api-access-c4s4t\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0xmjsk\" (UID: \"16b40f38-3769-44c9-962d-5668b7b791a9\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0xmjsk" Sep 10 16:08:09.330884 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:08:09.330674 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/16b40f38-3769-44c9-962d-5668b7b791a9-util\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0xmjsk\" (UID: \"16b40f38-3769-44c9-962d-5668b7b791a9\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0xmjsk" Sep 10 16:08:09.331071 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:08:09.331046 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/16b40f38-3769-44c9-962d-5668b7b791a9-bundle\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0xmjsk\" (UID: \"16b40f38-3769-44c9-962d-5668b7b791a9\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0xmjsk" Sep 10 16:08:09.331133 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:08:09.331069 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/16b40f38-3769-44c9-962d-5668b7b791a9-util\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0xmjsk\" (UID: \"16b40f38-3769-44c9-962d-5668b7b791a9\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0xmjsk" Sep 10 16:08:09.339078 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:08:09.339044 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c4s4t\" (UniqueName: \"kubernetes.io/projected/16b40f38-3769-44c9-962d-5668b7b791a9-kube-api-access-c4s4t\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0xmjsk\" (UID: \"16b40f38-3769-44c9-962d-5668b7b791a9\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0xmjsk" Sep 10 16:08:09.463516 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:08:09.463432 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0xmjsk" Sep 10 16:08:09.755502 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:08:09.755449 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0xmjsk"] Sep 10 16:08:09.757678 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:08:09.757644 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod16b40f38_3769_44c9_962d_5668b7b791a9.slice/crio-2e64a854f3d7f76cd65b1a73b3621483917daea4755603939f34a8db3e590179 WatchSource:0}: Error finding container 2e64a854f3d7f76cd65b1a73b3621483917daea4755603939f34a8db3e590179: Status 404 returned error can't find the container with id 2e64a854f3d7f76cd65b1a73b3621483917daea4755603939f34a8db3e590179 Sep 10 16:08:10.358325 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:08:10.358287 2574 generic.go:356] "Generic (PLEG): container finished" podID="16b40f38-3769-44c9-962d-5668b7b791a9" containerID="9b4e774d0c75cce24edd1b1d9ca0d9af0c01c929b5cd01a50309621bdc60afce" exitCode=0 Sep 10 16:08:10.358702 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:08:10.358373 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0xmjsk" event={"ID":"16b40f38-3769-44c9-962d-5668b7b791a9","Type":"ContainerDied","Data":"9b4e774d0c75cce24edd1b1d9ca0d9af0c01c929b5cd01a50309621bdc60afce"} Sep 10 16:08:10.358702 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:08:10.358422 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0xmjsk" event={"ID":"16b40f38-3769-44c9-962d-5668b7b791a9","Type":"ContainerStarted","Data":"2e64a854f3d7f76cd65b1a73b3621483917daea4755603939f34a8db3e590179"} Sep 10 16:08:11.210795 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:08:11.210756 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6ff9c7664b-n9v44"] Sep 10 16:08:11.214030 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:08:11.214013 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6ff9c7664b-n9v44" Sep 10 16:08:11.218997 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:08:11.218970 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Sep 10 16:08:11.218997 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:08:11.218984 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Sep 10 16:08:11.219361 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:08:11.219344 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Sep 10 16:08:11.221364 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:08:11.221343 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-784hl\"" Sep 10 16:08:11.224680 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:08:11.224666 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Sep 10 16:08:11.245757 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:08:11.245733 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/361e46df-94e7-425a-9226-f76be9c67917-manifests\") pod \"opendatahub-operator-controller-manager-6ff9c7664b-n9v44\" (UID: \"361e46df-94e7-425a-9226-f76be9c67917\") " pod="opendatahub/opendatahub-operator-controller-manager-6ff9c7664b-n9v44" Sep 10 16:08:11.245847 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:08:11.245784 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sqkbb\" (UniqueName: \"kubernetes.io/projected/361e46df-94e7-425a-9226-f76be9c67917-kube-api-access-sqkbb\") pod \"opendatahub-operator-controller-manager-6ff9c7664b-n9v44\" (UID: \"361e46df-94e7-425a-9226-f76be9c67917\") " pod="opendatahub/opendatahub-operator-controller-manager-6ff9c7664b-n9v44" Sep 10 16:08:11.245847 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:08:11.245839 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/361e46df-94e7-425a-9226-f76be9c67917-tmp\") pod \"opendatahub-operator-controller-manager-6ff9c7664b-n9v44\" (UID: \"361e46df-94e7-425a-9226-f76be9c67917\") " pod="opendatahub/opendatahub-operator-controller-manager-6ff9c7664b-n9v44" Sep 10 16:08:11.245933 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:08:11.245858 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/361e46df-94e7-425a-9226-f76be9c67917-webhook-cert\") pod \"opendatahub-operator-controller-manager-6ff9c7664b-n9v44\" (UID: \"361e46df-94e7-425a-9226-f76be9c67917\") " pod="opendatahub/opendatahub-operator-controller-manager-6ff9c7664b-n9v44" Sep 10 16:08:11.245933 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:08:11.245903 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/361e46df-94e7-425a-9226-f76be9c67917-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6ff9c7664b-n9v44\" (UID: \"361e46df-94e7-425a-9226-f76be9c67917\") " pod="opendatahub/opendatahub-operator-controller-manager-6ff9c7664b-n9v44" Sep 10 16:08:11.251989 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:08:11.251935 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6ff9c7664b-n9v44"] Sep 10 16:08:11.347054 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:08:11.347012 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/361e46df-94e7-425a-9226-f76be9c67917-manifests\") pod \"opendatahub-operator-controller-manager-6ff9c7664b-n9v44\" (UID: \"361e46df-94e7-425a-9226-f76be9c67917\") " pod="opendatahub/opendatahub-operator-controller-manager-6ff9c7664b-n9v44" Sep 10 16:08:11.347248 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:08:11.347154 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sqkbb\" (UniqueName: \"kubernetes.io/projected/361e46df-94e7-425a-9226-f76be9c67917-kube-api-access-sqkbb\") pod \"opendatahub-operator-controller-manager-6ff9c7664b-n9v44\" (UID: \"361e46df-94e7-425a-9226-f76be9c67917\") " pod="opendatahub/opendatahub-operator-controller-manager-6ff9c7664b-n9v44" Sep 10 16:08:11.347248 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:08:11.347187 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/361e46df-94e7-425a-9226-f76be9c67917-tmp\") pod \"opendatahub-operator-controller-manager-6ff9c7664b-n9v44\" (UID: \"361e46df-94e7-425a-9226-f76be9c67917\") " pod="opendatahub/opendatahub-operator-controller-manager-6ff9c7664b-n9v44" Sep 10 16:08:11.347248 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:08:11.347203 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/361e46df-94e7-425a-9226-f76be9c67917-webhook-cert\") pod \"opendatahub-operator-controller-manager-6ff9c7664b-n9v44\" (UID: \"361e46df-94e7-425a-9226-f76be9c67917\") " pod="opendatahub/opendatahub-operator-controller-manager-6ff9c7664b-n9v44" Sep 10 16:08:11.347248 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:08:11.347223 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/361e46df-94e7-425a-9226-f76be9c67917-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6ff9c7664b-n9v44\" (UID: \"361e46df-94e7-425a-9226-f76be9c67917\") " pod="opendatahub/opendatahub-operator-controller-manager-6ff9c7664b-n9v44" Sep 10 16:08:11.347545 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:08:11.347522 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/361e46df-94e7-425a-9226-f76be9c67917-manifests\") pod \"opendatahub-operator-controller-manager-6ff9c7664b-n9v44\" (UID: \"361e46df-94e7-425a-9226-f76be9c67917\") " pod="opendatahub/opendatahub-operator-controller-manager-6ff9c7664b-n9v44" Sep 10 16:08:11.349527 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:08:11.349500 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/361e46df-94e7-425a-9226-f76be9c67917-tmp\") pod \"opendatahub-operator-controller-manager-6ff9c7664b-n9v44\" (UID: \"361e46df-94e7-425a-9226-f76be9c67917\") " pod="opendatahub/opendatahub-operator-controller-manager-6ff9c7664b-n9v44" Sep 10 16:08:11.349668 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:08:11.349646 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/361e46df-94e7-425a-9226-f76be9c67917-webhook-cert\") pod \"opendatahub-operator-controller-manager-6ff9c7664b-n9v44\" (UID: \"361e46df-94e7-425a-9226-f76be9c67917\") " pod="opendatahub/opendatahub-operator-controller-manager-6ff9c7664b-n9v44" Sep 10 16:08:11.349704 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:08:11.349662 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/361e46df-94e7-425a-9226-f76be9c67917-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6ff9c7664b-n9v44\" (UID: \"361e46df-94e7-425a-9226-f76be9c67917\") " pod="opendatahub/opendatahub-operator-controller-manager-6ff9c7664b-n9v44" Sep 10 16:08:11.359559 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:08:11.359538 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sqkbb\" (UniqueName: \"kubernetes.io/projected/361e46df-94e7-425a-9226-f76be9c67917-kube-api-access-sqkbb\") pod \"opendatahub-operator-controller-manager-6ff9c7664b-n9v44\" (UID: \"361e46df-94e7-425a-9226-f76be9c67917\") " pod="opendatahub/opendatahub-operator-controller-manager-6ff9c7664b-n9v44" Sep 10 16:08:11.364307 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:08:11.364259 2574 generic.go:356] "Generic (PLEG): container finished" podID="16b40f38-3769-44c9-962d-5668b7b791a9" containerID="51f30e2163fcc7857e69002b565c2a1f7026bf8f7c640374b53cc4b67080286f" exitCode=0 Sep 10 16:08:11.364307 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:08:11.364292 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0xmjsk" event={"ID":"16b40f38-3769-44c9-962d-5668b7b791a9","Type":"ContainerDied","Data":"51f30e2163fcc7857e69002b565c2a1f7026bf8f7c640374b53cc4b67080286f"} Sep 10 16:08:11.523969 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:08:11.523940 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6ff9c7664b-n9v44" Sep 10 16:08:11.806044 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:08:11.806018 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6ff9c7664b-n9v44"] Sep 10 16:08:11.808659 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:08:11.808636 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod361e46df_94e7_425a_9226_f76be9c67917.slice/crio-e61589aa1a7a3669a107052861854f62dd9279a454386a8f61a873998b7c00cc WatchSource:0}: Error finding container e61589aa1a7a3669a107052861854f62dd9279a454386a8f61a873998b7c00cc: Status 404 returned error can't find the container with id e61589aa1a7a3669a107052861854f62dd9279a454386a8f61a873998b7c00cc Sep 10 16:08:12.373907 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:08:12.373867 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6ff9c7664b-n9v44" event={"ID":"361e46df-94e7-425a-9226-f76be9c67917","Type":"ContainerStarted","Data":"e61589aa1a7a3669a107052861854f62dd9279a454386a8f61a873998b7c00cc"} Sep 10 16:08:12.376603 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:08:12.376574 2574 generic.go:356] "Generic (PLEG): container finished" podID="16b40f38-3769-44c9-962d-5668b7b791a9" containerID="8e4d92e1beda864c3474e9a7689d764069abcc57ae7b55b071356354e7b3aa8b" exitCode=0 Sep 10 16:08:12.376701 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:08:12.376619 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0xmjsk" event={"ID":"16b40f38-3769-44c9-962d-5668b7b791a9","Type":"ContainerDied","Data":"8e4d92e1beda864c3474e9a7689d764069abcc57ae7b55b071356354e7b3aa8b"} Sep 10 16:08:14.780994 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:08:14.780969 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0xmjsk" Sep 10 16:08:14.876559 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:08:14.876528 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/16b40f38-3769-44c9-962d-5668b7b791a9-util\") pod \"16b40f38-3769-44c9-962d-5668b7b791a9\" (UID: \"16b40f38-3769-44c9-962d-5668b7b791a9\") " Sep 10 16:08:14.876661 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:08:14.876572 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/16b40f38-3769-44c9-962d-5668b7b791a9-bundle\") pod \"16b40f38-3769-44c9-962d-5668b7b791a9\" (UID: \"16b40f38-3769-44c9-962d-5668b7b791a9\") " Sep 10 16:08:14.876661 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:08:14.876655 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c4s4t\" (UniqueName: \"kubernetes.io/projected/16b40f38-3769-44c9-962d-5668b7b791a9-kube-api-access-c4s4t\") pod \"16b40f38-3769-44c9-962d-5668b7b791a9\" (UID: \"16b40f38-3769-44c9-962d-5668b7b791a9\") " Sep 10 16:08:14.877393 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:08:14.877362 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/16b40f38-3769-44c9-962d-5668b7b791a9-bundle" (OuterVolumeSpecName: "bundle") pod "16b40f38-3769-44c9-962d-5668b7b791a9" (UID: "16b40f38-3769-44c9-962d-5668b7b791a9"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 10 16:08:14.878739 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:08:14.878717 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/16b40f38-3769-44c9-962d-5668b7b791a9-kube-api-access-c4s4t" (OuterVolumeSpecName: "kube-api-access-c4s4t") pod "16b40f38-3769-44c9-962d-5668b7b791a9" (UID: "16b40f38-3769-44c9-962d-5668b7b791a9"). InnerVolumeSpecName "kube-api-access-c4s4t". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 16:08:14.978161 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:08:14.978125 2574 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/16b40f38-3769-44c9-962d-5668b7b791a9-bundle\") on node \"ip-10-0-135-53.ec2.internal\" DevicePath \"\"" Sep 10 16:08:14.978161 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:08:14.978155 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c4s4t\" (UniqueName: \"kubernetes.io/projected/16b40f38-3769-44c9-962d-5668b7b791a9-kube-api-access-c4s4t\") on node \"ip-10-0-135-53.ec2.internal\" DevicePath \"\"" Sep 10 16:08:15.000455 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:08:15.000399 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/16b40f38-3769-44c9-962d-5668b7b791a9-util" (OuterVolumeSpecName: "util") pod "16b40f38-3769-44c9-962d-5668b7b791a9" (UID: "16b40f38-3769-44c9-962d-5668b7b791a9"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 10 16:08:15.078915 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:08:15.078837 2574 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/16b40f38-3769-44c9-962d-5668b7b791a9-util\") on node \"ip-10-0-135-53.ec2.internal\" DevicePath \"\"" Sep 10 16:08:15.393313 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:08:15.393219 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0xmjsk" Sep 10 16:08:15.393313 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:08:15.393223 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0xmjsk" event={"ID":"16b40f38-3769-44c9-962d-5668b7b791a9","Type":"ContainerDied","Data":"2e64a854f3d7f76cd65b1a73b3621483917daea4755603939f34a8db3e590179"} Sep 10 16:08:15.393517 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:08:15.393321 2574 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2e64a854f3d7f76cd65b1a73b3621483917daea4755603939f34a8db3e590179" Sep 10 16:08:15.394995 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:08:15.394967 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6ff9c7664b-n9v44" event={"ID":"361e46df-94e7-425a-9226-f76be9c67917","Type":"ContainerStarted","Data":"f45be096f4fb62dc64fb81a60e7c350f3a9c67bba9c74c1ebdfe377a400ad4be"} Sep 10 16:08:16.400526 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:08:16.400492 2574 generic.go:356] "Generic (PLEG): container finished" podID="361e46df-94e7-425a-9226-f76be9c67917" containerID="f45be096f4fb62dc64fb81a60e7c350f3a9c67bba9c74c1ebdfe377a400ad4be" exitCode=0 Sep 10 16:08:16.400902 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:08:16.400573 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6ff9c7664b-n9v44" event={"ID":"361e46df-94e7-425a-9226-f76be9c67917","Type":"ContainerDied","Data":"f45be096f4fb62dc64fb81a60e7c350f3a9c67bba9c74c1ebdfe377a400ad4be"} Sep 10 16:08:17.406897 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:08:17.406862 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6ff9c7664b-n9v44" event={"ID":"361e46df-94e7-425a-9226-f76be9c67917","Type":"ContainerStarted","Data":"13688a7ae2e9c16a1e9c214aa19180e30fd5ecf539fe85604dbecc91aa2047c3"} Sep 10 16:08:17.407400 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:08:17.406988 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-6ff9c7664b-n9v44" Sep 10 16:08:17.431981 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:08:17.431931 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-6ff9c7664b-n9v44" podStartSLOduration=1.945233035 podStartE2EDuration="6.431915133s" totalImagesPullingTime="3.462116184s" totalInitContainerRuntime="1.024565914s" isStatefulPod=false podCreationTimestamp="2026-09-10 16:08:11 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 16:08:17.430204466 +0000 UTC m=+321.995408009" watchObservedRunningTime="2026-09-10 16:08:17.431915133 +0000 UTC m=+321.997118688" Sep 10 16:08:28.413228 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:08:28.413194 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-6ff9c7664b-n9v44" Sep 10 16:08:31.917383 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:08:31.917352 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-5468b79cc4-4l9t6"] Sep 10 16:08:31.917764 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:08:31.917691 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="16b40f38-3769-44c9-962d-5668b7b791a9" containerName="pull" Sep 10 16:08:31.917764 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:08:31.917703 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="16b40f38-3769-44c9-962d-5668b7b791a9" containerName="pull" Sep 10 16:08:31.917764 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:08:31.917711 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="16b40f38-3769-44c9-962d-5668b7b791a9" containerName="util" Sep 10 16:08:31.917764 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:08:31.917717 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="16b40f38-3769-44c9-962d-5668b7b791a9" containerName="util" Sep 10 16:08:31.917764 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:08:31.917727 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="16b40f38-3769-44c9-962d-5668b7b791a9" containerName="extract" Sep 10 16:08:31.917764 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:08:31.917733 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="16b40f38-3769-44c9-962d-5668b7b791a9" containerName="extract" Sep 10 16:08:31.917970 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:08:31.917784 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="16b40f38-3769-44c9-962d-5668b7b791a9" containerName="extract" Sep 10 16:08:31.924728 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:08:31.924706 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-5468b79cc4-4l9t6" Sep 10 16:08:31.931632 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:08:31.931604 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Sep 10 16:08:31.931759 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:08:31.931611 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Sep 10 16:08:31.946973 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:08:31.946943 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-5468b79cc4-4l9t6"] Sep 10 16:08:32.011494 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:08:32.011459 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7eaab891-6169-4c8c-b6eb-2f0bc525a05b-tls-certs\") pod \"kube-auth-proxy-5468b79cc4-4l9t6\" (UID: \"7eaab891-6169-4c8c-b6eb-2f0bc525a05b\") " pod="openshift-ingress/kube-auth-proxy-5468b79cc4-4l9t6" Sep 10 16:08:32.011494 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:08:32.011491 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7eaab891-6169-4c8c-b6eb-2f0bc525a05b-tmp\") pod \"kube-auth-proxy-5468b79cc4-4l9t6\" (UID: \"7eaab891-6169-4c8c-b6eb-2f0bc525a05b\") " pod="openshift-ingress/kube-auth-proxy-5468b79cc4-4l9t6" Sep 10 16:08:32.011708 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:08:32.011590 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gvggq\" (UniqueName: \"kubernetes.io/projected/7eaab891-6169-4c8c-b6eb-2f0bc525a05b-kube-api-access-gvggq\") pod \"kube-auth-proxy-5468b79cc4-4l9t6\" (UID: \"7eaab891-6169-4c8c-b6eb-2f0bc525a05b\") " pod="openshift-ingress/kube-auth-proxy-5468b79cc4-4l9t6" Sep 10 16:08:32.112694 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:08:32.112657 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7eaab891-6169-4c8c-b6eb-2f0bc525a05b-tls-certs\") pod \"kube-auth-proxy-5468b79cc4-4l9t6\" (UID: \"7eaab891-6169-4c8c-b6eb-2f0bc525a05b\") " pod="openshift-ingress/kube-auth-proxy-5468b79cc4-4l9t6" Sep 10 16:08:32.112694 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:08:32.112694 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7eaab891-6169-4c8c-b6eb-2f0bc525a05b-tmp\") pod \"kube-auth-proxy-5468b79cc4-4l9t6\" (UID: \"7eaab891-6169-4c8c-b6eb-2f0bc525a05b\") " pod="openshift-ingress/kube-auth-proxy-5468b79cc4-4l9t6" Sep 10 16:08:32.112950 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:08:32.112759 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gvggq\" (UniqueName: \"kubernetes.io/projected/7eaab891-6169-4c8c-b6eb-2f0bc525a05b-kube-api-access-gvggq\") pod \"kube-auth-proxy-5468b79cc4-4l9t6\" (UID: \"7eaab891-6169-4c8c-b6eb-2f0bc525a05b\") " pod="openshift-ingress/kube-auth-proxy-5468b79cc4-4l9t6" Sep 10 16:08:32.115058 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:08:32.115028 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7eaab891-6169-4c8c-b6eb-2f0bc525a05b-tmp\") pod \"kube-auth-proxy-5468b79cc4-4l9t6\" (UID: \"7eaab891-6169-4c8c-b6eb-2f0bc525a05b\") " pod="openshift-ingress/kube-auth-proxy-5468b79cc4-4l9t6" Sep 10 16:08:32.115342 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:08:32.115320 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7eaab891-6169-4c8c-b6eb-2f0bc525a05b-tls-certs\") pod \"kube-auth-proxy-5468b79cc4-4l9t6\" (UID: \"7eaab891-6169-4c8c-b6eb-2f0bc525a05b\") " pod="openshift-ingress/kube-auth-proxy-5468b79cc4-4l9t6" Sep 10 16:08:32.126941 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:08:32.124220 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gvggq\" (UniqueName: \"kubernetes.io/projected/7eaab891-6169-4c8c-b6eb-2f0bc525a05b-kube-api-access-gvggq\") pod \"kube-auth-proxy-5468b79cc4-4l9t6\" (UID: \"7eaab891-6169-4c8c-b6eb-2f0bc525a05b\") " pod="openshift-ingress/kube-auth-proxy-5468b79cc4-4l9t6" Sep 10 16:08:32.233720 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:08:32.233633 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-5468b79cc4-4l9t6" Sep 10 16:08:32.520666 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:08:32.520645 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-5468b79cc4-4l9t6"] Sep 10 16:08:32.522584 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:08:32.522555 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7eaab891_6169_4c8c_b6eb_2f0bc525a05b.slice/crio-9fde5bd7f32999a48d4f5c0b0e8dff61489dd9c4d415c0672e27e2284bb741fe WatchSource:0}: Error finding container 9fde5bd7f32999a48d4f5c0b0e8dff61489dd9c4d415c0672e27e2284bb741fe: Status 404 returned error can't find the container with id 9fde5bd7f32999a48d4f5c0b0e8dff61489dd9c4d415c0672e27e2284bb741fe Sep 10 16:08:33.479131 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:08:33.479096 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-5468b79cc4-4l9t6" event={"ID":"7eaab891-6169-4c8c-b6eb-2f0bc525a05b","Type":"ContainerStarted","Data":"9fde5bd7f32999a48d4f5c0b0e8dff61489dd9c4d415c0672e27e2284bb741fe"} Sep 10 16:08:33.733552 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:08:33.733471 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-clzbk"] Sep 10 16:08:33.738038 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:08:33.738020 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-clzbk" Sep 10 16:08:33.740937 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:08:33.740916 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-wpqv9\"" Sep 10 16:08:33.741121 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:08:33.741105 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Sep 10 16:08:33.741423 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:08:33.741406 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Sep 10 16:08:33.741957 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:08:33.741938 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Sep 10 16:08:33.741957 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:08:33.741948 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Sep 10 16:08:33.752940 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:08:33.752922 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-clzbk"] Sep 10 16:08:33.825690 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:08:33.825653 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/529ddad0-66e7-4279-b9cf-56a9b903cd06-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-clzbk\" (UID: \"529ddad0-66e7-4279-b9cf-56a9b903cd06\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-clzbk" Sep 10 16:08:33.825856 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:08:33.825697 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6zdqk\" (UniqueName: \"kubernetes.io/projected/529ddad0-66e7-4279-b9cf-56a9b903cd06-kube-api-access-6zdqk\") pod \"istiod-openshift-gateway-7b7995d5cd-clzbk\" (UID: \"529ddad0-66e7-4279-b9cf-56a9b903cd06\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-clzbk" Sep 10 16:08:33.825856 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:08:33.825753 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/529ddad0-66e7-4279-b9cf-56a9b903cd06-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-clzbk\" (UID: \"529ddad0-66e7-4279-b9cf-56a9b903cd06\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-clzbk" Sep 10 16:08:33.825856 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:08:33.825801 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/529ddad0-66e7-4279-b9cf-56a9b903cd06-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-clzbk\" (UID: \"529ddad0-66e7-4279-b9cf-56a9b903cd06\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-clzbk" Sep 10 16:08:33.825856 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:08:33.825821 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/529ddad0-66e7-4279-b9cf-56a9b903cd06-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-clzbk\" (UID: \"529ddad0-66e7-4279-b9cf-56a9b903cd06\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-clzbk" Sep 10 16:08:33.825856 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:08:33.825839 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/529ddad0-66e7-4279-b9cf-56a9b903cd06-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-clzbk\" (UID: \"529ddad0-66e7-4279-b9cf-56a9b903cd06\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-clzbk" Sep 10 16:08:33.826071 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:08:33.825915 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/529ddad0-66e7-4279-b9cf-56a9b903cd06-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-clzbk\" (UID: \"529ddad0-66e7-4279-b9cf-56a9b903cd06\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-clzbk" Sep 10 16:08:33.926886 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:08:33.926850 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/529ddad0-66e7-4279-b9cf-56a9b903cd06-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-clzbk\" (UID: \"529ddad0-66e7-4279-b9cf-56a9b903cd06\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-clzbk" Sep 10 16:08:33.926886 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:08:33.926895 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/529ddad0-66e7-4279-b9cf-56a9b903cd06-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-clzbk\" (UID: \"529ddad0-66e7-4279-b9cf-56a9b903cd06\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-clzbk" Sep 10 16:08:33.927092 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:08:33.926917 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/529ddad0-66e7-4279-b9cf-56a9b903cd06-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-clzbk\" (UID: \"529ddad0-66e7-4279-b9cf-56a9b903cd06\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-clzbk" Sep 10 16:08:33.927092 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:08:33.926942 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/529ddad0-66e7-4279-b9cf-56a9b903cd06-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-clzbk\" (UID: \"529ddad0-66e7-4279-b9cf-56a9b903cd06\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-clzbk" Sep 10 16:08:33.927092 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:08:33.926990 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/529ddad0-66e7-4279-b9cf-56a9b903cd06-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-clzbk\" (UID: \"529ddad0-66e7-4279-b9cf-56a9b903cd06\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-clzbk" Sep 10 16:08:33.927227 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:08:33.927186 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/529ddad0-66e7-4279-b9cf-56a9b903cd06-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-clzbk\" (UID: \"529ddad0-66e7-4279-b9cf-56a9b903cd06\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-clzbk" Sep 10 16:08:33.927308 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:08:33.927246 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6zdqk\" (UniqueName: \"kubernetes.io/projected/529ddad0-66e7-4279-b9cf-56a9b903cd06-kube-api-access-6zdqk\") pod \"istiod-openshift-gateway-7b7995d5cd-clzbk\" (UID: \"529ddad0-66e7-4279-b9cf-56a9b903cd06\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-clzbk" Sep 10 16:08:33.927763 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:08:33.927740 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/529ddad0-66e7-4279-b9cf-56a9b903cd06-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-clzbk\" (UID: \"529ddad0-66e7-4279-b9cf-56a9b903cd06\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-clzbk" Sep 10 16:08:33.929431 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:08:33.929402 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/529ddad0-66e7-4279-b9cf-56a9b903cd06-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-clzbk\" (UID: \"529ddad0-66e7-4279-b9cf-56a9b903cd06\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-clzbk" Sep 10 16:08:33.929516 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:08:33.929467 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/529ddad0-66e7-4279-b9cf-56a9b903cd06-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-clzbk\" (UID: \"529ddad0-66e7-4279-b9cf-56a9b903cd06\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-clzbk" Sep 10 16:08:33.929656 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:08:33.929640 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/529ddad0-66e7-4279-b9cf-56a9b903cd06-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-clzbk\" (UID: \"529ddad0-66e7-4279-b9cf-56a9b903cd06\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-clzbk" Sep 10 16:08:33.929758 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:08:33.929738 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/529ddad0-66e7-4279-b9cf-56a9b903cd06-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-clzbk\" (UID: \"529ddad0-66e7-4279-b9cf-56a9b903cd06\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-clzbk" Sep 10 16:08:33.935759 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:08:33.935740 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/529ddad0-66e7-4279-b9cf-56a9b903cd06-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-clzbk\" (UID: \"529ddad0-66e7-4279-b9cf-56a9b903cd06\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-clzbk" Sep 10 16:08:33.935834 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:08:33.935810 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6zdqk\" (UniqueName: \"kubernetes.io/projected/529ddad0-66e7-4279-b9cf-56a9b903cd06-kube-api-access-6zdqk\") pod \"istiod-openshift-gateway-7b7995d5cd-clzbk\" (UID: \"529ddad0-66e7-4279-b9cf-56a9b903cd06\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-clzbk" Sep 10 16:08:34.047593 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:08:34.047557 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-clzbk" Sep 10 16:08:34.338504 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:08:34.338433 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-clzbk"] Sep 10 16:08:34.341431 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:08:34.341400 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod529ddad0_66e7_4279_b9cf_56a9b903cd06.slice/crio-57e9dff3386c94a38250bc832e13fd186f1f3ef6ebdf390dbce92ade16452134 WatchSource:0}: Error finding container 57e9dff3386c94a38250bc832e13fd186f1f3ef6ebdf390dbce92ade16452134: Status 404 returned error can't find the container with id 57e9dff3386c94a38250bc832e13fd186f1f3ef6ebdf390dbce92ade16452134 Sep 10 16:08:34.487597 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:08:34.487548 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-clzbk" event={"ID":"529ddad0-66e7-4279-b9cf-56a9b903cd06","Type":"ContainerStarted","Data":"57e9dff3386c94a38250bc832e13fd186f1f3ef6ebdf390dbce92ade16452134"} Sep 10 16:08:36.502593 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:08:36.502510 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-5468b79cc4-4l9t6" event={"ID":"7eaab891-6169-4c8c-b6eb-2f0bc525a05b","Type":"ContainerStarted","Data":"80e4fae5212d4bdb590323d0d5a54e38f5a0fc03ff0e9ccdd3b2539b0519d1c9"} Sep 10 16:08:36.519604 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:08:36.519504 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-5468b79cc4-4l9t6" podStartSLOduration=1.9201657349999999 podStartE2EDuration="5.51948135s" totalImagesPullingTime="3.599315615s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 16:08:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 16:08:36.5193583 +0000 UTC m=+341.084561846" watchObservedRunningTime="2026-09-10 16:08:36.51948135 +0000 UTC m=+341.084684909" Sep 10 16:08:37.880648 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:08:37.880580 2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"} Sep 10 16:08:37.881014 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:08:37.880662 2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"} Sep 10 16:08:38.514217 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:08:38.514181 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-clzbk" event={"ID":"529ddad0-66e7-4279-b9cf-56a9b903cd06","Type":"ContainerStarted","Data":"fa7774474f5b53bc541e56fbe53d2d00d63e11a149888807523363ae771c3f8d"} Sep 10 16:08:38.514436 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:08:38.514357 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-clzbk" Sep 10 16:08:38.516173 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:08:38.516145 2574 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7b7995d5cd-clzbk container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Sep 10 16:08:38.516285 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:08:38.516200 2574 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-clzbk" podUID="529ddad0-66e7-4279-b9cf-56a9b903cd06" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503" Sep 10 16:08:38.537647 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:08:38.537599 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-clzbk" podStartSLOduration=2.00135452 podStartE2EDuration="5.537584415s" totalImagesPullingTime="3.536229895s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 16:08:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 16:08:38.536486159 +0000 UTC m=+343.101689702" watchObservedRunningTime="2026-09-10 16:08:38.537584415 +0000 UTC m=+343.102787959" Sep 10 16:08:39.519019 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:08:39.518977 2574 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7b7995d5cd-clzbk container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Sep 10 16:08:39.519425 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:08:39.519037 2574 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-clzbk" podUID="529ddad0-66e7-4279-b9cf-56a9b903cd06" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503" Sep 10 16:08:42.519974 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:08:42.519943 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-clzbk" Sep 10 16:08:51.150173 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:08:51.150089 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-5745f97d58-88nzj"] Sep 10 16:08:51.153618 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:08:51.153600 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-5745f97d58-88nzj" Sep 10 16:08:51.156324 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:08:51.156299 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Sep 10 16:08:51.157362 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:08:51.157341 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Sep 10 16:08:51.157362 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:08:51.157353 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-kmkp8\"" Sep 10 16:08:51.157525 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:08:51.157418 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Sep 10 16:08:51.162539 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:08:51.162519 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-5745f97d58-88nzj"] Sep 10 16:08:51.270500 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:08:51.270466 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ff8z7\" (UniqueName: \"kubernetes.io/projected/2b65925f-8df9-4dfe-9b5b-3fccf4cec112-kube-api-access-ff8z7\") pod \"lws-controller-manager-5745f97d58-88nzj\" (UID: \"2b65925f-8df9-4dfe-9b5b-3fccf4cec112\") " pod="openshift-lws-operator/lws-controller-manager-5745f97d58-88nzj" Sep 10 16:08:51.270667 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:08:51.270517 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/2b65925f-8df9-4dfe-9b5b-3fccf4cec112-metrics-cert\") pod \"lws-controller-manager-5745f97d58-88nzj\" (UID: \"2b65925f-8df9-4dfe-9b5b-3fccf4cec112\") " pod="openshift-lws-operator/lws-controller-manager-5745f97d58-88nzj" Sep 10 16:08:51.270667 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:08:51.270552 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/2b65925f-8df9-4dfe-9b5b-3fccf4cec112-manager-config\") pod \"lws-controller-manager-5745f97d58-88nzj\" (UID: \"2b65925f-8df9-4dfe-9b5b-3fccf4cec112\") " pod="openshift-lws-operator/lws-controller-manager-5745f97d58-88nzj" Sep 10 16:08:51.270667 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:08:51.270584 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2b65925f-8df9-4dfe-9b5b-3fccf4cec112-cert\") pod \"lws-controller-manager-5745f97d58-88nzj\" (UID: \"2b65925f-8df9-4dfe-9b5b-3fccf4cec112\") " pod="openshift-lws-operator/lws-controller-manager-5745f97d58-88nzj" Sep 10 16:08:51.371953 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:08:51.371897 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ff8z7\" (UniqueName: \"kubernetes.io/projected/2b65925f-8df9-4dfe-9b5b-3fccf4cec112-kube-api-access-ff8z7\") pod \"lws-controller-manager-5745f97d58-88nzj\" (UID: \"2b65925f-8df9-4dfe-9b5b-3fccf4cec112\") " pod="openshift-lws-operator/lws-controller-manager-5745f97d58-88nzj" Sep 10 16:08:51.372135 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:08:51.371990 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/2b65925f-8df9-4dfe-9b5b-3fccf4cec112-metrics-cert\") pod \"lws-controller-manager-5745f97d58-88nzj\" (UID: \"2b65925f-8df9-4dfe-9b5b-3fccf4cec112\") " pod="openshift-lws-operator/lws-controller-manager-5745f97d58-88nzj" Sep 10 16:08:51.372135 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:08:51.372023 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/2b65925f-8df9-4dfe-9b5b-3fccf4cec112-manager-config\") pod \"lws-controller-manager-5745f97d58-88nzj\" (UID: \"2b65925f-8df9-4dfe-9b5b-3fccf4cec112\") " pod="openshift-lws-operator/lws-controller-manager-5745f97d58-88nzj" Sep 10 16:08:51.372135 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:08:51.372048 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2b65925f-8df9-4dfe-9b5b-3fccf4cec112-cert\") pod \"lws-controller-manager-5745f97d58-88nzj\" (UID: \"2b65925f-8df9-4dfe-9b5b-3fccf4cec112\") " pod="openshift-lws-operator/lws-controller-manager-5745f97d58-88nzj" Sep 10 16:08:51.372677 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:08:51.372651 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/2b65925f-8df9-4dfe-9b5b-3fccf4cec112-manager-config\") pod \"lws-controller-manager-5745f97d58-88nzj\" (UID: \"2b65925f-8df9-4dfe-9b5b-3fccf4cec112\") " pod="openshift-lws-operator/lws-controller-manager-5745f97d58-88nzj" Sep 10 16:08:51.374710 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:08:51.374678 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2b65925f-8df9-4dfe-9b5b-3fccf4cec112-cert\") pod \"lws-controller-manager-5745f97d58-88nzj\" (UID: \"2b65925f-8df9-4dfe-9b5b-3fccf4cec112\") " pod="openshift-lws-operator/lws-controller-manager-5745f97d58-88nzj" Sep 10 16:08:51.374796 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:08:51.374678 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/2b65925f-8df9-4dfe-9b5b-3fccf4cec112-metrics-cert\") pod \"lws-controller-manager-5745f97d58-88nzj\" (UID: \"2b65925f-8df9-4dfe-9b5b-3fccf4cec112\") " pod="openshift-lws-operator/lws-controller-manager-5745f97d58-88nzj" Sep 10 16:08:51.382933 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:08:51.382908 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ff8z7\" (UniqueName: \"kubernetes.io/projected/2b65925f-8df9-4dfe-9b5b-3fccf4cec112-kube-api-access-ff8z7\") pod \"lws-controller-manager-5745f97d58-88nzj\" (UID: \"2b65925f-8df9-4dfe-9b5b-3fccf4cec112\") " pod="openshift-lws-operator/lws-controller-manager-5745f97d58-88nzj" Sep 10 16:08:51.463803 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:08:51.463708 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-5745f97d58-88nzj" Sep 10 16:08:51.741349 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:08:51.741313 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-5745f97d58-88nzj"] Sep 10 16:08:51.742595 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:08:51.742570 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2b65925f_8df9_4dfe_9b5b_3fccf4cec112.slice/crio-bd881d2b9e00d73a2365b449eeb959b43a140810c23e371d2a3397a6e1ee3bb3 WatchSource:0}: Error finding container bd881d2b9e00d73a2365b449eeb959b43a140810c23e371d2a3397a6e1ee3bb3: Status 404 returned error can't find the container with id bd881d2b9e00d73a2365b449eeb959b43a140810c23e371d2a3397a6e1ee3bb3 Sep 10 16:08:52.579488 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:08:52.579447 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-5745f97d58-88nzj" event={"ID":"2b65925f-8df9-4dfe-9b5b-3fccf4cec112","Type":"ContainerStarted","Data":"bd881d2b9e00d73a2365b449eeb959b43a140810c23e371d2a3397a6e1ee3bb3"} Sep 10 16:08:53.585479 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:08:53.585444 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-5745f97d58-88nzj" event={"ID":"2b65925f-8df9-4dfe-9b5b-3fccf4cec112","Type":"ContainerStarted","Data":"84b2a7be1bbb6ae65d127bb12e74a6a55db05ad93bebea3c15858039b2d8aee7"} Sep 10 16:08:53.585840 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:08:53.585561 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-5745f97d58-88nzj" Sep 10 16:08:53.608799 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:08:53.608751 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-5745f97d58-88nzj" podStartSLOduration=0.926788313 podStartE2EDuration="2.608736225s" totalImagesPullingTime="1.681947912s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 16:08:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 16:08:53.607132997 +0000 UTC m=+358.172336540" watchObservedRunningTime="2026-09-10 16:08:53.608736225 +0000 UTC m=+358.173939769" Sep 10 16:08:54.200583 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:08:54.200549 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-clzbk"] Sep 10 16:08:54.200881 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:08:54.200849 2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-clzbk" podUID="529ddad0-66e7-4279-b9cf-56a9b903cd06" containerName="discovery" containerID="cri-o://fa7774474f5b53bc541e56fbe53d2d00d63e11a149888807523363ae771c3f8d" gracePeriod=30 Sep 10 16:08:54.451405 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:08:54.451338 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-clzbk" Sep 10 16:08:54.595755 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:08:54.595710 2574 generic.go:356] "Generic (PLEG): container finished" podID="529ddad0-66e7-4279-b9cf-56a9b903cd06" containerID="fa7774474f5b53bc541e56fbe53d2d00d63e11a149888807523363ae771c3f8d" exitCode=0 Sep 10 16:08:54.595755 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:08:54.595752 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-clzbk" Sep 10 16:08:54.596218 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:08:54.595796 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-clzbk" event={"ID":"529ddad0-66e7-4279-b9cf-56a9b903cd06","Type":"ContainerDied","Data":"fa7774474f5b53bc541e56fbe53d2d00d63e11a149888807523363ae771c3f8d"} Sep 10 16:08:54.596218 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:08:54.595875 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-clzbk" event={"ID":"529ddad0-66e7-4279-b9cf-56a9b903cd06","Type":"ContainerDied","Data":"57e9dff3386c94a38250bc832e13fd186f1f3ef6ebdf390dbce92ade16452134"} Sep 10 16:08:54.596218 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:08:54.595901 2574 scope.go:117] "RemoveContainer" containerID="fa7774474f5b53bc541e56fbe53d2d00d63e11a149888807523363ae771c3f8d" Sep 10 16:08:54.596638 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:08:54.596617 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/529ddad0-66e7-4279-b9cf-56a9b903cd06-istio-csr-ca-configmap\") pod \"529ddad0-66e7-4279-b9cf-56a9b903cd06\" (UID: \"529ddad0-66e7-4279-b9cf-56a9b903cd06\") " Sep 10 16:08:54.596707 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:08:54.596672 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/529ddad0-66e7-4279-b9cf-56a9b903cd06-istio-csr-dns-cert\") pod \"529ddad0-66e7-4279-b9cf-56a9b903cd06\" (UID: \"529ddad0-66e7-4279-b9cf-56a9b903cd06\") " Sep 10 16:08:54.596707 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:08:54.596699 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/529ddad0-66e7-4279-b9cf-56a9b903cd06-istio-kubeconfig\") pod \"529ddad0-66e7-4279-b9cf-56a9b903cd06\" (UID: \"529ddad0-66e7-4279-b9cf-56a9b903cd06\") " Sep 10 16:08:54.596785 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:08:54.596723 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/529ddad0-66e7-4279-b9cf-56a9b903cd06-istio-token\") pod \"529ddad0-66e7-4279-b9cf-56a9b903cd06\" (UID: \"529ddad0-66e7-4279-b9cf-56a9b903cd06\") " Sep 10 16:08:54.596785 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:08:54.596744 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/529ddad0-66e7-4279-b9cf-56a9b903cd06-local-certs\") pod \"529ddad0-66e7-4279-b9cf-56a9b903cd06\" (UID: \"529ddad0-66e7-4279-b9cf-56a9b903cd06\") " Sep 10 16:08:54.596883 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:08:54.596784 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/529ddad0-66e7-4279-b9cf-56a9b903cd06-cacerts\") pod \"529ddad0-66e7-4279-b9cf-56a9b903cd06\" (UID: \"529ddad0-66e7-4279-b9cf-56a9b903cd06\") " Sep 10 16:08:54.596883 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:08:54.596849 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6zdqk\" (UniqueName: \"kubernetes.io/projected/529ddad0-66e7-4279-b9cf-56a9b903cd06-kube-api-access-6zdqk\") pod \"529ddad0-66e7-4279-b9cf-56a9b903cd06\" (UID: \"529ddad0-66e7-4279-b9cf-56a9b903cd06\") " Sep 10 16:08:54.597084 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:08:54.597044 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/529ddad0-66e7-4279-b9cf-56a9b903cd06-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "529ddad0-66e7-4279-b9cf-56a9b903cd06" (UID: "529ddad0-66e7-4279-b9cf-56a9b903cd06"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 10 16:08:54.599307 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:08:54.599242 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/529ddad0-66e7-4279-b9cf-56a9b903cd06-istio-token" (OuterVolumeSpecName: "istio-token") pod "529ddad0-66e7-4279-b9cf-56a9b903cd06" (UID: "529ddad0-66e7-4279-b9cf-56a9b903cd06"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 16:08:54.599461 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:08:54.599426 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/529ddad0-66e7-4279-b9cf-56a9b903cd06-cacerts" (OuterVolumeSpecName: "cacerts") pod "529ddad0-66e7-4279-b9cf-56a9b903cd06" (UID: "529ddad0-66e7-4279-b9cf-56a9b903cd06"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 10 16:08:54.599559 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:08:54.599533 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/529ddad0-66e7-4279-b9cf-56a9b903cd06-kube-api-access-6zdqk" (OuterVolumeSpecName: "kube-api-access-6zdqk") pod "529ddad0-66e7-4279-b9cf-56a9b903cd06" (UID: "529ddad0-66e7-4279-b9cf-56a9b903cd06"). InnerVolumeSpecName "kube-api-access-6zdqk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 16:08:54.599680 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:08:54.599661 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/529ddad0-66e7-4279-b9cf-56a9b903cd06-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "529ddad0-66e7-4279-b9cf-56a9b903cd06" (UID: "529ddad0-66e7-4279-b9cf-56a9b903cd06"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 10 16:08:54.599749 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:08:54.599723 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/529ddad0-66e7-4279-b9cf-56a9b903cd06-local-certs" (OuterVolumeSpecName: "local-certs") pod "529ddad0-66e7-4279-b9cf-56a9b903cd06" (UID: "529ddad0-66e7-4279-b9cf-56a9b903cd06"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 10 16:08:54.599787 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:08:54.599731 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/529ddad0-66e7-4279-b9cf-56a9b903cd06-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "529ddad0-66e7-4279-b9cf-56a9b903cd06" (UID: "529ddad0-66e7-4279-b9cf-56a9b903cd06"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 10 16:08:54.615567 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:08:54.615549 2574 scope.go:117] "RemoveContainer" containerID="fa7774474f5b53bc541e56fbe53d2d00d63e11a149888807523363ae771c3f8d" Sep 10 16:08:54.615880 ip-10-0-135-53 kubenswrapper[2574]: E0910 16:08:54.615858 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fa7774474f5b53bc541e56fbe53d2d00d63e11a149888807523363ae771c3f8d\": container with ID starting with fa7774474f5b53bc541e56fbe53d2d00d63e11a149888807523363ae771c3f8d not found: ID does not exist" containerID="fa7774474f5b53bc541e56fbe53d2d00d63e11a149888807523363ae771c3f8d" Sep 10 16:08:54.615939 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:08:54.615889 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fa7774474f5b53bc541e56fbe53d2d00d63e11a149888807523363ae771c3f8d"} err="failed to get container status \"fa7774474f5b53bc541e56fbe53d2d00d63e11a149888807523363ae771c3f8d\": rpc error: code = NotFound desc = could not find container \"fa7774474f5b53bc541e56fbe53d2d00d63e11a149888807523363ae771c3f8d\": container with ID starting with fa7774474f5b53bc541e56fbe53d2d00d63e11a149888807523363ae771c3f8d not found: ID does not exist" Sep 10 16:08:54.697680 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:08:54.697648 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6zdqk\" (UniqueName: \"kubernetes.io/projected/529ddad0-66e7-4279-b9cf-56a9b903cd06-kube-api-access-6zdqk\") on node \"ip-10-0-135-53.ec2.internal\" DevicePath \"\"" Sep 10 16:08:54.697680 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:08:54.697675 2574 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/529ddad0-66e7-4279-b9cf-56a9b903cd06-istio-csr-ca-configmap\") on node \"ip-10-0-135-53.ec2.internal\" DevicePath \"\"" Sep 10 16:08:54.697680 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:08:54.697686 2574 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/529ddad0-66e7-4279-b9cf-56a9b903cd06-istio-csr-dns-cert\") on node \"ip-10-0-135-53.ec2.internal\" DevicePath \"\"" Sep 10 16:08:54.697997 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:08:54.697695 2574 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/529ddad0-66e7-4279-b9cf-56a9b903cd06-istio-kubeconfig\") on node \"ip-10-0-135-53.ec2.internal\" DevicePath \"\"" Sep 10 16:08:54.697997 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:08:54.697704 2574 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/529ddad0-66e7-4279-b9cf-56a9b903cd06-istio-token\") on node \"ip-10-0-135-53.ec2.internal\" DevicePath \"\"" Sep 10 16:08:54.697997 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:08:54.697711 2574 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/529ddad0-66e7-4279-b9cf-56a9b903cd06-local-certs\") on node \"ip-10-0-135-53.ec2.internal\" DevicePath \"\"" Sep 10 16:08:54.697997 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:08:54.697721 2574 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/529ddad0-66e7-4279-b9cf-56a9b903cd06-cacerts\") on node \"ip-10-0-135-53.ec2.internal\" DevicePath \"\"" Sep 10 16:08:54.934043 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:08:54.934013 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-clzbk"] Sep 10 16:08:54.947275 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:08:54.947233 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-clzbk"] Sep 10 16:08:56.080196 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:08:56.080151 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="529ddad0-66e7-4279-b9cf-56a9b903cd06" path="/var/lib/kubelet/pods/529ddad0-66e7-4279-b9cf-56a9b903cd06/volumes" Sep 10 16:09:04.598723 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:09:04.598689 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-5745f97d58-88nzj" Sep 10 16:09:47.855576 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:09:47.855534 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6hpzl6"] Sep 10 16:09:47.856131 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:09:47.856000 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="529ddad0-66e7-4279-b9cf-56a9b903cd06" containerName="discovery" Sep 10 16:09:47.856131 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:09:47.856020 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="529ddad0-66e7-4279-b9cf-56a9b903cd06" containerName="discovery" Sep 10 16:09:47.856131 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:09:47.856097 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="529ddad0-66e7-4279-b9cf-56a9b903cd06" containerName="discovery" Sep 10 16:09:47.859497 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:09:47.859476 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6hpzl6" Sep 10 16:09:47.862189 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:09:47.862158 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Sep 10 16:09:47.862298 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:09:47.862202 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Sep 10 16:09:47.863232 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:09:47.863217 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-fn6b2\"" Sep 10 16:09:47.870294 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:09:47.870250 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6hpzl6"] Sep 10 16:09:47.936051 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:09:47.936010 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6af29b58-c074-4a43-8d53-897248b75a84-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6hpzl6\" (UID: \"6af29b58-c074-4a43-8d53-897248b75a84\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6hpzl6" Sep 10 16:09:47.936221 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:09:47.936073 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6af29b58-c074-4a43-8d53-897248b75a84-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6hpzl6\" (UID: \"6af29b58-c074-4a43-8d53-897248b75a84\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6hpzl6" Sep 10 16:09:47.936221 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:09:47.936169 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2d268\" (UniqueName: \"kubernetes.io/projected/6af29b58-c074-4a43-8d53-897248b75a84-kube-api-access-2d268\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6hpzl6\" (UID: \"6af29b58-c074-4a43-8d53-897248b75a84\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6hpzl6" Sep 10 16:09:47.957914 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:09:47.957874 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7llgdk"] Sep 10 16:09:47.961344 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:09:47.961327 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7llgdk" Sep 10 16:09:47.969751 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:09:47.969726 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7llgdk"] Sep 10 16:09:48.036832 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:09:48.036791 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6af29b58-c074-4a43-8d53-897248b75a84-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6hpzl6\" (UID: \"6af29b58-c074-4a43-8d53-897248b75a84\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6hpzl6" Sep 10 16:09:48.037015 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:09:48.036851 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f8102fcf-e931-427c-b958-54dec4c3abda-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7llgdk\" (UID: \"f8102fcf-e931-427c-b958-54dec4c3abda\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7llgdk" Sep 10 16:09:48.037015 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:09:48.036878 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w4v6k\" (UniqueName: \"kubernetes.io/projected/f8102fcf-e931-427c-b958-54dec4c3abda-kube-api-access-w4v6k\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7llgdk\" (UID: \"f8102fcf-e931-427c-b958-54dec4c3abda\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7llgdk" Sep 10 16:09:48.037015 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:09:48.036924 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2d268\" (UniqueName: \"kubernetes.io/projected/6af29b58-c074-4a43-8d53-897248b75a84-kube-api-access-2d268\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6hpzl6\" (UID: \"6af29b58-c074-4a43-8d53-897248b75a84\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6hpzl6" Sep 10 16:09:48.037188 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:09:48.037021 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f8102fcf-e931-427c-b958-54dec4c3abda-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7llgdk\" (UID: \"f8102fcf-e931-427c-b958-54dec4c3abda\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7llgdk" Sep 10 16:09:48.037188 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:09:48.037064 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6af29b58-c074-4a43-8d53-897248b75a84-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6hpzl6\" (UID: \"6af29b58-c074-4a43-8d53-897248b75a84\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6hpzl6" Sep 10 16:09:48.037188 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:09:48.037182 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6af29b58-c074-4a43-8d53-897248b75a84-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6hpzl6\" (UID: \"6af29b58-c074-4a43-8d53-897248b75a84\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6hpzl6" Sep 10 16:09:48.037448 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:09:48.037427 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6af29b58-c074-4a43-8d53-897248b75a84-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6hpzl6\" (UID: \"6af29b58-c074-4a43-8d53-897248b75a84\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6hpzl6" Sep 10 16:09:48.044996 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:09:48.044971 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2d268\" (UniqueName: \"kubernetes.io/projected/6af29b58-c074-4a43-8d53-897248b75a84-kube-api-access-2d268\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6hpzl6\" (UID: \"6af29b58-c074-4a43-8d53-897248b75a84\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6hpzl6" Sep 10 16:09:48.059087 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:09:48.059061 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847arhjqp"] Sep 10 16:09:48.062606 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:09:48.062588 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847arhjqp" Sep 10 16:09:48.073254 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:09:48.073229 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847arhjqp"] Sep 10 16:09:48.137641 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:09:48.137557 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f8102fcf-e931-427c-b958-54dec4c3abda-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7llgdk\" (UID: \"f8102fcf-e931-427c-b958-54dec4c3abda\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7llgdk" Sep 10 16:09:48.137641 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:09:48.137591 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w4v6k\" (UniqueName: \"kubernetes.io/projected/f8102fcf-e931-427c-b958-54dec4c3abda-kube-api-access-w4v6k\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7llgdk\" (UID: \"f8102fcf-e931-427c-b958-54dec4c3abda\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7llgdk" Sep 10 16:09:48.137641 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:09:48.137613 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/371ddc86-a5f7-4385-a86e-b8b2f57b7ae8-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847arhjqp\" (UID: \"371ddc86-a5f7-4385-a86e-b8b2f57b7ae8\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847arhjqp" Sep 10 16:09:48.137641 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:09:48.137630 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/371ddc86-a5f7-4385-a86e-b8b2f57b7ae8-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847arhjqp\" (UID: \"371ddc86-a5f7-4385-a86e-b8b2f57b7ae8\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847arhjqp" Sep 10 16:09:48.137903 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:09:48.137744 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f8102fcf-e931-427c-b958-54dec4c3abda-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7llgdk\" (UID: \"f8102fcf-e931-427c-b958-54dec4c3abda\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7llgdk" Sep 10 16:09:48.137903 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:09:48.137782 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-svs8t\" (UniqueName: \"kubernetes.io/projected/371ddc86-a5f7-4385-a86e-b8b2f57b7ae8-kube-api-access-svs8t\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847arhjqp\" (UID: \"371ddc86-a5f7-4385-a86e-b8b2f57b7ae8\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847arhjqp" Sep 10 16:09:48.137974 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:09:48.137907 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f8102fcf-e931-427c-b958-54dec4c3abda-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7llgdk\" (UID: \"f8102fcf-e931-427c-b958-54dec4c3abda\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7llgdk" Sep 10 16:09:48.138050 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:09:48.138034 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f8102fcf-e931-427c-b958-54dec4c3abda-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7llgdk\" (UID: \"f8102fcf-e931-427c-b958-54dec4c3abda\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7llgdk" Sep 10 16:09:48.146202 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:09:48.146178 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w4v6k\" (UniqueName: \"kubernetes.io/projected/f8102fcf-e931-427c-b958-54dec4c3abda-kube-api-access-w4v6k\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7llgdk\" (UID: \"f8102fcf-e931-427c-b958-54dec4c3abda\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7llgdk" Sep 10 16:09:48.163505 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:09:48.163474 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cxc2jw"] Sep 10 16:09:48.166929 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:09:48.166910 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cxc2jw" Sep 10 16:09:48.172723 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:09:48.172699 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6hpzl6" Sep 10 16:09:48.175969 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:09:48.175877 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cxc2jw"] Sep 10 16:09:48.239107 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:09:48.239021 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/371ddc86-a5f7-4385-a86e-b8b2f57b7ae8-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847arhjqp\" (UID: \"371ddc86-a5f7-4385-a86e-b8b2f57b7ae8\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847arhjqp" Sep 10 16:09:48.239107 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:09:48.239053 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/371ddc86-a5f7-4385-a86e-b8b2f57b7ae8-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847arhjqp\" (UID: \"371ddc86-a5f7-4385-a86e-b8b2f57b7ae8\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847arhjqp" Sep 10 16:09:48.239356 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:09:48.239335 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dxlkv\" (UniqueName: \"kubernetes.io/projected/5d583a30-2d7a-49f7-aae5-d544bcf7717c-kube-api-access-dxlkv\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cxc2jw\" (UID: \"5d583a30-2d7a-49f7-aae5-d544bcf7717c\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cxc2jw" Sep 10 16:09:48.239418 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:09:48.239383 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5d583a30-2d7a-49f7-aae5-d544bcf7717c-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cxc2jw\" (UID: \"5d583a30-2d7a-49f7-aae5-d544bcf7717c\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cxc2jw" Sep 10 16:09:48.239418 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:09:48.239406 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5d583a30-2d7a-49f7-aae5-d544bcf7717c-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cxc2jw\" (UID: \"5d583a30-2d7a-49f7-aae5-d544bcf7717c\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cxc2jw" Sep 10 16:09:48.239520 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:09:48.239462 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-svs8t\" (UniqueName: \"kubernetes.io/projected/371ddc86-a5f7-4385-a86e-b8b2f57b7ae8-kube-api-access-svs8t\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847arhjqp\" (UID: \"371ddc86-a5f7-4385-a86e-b8b2f57b7ae8\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847arhjqp" Sep 10 16:09:48.239625 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:09:48.239593 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/371ddc86-a5f7-4385-a86e-b8b2f57b7ae8-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847arhjqp\" (UID: \"371ddc86-a5f7-4385-a86e-b8b2f57b7ae8\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847arhjqp" Sep 10 16:09:48.239681 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:09:48.239621 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/371ddc86-a5f7-4385-a86e-b8b2f57b7ae8-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847arhjqp\" (UID: \"371ddc86-a5f7-4385-a86e-b8b2f57b7ae8\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847arhjqp" Sep 10 16:09:48.248120 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:09:48.248097 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-svs8t\" (UniqueName: \"kubernetes.io/projected/371ddc86-a5f7-4385-a86e-b8b2f57b7ae8-kube-api-access-svs8t\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847arhjqp\" (UID: \"371ddc86-a5f7-4385-a86e-b8b2f57b7ae8\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847arhjqp" Sep 10 16:09:48.270185 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:09:48.270160 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7llgdk" Sep 10 16:09:48.340803 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:09:48.340770 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5d583a30-2d7a-49f7-aae5-d544bcf7717c-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cxc2jw\" (UID: \"5d583a30-2d7a-49f7-aae5-d544bcf7717c\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cxc2jw" Sep 10 16:09:48.340941 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:09:48.340883 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dxlkv\" (UniqueName: \"kubernetes.io/projected/5d583a30-2d7a-49f7-aae5-d544bcf7717c-kube-api-access-dxlkv\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cxc2jw\" (UID: \"5d583a30-2d7a-49f7-aae5-d544bcf7717c\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cxc2jw" Sep 10 16:09:48.340941 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:09:48.340909 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5d583a30-2d7a-49f7-aae5-d544bcf7717c-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cxc2jw\" (UID: \"5d583a30-2d7a-49f7-aae5-d544bcf7717c\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cxc2jw" Sep 10 16:09:48.341150 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:09:48.341131 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5d583a30-2d7a-49f7-aae5-d544bcf7717c-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cxc2jw\" (UID: \"5d583a30-2d7a-49f7-aae5-d544bcf7717c\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cxc2jw" Sep 10 16:09:48.341191 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:09:48.341181 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5d583a30-2d7a-49f7-aae5-d544bcf7717c-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cxc2jw\" (UID: \"5d583a30-2d7a-49f7-aae5-d544bcf7717c\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cxc2jw" Sep 10 16:09:48.350483 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:09:48.350451 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dxlkv\" (UniqueName: \"kubernetes.io/projected/5d583a30-2d7a-49f7-aae5-d544bcf7717c-kube-api-access-dxlkv\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cxc2jw\" (UID: \"5d583a30-2d7a-49f7-aae5-d544bcf7717c\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cxc2jw" Sep 10 16:09:48.372000 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:09:48.371967 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847arhjqp" Sep 10 16:09:48.443809 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:09:48.443776 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6hpzl6"] Sep 10 16:09:48.444360 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:09:48.444323 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6af29b58_c074_4a43_8d53_897248b75a84.slice/crio-2cb23b9b5f71ef4bb3b210bd1d4390c787b008445bf78ae92e5b958cf0603ff6 WatchSource:0}: Error finding container 2cb23b9b5f71ef4bb3b210bd1d4390c787b008445bf78ae92e5b958cf0603ff6: Status 404 returned error can't find the container with id 2cb23b9b5f71ef4bb3b210bd1d4390c787b008445bf78ae92e5b958cf0603ff6 Sep 10 16:09:48.477043 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:09:48.477021 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cxc2jw" Sep 10 16:09:48.546708 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:09:48.546680 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7llgdk"] Sep 10 16:09:48.599204 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:09:48.599159 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf8102fcf_e931_427c_b958_54dec4c3abda.slice/crio-7d0c86fefb3384e6dfdbd004939027fdafe8d850311f8ff6f49a2e8a42a3446e WatchSource:0}: Error finding container 7d0c86fefb3384e6dfdbd004939027fdafe8d850311f8ff6f49a2e8a42a3446e: Status 404 returned error can't find the container with id 7d0c86fefb3384e6dfdbd004939027fdafe8d850311f8ff6f49a2e8a42a3446e Sep 10 16:09:48.642073 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:09:48.642047 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847arhjqp"] Sep 10 16:09:48.643179 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:09:48.643116 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod371ddc86_a5f7_4385_a86e_b8b2f57b7ae8.slice/crio-7db87a8fece7402033994a2f49b6b35c9f8cdb8afa472191dfa97990e7dbce81 WatchSource:0}: Error finding container 7db87a8fece7402033994a2f49b6b35c9f8cdb8afa472191dfa97990e7dbce81: Status 404 returned error can't find the container with id 7db87a8fece7402033994a2f49b6b35c9f8cdb8afa472191dfa97990e7dbce81 Sep 10 16:09:48.749255 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:09:48.749232 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cxc2jw"] Sep 10 16:09:48.751428 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:09:48.751405 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5d583a30_2d7a_49f7_aae5_d544bcf7717c.slice/crio-27d75ad79b6be566831f3366f6f1dd0eb906c3e3d2ce72b10492791998ebcc5f WatchSource:0}: Error finding container 27d75ad79b6be566831f3366f6f1dd0eb906c3e3d2ce72b10492791998ebcc5f: Status 404 returned error can't find the container with id 27d75ad79b6be566831f3366f6f1dd0eb906c3e3d2ce72b10492791998ebcc5f Sep 10 16:09:48.840311 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:09:48.840274 2574 generic.go:356] "Generic (PLEG): container finished" podID="371ddc86-a5f7-4385-a86e-b8b2f57b7ae8" containerID="307f70d476c57cf7a8ae6e7b28cf5e7b25a8323bca8a2f53524221d1bc3639f4" exitCode=0 Sep 10 16:09:48.840464 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:09:48.840355 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847arhjqp" event={"ID":"371ddc86-a5f7-4385-a86e-b8b2f57b7ae8","Type":"ContainerDied","Data":"307f70d476c57cf7a8ae6e7b28cf5e7b25a8323bca8a2f53524221d1bc3639f4"} Sep 10 16:09:48.840464 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:09:48.840409 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847arhjqp" event={"ID":"371ddc86-a5f7-4385-a86e-b8b2f57b7ae8","Type":"ContainerStarted","Data":"7db87a8fece7402033994a2f49b6b35c9f8cdb8afa472191dfa97990e7dbce81"} Sep 10 16:09:48.842271 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:09:48.842236 2574 generic.go:356] "Generic (PLEG): container finished" podID="6af29b58-c074-4a43-8d53-897248b75a84" containerID="8771f7e24617c7f80b262e4c013212ef5feb38c4e83026993c945b412a408eb6" exitCode=0 Sep 10 16:09:48.842372 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:09:48.842302 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6hpzl6" event={"ID":"6af29b58-c074-4a43-8d53-897248b75a84","Type":"ContainerDied","Data":"8771f7e24617c7f80b262e4c013212ef5feb38c4e83026993c945b412a408eb6"} Sep 10 16:09:48.842372 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:09:48.842366 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6hpzl6" event={"ID":"6af29b58-c074-4a43-8d53-897248b75a84","Type":"ContainerStarted","Data":"2cb23b9b5f71ef4bb3b210bd1d4390c787b008445bf78ae92e5b958cf0603ff6"} Sep 10 16:09:48.844064 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:09:48.844036 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cxc2jw" event={"ID":"5d583a30-2d7a-49f7-aae5-d544bcf7717c","Type":"ContainerStarted","Data":"1b10c39cea203fedac9949c5ba43546228e9587fc711eb1c1a1b28b5fbf2e400"} Sep 10 16:09:48.844159 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:09:48.844098 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cxc2jw" event={"ID":"5d583a30-2d7a-49f7-aae5-d544bcf7717c","Type":"ContainerStarted","Data":"27d75ad79b6be566831f3366f6f1dd0eb906c3e3d2ce72b10492791998ebcc5f"} Sep 10 16:09:48.846242 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:09:48.846222 2574 generic.go:356] "Generic (PLEG): container finished" podID="f8102fcf-e931-427c-b958-54dec4c3abda" containerID="c70cb880116717fc8311bb445b567896fcf8b3553a3fffe41addaa9d3a6256a3" exitCode=0 Sep 10 16:09:48.846363 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:09:48.846253 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7llgdk" event={"ID":"f8102fcf-e931-427c-b958-54dec4c3abda","Type":"ContainerDied","Data":"c70cb880116717fc8311bb445b567896fcf8b3553a3fffe41addaa9d3a6256a3"} Sep 10 16:09:48.846363 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:09:48.846325 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7llgdk" event={"ID":"f8102fcf-e931-427c-b958-54dec4c3abda","Type":"ContainerStarted","Data":"7d0c86fefb3384e6dfdbd004939027fdafe8d850311f8ff6f49a2e8a42a3446e"} Sep 10 16:09:49.852587 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:09:49.852553 2574 generic.go:356] "Generic (PLEG): container finished" podID="5d583a30-2d7a-49f7-aae5-d544bcf7717c" containerID="1b10c39cea203fedac9949c5ba43546228e9587fc711eb1c1a1b28b5fbf2e400" exitCode=0 Sep 10 16:09:49.853028 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:09:49.852644 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cxc2jw" event={"ID":"5d583a30-2d7a-49f7-aae5-d544bcf7717c","Type":"ContainerDied","Data":"1b10c39cea203fedac9949c5ba43546228e9587fc711eb1c1a1b28b5fbf2e400"} Sep 10 16:09:49.854609 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:09:49.854577 2574 generic.go:356] "Generic (PLEG): container finished" podID="f8102fcf-e931-427c-b958-54dec4c3abda" containerID="e42bd0a360441aa8459ec9bdf1102f59624ca2878bc74931901fa25fa0c645aa" exitCode=0 Sep 10 16:09:49.854691 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:09:49.854662 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7llgdk" event={"ID":"f8102fcf-e931-427c-b958-54dec4c3abda","Type":"ContainerDied","Data":"e42bd0a360441aa8459ec9bdf1102f59624ca2878bc74931901fa25fa0c645aa"} Sep 10 16:09:50.861787 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:09:50.861749 2574 generic.go:356] "Generic (PLEG): container finished" podID="f8102fcf-e931-427c-b958-54dec4c3abda" containerID="c975466ba0a50faa001976ba09d64ce553eba68fb7a7e8e0957758efe65bf097" exitCode=0 Sep 10 16:09:50.862156 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:09:50.861836 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7llgdk" event={"ID":"f8102fcf-e931-427c-b958-54dec4c3abda","Type":"ContainerDied","Data":"c975466ba0a50faa001976ba09d64ce553eba68fb7a7e8e0957758efe65bf097"} Sep 10 16:09:51.869926 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:09:51.869893 2574 generic.go:356] "Generic (PLEG): container finished" podID="371ddc86-a5f7-4385-a86e-b8b2f57b7ae8" containerID="c9834fc66096ccb18f1cec8b8bd33a93f82840edce6d0a882be9b2203c21863a" exitCode=0 Sep 10 16:09:51.870419 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:09:51.869958 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847arhjqp" event={"ID":"371ddc86-a5f7-4385-a86e-b8b2f57b7ae8","Type":"ContainerDied","Data":"c9834fc66096ccb18f1cec8b8bd33a93f82840edce6d0a882be9b2203c21863a"} Sep 10 16:09:52.005336 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:09:52.005305 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7llgdk" Sep 10 16:09:52.174320 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:09:52.174217 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f8102fcf-e931-427c-b958-54dec4c3abda-util\") pod \"f8102fcf-e931-427c-b958-54dec4c3abda\" (UID: \"f8102fcf-e931-427c-b958-54dec4c3abda\") " Sep 10 16:09:52.174320 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:09:52.174292 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w4v6k\" (UniqueName: \"kubernetes.io/projected/f8102fcf-e931-427c-b958-54dec4c3abda-kube-api-access-w4v6k\") pod \"f8102fcf-e931-427c-b958-54dec4c3abda\" (UID: \"f8102fcf-e931-427c-b958-54dec4c3abda\") " Sep 10 16:09:52.174320 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:09:52.174320 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f8102fcf-e931-427c-b958-54dec4c3abda-bundle\") pod \"f8102fcf-e931-427c-b958-54dec4c3abda\" (UID: \"f8102fcf-e931-427c-b958-54dec4c3abda\") " Sep 10 16:09:52.174891 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:09:52.174862 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f8102fcf-e931-427c-b958-54dec4c3abda-bundle" (OuterVolumeSpecName: "bundle") pod "f8102fcf-e931-427c-b958-54dec4c3abda" (UID: "f8102fcf-e931-427c-b958-54dec4c3abda"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 10 16:09:52.176432 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:09:52.176411 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f8102fcf-e931-427c-b958-54dec4c3abda-kube-api-access-w4v6k" (OuterVolumeSpecName: "kube-api-access-w4v6k") pod "f8102fcf-e931-427c-b958-54dec4c3abda" (UID: "f8102fcf-e931-427c-b958-54dec4c3abda"). InnerVolumeSpecName "kube-api-access-w4v6k". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 16:09:52.179191 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:09:52.179148 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f8102fcf-e931-427c-b958-54dec4c3abda-util" (OuterVolumeSpecName: "util") pod "f8102fcf-e931-427c-b958-54dec4c3abda" (UID: "f8102fcf-e931-427c-b958-54dec4c3abda"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 10 16:09:52.275320 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:09:52.275287 2574 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f8102fcf-e931-427c-b958-54dec4c3abda-util\") on node \"ip-10-0-135-53.ec2.internal\" DevicePath \"\"" Sep 10 16:09:52.275320 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:09:52.275316 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w4v6k\" (UniqueName: \"kubernetes.io/projected/f8102fcf-e931-427c-b958-54dec4c3abda-kube-api-access-w4v6k\") on node \"ip-10-0-135-53.ec2.internal\" DevicePath \"\"" Sep 10 16:09:52.275320 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:09:52.275328 2574 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f8102fcf-e931-427c-b958-54dec4c3abda-bundle\") on node \"ip-10-0-135-53.ec2.internal\" DevicePath \"\"" Sep 10 16:09:52.877396 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:09:52.877299 2574 generic.go:356] "Generic (PLEG): container finished" podID="371ddc86-a5f7-4385-a86e-b8b2f57b7ae8" containerID="8c931bf5dbb82e93b1392e81e1d53ffb52ca69ff24a3bde3bb4964ab83736a49" exitCode=0 Sep 10 16:09:52.877774 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:09:52.877413 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847arhjqp" event={"ID":"371ddc86-a5f7-4385-a86e-b8b2f57b7ae8","Type":"ContainerDied","Data":"8c931bf5dbb82e93b1392e81e1d53ffb52ca69ff24a3bde3bb4964ab83736a49"} Sep 10 16:09:52.879155 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:09:52.879130 2574 generic.go:356] "Generic (PLEG): container finished" podID="6af29b58-c074-4a43-8d53-897248b75a84" containerID="f7024fd539c2fc397fdbc69999818f10efe5a38a3d5755b35d9c350cc51774fb" exitCode=0 Sep 10 16:09:52.879290 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:09:52.879216 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6hpzl6" event={"ID":"6af29b58-c074-4a43-8d53-897248b75a84","Type":"ContainerDied","Data":"f7024fd539c2fc397fdbc69999818f10efe5a38a3d5755b35d9c350cc51774fb"} Sep 10 16:09:52.881107 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:09:52.881075 2574 generic.go:356] "Generic (PLEG): container finished" podID="5d583a30-2d7a-49f7-aae5-d544bcf7717c" containerID="ebb8f78f71cec20ff5f819f52ade9d87e5031966b52845375ceef781240687c9" exitCode=0 Sep 10 16:09:52.881244 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:09:52.881142 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cxc2jw" event={"ID":"5d583a30-2d7a-49f7-aae5-d544bcf7717c","Type":"ContainerDied","Data":"ebb8f78f71cec20ff5f819f52ade9d87e5031966b52845375ceef781240687c9"} Sep 10 16:09:52.883135 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:09:52.883110 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7llgdk" Sep 10 16:09:52.883225 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:09:52.883115 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7llgdk" event={"ID":"f8102fcf-e931-427c-b958-54dec4c3abda","Type":"ContainerDied","Data":"7d0c86fefb3384e6dfdbd004939027fdafe8d850311f8ff6f49a2e8a42a3446e"} Sep 10 16:09:52.883293 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:09:52.883226 2574 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7d0c86fefb3384e6dfdbd004939027fdafe8d850311f8ff6f49a2e8a42a3446e" Sep 10 16:09:53.894746 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:09:53.894710 2574 generic.go:356] "Generic (PLEG): container finished" podID="6af29b58-c074-4a43-8d53-897248b75a84" containerID="b34032f50a05c24cfebf57b2f644b941fe5659a5d127c6eaf2e866c40e20da97" exitCode=0 Sep 10 16:09:53.895311 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:09:53.894792 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6hpzl6" event={"ID":"6af29b58-c074-4a43-8d53-897248b75a84","Type":"ContainerDied","Data":"b34032f50a05c24cfebf57b2f644b941fe5659a5d127c6eaf2e866c40e20da97"} Sep 10 16:09:53.896880 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:09:53.896857 2574 generic.go:356] "Generic (PLEG): container finished" podID="5d583a30-2d7a-49f7-aae5-d544bcf7717c" containerID="525b0a56b32a2036c41a254739202f36f3964d68fac182584607633759faf139" exitCode=0 Sep 10 16:09:53.896994 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:09:53.896910 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cxc2jw" event={"ID":"5d583a30-2d7a-49f7-aae5-d544bcf7717c","Type":"ContainerDied","Data":"525b0a56b32a2036c41a254739202f36f3964d68fac182584607633759faf139"} Sep 10 16:09:54.051951 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:09:54.051925 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847arhjqp" Sep 10 16:09:54.191464 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:09:54.191372 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-svs8t\" (UniqueName: \"kubernetes.io/projected/371ddc86-a5f7-4385-a86e-b8b2f57b7ae8-kube-api-access-svs8t\") pod \"371ddc86-a5f7-4385-a86e-b8b2f57b7ae8\" (UID: \"371ddc86-a5f7-4385-a86e-b8b2f57b7ae8\") " Sep 10 16:09:54.191464 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:09:54.191434 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/371ddc86-a5f7-4385-a86e-b8b2f57b7ae8-bundle\") pod \"371ddc86-a5f7-4385-a86e-b8b2f57b7ae8\" (UID: \"371ddc86-a5f7-4385-a86e-b8b2f57b7ae8\") " Sep 10 16:09:54.191464 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:09:54.191467 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/371ddc86-a5f7-4385-a86e-b8b2f57b7ae8-util\") pod \"371ddc86-a5f7-4385-a86e-b8b2f57b7ae8\" (UID: \"371ddc86-a5f7-4385-a86e-b8b2f57b7ae8\") " Sep 10 16:09:54.192140 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:09:54.192107 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/371ddc86-a5f7-4385-a86e-b8b2f57b7ae8-bundle" (OuterVolumeSpecName: "bundle") pod "371ddc86-a5f7-4385-a86e-b8b2f57b7ae8" (UID: "371ddc86-a5f7-4385-a86e-b8b2f57b7ae8"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 10 16:09:54.193567 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:09:54.193539 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/371ddc86-a5f7-4385-a86e-b8b2f57b7ae8-kube-api-access-svs8t" (OuterVolumeSpecName: "kube-api-access-svs8t") pod "371ddc86-a5f7-4385-a86e-b8b2f57b7ae8" (UID: "371ddc86-a5f7-4385-a86e-b8b2f57b7ae8"). InnerVolumeSpecName "kube-api-access-svs8t". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 16:09:54.292767 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:09:54.292721 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-svs8t\" (UniqueName: \"kubernetes.io/projected/371ddc86-a5f7-4385-a86e-b8b2f57b7ae8-kube-api-access-svs8t\") on node \"ip-10-0-135-53.ec2.internal\" DevicePath \"\"" Sep 10 16:09:54.292939 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:09:54.292781 2574 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/371ddc86-a5f7-4385-a86e-b8b2f57b7ae8-bundle\") on node \"ip-10-0-135-53.ec2.internal\" DevicePath \"\"" Sep 10 16:09:54.400442 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:09:54.400401 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/371ddc86-a5f7-4385-a86e-b8b2f57b7ae8-util" (OuterVolumeSpecName: "util") pod "371ddc86-a5f7-4385-a86e-b8b2f57b7ae8" (UID: "371ddc86-a5f7-4385-a86e-b8b2f57b7ae8"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 10 16:09:54.494523 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:09:54.494433 2574 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/371ddc86-a5f7-4385-a86e-b8b2f57b7ae8-util\") on node \"ip-10-0-135-53.ec2.internal\" DevicePath \"\"" Sep 10 16:09:54.903671 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:09:54.903635 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847arhjqp" event={"ID":"371ddc86-a5f7-4385-a86e-b8b2f57b7ae8","Type":"ContainerDied","Data":"7db87a8fece7402033994a2f49b6b35c9f8cdb8afa472191dfa97990e7dbce81"} Sep 10 16:09:54.903671 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:09:54.903669 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847arhjqp" Sep 10 16:09:54.904089 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:09:54.903688 2574 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7db87a8fece7402033994a2f49b6b35c9f8cdb8afa472191dfa97990e7dbce81" Sep 10 16:09:55.055146 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:09:55.055119 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6hpzl6" Sep 10 16:09:55.058592 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:09:55.058572 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cxc2jw" Sep 10 16:09:55.200706 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:09:55.200619 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5d583a30-2d7a-49f7-aae5-d544bcf7717c-bundle\") pod \"5d583a30-2d7a-49f7-aae5-d544bcf7717c\" (UID: \"5d583a30-2d7a-49f7-aae5-d544bcf7717c\") " Sep 10 16:09:55.200706 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:09:55.200657 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2d268\" (UniqueName: \"kubernetes.io/projected/6af29b58-c074-4a43-8d53-897248b75a84-kube-api-access-2d268\") pod \"6af29b58-c074-4a43-8d53-897248b75a84\" (UID: \"6af29b58-c074-4a43-8d53-897248b75a84\") " Sep 10 16:09:55.200706 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:09:55.200679 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6af29b58-c074-4a43-8d53-897248b75a84-bundle\") pod \"6af29b58-c074-4a43-8d53-897248b75a84\" (UID: \"6af29b58-c074-4a43-8d53-897248b75a84\") " Sep 10 16:09:55.200974 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:09:55.200719 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6af29b58-c074-4a43-8d53-897248b75a84-util\") pod \"6af29b58-c074-4a43-8d53-897248b75a84\" (UID: \"6af29b58-c074-4a43-8d53-897248b75a84\") " Sep 10 16:09:55.200974 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:09:55.200750 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5d583a30-2d7a-49f7-aae5-d544bcf7717c-util\") pod \"5d583a30-2d7a-49f7-aae5-d544bcf7717c\" (UID: \"5d583a30-2d7a-49f7-aae5-d544bcf7717c\") " Sep 10 16:09:55.200974 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:09:55.200775 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dxlkv\" (UniqueName: \"kubernetes.io/projected/5d583a30-2d7a-49f7-aae5-d544bcf7717c-kube-api-access-dxlkv\") pod \"5d583a30-2d7a-49f7-aae5-d544bcf7717c\" (UID: \"5d583a30-2d7a-49f7-aae5-d544bcf7717c\") " Sep 10 16:09:55.201405 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:09:55.201336 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5d583a30-2d7a-49f7-aae5-d544bcf7717c-bundle" (OuterVolumeSpecName: "bundle") pod "5d583a30-2d7a-49f7-aae5-d544bcf7717c" (UID: "5d583a30-2d7a-49f7-aae5-d544bcf7717c"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 10 16:09:55.201550 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:09:55.201464 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6af29b58-c074-4a43-8d53-897248b75a84-bundle" (OuterVolumeSpecName: "bundle") pod "6af29b58-c074-4a43-8d53-897248b75a84" (UID: "6af29b58-c074-4a43-8d53-897248b75a84"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 10 16:09:55.203017 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:09:55.202989 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6af29b58-c074-4a43-8d53-897248b75a84-kube-api-access-2d268" (OuterVolumeSpecName: "kube-api-access-2d268") pod "6af29b58-c074-4a43-8d53-897248b75a84" (UID: "6af29b58-c074-4a43-8d53-897248b75a84"). InnerVolumeSpecName "kube-api-access-2d268". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 16:09:55.203484 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:09:55.203459 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5d583a30-2d7a-49f7-aae5-d544bcf7717c-kube-api-access-dxlkv" (OuterVolumeSpecName: "kube-api-access-dxlkv") pod "5d583a30-2d7a-49f7-aae5-d544bcf7717c" (UID: "5d583a30-2d7a-49f7-aae5-d544bcf7717c"). InnerVolumeSpecName "kube-api-access-dxlkv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 16:09:55.206297 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:09:55.206274 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6af29b58-c074-4a43-8d53-897248b75a84-util" (OuterVolumeSpecName: "util") pod "6af29b58-c074-4a43-8d53-897248b75a84" (UID: "6af29b58-c074-4a43-8d53-897248b75a84"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 10 16:09:55.206490 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:09:55.206466 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5d583a30-2d7a-49f7-aae5-d544bcf7717c-util" (OuterVolumeSpecName: "util") pod "5d583a30-2d7a-49f7-aae5-d544bcf7717c" (UID: "5d583a30-2d7a-49f7-aae5-d544bcf7717c"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 10 16:09:55.302054 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:09:55.302017 2574 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6af29b58-c074-4a43-8d53-897248b75a84-util\") on node \"ip-10-0-135-53.ec2.internal\" DevicePath \"\"" Sep 10 16:09:55.302054 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:09:55.302047 2574 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5d583a30-2d7a-49f7-aae5-d544bcf7717c-util\") on node \"ip-10-0-135-53.ec2.internal\" DevicePath \"\"" Sep 10 16:09:55.302054 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:09:55.302057 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dxlkv\" (UniqueName: \"kubernetes.io/projected/5d583a30-2d7a-49f7-aae5-d544bcf7717c-kube-api-access-dxlkv\") on node \"ip-10-0-135-53.ec2.internal\" DevicePath \"\"" Sep 10 16:09:55.302054 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:09:55.302067 2574 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5d583a30-2d7a-49f7-aae5-d544bcf7717c-bundle\") on node \"ip-10-0-135-53.ec2.internal\" DevicePath \"\"" Sep 10 16:09:55.302333 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:09:55.302075 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2d268\" (UniqueName: \"kubernetes.io/projected/6af29b58-c074-4a43-8d53-897248b75a84-kube-api-access-2d268\") on node \"ip-10-0-135-53.ec2.internal\" DevicePath \"\"" Sep 10 16:09:55.302333 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:09:55.302083 2574 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6af29b58-c074-4a43-8d53-897248b75a84-bundle\") on node \"ip-10-0-135-53.ec2.internal\" DevicePath \"\"" Sep 10 16:09:55.910077 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:09:55.910042 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6hpzl6" event={"ID":"6af29b58-c074-4a43-8d53-897248b75a84","Type":"ContainerDied","Data":"2cb23b9b5f71ef4bb3b210bd1d4390c787b008445bf78ae92e5b958cf0603ff6"} Sep 10 16:09:55.910509 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:09:55.910098 2574 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2cb23b9b5f71ef4bb3b210bd1d4390c787b008445bf78ae92e5b958cf0603ff6" Sep 10 16:09:55.910509 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:09:55.910048 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6hpzl6" Sep 10 16:09:55.912048 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:09:55.912023 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cxc2jw" event={"ID":"5d583a30-2d7a-49f7-aae5-d544bcf7717c","Type":"ContainerDied","Data":"27d75ad79b6be566831f3366f6f1dd0eb906c3e3d2ce72b10492791998ebcc5f"} Sep 10 16:09:55.912164 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:09:55.912068 2574 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="27d75ad79b6be566831f3366f6f1dd0eb906c3e3d2ce72b10492791998ebcc5f" Sep 10 16:09:55.912164 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:09:55.912035 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cxc2jw" Sep 10 16:10:15.309975 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:10:15.309941 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-fbdd4f445-6xz94"] Sep 10 16:10:15.310456 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:10:15.310224 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5d583a30-2d7a-49f7-aae5-d544bcf7717c" containerName="extract" Sep 10 16:10:15.310456 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:10:15.310234 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="5d583a30-2d7a-49f7-aae5-d544bcf7717c" containerName="extract" Sep 10 16:10:15.310456 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:10:15.310243 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f8102fcf-e931-427c-b958-54dec4c3abda" containerName="pull" Sep 10 16:10:15.310456 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:10:15.310249 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="f8102fcf-e931-427c-b958-54dec4c3abda" containerName="pull" Sep 10 16:10:15.310456 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:10:15.310257 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5d583a30-2d7a-49f7-aae5-d544bcf7717c" containerName="util" Sep 10 16:10:15.310456 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:10:15.310278 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="5d583a30-2d7a-49f7-aae5-d544bcf7717c" containerName="util" Sep 10 16:10:15.310456 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:10:15.310284 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6af29b58-c074-4a43-8d53-897248b75a84" containerName="pull" Sep 10 16:10:15.310456 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:10:15.310289 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="6af29b58-c074-4a43-8d53-897248b75a84" containerName="pull" Sep 10 16:10:15.310456 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:10:15.310295 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f8102fcf-e931-427c-b958-54dec4c3abda" containerName="util" Sep 10 16:10:15.310456 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:10:15.310300 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="f8102fcf-e931-427c-b958-54dec4c3abda" containerName="util" Sep 10 16:10:15.310456 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:10:15.310308 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6af29b58-c074-4a43-8d53-897248b75a84" containerName="util" Sep 10 16:10:15.310456 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:10:15.310313 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="6af29b58-c074-4a43-8d53-897248b75a84" containerName="util" Sep 10 16:10:15.310456 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:10:15.310323 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="371ddc86-a5f7-4385-a86e-b8b2f57b7ae8" containerName="pull" Sep 10 16:10:15.310456 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:10:15.310328 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="371ddc86-a5f7-4385-a86e-b8b2f57b7ae8" containerName="pull" Sep 10 16:10:15.310456 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:10:15.310334 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6af29b58-c074-4a43-8d53-897248b75a84" containerName="extract" Sep 10 16:10:15.310456 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:10:15.310339 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="6af29b58-c074-4a43-8d53-897248b75a84" containerName="extract" Sep 10 16:10:15.310456 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:10:15.310348 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f8102fcf-e931-427c-b958-54dec4c3abda" containerName="extract" Sep 10 16:10:15.310456 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:10:15.310353 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="f8102fcf-e931-427c-b958-54dec4c3abda" containerName="extract" Sep 10 16:10:15.310456 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:10:15.310358 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="371ddc86-a5f7-4385-a86e-b8b2f57b7ae8" containerName="extract" Sep 10 16:10:15.310456 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:10:15.310363 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="371ddc86-a5f7-4385-a86e-b8b2f57b7ae8" containerName="extract" Sep 10 16:10:15.310456 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:10:15.310368 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5d583a30-2d7a-49f7-aae5-d544bcf7717c" containerName="pull" Sep 10 16:10:15.310456 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:10:15.310373 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="5d583a30-2d7a-49f7-aae5-d544bcf7717c" containerName="pull" Sep 10 16:10:15.310456 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:10:15.310380 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="371ddc86-a5f7-4385-a86e-b8b2f57b7ae8" containerName="util" Sep 10 16:10:15.310456 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:10:15.310385 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="371ddc86-a5f7-4385-a86e-b8b2f57b7ae8" containerName="util" Sep 10 16:10:15.310456 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:10:15.310430 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="f8102fcf-e931-427c-b958-54dec4c3abda" containerName="extract" Sep 10 16:10:15.310456 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:10:15.310436 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="6af29b58-c074-4a43-8d53-897248b75a84" containerName="extract" Sep 10 16:10:15.310456 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:10:15.310442 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="5d583a30-2d7a-49f7-aae5-d544bcf7717c" containerName="extract" Sep 10 16:10:15.310456 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:10:15.310449 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="371ddc86-a5f7-4385-a86e-b8b2f57b7ae8" containerName="extract" Sep 10 16:10:15.314574 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:10:15.314558 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-6xz94" Sep 10 16:10:15.317799 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:10:15.317774 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\"" Sep 10 16:10:15.317912 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:10:15.317865 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Sep 10 16:10:15.318096 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:10:15.318080 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\"" Sep 10 16:10:15.318374 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:10:15.318357 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Sep 10 16:10:15.319119 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:10:15.319095 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-j5jtb\"" Sep 10 16:10:15.322723 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:10:15.322702 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-fbdd4f445-6xz94"] Sep 10 16:10:15.351766 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:10:15.351735 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/55a41cd9-4356-4be2-9e70-a49dc683ca82-nginx-conf\") pod \"kuadrant-console-plugin-fbdd4f445-6xz94\" (UID: \"55a41cd9-4356-4be2-9e70-a49dc683ca82\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-6xz94" Sep 10 16:10:15.351910 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:10:15.351781 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/55a41cd9-4356-4be2-9e70-a49dc683ca82-plugin-serving-cert\") pod \"kuadrant-console-plugin-fbdd4f445-6xz94\" (UID: \"55a41cd9-4356-4be2-9e70-a49dc683ca82\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-6xz94" Sep 10 16:10:15.351910 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:10:15.351801 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k65cn\" (UniqueName: \"kubernetes.io/projected/55a41cd9-4356-4be2-9e70-a49dc683ca82-kube-api-access-k65cn\") pod \"kuadrant-console-plugin-fbdd4f445-6xz94\" (UID: \"55a41cd9-4356-4be2-9e70-a49dc683ca82\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-6xz94" Sep 10 16:10:15.452751 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:10:15.452713 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/55a41cd9-4356-4be2-9e70-a49dc683ca82-nginx-conf\") pod \"kuadrant-console-plugin-fbdd4f445-6xz94\" (UID: \"55a41cd9-4356-4be2-9e70-a49dc683ca82\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-6xz94" Sep 10 16:10:15.452907 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:10:15.452768 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/55a41cd9-4356-4be2-9e70-a49dc683ca82-plugin-serving-cert\") pod \"kuadrant-console-plugin-fbdd4f445-6xz94\" (UID: \"55a41cd9-4356-4be2-9e70-a49dc683ca82\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-6xz94" Sep 10 16:10:15.452907 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:10:15.452793 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k65cn\" (UniqueName: \"kubernetes.io/projected/55a41cd9-4356-4be2-9e70-a49dc683ca82-kube-api-access-k65cn\") pod \"kuadrant-console-plugin-fbdd4f445-6xz94\" (UID: \"55a41cd9-4356-4be2-9e70-a49dc683ca82\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-6xz94" Sep 10 16:10:15.452907 ip-10-0-135-53 kubenswrapper[2574]: E0910 16:10:15.452857 2574 secret.go:189] Couldn't get secret kuadrant-system/plugin-serving-cert: secret "plugin-serving-cert" not found Sep 10 16:10:15.453018 ip-10-0-135-53 kubenswrapper[2574]: E0910 16:10:15.452932 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/55a41cd9-4356-4be2-9e70-a49dc683ca82-plugin-serving-cert podName:55a41cd9-4356-4be2-9e70-a49dc683ca82 nodeName:}" failed. No retries permitted until 2026-09-10 16:10:15.952916251 +0000 UTC m=+440.518119778 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "plugin-serving-cert" (UniqueName: "kubernetes.io/secret/55a41cd9-4356-4be2-9e70-a49dc683ca82-plugin-serving-cert") pod "kuadrant-console-plugin-fbdd4f445-6xz94" (UID: "55a41cd9-4356-4be2-9e70-a49dc683ca82") : secret "plugin-serving-cert" not found Sep 10 16:10:15.453371 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:10:15.453351 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/55a41cd9-4356-4be2-9e70-a49dc683ca82-nginx-conf\") pod \"kuadrant-console-plugin-fbdd4f445-6xz94\" (UID: \"55a41cd9-4356-4be2-9e70-a49dc683ca82\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-6xz94" Sep 10 16:10:15.464122 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:10:15.464096 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k65cn\" (UniqueName: \"kubernetes.io/projected/55a41cd9-4356-4be2-9e70-a49dc683ca82-kube-api-access-k65cn\") pod \"kuadrant-console-plugin-fbdd4f445-6xz94\" (UID: \"55a41cd9-4356-4be2-9e70-a49dc683ca82\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-6xz94" Sep 10 16:10:15.956161 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:10:15.956122 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/55a41cd9-4356-4be2-9e70-a49dc683ca82-plugin-serving-cert\") pod \"kuadrant-console-plugin-fbdd4f445-6xz94\" (UID: \"55a41cd9-4356-4be2-9e70-a49dc683ca82\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-6xz94" Sep 10 16:10:15.958654 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:10:15.958620 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/55a41cd9-4356-4be2-9e70-a49dc683ca82-plugin-serving-cert\") pod \"kuadrant-console-plugin-fbdd4f445-6xz94\" (UID: \"55a41cd9-4356-4be2-9e70-a49dc683ca82\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-6xz94" Sep 10 16:10:16.224840 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:10:16.224752 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-6xz94" Sep 10 16:10:16.497754 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:10:16.497726 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-fbdd4f445-6xz94"] Sep 10 16:10:16.499341 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:10:16.499313 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod55a41cd9_4356_4be2_9e70_a49dc683ca82.slice/crio-7685b1d2f73de5ec34c78cb64a7fb6b826b326f7a386c2e4bb42f9bdb226aef8 WatchSource:0}: Error finding container 7685b1d2f73de5ec34c78cb64a7fb6b826b326f7a386c2e4bb42f9bdb226aef8: Status 404 returned error can't find the container with id 7685b1d2f73de5ec34c78cb64a7fb6b826b326f7a386c2e4bb42f9bdb226aef8 Sep 10 16:10:17.021597 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:10:17.021563 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-6xz94" event={"ID":"55a41cd9-4356-4be2-9e70-a49dc683ca82","Type":"ContainerStarted","Data":"7685b1d2f73de5ec34c78cb64a7fb6b826b326f7a386c2e4bb42f9bdb226aef8"} Sep 10 16:10:22.048744 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:10:22.048699 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-6xz94" event={"ID":"55a41cd9-4356-4be2-9e70-a49dc683ca82","Type":"ContainerStarted","Data":"b44f75b257718068ed25fb8450be71c2922ee4b741faccb40600aa80a360c13c"} Sep 10 16:10:22.066248 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:10:22.066200 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-6xz94" podStartSLOduration=2.441160774 podStartE2EDuration="7.06618479s" totalImagesPullingTime="4.625024016s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 16:10:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 16:10:22.064309567 +0000 UTC m=+446.629513112" watchObservedRunningTime="2026-09-10 16:10:22.06618479 +0000 UTC m=+446.631388334" Sep 10 16:11:11.367823 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:11:11.367784 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-r9pph"] Sep 10 16:11:11.390082 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:11:11.390051 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-r9pph"] Sep 10 16:11:11.390237 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:11:11.390144 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7bcfd8f9cd-r9pph" Sep 10 16:11:11.394519 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:11:11.394494 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-cd4wj\"" Sep 10 16:11:11.496394 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:11:11.496356 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tfv69\" (UniqueName: \"kubernetes.io/projected/d1df9510-b04b-43c9-9915-3a6186822def-kube-api-access-tfv69\") pod \"authorino-7bcfd8f9cd-r9pph\" (UID: \"d1df9510-b04b-43c9-9915-3a6186822def\") " pod="kuadrant-system/authorino-7bcfd8f9cd-r9pph" Sep 10 16:11:11.597459 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:11:11.597425 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tfv69\" (UniqueName: \"kubernetes.io/projected/d1df9510-b04b-43c9-9915-3a6186822def-kube-api-access-tfv69\") pod \"authorino-7bcfd8f9cd-r9pph\" (UID: \"d1df9510-b04b-43c9-9915-3a6186822def\") " pod="kuadrant-system/authorino-7bcfd8f9cd-r9pph" Sep 10 16:11:11.607315 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:11:11.607278 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tfv69\" (UniqueName: \"kubernetes.io/projected/d1df9510-b04b-43c9-9915-3a6186822def-kube-api-access-tfv69\") pod \"authorino-7bcfd8f9cd-r9pph\" (UID: \"d1df9510-b04b-43c9-9915-3a6186822def\") " pod="kuadrant-system/authorino-7bcfd8f9cd-r9pph" Sep 10 16:11:11.609143 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:11:11.609121 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-59c974bd48-kpp9x"] Sep 10 16:11:11.612602 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:11:11.612581 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-59c974bd48-kpp9x" Sep 10 16:11:11.618629 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:11:11.618574 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-59c974bd48-kpp9x"] Sep 10 16:11:11.698158 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:11:11.698120 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9wd4s\" (UniqueName: \"kubernetes.io/projected/183d20d0-f5ff-492c-9c45-307751ce906e-kube-api-access-9wd4s\") pod \"authorino-59c974bd48-kpp9x\" (UID: \"183d20d0-f5ff-492c-9c45-307751ce906e\") " pod="kuadrant-system/authorino-59c974bd48-kpp9x" Sep 10 16:11:11.698949 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:11:11.698933 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7bcfd8f9cd-r9pph" Sep 10 16:11:11.799009 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:11:11.798966 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9wd4s\" (UniqueName: \"kubernetes.io/projected/183d20d0-f5ff-492c-9c45-307751ce906e-kube-api-access-9wd4s\") pod \"authorino-59c974bd48-kpp9x\" (UID: \"183d20d0-f5ff-492c-9c45-307751ce906e\") " pod="kuadrant-system/authorino-59c974bd48-kpp9x" Sep 10 16:11:11.809488 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:11:11.809456 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9wd4s\" (UniqueName: \"kubernetes.io/projected/183d20d0-f5ff-492c-9c45-307751ce906e-kube-api-access-9wd4s\") pod \"authorino-59c974bd48-kpp9x\" (UID: \"183d20d0-f5ff-492c-9c45-307751ce906e\") " pod="kuadrant-system/authorino-59c974bd48-kpp9x" Sep 10 16:11:11.923695 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:11:11.923597 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-59c974bd48-kpp9x" Sep 10 16:11:11.971821 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:11:11.971783 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-r9pph"] Sep 10 16:11:11.973933 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:11:11.973876 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd1df9510_b04b_43c9_9915_3a6186822def.slice/crio-d6b25a3b7fb519b94e619f639df8a59befc16e0731a1ac93aa22282d326f3897 WatchSource:0}: Error finding container d6b25a3b7fb519b94e619f639df8a59befc16e0731a1ac93aa22282d326f3897: Status 404 returned error can't find the container with id d6b25a3b7fb519b94e619f639df8a59befc16e0731a1ac93aa22282d326f3897 Sep 10 16:11:12.195401 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:11:12.195377 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-59c974bd48-kpp9x"] Sep 10 16:11:12.196788 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:11:12.196758 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod183d20d0_f5ff_492c_9c45_307751ce906e.slice/crio-6008d32d6ff6813ad3d2bf791f6c4efa7f77078b631537b55f5f9439548d47ef WatchSource:0}: Error finding container 6008d32d6ff6813ad3d2bf791f6c4efa7f77078b631537b55f5f9439548d47ef: Status 404 returned error can't find the container with id 6008d32d6ff6813ad3d2bf791f6c4efa7f77078b631537b55f5f9439548d47ef Sep 10 16:11:12.286510 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:11:12.286468 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7bcfd8f9cd-r9pph" event={"ID":"d1df9510-b04b-43c9-9915-3a6186822def","Type":"ContainerStarted","Data":"d6b25a3b7fb519b94e619f639df8a59befc16e0731a1ac93aa22282d326f3897"} Sep 10 16:11:12.287630 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:11:12.287610 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-59c974bd48-kpp9x" event={"ID":"183d20d0-f5ff-492c-9c45-307751ce906e","Type":"ContainerStarted","Data":"6008d32d6ff6813ad3d2bf791f6c4efa7f77078b631537b55f5f9439548d47ef"} Sep 10 16:11:15.304042 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:11:15.304005 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-59c974bd48-kpp9x" event={"ID":"183d20d0-f5ff-492c-9c45-307751ce906e","Type":"ContainerStarted","Data":"ea5827d9010ba393ffef367f8b483c4b30a4b0a8edd112a1e97901cbfe32d4a0"} Sep 10 16:11:15.319006 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:11:15.318959 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-59c974bd48-kpp9x" podStartSLOduration=1.745756549 podStartE2EDuration="4.318944172s" totalImagesPullingTime="2.573187623s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 16:11:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 16:11:15.318159381 +0000 UTC m=+499.883362938" watchObservedRunningTime="2026-09-10 16:11:15.318944172 +0000 UTC m=+499.884147716" Sep 10 16:11:15.346332 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:11:15.346290 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-r9pph"] Sep 10 16:11:20.328766 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:11:20.328725 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7bcfd8f9cd-r9pph" event={"ID":"d1df9510-b04b-43c9-9915-3a6186822def","Type":"ContainerStarted","Data":"0b866dd4974a20a2cafa723f33cac9dead1d7f3bf5fd32b133d30bf6ebc5c230"} Sep 10 16:11:20.328766 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:11:20.328751 2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-7bcfd8f9cd-r9pph" podUID="d1df9510-b04b-43c9-9915-3a6186822def" containerName="authorino" containerID="cri-o://0b866dd4974a20a2cafa723f33cac9dead1d7f3bf5fd32b133d30bf6ebc5c230" gracePeriod=30 Sep 10 16:11:20.369675 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:11:20.369614 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-7bcfd8f9cd-r9pph" podStartSLOduration=1.510631021 podStartE2EDuration="9.369596099s" totalImagesPullingTime="7.858965078s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 16:11:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 16:11:20.35686355 +0000 UTC m=+504.922067093" watchObservedRunningTime="2026-09-10 16:11:20.369596099 +0000 UTC m=+504.934799643" Sep 10 16:11:20.578813 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:11:20.578756 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7bcfd8f9cd-r9pph" Sep 10 16:11:20.676704 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:11:20.676667 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tfv69\" (UniqueName: \"kubernetes.io/projected/d1df9510-b04b-43c9-9915-3a6186822def-kube-api-access-tfv69\") pod \"d1df9510-b04b-43c9-9915-3a6186822def\" (UID: \"d1df9510-b04b-43c9-9915-3a6186822def\") " Sep 10 16:11:20.678898 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:11:20.678871 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d1df9510-b04b-43c9-9915-3a6186822def-kube-api-access-tfv69" (OuterVolumeSpecName: "kube-api-access-tfv69") pod "d1df9510-b04b-43c9-9915-3a6186822def" (UID: "d1df9510-b04b-43c9-9915-3a6186822def"). InnerVolumeSpecName "kube-api-access-tfv69". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 16:11:20.778117 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:11:20.778080 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tfv69\" (UniqueName: \"kubernetes.io/projected/d1df9510-b04b-43c9-9915-3a6186822def-kube-api-access-tfv69\") on node \"ip-10-0-135-53.ec2.internal\" DevicePath \"\"" Sep 10 16:11:21.334570 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:11:21.334532 2574 generic.go:356] "Generic (PLEG): container finished" podID="d1df9510-b04b-43c9-9915-3a6186822def" containerID="0b866dd4974a20a2cafa723f33cac9dead1d7f3bf5fd32b133d30bf6ebc5c230" exitCode=0 Sep 10 16:11:21.334954 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:11:21.334576 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7bcfd8f9cd-r9pph" Sep 10 16:11:21.334954 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:11:21.334623 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7bcfd8f9cd-r9pph" event={"ID":"d1df9510-b04b-43c9-9915-3a6186822def","Type":"ContainerDied","Data":"0b866dd4974a20a2cafa723f33cac9dead1d7f3bf5fd32b133d30bf6ebc5c230"} Sep 10 16:11:21.334954 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:11:21.334660 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7bcfd8f9cd-r9pph" event={"ID":"d1df9510-b04b-43c9-9915-3a6186822def","Type":"ContainerDied","Data":"d6b25a3b7fb519b94e619f639df8a59befc16e0731a1ac93aa22282d326f3897"} Sep 10 16:11:21.334954 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:11:21.334677 2574 scope.go:117] "RemoveContainer" containerID="0b866dd4974a20a2cafa723f33cac9dead1d7f3bf5fd32b133d30bf6ebc5c230" Sep 10 16:11:21.343421 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:11:21.343403 2574 scope.go:117] "RemoveContainer" containerID="0b866dd4974a20a2cafa723f33cac9dead1d7f3bf5fd32b133d30bf6ebc5c230" Sep 10 16:11:21.343699 ip-10-0-135-53 kubenswrapper[2574]: E0910 16:11:21.343682 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0b866dd4974a20a2cafa723f33cac9dead1d7f3bf5fd32b133d30bf6ebc5c230\": container with ID starting with 0b866dd4974a20a2cafa723f33cac9dead1d7f3bf5fd32b133d30bf6ebc5c230 not found: ID does not exist" containerID="0b866dd4974a20a2cafa723f33cac9dead1d7f3bf5fd32b133d30bf6ebc5c230" Sep 10 16:11:21.343751 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:11:21.343708 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0b866dd4974a20a2cafa723f33cac9dead1d7f3bf5fd32b133d30bf6ebc5c230"} err="failed to get container status \"0b866dd4974a20a2cafa723f33cac9dead1d7f3bf5fd32b133d30bf6ebc5c230\": rpc error: code = NotFound desc = could not find container \"0b866dd4974a20a2cafa723f33cac9dead1d7f3bf5fd32b133d30bf6ebc5c230\": container with ID starting with 0b866dd4974a20a2cafa723f33cac9dead1d7f3bf5fd32b133d30bf6ebc5c230 not found: ID does not exist" Sep 10 16:11:21.358948 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:11:21.358923 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-r9pph"] Sep 10 16:11:21.361664 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:11:21.361641 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-r9pph"] Sep 10 16:11:22.079799 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:11:22.079762 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d1df9510-b04b-43c9-9915-3a6186822def" path="/var/lib/kubelet/pods/d1df9510-b04b-43c9-9915-3a6186822def/volumes" Sep 10 16:11:42.470094 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:11:42.470058 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-557f876f69-6xxnp"] Sep 10 16:11:42.470520 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:11:42.470391 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d1df9510-b04b-43c9-9915-3a6186822def" containerName="authorino" Sep 10 16:11:42.470520 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:11:42.470404 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="d1df9510-b04b-43c9-9915-3a6186822def" containerName="authorino" Sep 10 16:11:42.470520 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:11:42.470465 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="d1df9510-b04b-43c9-9915-3a6186822def" containerName="authorino" Sep 10 16:11:42.474539 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:11:42.474515 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-557f876f69-6xxnp" Sep 10 16:11:42.493089 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:11:42.493059 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-557f876f69-6xxnp"] Sep 10 16:11:42.532983 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:11:42.532947 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4vdk8\" (UniqueName: \"kubernetes.io/projected/d95cab1f-0b59-4865-a4dd-3cc979809338-kube-api-access-4vdk8\") pod \"authorino-557f876f69-6xxnp\" (UID: \"d95cab1f-0b59-4865-a4dd-3cc979809338\") " pod="kuadrant-system/authorino-557f876f69-6xxnp" Sep 10 16:11:42.633489 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:11:42.633459 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4vdk8\" (UniqueName: \"kubernetes.io/projected/d95cab1f-0b59-4865-a4dd-3cc979809338-kube-api-access-4vdk8\") pod \"authorino-557f876f69-6xxnp\" (UID: \"d95cab1f-0b59-4865-a4dd-3cc979809338\") " pod="kuadrant-system/authorino-557f876f69-6xxnp" Sep 10 16:11:42.644059 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:11:42.644029 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4vdk8\" (UniqueName: \"kubernetes.io/projected/d95cab1f-0b59-4865-a4dd-3cc979809338-kube-api-access-4vdk8\") pod \"authorino-557f876f69-6xxnp\" (UID: \"d95cab1f-0b59-4865-a4dd-3cc979809338\") " pod="kuadrant-system/authorino-557f876f69-6xxnp" Sep 10 16:11:42.707696 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:11:42.707658 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-557f876f69-6xxnp"] Sep 10 16:11:42.707909 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:11:42.707897 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-557f876f69-6xxnp" Sep 10 16:11:42.759940 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:11:42.759912 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-76cb6b4ffc-j2rb9"] Sep 10 16:11:42.764315 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:11:42.764294 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-76cb6b4ffc-j2rb9" Sep 10 16:11:42.782301 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:11:42.781735 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-76cb6b4ffc-j2rb9"] Sep 10 16:11:42.835152 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:11:42.835110 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pgbn2\" (UniqueName: \"kubernetes.io/projected/88604aeb-95c0-422a-b632-79357810d01b-kube-api-access-pgbn2\") pod \"authorino-76cb6b4ffc-j2rb9\" (UID: \"88604aeb-95c0-422a-b632-79357810d01b\") " pod="kuadrant-system/authorino-76cb6b4ffc-j2rb9" Sep 10 16:11:42.840750 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:11:42.840721 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-76cb6b4ffc-j2rb9"] Sep 10 16:11:42.840958 ip-10-0-135-53 kubenswrapper[2574]: E0910 16:11:42.840939 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-pgbn2], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-76cb6b4ffc-j2rb9" podUID="88604aeb-95c0-422a-b632-79357810d01b" Sep 10 16:11:42.895491 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:11:42.895457 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-78466cb655-zbcp6"] Sep 10 16:11:42.898682 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:11:42.898665 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-78466cb655-zbcp6" Sep 10 16:11:42.901405 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:11:42.901384 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" Sep 10 16:11:42.913946 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:11:42.913921 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-78466cb655-zbcp6"] Sep 10 16:11:42.935641 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:11:42.935606 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-phlns\" (UniqueName: \"kubernetes.io/projected/01db95f1-ff66-46ec-9d4e-dc6f68d8e003-kube-api-access-phlns\") pod \"authorino-78466cb655-zbcp6\" (UID: \"01db95f1-ff66-46ec-9d4e-dc6f68d8e003\") " pod="kuadrant-system/authorino-78466cb655-zbcp6" Sep 10 16:11:42.935796 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:11:42.935706 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/01db95f1-ff66-46ec-9d4e-dc6f68d8e003-tls-cert\") pod \"authorino-78466cb655-zbcp6\" (UID: \"01db95f1-ff66-46ec-9d4e-dc6f68d8e003\") " pod="kuadrant-system/authorino-78466cb655-zbcp6" Sep 10 16:11:42.935796 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:11:42.935736 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pgbn2\" (UniqueName: \"kubernetes.io/projected/88604aeb-95c0-422a-b632-79357810d01b-kube-api-access-pgbn2\") pod \"authorino-76cb6b4ffc-j2rb9\" (UID: \"88604aeb-95c0-422a-b632-79357810d01b\") " pod="kuadrant-system/authorino-76cb6b4ffc-j2rb9" Sep 10 16:11:42.945355 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:11:42.945327 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pgbn2\" (UniqueName: \"kubernetes.io/projected/88604aeb-95c0-422a-b632-79357810d01b-kube-api-access-pgbn2\") pod \"authorino-76cb6b4ffc-j2rb9\" (UID: \"88604aeb-95c0-422a-b632-79357810d01b\") " pod="kuadrant-system/authorino-76cb6b4ffc-j2rb9" Sep 10 16:11:42.987289 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:11:42.987249 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-557f876f69-6xxnp"] Sep 10 16:11:42.989442 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:11:42.989418 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd95cab1f_0b59_4865_a4dd_3cc979809338.slice/crio-5d061cdf33791ed45f3be0351e4fc542e71f2ad7f5c25cd0f4c1f74c41ea9bc5 WatchSource:0}: Error finding container 5d061cdf33791ed45f3be0351e4fc542e71f2ad7f5c25cd0f4c1f74c41ea9bc5: Status 404 returned error can't find the container with id 5d061cdf33791ed45f3be0351e4fc542e71f2ad7f5c25cd0f4c1f74c41ea9bc5 Sep 10 16:11:43.036559 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:11:43.036528 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-phlns\" (UniqueName: \"kubernetes.io/projected/01db95f1-ff66-46ec-9d4e-dc6f68d8e003-kube-api-access-phlns\") pod \"authorino-78466cb655-zbcp6\" (UID: \"01db95f1-ff66-46ec-9d4e-dc6f68d8e003\") " pod="kuadrant-system/authorino-78466cb655-zbcp6" Sep 10 16:11:43.036746 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:11:43.036611 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/01db95f1-ff66-46ec-9d4e-dc6f68d8e003-tls-cert\") pod \"authorino-78466cb655-zbcp6\" (UID: \"01db95f1-ff66-46ec-9d4e-dc6f68d8e003\") " pod="kuadrant-system/authorino-78466cb655-zbcp6" Sep 10 16:11:43.039029 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:11:43.039004 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/01db95f1-ff66-46ec-9d4e-dc6f68d8e003-tls-cert\") pod \"authorino-78466cb655-zbcp6\" (UID: \"01db95f1-ff66-46ec-9d4e-dc6f68d8e003\") " pod="kuadrant-system/authorino-78466cb655-zbcp6" Sep 10 16:11:43.047274 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:11:43.047240 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-phlns\" (UniqueName: \"kubernetes.io/projected/01db95f1-ff66-46ec-9d4e-dc6f68d8e003-kube-api-access-phlns\") pod \"authorino-78466cb655-zbcp6\" (UID: \"01db95f1-ff66-46ec-9d4e-dc6f68d8e003\") " pod="kuadrant-system/authorino-78466cb655-zbcp6" Sep 10 16:11:43.207173 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:11:43.207132 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-78466cb655-zbcp6" Sep 10 16:11:43.437751 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:11:43.437674 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-76cb6b4ffc-j2rb9" Sep 10 16:11:43.437751 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:11:43.437708 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-557f876f69-6xxnp" event={"ID":"d95cab1f-0b59-4865-a4dd-3cc979809338","Type":"ContainerStarted","Data":"5d061cdf33791ed45f3be0351e4fc542e71f2ad7f5c25cd0f4c1f74c41ea9bc5"} Sep 10 16:11:43.444836 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:11:43.444815 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-76cb6b4ffc-j2rb9" Sep 10 16:11:43.490036 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:11:43.490008 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-78466cb655-zbcp6"] Sep 10 16:11:43.495086 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:11:43.495058 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod01db95f1_ff66_46ec_9d4e_dc6f68d8e003.slice/crio-c9d378b2c6447fd9af8cef55ba08c384b0fea01233cb6fa3eed55a7d05ef6964 WatchSource:0}: Error finding container c9d378b2c6447fd9af8cef55ba08c384b0fea01233cb6fa3eed55a7d05ef6964: Status 404 returned error can't find the container with id c9d378b2c6447fd9af8cef55ba08c384b0fea01233cb6fa3eed55a7d05ef6964 Sep 10 16:11:43.541348 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:11:43.541321 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pgbn2\" (UniqueName: \"kubernetes.io/projected/88604aeb-95c0-422a-b632-79357810d01b-kube-api-access-pgbn2\") pod \"88604aeb-95c0-422a-b632-79357810d01b\" (UID: \"88604aeb-95c0-422a-b632-79357810d01b\") " Sep 10 16:11:43.543294 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:11:43.543244 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/88604aeb-95c0-422a-b632-79357810d01b-kube-api-access-pgbn2" (OuterVolumeSpecName: "kube-api-access-pgbn2") pod "88604aeb-95c0-422a-b632-79357810d01b" (UID: "88604aeb-95c0-422a-b632-79357810d01b"). InnerVolumeSpecName "kube-api-access-pgbn2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 16:11:43.642474 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:11:43.642439 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pgbn2\" (UniqueName: \"kubernetes.io/projected/88604aeb-95c0-422a-b632-79357810d01b-kube-api-access-pgbn2\") on node \"ip-10-0-135-53.ec2.internal\" DevicePath \"\"" Sep 10 16:11:44.444258 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:11:44.444222 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-78466cb655-zbcp6" event={"ID":"01db95f1-ff66-46ec-9d4e-dc6f68d8e003","Type":"ContainerStarted","Data":"fbd20f4c5a374430062bf358a778eddc6a1b6a90024a8df75c9b3d41f9f8f7ed"} Sep 10 16:11:44.444459 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:11:44.444281 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-78466cb655-zbcp6" event={"ID":"01db95f1-ff66-46ec-9d4e-dc6f68d8e003","Type":"ContainerStarted","Data":"c9d378b2c6447fd9af8cef55ba08c384b0fea01233cb6fa3eed55a7d05ef6964"} Sep 10 16:11:44.445759 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:11:44.445733 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-76cb6b4ffc-j2rb9" Sep 10 16:11:44.445856 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:11:44.445774 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-557f876f69-6xxnp" event={"ID":"d95cab1f-0b59-4865-a4dd-3cc979809338","Type":"ContainerStarted","Data":"b43a35fb5b285a0888a57e7abd72b31f49d255b3464e72778027727c64673341"} Sep 10 16:11:44.445982 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:11:44.445963 2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-557f876f69-6xxnp" podUID="d95cab1f-0b59-4865-a4dd-3cc979809338" containerName="authorino" containerID="cri-o://b43a35fb5b285a0888a57e7abd72b31f49d255b3464e72778027727c64673341" gracePeriod=30 Sep 10 16:11:44.466751 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:11:44.466707 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-78466cb655-zbcp6" podStartSLOduration=1.986424835 podStartE2EDuration="2.466689903s" totalImagesPullingTime="480.265068ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 16:11:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 16:11:44.466380117 +0000 UTC m=+529.031583676" watchObservedRunningTime="2026-09-10 16:11:44.466689903 +0000 UTC m=+529.031893447" Sep 10 16:11:44.519428 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:11:44.519350 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-557f876f69-6xxnp" podStartSLOduration=2.029699618 podStartE2EDuration="2.519322292s" totalImagesPullingTime="489.622674ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 16:11:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 16:11:44.493886562 +0000 UTC m=+529.059090107" watchObservedRunningTime="2026-09-10 16:11:44.519322292 +0000 UTC m=+529.084525864" Sep 10 16:11:44.521428 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:11:44.521408 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-59c974bd48-kpp9x"] Sep 10 16:11:44.521605 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:11:44.521583 2574 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-59c974bd48-kpp9x" podUID="183d20d0-f5ff-492c-9c45-307751ce906e" containerName="authorino" containerID="cri-o://ea5827d9010ba393ffef367f8b483c4b30a4b0a8edd112a1e97901cbfe32d4a0" gracePeriod=30 Sep 10 16:11:44.544635 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:11:44.544600 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-76cb6b4ffc-j2rb9"] Sep 10 16:11:44.556123 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:11:44.556090 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-76cb6b4ffc-j2rb9"] Sep 10 16:11:44.788903 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:11:44.788876 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-557f876f69-6xxnp" Sep 10 16:11:44.791681 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:11:44.791662 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-59c974bd48-kpp9x" Sep 10 16:11:44.850972 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:11:44.850941 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9wd4s\" (UniqueName: \"kubernetes.io/projected/183d20d0-f5ff-492c-9c45-307751ce906e-kube-api-access-9wd4s\") pod \"183d20d0-f5ff-492c-9c45-307751ce906e\" (UID: \"183d20d0-f5ff-492c-9c45-307751ce906e\") " Sep 10 16:11:44.851139 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:11:44.851053 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4vdk8\" (UniqueName: \"kubernetes.io/projected/d95cab1f-0b59-4865-a4dd-3cc979809338-kube-api-access-4vdk8\") pod \"d95cab1f-0b59-4865-a4dd-3cc979809338\" (UID: \"d95cab1f-0b59-4865-a4dd-3cc979809338\") " Sep 10 16:11:44.853105 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:11:44.853074 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d95cab1f-0b59-4865-a4dd-3cc979809338-kube-api-access-4vdk8" (OuterVolumeSpecName: "kube-api-access-4vdk8") pod "d95cab1f-0b59-4865-a4dd-3cc979809338" (UID: "d95cab1f-0b59-4865-a4dd-3cc979809338"). InnerVolumeSpecName "kube-api-access-4vdk8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 16:11:44.853223 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:11:44.853113 2574 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/183d20d0-f5ff-492c-9c45-307751ce906e-kube-api-access-9wd4s" (OuterVolumeSpecName: "kube-api-access-9wd4s") pod "183d20d0-f5ff-492c-9c45-307751ce906e" (UID: "183d20d0-f5ff-492c-9c45-307751ce906e"). InnerVolumeSpecName "kube-api-access-9wd4s". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 10 16:11:44.951765 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:11:44.951727 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4vdk8\" (UniqueName: \"kubernetes.io/projected/d95cab1f-0b59-4865-a4dd-3cc979809338-kube-api-access-4vdk8\") on node \"ip-10-0-135-53.ec2.internal\" DevicePath \"\"" Sep 10 16:11:44.951765 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:11:44.951760 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9wd4s\" (UniqueName: \"kubernetes.io/projected/183d20d0-f5ff-492c-9c45-307751ce906e-kube-api-access-9wd4s\") on node \"ip-10-0-135-53.ec2.internal\" DevicePath \"\"" Sep 10 16:11:45.452586 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:11:45.452550 2574 generic.go:356] "Generic (PLEG): container finished" podID="183d20d0-f5ff-492c-9c45-307751ce906e" containerID="ea5827d9010ba393ffef367f8b483c4b30a4b0a8edd112a1e97901cbfe32d4a0" exitCode=0 Sep 10 16:11:45.452730 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:11:45.452603 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-59c974bd48-kpp9x" Sep 10 16:11:45.452730 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:11:45.452631 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-59c974bd48-kpp9x" event={"ID":"183d20d0-f5ff-492c-9c45-307751ce906e","Type":"ContainerDied","Data":"ea5827d9010ba393ffef367f8b483c4b30a4b0a8edd112a1e97901cbfe32d4a0"} Sep 10 16:11:45.452730 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:11:45.452673 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-59c974bd48-kpp9x" event={"ID":"183d20d0-f5ff-492c-9c45-307751ce906e","Type":"ContainerDied","Data":"6008d32d6ff6813ad3d2bf791f6c4efa7f77078b631537b55f5f9439548d47ef"} Sep 10 16:11:45.452730 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:11:45.452698 2574 scope.go:117] "RemoveContainer" containerID="ea5827d9010ba393ffef367f8b483c4b30a4b0a8edd112a1e97901cbfe32d4a0" Sep 10 16:11:45.454182 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:11:45.454159 2574 generic.go:356] "Generic (PLEG): container finished" podID="d95cab1f-0b59-4865-a4dd-3cc979809338" containerID="b43a35fb5b285a0888a57e7abd72b31f49d255b3464e72778027727c64673341" exitCode=0 Sep 10 16:11:45.454292 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:11:45.454227 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-557f876f69-6xxnp" Sep 10 16:11:45.454292 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:11:45.454253 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-557f876f69-6xxnp" event={"ID":"d95cab1f-0b59-4865-a4dd-3cc979809338","Type":"ContainerDied","Data":"b43a35fb5b285a0888a57e7abd72b31f49d255b3464e72778027727c64673341"} Sep 10 16:11:45.454408 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:11:45.454319 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-557f876f69-6xxnp" event={"ID":"d95cab1f-0b59-4865-a4dd-3cc979809338","Type":"ContainerDied","Data":"5d061cdf33791ed45f3be0351e4fc542e71f2ad7f5c25cd0f4c1f74c41ea9bc5"} Sep 10 16:11:45.462730 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:11:45.462709 2574 scope.go:117] "RemoveContainer" containerID="ea5827d9010ba393ffef367f8b483c4b30a4b0a8edd112a1e97901cbfe32d4a0" Sep 10 16:11:45.463008 ip-10-0-135-53 kubenswrapper[2574]: E0910 16:11:45.462984 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ea5827d9010ba393ffef367f8b483c4b30a4b0a8edd112a1e97901cbfe32d4a0\": container with ID starting with ea5827d9010ba393ffef367f8b483c4b30a4b0a8edd112a1e97901cbfe32d4a0 not found: ID does not exist" containerID="ea5827d9010ba393ffef367f8b483c4b30a4b0a8edd112a1e97901cbfe32d4a0" Sep 10 16:11:45.463061 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:11:45.463014 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ea5827d9010ba393ffef367f8b483c4b30a4b0a8edd112a1e97901cbfe32d4a0"} err="failed to get container status \"ea5827d9010ba393ffef367f8b483c4b30a4b0a8edd112a1e97901cbfe32d4a0\": rpc error: code = NotFound desc = could not find container \"ea5827d9010ba393ffef367f8b483c4b30a4b0a8edd112a1e97901cbfe32d4a0\": container with ID starting with ea5827d9010ba393ffef367f8b483c4b30a4b0a8edd112a1e97901cbfe32d4a0 not found: ID does not exist" Sep 10 16:11:45.463061 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:11:45.463031 2574 scope.go:117] "RemoveContainer" containerID="b43a35fb5b285a0888a57e7abd72b31f49d255b3464e72778027727c64673341" Sep 10 16:11:45.471049 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:11:45.471033 2574 scope.go:117] "RemoveContainer" containerID="b43a35fb5b285a0888a57e7abd72b31f49d255b3464e72778027727c64673341" Sep 10 16:11:45.471362 ip-10-0-135-53 kubenswrapper[2574]: E0910 16:11:45.471342 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b43a35fb5b285a0888a57e7abd72b31f49d255b3464e72778027727c64673341\": container with ID starting with b43a35fb5b285a0888a57e7abd72b31f49d255b3464e72778027727c64673341 not found: ID does not exist" containerID="b43a35fb5b285a0888a57e7abd72b31f49d255b3464e72778027727c64673341" Sep 10 16:11:45.471422 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:11:45.471371 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b43a35fb5b285a0888a57e7abd72b31f49d255b3464e72778027727c64673341"} err="failed to get container status \"b43a35fb5b285a0888a57e7abd72b31f49d255b3464e72778027727c64673341\": rpc error: code = NotFound desc = could not find container \"b43a35fb5b285a0888a57e7abd72b31f49d255b3464e72778027727c64673341\": container with ID starting with b43a35fb5b285a0888a57e7abd72b31f49d255b3464e72778027727c64673341 not found: ID does not exist" Sep 10 16:11:45.494376 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:11:45.494338 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-59c974bd48-kpp9x"] Sep 10 16:11:45.497711 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:11:45.497689 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-59c974bd48-kpp9x"] Sep 10 16:11:45.521963 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:11:45.521935 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-557f876f69-6xxnp"] Sep 10 16:11:45.528773 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:11:45.528744 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-557f876f69-6xxnp"] Sep 10 16:11:46.080821 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:11:46.080790 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="183d20d0-f5ff-492c-9c45-307751ce906e" path="/var/lib/kubelet/pods/183d20d0-f5ff-492c-9c45-307751ce906e/volumes" Sep 10 16:11:46.081123 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:11:46.081109 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="88604aeb-95c0-422a-b632-79357810d01b" path="/var/lib/kubelet/pods/88604aeb-95c0-422a-b632-79357810d01b/volumes" Sep 10 16:11:46.081329 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:11:46.081317 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d95cab1f-0b59-4865-a4dd-3cc979809338" path="/var/lib/kubelet/pods/d95cab1f-0b59-4865-a4dd-3cc979809338/volumes" Sep 10 16:12:29.658208 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:12:29.658163 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-59fbc47bf8-5gf4t"] Sep 10 16:12:29.658742 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:12:29.658541 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d95cab1f-0b59-4865-a4dd-3cc979809338" containerName="authorino" Sep 10 16:12:29.658742 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:12:29.658555 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="d95cab1f-0b59-4865-a4dd-3cc979809338" containerName="authorino" Sep 10 16:12:29.658742 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:12:29.658574 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="183d20d0-f5ff-492c-9c45-307751ce906e" containerName="authorino" Sep 10 16:12:29.658742 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:12:29.658580 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="183d20d0-f5ff-492c-9c45-307751ce906e" containerName="authorino" Sep 10 16:12:29.658742 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:12:29.658627 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="d95cab1f-0b59-4865-a4dd-3cc979809338" containerName="authorino" Sep 10 16:12:29.658742 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:12:29.658637 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="183d20d0-f5ff-492c-9c45-307751ce906e" containerName="authorino" Sep 10 16:12:29.661656 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:12:29.661633 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-5gf4t" Sep 10 16:12:29.664382 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:12:29.664358 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-jn2d7\"" Sep 10 16:12:29.664606 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:12:29.664590 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Sep 10 16:12:29.671233 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:12:29.671194 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-59fbc47bf8-5gf4t"] Sep 10 16:12:29.733527 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:12:29.733490 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d4518659-7bcb-4412-8a62-6d6155c630af-plugins-config-volume\") pod \"payload-pre-processing-59fbc47bf8-5gf4t\" (UID: \"d4518659-7bcb-4412-8a62-6d6155c630af\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-5gf4t" Sep 10 16:12:29.733709 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:12:29.733540 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ng96w\" (UniqueName: \"kubernetes.io/projected/d4518659-7bcb-4412-8a62-6d6155c630af-kube-api-access-ng96w\") pod \"payload-pre-processing-59fbc47bf8-5gf4t\" (UID: \"d4518659-7bcb-4412-8a62-6d6155c630af\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-5gf4t" Sep 10 16:12:29.834563 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:12:29.834522 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d4518659-7bcb-4412-8a62-6d6155c630af-plugins-config-volume\") pod \"payload-pre-processing-59fbc47bf8-5gf4t\" (UID: \"d4518659-7bcb-4412-8a62-6d6155c630af\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-5gf4t" Sep 10 16:12:29.834730 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:12:29.834596 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ng96w\" (UniqueName: \"kubernetes.io/projected/d4518659-7bcb-4412-8a62-6d6155c630af-kube-api-access-ng96w\") pod \"payload-pre-processing-59fbc47bf8-5gf4t\" (UID: \"d4518659-7bcb-4412-8a62-6d6155c630af\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-5gf4t" Sep 10 16:12:29.835286 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:12:29.835252 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d4518659-7bcb-4412-8a62-6d6155c630af-plugins-config-volume\") pod \"payload-pre-processing-59fbc47bf8-5gf4t\" (UID: \"d4518659-7bcb-4412-8a62-6d6155c630af\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-5gf4t" Sep 10 16:12:29.846480 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:12:29.846448 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ng96w\" (UniqueName: \"kubernetes.io/projected/d4518659-7bcb-4412-8a62-6d6155c630af-kube-api-access-ng96w\") pod \"payload-pre-processing-59fbc47bf8-5gf4t\" (UID: \"d4518659-7bcb-4412-8a62-6d6155c630af\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-5gf4t" Sep 10 16:12:29.973018 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:12:29.972923 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-5gf4t" Sep 10 16:12:30.252257 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:12:30.252121 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-59fbc47bf8-5gf4t"] Sep 10 16:12:30.254568 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:12:30.254540 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd4518659_7bcb_4412_8a62_6d6155c630af.slice/crio-92d21645bc06989951d70c43654824b400d00e755bc07909075c4a915f710628 WatchSource:0}: Error finding container 92d21645bc06989951d70c43654824b400d00e755bc07909075c4a915f710628: Status 404 returned error can't find the container with id 92d21645bc06989951d70c43654824b400d00e755bc07909075c4a915f710628 Sep 10 16:12:30.668418 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:12:30.668379 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-5gf4t" event={"ID":"d4518659-7bcb-4412-8a62-6d6155c630af","Type":"ContainerStarted","Data":"92d21645bc06989951d70c43654824b400d00e755bc07909075c4a915f710628"} Sep 10 16:12:32.681765 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:12:32.681727 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-5gf4t" event={"ID":"d4518659-7bcb-4412-8a62-6d6155c630af","Type":"ContainerStarted","Data":"27115c5607e3920b9d14e0dbe7ac784aedc2fb660cff5b8be31facaf9bf45431"} Sep 10 16:12:32.682160 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:12:32.681808 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-5gf4t" Sep 10 16:12:32.703191 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:12:32.703134 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-5gf4t" podStartSLOduration=1.8651713989999998 podStartE2EDuration="3.703117517s" totalImagesPullingTime="1.837946118s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 16:12:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 16:12:32.701555257 +0000 UTC m=+577.266758802" watchObservedRunningTime="2026-09-10 16:12:32.703117517 +0000 UTC m=+577.268321060" Sep 10 16:12:43.688862 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:12:43.688829 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-5gf4t" Sep 10 16:12:44.630753 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:12:44.630711 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-859856b874-jrnjn"] Sep 10 16:12:44.634354 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:12:44.634335 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-jrnjn" Sep 10 16:12:44.637039 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:12:44.637012 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Sep 10 16:12:44.637166 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:12:44.637025 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Sep 10 16:12:44.638079 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:12:44.638051 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\"" Sep 10 16:12:44.638171 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:12:44.638092 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-kf6s8\"" Sep 10 16:12:44.643523 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:12:44.643501 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-859856b874-jrnjn"] Sep 10 16:12:44.761947 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:12:44.761905 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/20ce5068-6bc5-43d0-b6ef-92efd6ef0c64-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-859856b874-jrnjn\" (UID: \"20ce5068-6bc5-43d0-b6ef-92efd6ef0c64\") " pod="llm/e2e-distinct-2-simulated-kserve-859856b874-jrnjn" Sep 10 16:12:44.761947 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:12:44.761945 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/20ce5068-6bc5-43d0-b6ef-92efd6ef0c64-home\") pod \"e2e-distinct-2-simulated-kserve-859856b874-jrnjn\" (UID: \"20ce5068-6bc5-43d0-b6ef-92efd6ef0c64\") " pod="llm/e2e-distinct-2-simulated-kserve-859856b874-jrnjn" Sep 10 16:12:44.762427 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:12:44.762023 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/20ce5068-6bc5-43d0-b6ef-92efd6ef0c64-dshm\") pod \"e2e-distinct-2-simulated-kserve-859856b874-jrnjn\" (UID: \"20ce5068-6bc5-43d0-b6ef-92efd6ef0c64\") " pod="llm/e2e-distinct-2-simulated-kserve-859856b874-jrnjn" Sep 10 16:12:44.762427 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:12:44.762042 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/20ce5068-6bc5-43d0-b6ef-92efd6ef0c64-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-859856b874-jrnjn\" (UID: \"20ce5068-6bc5-43d0-b6ef-92efd6ef0c64\") " pod="llm/e2e-distinct-2-simulated-kserve-859856b874-jrnjn" Sep 10 16:12:44.762427 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:12:44.762066 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8z7pn\" (UniqueName: \"kubernetes.io/projected/20ce5068-6bc5-43d0-b6ef-92efd6ef0c64-kube-api-access-8z7pn\") pod \"e2e-distinct-2-simulated-kserve-859856b874-jrnjn\" (UID: \"20ce5068-6bc5-43d0-b6ef-92efd6ef0c64\") " pod="llm/e2e-distinct-2-simulated-kserve-859856b874-jrnjn" Sep 10 16:12:44.762427 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:12:44.762120 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/20ce5068-6bc5-43d0-b6ef-92efd6ef0c64-model-cache\") pod \"e2e-distinct-2-simulated-kserve-859856b874-jrnjn\" (UID: \"20ce5068-6bc5-43d0-b6ef-92efd6ef0c64\") " pod="llm/e2e-distinct-2-simulated-kserve-859856b874-jrnjn" Sep 10 16:12:44.863320 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:12:44.863249 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/20ce5068-6bc5-43d0-b6ef-92efd6ef0c64-dshm\") pod \"e2e-distinct-2-simulated-kserve-859856b874-jrnjn\" (UID: \"20ce5068-6bc5-43d0-b6ef-92efd6ef0c64\") " pod="llm/e2e-distinct-2-simulated-kserve-859856b874-jrnjn" Sep 10 16:12:44.863320 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:12:44.863318 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/20ce5068-6bc5-43d0-b6ef-92efd6ef0c64-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-859856b874-jrnjn\" (UID: \"20ce5068-6bc5-43d0-b6ef-92efd6ef0c64\") " pod="llm/e2e-distinct-2-simulated-kserve-859856b874-jrnjn" Sep 10 16:12:44.863577 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:12:44.863346 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8z7pn\" (UniqueName: \"kubernetes.io/projected/20ce5068-6bc5-43d0-b6ef-92efd6ef0c64-kube-api-access-8z7pn\") pod \"e2e-distinct-2-simulated-kserve-859856b874-jrnjn\" (UID: \"20ce5068-6bc5-43d0-b6ef-92efd6ef0c64\") " pod="llm/e2e-distinct-2-simulated-kserve-859856b874-jrnjn" Sep 10 16:12:44.863577 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:12:44.863377 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/20ce5068-6bc5-43d0-b6ef-92efd6ef0c64-model-cache\") pod \"e2e-distinct-2-simulated-kserve-859856b874-jrnjn\" (UID: \"20ce5068-6bc5-43d0-b6ef-92efd6ef0c64\") " pod="llm/e2e-distinct-2-simulated-kserve-859856b874-jrnjn" Sep 10 16:12:44.863577 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:12:44.863411 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/20ce5068-6bc5-43d0-b6ef-92efd6ef0c64-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-859856b874-jrnjn\" (UID: \"20ce5068-6bc5-43d0-b6ef-92efd6ef0c64\") " pod="llm/e2e-distinct-2-simulated-kserve-859856b874-jrnjn" Sep 10 16:12:44.863577 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:12:44.863428 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/20ce5068-6bc5-43d0-b6ef-92efd6ef0c64-home\") pod \"e2e-distinct-2-simulated-kserve-859856b874-jrnjn\" (UID: \"20ce5068-6bc5-43d0-b6ef-92efd6ef0c64\") " pod="llm/e2e-distinct-2-simulated-kserve-859856b874-jrnjn" Sep 10 16:12:44.863841 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:12:44.863802 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/20ce5068-6bc5-43d0-b6ef-92efd6ef0c64-model-cache\") pod \"e2e-distinct-2-simulated-kserve-859856b874-jrnjn\" (UID: \"20ce5068-6bc5-43d0-b6ef-92efd6ef0c64\") " pod="llm/e2e-distinct-2-simulated-kserve-859856b874-jrnjn" Sep 10 16:12:44.863915 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:12:44.863816 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/20ce5068-6bc5-43d0-b6ef-92efd6ef0c64-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-859856b874-jrnjn\" (UID: \"20ce5068-6bc5-43d0-b6ef-92efd6ef0c64\") " pod="llm/e2e-distinct-2-simulated-kserve-859856b874-jrnjn" Sep 10 16:12:44.863915 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:12:44.863854 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/20ce5068-6bc5-43d0-b6ef-92efd6ef0c64-home\") pod \"e2e-distinct-2-simulated-kserve-859856b874-jrnjn\" (UID: \"20ce5068-6bc5-43d0-b6ef-92efd6ef0c64\") " pod="llm/e2e-distinct-2-simulated-kserve-859856b874-jrnjn" Sep 10 16:12:44.865582 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:12:44.865558 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/20ce5068-6bc5-43d0-b6ef-92efd6ef0c64-dshm\") pod \"e2e-distinct-2-simulated-kserve-859856b874-jrnjn\" (UID: \"20ce5068-6bc5-43d0-b6ef-92efd6ef0c64\") " pod="llm/e2e-distinct-2-simulated-kserve-859856b874-jrnjn" Sep 10 16:12:44.865979 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:12:44.865959 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/20ce5068-6bc5-43d0-b6ef-92efd6ef0c64-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-859856b874-jrnjn\" (UID: \"20ce5068-6bc5-43d0-b6ef-92efd6ef0c64\") " pod="llm/e2e-distinct-2-simulated-kserve-859856b874-jrnjn" Sep 10 16:12:44.871645 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:12:44.871627 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8z7pn\" (UniqueName: \"kubernetes.io/projected/20ce5068-6bc5-43d0-b6ef-92efd6ef0c64-kube-api-access-8z7pn\") pod \"e2e-distinct-2-simulated-kserve-859856b874-jrnjn\" (UID: \"20ce5068-6bc5-43d0-b6ef-92efd6ef0c64\") " pod="llm/e2e-distinct-2-simulated-kserve-859856b874-jrnjn" Sep 10 16:12:44.945487 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:12:44.945407 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-jrnjn" Sep 10 16:12:45.217433 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:12:45.217403 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-859856b874-jrnjn"] Sep 10 16:12:45.218827 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:12:45.218802 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod20ce5068_6bc5_43d0_b6ef_92efd6ef0c64.slice/crio-f2e41e3408e46593ab869099e8a0956b49174a1f83d39b5391e4f9c564bad0b8 WatchSource:0}: Error finding container f2e41e3408e46593ab869099e8a0956b49174a1f83d39b5391e4f9c564bad0b8: Status 404 returned error can't find the container with id f2e41e3408e46593ab869099e8a0956b49174a1f83d39b5391e4f9c564bad0b8 Sep 10 16:12:45.748050 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:12:45.748001 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-jrnjn" event={"ID":"20ce5068-6bc5-43d0-b6ef-92efd6ef0c64","Type":"ContainerStarted","Data":"f2e41e3408e46593ab869099e8a0956b49174a1f83d39b5391e4f9c564bad0b8"} Sep 10 16:12:46.754796 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:12:46.754706 2574 generic.go:356] "Generic (PLEG): container finished" podID="20ce5068-6bc5-43d0-b6ef-92efd6ef0c64" containerID="caaf503d33c512324add385ce88f452bd6ac068dcf79cdb985a7d4ef747834d3" exitCode=0 Sep 10 16:12:46.755144 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:12:46.754786 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-jrnjn" event={"ID":"20ce5068-6bc5-43d0-b6ef-92efd6ef0c64","Type":"ContainerDied","Data":"caaf503d33c512324add385ce88f452bd6ac068dcf79cdb985a7d4ef747834d3"} Sep 10 16:12:46.755144 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:12:46.755003 2574 scope.go:117] "RemoveContainer" containerID="caaf503d33c512324add385ce88f452bd6ac068dcf79cdb985a7d4ef747834d3" Sep 10 16:12:47.761403 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:12:47.761372 2574 generic.go:356] "Generic (PLEG): container finished" podID="20ce5068-6bc5-43d0-b6ef-92efd6ef0c64" containerID="38434f24ac3a4b0dab951a05ae254ac2c39d9dff1075c573ac9e01e31c99e69f" exitCode=0 Sep 10 16:12:47.761794 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:12:47.761420 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-jrnjn" event={"ID":"20ce5068-6bc5-43d0-b6ef-92efd6ef0c64","Type":"ContainerDied","Data":"38434f24ac3a4b0dab951a05ae254ac2c39d9dff1075c573ac9e01e31c99e69f"} Sep 10 16:12:47.761794 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:12:47.761465 2574 scope.go:117] "RemoveContainer" containerID="caaf503d33c512324add385ce88f452bd6ac068dcf79cdb985a7d4ef747834d3" Sep 10 16:12:47.761794 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:12:47.761716 2574 scope.go:117] "RemoveContainer" containerID="38434f24ac3a4b0dab951a05ae254ac2c39d9dff1075c573ac9e01e31c99e69f" Sep 10 16:12:47.761938 ip-10-0-135-53 kubenswrapper[2574]: E0910 16:12:47.761919 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 10s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-jrnjn_llm(20ce5068-6bc5-43d0-b6ef-92efd6ef0c64)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-jrnjn" podUID="20ce5068-6bc5-43d0-b6ef-92efd6ef0c64" Sep 10 16:12:48.769847 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:12:48.769823 2574 scope.go:117] "RemoveContainer" containerID="38434f24ac3a4b0dab951a05ae254ac2c39d9dff1075c573ac9e01e31c99e69f" Sep 10 16:12:48.770199 ip-10-0-135-53 kubenswrapper[2574]: E0910 16:12:48.769989 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 10s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-jrnjn_llm(20ce5068-6bc5-43d0-b6ef-92efd6ef0c64)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-jrnjn" podUID="20ce5068-6bc5-43d0-b6ef-92efd6ef0c64" Sep 10 16:12:54.945797 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:12:54.945760 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-jrnjn" Sep 10 16:12:54.946139 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:12:54.945823 2574 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-jrnjn" Sep 10 16:12:54.946139 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:12:54.945840 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-jrnjn" Sep 10 16:12:54.946139 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:12:54.945853 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-jrnjn" Sep 10 16:12:54.946286 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:12:54.946200 2574 scope.go:117] "RemoveContainer" containerID="38434f24ac3a4b0dab951a05ae254ac2c39d9dff1075c573ac9e01e31c99e69f" Sep 10 16:12:54.946386 ip-10-0-135-53 kubenswrapper[2574]: E0910 16:12:54.946367 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 10s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-jrnjn_llm(20ce5068-6bc5-43d0-b6ef-92efd6ef0c64)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-jrnjn" podUID="20ce5068-6bc5-43d0-b6ef-92efd6ef0c64" Sep 10 16:12:55.886969 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:12:55.886937 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-frshx_9baedfdd-1384-4da1-b9c0-58dea49d3ae0/console-operator/1.log" Sep 10 16:12:55.888103 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:12:55.888083 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-frshx_9baedfdd-1384-4da1-b9c0-58dea49d3ae0/console-operator/1.log" Sep 10 16:13:09.074713 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:13:09.074682 2574 scope.go:117] "RemoveContainer" containerID="38434f24ac3a4b0dab951a05ae254ac2c39d9dff1075c573ac9e01e31c99e69f" Sep 10 16:13:09.078700 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:13:09.074963 2574 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 10 16:13:09.876874 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:13:09.876841 2574 generic.go:356] "Generic (PLEG): container finished" podID="20ce5068-6bc5-43d0-b6ef-92efd6ef0c64" containerID="dca254059d5b9741a8dfa8c7d52e7a0b8e53dbc5f7a50bedcc32d0d07bd67564" exitCode=0 Sep 10 16:13:09.877070 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:13:09.876888 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-jrnjn" event={"ID":"20ce5068-6bc5-43d0-b6ef-92efd6ef0c64","Type":"ContainerDied","Data":"dca254059d5b9741a8dfa8c7d52e7a0b8e53dbc5f7a50bedcc32d0d07bd67564"} Sep 10 16:13:09.877070 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:13:09.876936 2574 scope.go:117] "RemoveContainer" containerID="38434f24ac3a4b0dab951a05ae254ac2c39d9dff1075c573ac9e01e31c99e69f" Sep 10 16:13:09.877321 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:13:09.877303 2574 scope.go:117] "RemoveContainer" containerID="dca254059d5b9741a8dfa8c7d52e7a0b8e53dbc5f7a50bedcc32d0d07bd67564" Sep 10 16:13:09.877561 ip-10-0-135-53 kubenswrapper[2574]: E0910 16:13:09.877541 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 20s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-jrnjn_llm(20ce5068-6bc5-43d0-b6ef-92efd6ef0c64)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-jrnjn" podUID="20ce5068-6bc5-43d0-b6ef-92efd6ef0c64" Sep 10 16:13:14.946536 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:13:14.946500 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-jrnjn" Sep 10 16:13:14.946932 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:13:14.946556 2574 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-jrnjn" Sep 10 16:13:14.946932 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:13:14.946575 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-jrnjn" Sep 10 16:13:14.946932 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:13:14.946589 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-jrnjn" Sep 10 16:13:14.946932 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:13:14.946898 2574 scope.go:117] "RemoveContainer" containerID="dca254059d5b9741a8dfa8c7d52e7a0b8e53dbc5f7a50bedcc32d0d07bd67564" Sep 10 16:13:14.947104 ip-10-0-135-53 kubenswrapper[2574]: E0910 16:13:14.947083 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 20s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-jrnjn_llm(20ce5068-6bc5-43d0-b6ef-92efd6ef0c64)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-jrnjn" podUID="20ce5068-6bc5-43d0-b6ef-92efd6ef0c64" Sep 10 16:13:28.085958 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:13:28.085881 2574 scope.go:117] "RemoveContainer" containerID="dca254059d5b9741a8dfa8c7d52e7a0b8e53dbc5f7a50bedcc32d0d07bd67564" Sep 10 16:13:28.086336 ip-10-0-135-53 kubenswrapper[2574]: E0910 16:13:28.086047 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 20s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-jrnjn_llm(20ce5068-6bc5-43d0-b6ef-92efd6ef0c64)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-jrnjn" podUID="20ce5068-6bc5-43d0-b6ef-92efd6ef0c64" Sep 10 16:13:40.074710 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:13:40.074678 2574 scope.go:117] "RemoveContainer" containerID="dca254059d5b9741a8dfa8c7d52e7a0b8e53dbc5f7a50bedcc32d0d07bd67564" Sep 10 16:13:41.035847 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:13:41.035812 2574 generic.go:356] "Generic (PLEG): container finished" podID="20ce5068-6bc5-43d0-b6ef-92efd6ef0c64" containerID="2b13e27435e2c779bdbefd9bc1312d5bbec107d79f9022f10544aa24f5452e99" exitCode=0 Sep 10 16:13:41.036011 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:13:41.035889 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-jrnjn" event={"ID":"20ce5068-6bc5-43d0-b6ef-92efd6ef0c64","Type":"ContainerDied","Data":"2b13e27435e2c779bdbefd9bc1312d5bbec107d79f9022f10544aa24f5452e99"} Sep 10 16:13:41.036011 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:13:41.035950 2574 scope.go:117] "RemoveContainer" containerID="dca254059d5b9741a8dfa8c7d52e7a0b8e53dbc5f7a50bedcc32d0d07bd67564" Sep 10 16:13:41.036296 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:13:41.036278 2574 scope.go:117] "RemoveContainer" containerID="2b13e27435e2c779bdbefd9bc1312d5bbec107d79f9022f10544aa24f5452e99" Sep 10 16:13:41.036472 ip-10-0-135-53 kubenswrapper[2574]: E0910 16:13:41.036452 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 40s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-jrnjn_llm(20ce5068-6bc5-43d0-b6ef-92efd6ef0c64)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-jrnjn" podUID="20ce5068-6bc5-43d0-b6ef-92efd6ef0c64" Sep 10 16:13:44.946210 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:13:44.946173 2574 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-jrnjn" Sep 10 16:13:44.946638 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:13:44.946235 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-jrnjn" Sep 10 16:13:44.946638 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:13:44.946256 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-jrnjn" Sep 10 16:13:44.946638 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:13:44.946284 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-jrnjn" Sep 10 16:13:44.946638 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:13:44.946630 2574 scope.go:117] "RemoveContainer" containerID="2b13e27435e2c779bdbefd9bc1312d5bbec107d79f9022f10544aa24f5452e99" Sep 10 16:13:44.946807 ip-10-0-135-53 kubenswrapper[2574]: E0910 16:13:44.946789 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 40s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-jrnjn_llm(20ce5068-6bc5-43d0-b6ef-92efd6ef0c64)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-jrnjn" podUID="20ce5068-6bc5-43d0-b6ef-92efd6ef0c64" Sep 10 16:13:47.533358 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:13:47.533325 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-j8hn6"] Sep 10 16:13:47.537614 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:13:47.537593 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-j8hn6" Sep 10 16:13:47.540102 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:13:47.540082 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\"" Sep 10 16:13:47.549180 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:13:47.549154 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-j8hn6"] Sep 10 16:13:47.585687 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:13:47.585642 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/47163db1-5817-41a7-8d5b-1ee15cc28ed6-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-j8hn6\" (UID: \"47163db1-5817-41a7-8d5b-1ee15cc28ed6\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-j8hn6" Sep 10 16:13:47.585687 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:13:47.585694 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ddlxm\" (UniqueName: \"kubernetes.io/projected/47163db1-5817-41a7-8d5b-1ee15cc28ed6-kube-api-access-ddlxm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-j8hn6\" (UID: \"47163db1-5817-41a7-8d5b-1ee15cc28ed6\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-j8hn6" Sep 10 16:13:47.585907 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:13:47.585797 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/47163db1-5817-41a7-8d5b-1ee15cc28ed6-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-j8hn6\" (UID: \"47163db1-5817-41a7-8d5b-1ee15cc28ed6\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-j8hn6" Sep 10 16:13:47.585907 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:13:47.585833 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/47163db1-5817-41a7-8d5b-1ee15cc28ed6-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-j8hn6\" (UID: \"47163db1-5817-41a7-8d5b-1ee15cc28ed6\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-j8hn6" Sep 10 16:13:47.585907 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:13:47.585858 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/47163db1-5817-41a7-8d5b-1ee15cc28ed6-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-j8hn6\" (UID: \"47163db1-5817-41a7-8d5b-1ee15cc28ed6\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-j8hn6" Sep 10 16:13:47.585907 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:13:47.585872 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/47163db1-5817-41a7-8d5b-1ee15cc28ed6-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-j8hn6\" (UID: \"47163db1-5817-41a7-8d5b-1ee15cc28ed6\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-j8hn6" Sep 10 16:13:47.686492 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:13:47.686456 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ddlxm\" (UniqueName: \"kubernetes.io/projected/47163db1-5817-41a7-8d5b-1ee15cc28ed6-kube-api-access-ddlxm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-j8hn6\" (UID: \"47163db1-5817-41a7-8d5b-1ee15cc28ed6\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-j8hn6" Sep 10 16:13:47.686644 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:13:47.686551 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/47163db1-5817-41a7-8d5b-1ee15cc28ed6-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-j8hn6\" (UID: \"47163db1-5817-41a7-8d5b-1ee15cc28ed6\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-j8hn6" Sep 10 16:13:47.686644 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:13:47.686585 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/47163db1-5817-41a7-8d5b-1ee15cc28ed6-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-j8hn6\" (UID: \"47163db1-5817-41a7-8d5b-1ee15cc28ed6\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-j8hn6" Sep 10 16:13:47.686644 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:13:47.686618 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/47163db1-5817-41a7-8d5b-1ee15cc28ed6-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-j8hn6\" (UID: \"47163db1-5817-41a7-8d5b-1ee15cc28ed6\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-j8hn6" Sep 10 16:13:47.686753 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:13:47.686730 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/47163db1-5817-41a7-8d5b-1ee15cc28ed6-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-j8hn6\" (UID: \"47163db1-5817-41a7-8d5b-1ee15cc28ed6\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-j8hn6" Sep 10 16:13:47.686796 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:13:47.686785 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/47163db1-5817-41a7-8d5b-1ee15cc28ed6-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-j8hn6\" (UID: \"47163db1-5817-41a7-8d5b-1ee15cc28ed6\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-j8hn6" Sep 10 16:13:47.687018 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:13:47.686998 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/47163db1-5817-41a7-8d5b-1ee15cc28ed6-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-j8hn6\" (UID: \"47163db1-5817-41a7-8d5b-1ee15cc28ed6\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-j8hn6" Sep 10 16:13:47.687114 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:13:47.687074 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/47163db1-5817-41a7-8d5b-1ee15cc28ed6-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-j8hn6\" (UID: \"47163db1-5817-41a7-8d5b-1ee15cc28ed6\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-j8hn6" Sep 10 16:13:47.687114 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:13:47.687083 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/47163db1-5817-41a7-8d5b-1ee15cc28ed6-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-j8hn6\" (UID: \"47163db1-5817-41a7-8d5b-1ee15cc28ed6\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-j8hn6" Sep 10 16:13:47.689030 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:13:47.689009 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/47163db1-5817-41a7-8d5b-1ee15cc28ed6-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-j8hn6\" (UID: \"47163db1-5817-41a7-8d5b-1ee15cc28ed6\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-j8hn6" Sep 10 16:13:47.689304 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:13:47.689286 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/47163db1-5817-41a7-8d5b-1ee15cc28ed6-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-j8hn6\" (UID: \"47163db1-5817-41a7-8d5b-1ee15cc28ed6\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-j8hn6" Sep 10 16:13:47.694477 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:13:47.694456 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ddlxm\" (UniqueName: \"kubernetes.io/projected/47163db1-5817-41a7-8d5b-1ee15cc28ed6-kube-api-access-ddlxm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-j8hn6\" (UID: \"47163db1-5817-41a7-8d5b-1ee15cc28ed6\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-j8hn6" Sep 10 16:13:47.848430 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:13:47.848322 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-j8hn6" Sep 10 16:13:48.120566 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:13:48.120534 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-j8hn6"] Sep 10 16:13:48.122306 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:13:48.122257 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod47163db1_5817_41a7_8d5b_1ee15cc28ed6.slice/crio-baacb1590b8d2e043aef5a1ee383220aab56695b6e52aae4fe78525af42688da WatchSource:0}: Error finding container baacb1590b8d2e043aef5a1ee383220aab56695b6e52aae4fe78525af42688da: Status 404 returned error can't find the container with id baacb1590b8d2e043aef5a1ee383220aab56695b6e52aae4fe78525af42688da Sep 10 16:13:49.088893 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:13:49.088847 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-j8hn6" event={"ID":"47163db1-5817-41a7-8d5b-1ee15cc28ed6","Type":"ContainerStarted","Data":"cafc8f648ac47df5d11e6363f096ff04b4db317cd231c88e488b5ebf54d30a97"} Sep 10 16:13:49.089405 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:13:49.088908 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-j8hn6" event={"ID":"47163db1-5817-41a7-8d5b-1ee15cc28ed6","Type":"ContainerStarted","Data":"baacb1590b8d2e043aef5a1ee383220aab56695b6e52aae4fe78525af42688da"} Sep 10 16:13:49.111938 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:13:49.111875 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-j8hn6" podStartSLOduration=1.9005752999999999 podStartE2EDuration="2.111855685s" totalImagesPullingTime="211.280385ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 16:13:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 16:13:49.10934948 +0000 UTC m=+653.674553028" watchObservedRunningTime="2026-09-10 16:13:49.111855685 +0000 UTC m=+653.677059264" Sep 10 16:13:57.849217 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:13:57.849176 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-j8hn6" Sep 10 16:13:57.849703 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:13:57.849330 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-j8hn6" Sep 10 16:13:57.861972 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:13:57.861937 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-j8hn6" Sep 10 16:13:58.144608 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:13:58.144513 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-j8hn6" Sep 10 16:14:00.075011 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:14:00.074968 2574 scope.go:117] "RemoveContainer" containerID="2b13e27435e2c779bdbefd9bc1312d5bbec107d79f9022f10544aa24f5452e99" Sep 10 16:14:00.075432 ip-10-0-135-53 kubenswrapper[2574]: E0910 16:14:00.075214 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 40s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-jrnjn_llm(20ce5068-6bc5-43d0-b6ef-92efd6ef0c64)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-jrnjn" podUID="20ce5068-6bc5-43d0-b6ef-92efd6ef0c64" Sep 10 16:14:11.074954 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:14:11.074914 2574 scope.go:117] "RemoveContainer" containerID="2b13e27435e2c779bdbefd9bc1312d5bbec107d79f9022f10544aa24f5452e99" Sep 10 16:14:11.075471 ip-10-0-135-53 kubenswrapper[2574]: E0910 16:14:11.075097 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 40s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-jrnjn_llm(20ce5068-6bc5-43d0-b6ef-92efd6ef0c64)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-jrnjn" podUID="20ce5068-6bc5-43d0-b6ef-92efd6ef0c64" Sep 10 16:14:16.726990 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:14:16.726948 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-wfqsm"] Sep 10 16:14:16.730431 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:14:16.730413 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-wfqsm" Sep 10 16:14:16.733572 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:14:16.733555 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\"" Sep 10 16:14:16.742879 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:14:16.742851 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-wfqsm"] Sep 10 16:14:16.847556 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:14:16.847520 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a557ef2f-ee80-4404-a5e3-004f9b802fd6-model-cache\") pod \"facebook-opt-125m-simulated-kserve-64dfc7b8f-wfqsm\" (UID: \"a557ef2f-ee80-4404-a5e3-004f9b802fd6\") " pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-wfqsm" Sep 10 16:14:16.847700 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:14:16.847581 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2rccd\" (UniqueName: \"kubernetes.io/projected/a557ef2f-ee80-4404-a5e3-004f9b802fd6-kube-api-access-2rccd\") pod \"facebook-opt-125m-simulated-kserve-64dfc7b8f-wfqsm\" (UID: \"a557ef2f-ee80-4404-a5e3-004f9b802fd6\") " pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-wfqsm" Sep 10 16:14:16.847700 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:14:16.847621 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a557ef2f-ee80-4404-a5e3-004f9b802fd6-dshm\") pod \"facebook-opt-125m-simulated-kserve-64dfc7b8f-wfqsm\" (UID: \"a557ef2f-ee80-4404-a5e3-004f9b802fd6\") " pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-wfqsm" Sep 10 16:14:16.847700 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:14:16.847671 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a557ef2f-ee80-4404-a5e3-004f9b802fd6-home\") pod \"facebook-opt-125m-simulated-kserve-64dfc7b8f-wfqsm\" (UID: \"a557ef2f-ee80-4404-a5e3-004f9b802fd6\") " pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-wfqsm" Sep 10 16:14:16.847700 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:14:16.847694 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a557ef2f-ee80-4404-a5e3-004f9b802fd6-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-64dfc7b8f-wfqsm\" (UID: \"a557ef2f-ee80-4404-a5e3-004f9b802fd6\") " pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-wfqsm" Sep 10 16:14:16.847874 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:14:16.847739 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a557ef2f-ee80-4404-a5e3-004f9b802fd6-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-64dfc7b8f-wfqsm\" (UID: \"a557ef2f-ee80-4404-a5e3-004f9b802fd6\") " pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-wfqsm" Sep 10 16:14:16.948648 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:14:16.948604 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a557ef2f-ee80-4404-a5e3-004f9b802fd6-home\") pod \"facebook-opt-125m-simulated-kserve-64dfc7b8f-wfqsm\" (UID: \"a557ef2f-ee80-4404-a5e3-004f9b802fd6\") " pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-wfqsm" Sep 10 16:14:16.948648 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:14:16.948652 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a557ef2f-ee80-4404-a5e3-004f9b802fd6-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-64dfc7b8f-wfqsm\" (UID: \"a557ef2f-ee80-4404-a5e3-004f9b802fd6\") " pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-wfqsm" Sep 10 16:14:16.948849 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:14:16.948771 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a557ef2f-ee80-4404-a5e3-004f9b802fd6-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-64dfc7b8f-wfqsm\" (UID: \"a557ef2f-ee80-4404-a5e3-004f9b802fd6\") " pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-wfqsm" Sep 10 16:14:16.948849 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:14:16.948815 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a557ef2f-ee80-4404-a5e3-004f9b802fd6-model-cache\") pod \"facebook-opt-125m-simulated-kserve-64dfc7b8f-wfqsm\" (UID: \"a557ef2f-ee80-4404-a5e3-004f9b802fd6\") " pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-wfqsm" Sep 10 16:14:16.948932 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:14:16.948857 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2rccd\" (UniqueName: \"kubernetes.io/projected/a557ef2f-ee80-4404-a5e3-004f9b802fd6-kube-api-access-2rccd\") pod \"facebook-opt-125m-simulated-kserve-64dfc7b8f-wfqsm\" (UID: \"a557ef2f-ee80-4404-a5e3-004f9b802fd6\") " pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-wfqsm" Sep 10 16:14:16.948932 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:14:16.948889 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a557ef2f-ee80-4404-a5e3-004f9b802fd6-dshm\") pod \"facebook-opt-125m-simulated-kserve-64dfc7b8f-wfqsm\" (UID: \"a557ef2f-ee80-4404-a5e3-004f9b802fd6\") " pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-wfqsm" Sep 10 16:14:16.949076 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:14:16.949052 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a557ef2f-ee80-4404-a5e3-004f9b802fd6-home\") pod \"facebook-opt-125m-simulated-kserve-64dfc7b8f-wfqsm\" (UID: \"a557ef2f-ee80-4404-a5e3-004f9b802fd6\") " pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-wfqsm" Sep 10 16:14:16.949132 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:14:16.949081 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a557ef2f-ee80-4404-a5e3-004f9b802fd6-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-64dfc7b8f-wfqsm\" (UID: \"a557ef2f-ee80-4404-a5e3-004f9b802fd6\") " pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-wfqsm" Sep 10 16:14:16.949193 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:14:16.949175 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a557ef2f-ee80-4404-a5e3-004f9b802fd6-model-cache\") pod \"facebook-opt-125m-simulated-kserve-64dfc7b8f-wfqsm\" (UID: \"a557ef2f-ee80-4404-a5e3-004f9b802fd6\") " pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-wfqsm" Sep 10 16:14:16.950974 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:14:16.950945 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a557ef2f-ee80-4404-a5e3-004f9b802fd6-dshm\") pod \"facebook-opt-125m-simulated-kserve-64dfc7b8f-wfqsm\" (UID: \"a557ef2f-ee80-4404-a5e3-004f9b802fd6\") " pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-wfqsm" Sep 10 16:14:16.951382 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:14:16.951361 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a557ef2f-ee80-4404-a5e3-004f9b802fd6-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-64dfc7b8f-wfqsm\" (UID: \"a557ef2f-ee80-4404-a5e3-004f9b802fd6\") " pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-wfqsm" Sep 10 16:14:16.974888 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:14:16.974861 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2rccd\" (UniqueName: \"kubernetes.io/projected/a557ef2f-ee80-4404-a5e3-004f9b802fd6-kube-api-access-2rccd\") pod \"facebook-opt-125m-simulated-kserve-64dfc7b8f-wfqsm\" (UID: \"a557ef2f-ee80-4404-a5e3-004f9b802fd6\") " pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-wfqsm" Sep 10 16:14:17.040728 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:14:17.040694 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-wfqsm" Sep 10 16:14:17.313788 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:14:17.313744 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-wfqsm"] Sep 10 16:14:17.315171 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:14:17.315142 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda557ef2f_ee80_4404_a5e3_004f9b802fd6.slice/crio-e513397087ce5103d8f1aa58090a05c236581b1dfb7afcdedbe171364ef2812c WatchSource:0}: Error finding container e513397087ce5103d8f1aa58090a05c236581b1dfb7afcdedbe171364ef2812c: Status 404 returned error can't find the container with id e513397087ce5103d8f1aa58090a05c236581b1dfb7afcdedbe171364ef2812c Sep 10 16:14:18.236726 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:14:18.236685 2574 generic.go:356] "Generic (PLEG): container finished" podID="a557ef2f-ee80-4404-a5e3-004f9b802fd6" containerID="4194bf603ed06e239ed7a5f9ff3e1af822734e8b3418b42cc3a0e9765c79527c" exitCode=0 Sep 10 16:14:18.237107 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:14:18.236764 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-wfqsm" event={"ID":"a557ef2f-ee80-4404-a5e3-004f9b802fd6","Type":"ContainerDied","Data":"4194bf603ed06e239ed7a5f9ff3e1af822734e8b3418b42cc3a0e9765c79527c"} Sep 10 16:14:18.237107 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:14:18.236812 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-wfqsm" event={"ID":"a557ef2f-ee80-4404-a5e3-004f9b802fd6","Type":"ContainerStarted","Data":"e513397087ce5103d8f1aa58090a05c236581b1dfb7afcdedbe171364ef2812c"} Sep 10 16:14:18.237107 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:14:18.236979 2574 scope.go:117] "RemoveContainer" containerID="4194bf603ed06e239ed7a5f9ff3e1af822734e8b3418b42cc3a0e9765c79527c" Sep 10 16:14:19.243934 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:14:19.243902 2574 generic.go:356] "Generic (PLEG): container finished" podID="a557ef2f-ee80-4404-a5e3-004f9b802fd6" containerID="645f28441df04de262000865b7b03ffb93fb8cff4676dc856e93163622e69a6b" exitCode=0 Sep 10 16:14:19.244404 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:14:19.243990 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-wfqsm" event={"ID":"a557ef2f-ee80-4404-a5e3-004f9b802fd6","Type":"ContainerDied","Data":"645f28441df04de262000865b7b03ffb93fb8cff4676dc856e93163622e69a6b"} Sep 10 16:14:19.244404 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:14:19.244067 2574 scope.go:117] "RemoveContainer" containerID="4194bf603ed06e239ed7a5f9ff3e1af822734e8b3418b42cc3a0e9765c79527c" Sep 10 16:14:19.244404 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:14:19.244357 2574 scope.go:117] "RemoveContainer" containerID="645f28441df04de262000865b7b03ffb93fb8cff4676dc856e93163622e69a6b" Sep 10 16:14:19.244567 ip-10-0-135-53 kubenswrapper[2574]: E0910 16:14:19.244549 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 10s restarting failed container=main pod=facebook-opt-125m-simulated-kserve-64dfc7b8f-wfqsm_llm(a557ef2f-ee80-4404-a5e3-004f9b802fd6)\"" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-wfqsm" podUID="a557ef2f-ee80-4404-a5e3-004f9b802fd6" Sep 10 16:14:20.250753 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:14:20.250724 2574 scope.go:117] "RemoveContainer" containerID="645f28441df04de262000865b7b03ffb93fb8cff4676dc856e93163622e69a6b" Sep 10 16:14:20.251125 ip-10-0-135-53 kubenswrapper[2574]: E0910 16:14:20.250902 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 10s restarting failed container=main pod=facebook-opt-125m-simulated-kserve-64dfc7b8f-wfqsm_llm(a557ef2f-ee80-4404-a5e3-004f9b802fd6)\"" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-wfqsm" podUID="a557ef2f-ee80-4404-a5e3-004f9b802fd6" Sep 10 16:14:25.074511 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:14:25.074477 2574 scope.go:117] "RemoveContainer" containerID="2b13e27435e2c779bdbefd9bc1312d5bbec107d79f9022f10544aa24f5452e99" Sep 10 16:14:26.281329 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:14:26.281297 2574 generic.go:356] "Generic (PLEG): container finished" podID="20ce5068-6bc5-43d0-b6ef-92efd6ef0c64" containerID="1abb4a2379b42b967af23d6a278e9e6f517ead2a7a3e81e1d82ca432d6d15225" exitCode=0 Sep 10 16:14:26.281741 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:14:26.281372 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-jrnjn" event={"ID":"20ce5068-6bc5-43d0-b6ef-92efd6ef0c64","Type":"ContainerDied","Data":"1abb4a2379b42b967af23d6a278e9e6f517ead2a7a3e81e1d82ca432d6d15225"} Sep 10 16:14:26.281741 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:14:26.281434 2574 scope.go:117] "RemoveContainer" containerID="2b13e27435e2c779bdbefd9bc1312d5bbec107d79f9022f10544aa24f5452e99" Sep 10 16:14:26.281832 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:14:26.281772 2574 scope.go:117] "RemoveContainer" containerID="1abb4a2379b42b967af23d6a278e9e6f517ead2a7a3e81e1d82ca432d6d15225" Sep 10 16:14:26.281990 ip-10-0-135-53 kubenswrapper[2574]: E0910 16:14:26.281971 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-jrnjn_llm(20ce5068-6bc5-43d0-b6ef-92efd6ef0c64)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-jrnjn" podUID="20ce5068-6bc5-43d0-b6ef-92efd6ef0c64" Sep 10 16:14:27.041693 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:14:27.041648 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-wfqsm" Sep 10 16:14:27.041869 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:14:27.041713 2574 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-wfqsm" Sep 10 16:14:27.041869 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:14:27.041730 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-wfqsm" Sep 10 16:14:27.041869 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:14:27.041743 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-wfqsm" Sep 10 16:14:27.042111 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:14:27.042098 2574 scope.go:117] "RemoveContainer" containerID="645f28441df04de262000865b7b03ffb93fb8cff4676dc856e93163622e69a6b" Sep 10 16:14:27.042304 ip-10-0-135-53 kubenswrapper[2574]: E0910 16:14:27.042254 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 10s restarting failed container=main pod=facebook-opt-125m-simulated-kserve-64dfc7b8f-wfqsm_llm(a557ef2f-ee80-4404-a5e3-004f9b802fd6)\"" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-wfqsm" podUID="a557ef2f-ee80-4404-a5e3-004f9b802fd6" Sep 10 16:14:34.946315 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:14:34.946279 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-jrnjn" Sep 10 16:14:34.946708 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:14:34.946350 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-jrnjn" Sep 10 16:14:34.946708 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:14:34.946372 2574 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-jrnjn" Sep 10 16:14:34.946708 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:14:34.946392 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-jrnjn" Sep 10 16:14:34.946827 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:14:34.946807 2574 scope.go:117] "RemoveContainer" containerID="1abb4a2379b42b967af23d6a278e9e6f517ead2a7a3e81e1d82ca432d6d15225" Sep 10 16:14:34.947036 ip-10-0-135-53 kubenswrapper[2574]: E0910 16:14:34.947016 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-jrnjn_llm(20ce5068-6bc5-43d0-b6ef-92efd6ef0c64)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-jrnjn" podUID="20ce5068-6bc5-43d0-b6ef-92efd6ef0c64" Sep 10 16:14:35.114123 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:14:35.114089 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5758cf6949-b8pqt"] Sep 10 16:14:35.118315 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:14:35.118289 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-b8pqt" Sep 10 16:14:35.121322 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:14:35.121298 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\"" Sep 10 16:14:35.134729 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:14:35.134697 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5758cf6949-b8pqt"] Sep 10 16:14:35.206491 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:14:35.206404 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b6a0e2ea-eb1f-4f79-8bdd-8ab3e8515f2e-home\") pod \"premium-simulated-simulated-premium-kserve-5758cf6949-b8pqt\" (UID: \"b6a0e2ea-eb1f-4f79-8bdd-8ab3e8515f2e\") " pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-b8pqt" Sep 10 16:14:35.206657 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:14:35.206491 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9txf4\" (UniqueName: \"kubernetes.io/projected/b6a0e2ea-eb1f-4f79-8bdd-8ab3e8515f2e-kube-api-access-9txf4\") pod \"premium-simulated-simulated-premium-kserve-5758cf6949-b8pqt\" (UID: \"b6a0e2ea-eb1f-4f79-8bdd-8ab3e8515f2e\") " pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-b8pqt" Sep 10 16:14:35.206657 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:14:35.206539 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b6a0e2ea-eb1f-4f79-8bdd-8ab3e8515f2e-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5758cf6949-b8pqt\" (UID: \"b6a0e2ea-eb1f-4f79-8bdd-8ab3e8515f2e\") " pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-b8pqt" Sep 10 16:14:35.206657 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:14:35.206572 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b6a0e2ea-eb1f-4f79-8bdd-8ab3e8515f2e-dshm\") pod \"premium-simulated-simulated-premium-kserve-5758cf6949-b8pqt\" (UID: \"b6a0e2ea-eb1f-4f79-8bdd-8ab3e8515f2e\") " pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-b8pqt" Sep 10 16:14:35.206657 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:14:35.206620 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b6a0e2ea-eb1f-4f79-8bdd-8ab3e8515f2e-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5758cf6949-b8pqt\" (UID: \"b6a0e2ea-eb1f-4f79-8bdd-8ab3e8515f2e\") " pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-b8pqt" Sep 10 16:14:35.206657 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:14:35.206644 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b6a0e2ea-eb1f-4f79-8bdd-8ab3e8515f2e-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5758cf6949-b8pqt\" (UID: \"b6a0e2ea-eb1f-4f79-8bdd-8ab3e8515f2e\") " pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-b8pqt" Sep 10 16:14:35.308027 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:14:35.307969 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b6a0e2ea-eb1f-4f79-8bdd-8ab3e8515f2e-home\") pod \"premium-simulated-simulated-premium-kserve-5758cf6949-b8pqt\" (UID: \"b6a0e2ea-eb1f-4f79-8bdd-8ab3e8515f2e\") " pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-b8pqt" Sep 10 16:14:35.308205 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:14:35.308049 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9txf4\" (UniqueName: \"kubernetes.io/projected/b6a0e2ea-eb1f-4f79-8bdd-8ab3e8515f2e-kube-api-access-9txf4\") pod \"premium-simulated-simulated-premium-kserve-5758cf6949-b8pqt\" (UID: \"b6a0e2ea-eb1f-4f79-8bdd-8ab3e8515f2e\") " pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-b8pqt" Sep 10 16:14:35.308205 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:14:35.308089 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b6a0e2ea-eb1f-4f79-8bdd-8ab3e8515f2e-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5758cf6949-b8pqt\" (UID: \"b6a0e2ea-eb1f-4f79-8bdd-8ab3e8515f2e\") " pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-b8pqt" Sep 10 16:14:35.308205 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:14:35.308109 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b6a0e2ea-eb1f-4f79-8bdd-8ab3e8515f2e-dshm\") pod \"premium-simulated-simulated-premium-kserve-5758cf6949-b8pqt\" (UID: \"b6a0e2ea-eb1f-4f79-8bdd-8ab3e8515f2e\") " pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-b8pqt" Sep 10 16:14:35.308205 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:14:35.308136 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b6a0e2ea-eb1f-4f79-8bdd-8ab3e8515f2e-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5758cf6949-b8pqt\" (UID: \"b6a0e2ea-eb1f-4f79-8bdd-8ab3e8515f2e\") " pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-b8pqt" Sep 10 16:14:35.308205 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:14:35.308159 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b6a0e2ea-eb1f-4f79-8bdd-8ab3e8515f2e-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5758cf6949-b8pqt\" (UID: \"b6a0e2ea-eb1f-4f79-8bdd-8ab3e8515f2e\") " pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-b8pqt" Sep 10 16:14:35.308516 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:14:35.308428 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b6a0e2ea-eb1f-4f79-8bdd-8ab3e8515f2e-home\") pod \"premium-simulated-simulated-premium-kserve-5758cf6949-b8pqt\" (UID: \"b6a0e2ea-eb1f-4f79-8bdd-8ab3e8515f2e\") " pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-b8pqt" Sep 10 16:14:35.308516 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:14:35.308480 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b6a0e2ea-eb1f-4f79-8bdd-8ab3e8515f2e-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5758cf6949-b8pqt\" (UID: \"b6a0e2ea-eb1f-4f79-8bdd-8ab3e8515f2e\") " pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-b8pqt" Sep 10 16:14:35.308614 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:14:35.308532 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b6a0e2ea-eb1f-4f79-8bdd-8ab3e8515f2e-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5758cf6949-b8pqt\" (UID: \"b6a0e2ea-eb1f-4f79-8bdd-8ab3e8515f2e\") " pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-b8pqt" Sep 10 16:14:35.310559 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:14:35.310533 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b6a0e2ea-eb1f-4f79-8bdd-8ab3e8515f2e-dshm\") pod \"premium-simulated-simulated-premium-kserve-5758cf6949-b8pqt\" (UID: \"b6a0e2ea-eb1f-4f79-8bdd-8ab3e8515f2e\") " pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-b8pqt" Sep 10 16:14:35.310653 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:14:35.310638 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b6a0e2ea-eb1f-4f79-8bdd-8ab3e8515f2e-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5758cf6949-b8pqt\" (UID: \"b6a0e2ea-eb1f-4f79-8bdd-8ab3e8515f2e\") " pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-b8pqt" Sep 10 16:14:35.317158 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:14:35.317135 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9txf4\" (UniqueName: \"kubernetes.io/projected/b6a0e2ea-eb1f-4f79-8bdd-8ab3e8515f2e-kube-api-access-9txf4\") pod \"premium-simulated-simulated-premium-kserve-5758cf6949-b8pqt\" (UID: \"b6a0e2ea-eb1f-4f79-8bdd-8ab3e8515f2e\") " pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-b8pqt" Sep 10 16:14:35.427104 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:14:35.427074 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-b8pqt" Sep 10 16:14:35.698990 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:14:35.698960 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5758cf6949-b8pqt"] Sep 10 16:14:35.701028 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:14:35.701001 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb6a0e2ea_eb1f_4f79_8bdd_8ab3e8515f2e.slice/crio-506b38e100c689a68e7597825ee4be9f446465cf157cd74d2727c6e9dc9f96ac WatchSource:0}: Error finding container 506b38e100c689a68e7597825ee4be9f446465cf157cd74d2727c6e9dc9f96ac: Status 404 returned error can't find the container with id 506b38e100c689a68e7597825ee4be9f446465cf157cd74d2727c6e9dc9f96ac Sep 10 16:14:36.336143 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:14:36.336101 2574 generic.go:356] "Generic (PLEG): container finished" podID="b6a0e2ea-eb1f-4f79-8bdd-8ab3e8515f2e" containerID="7ebe259307d12f3b174ac53bdf156fe8fe60c6f6fc1f9415b201ebd5b45cb7c2" exitCode=0 Sep 10 16:14:36.336621 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:14:36.336184 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-b8pqt" event={"ID":"b6a0e2ea-eb1f-4f79-8bdd-8ab3e8515f2e","Type":"ContainerDied","Data":"7ebe259307d12f3b174ac53bdf156fe8fe60c6f6fc1f9415b201ebd5b45cb7c2"} Sep 10 16:14:36.336621 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:14:36.336223 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-b8pqt" event={"ID":"b6a0e2ea-eb1f-4f79-8bdd-8ab3e8515f2e","Type":"ContainerStarted","Data":"506b38e100c689a68e7597825ee4be9f446465cf157cd74d2727c6e9dc9f96ac"} Sep 10 16:14:36.336621 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:14:36.336485 2574 scope.go:117] "RemoveContainer" containerID="7ebe259307d12f3b174ac53bdf156fe8fe60c6f6fc1f9415b201ebd5b45cb7c2" Sep 10 16:14:37.348209 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:14:37.348169 2574 generic.go:356] "Generic (PLEG): container finished" podID="b6a0e2ea-eb1f-4f79-8bdd-8ab3e8515f2e" containerID="f110a9a3597315256a38fff9e17cedada275f5d31140e0835c123eef814aaf07" exitCode=0 Sep 10 16:14:37.348632 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:14:37.348238 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-b8pqt" event={"ID":"b6a0e2ea-eb1f-4f79-8bdd-8ab3e8515f2e","Type":"ContainerDied","Data":"f110a9a3597315256a38fff9e17cedada275f5d31140e0835c123eef814aaf07"} Sep 10 16:14:37.348632 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:14:37.348297 2574 scope.go:117] "RemoveContainer" containerID="7ebe259307d12f3b174ac53bdf156fe8fe60c6f6fc1f9415b201ebd5b45cb7c2" Sep 10 16:14:37.348738 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:14:37.348654 2574 scope.go:117] "RemoveContainer" containerID="f110a9a3597315256a38fff9e17cedada275f5d31140e0835c123eef814aaf07" Sep 10 16:14:37.348896 ip-10-0-135-53 kubenswrapper[2574]: E0910 16:14:37.348870 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 10s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-b8pqt_llm(b6a0e2ea-eb1f-4f79-8bdd-8ab3e8515f2e)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-b8pqt" podUID="b6a0e2ea-eb1f-4f79-8bdd-8ab3e8515f2e" Sep 10 16:14:38.356042 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:14:38.356013 2574 scope.go:117] "RemoveContainer" containerID="f110a9a3597315256a38fff9e17cedada275f5d31140e0835c123eef814aaf07" Sep 10 16:14:38.356450 ip-10-0-135-53 kubenswrapper[2574]: E0910 16:14:38.356215 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 10s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-b8pqt_llm(b6a0e2ea-eb1f-4f79-8bdd-8ab3e8515f2e)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-b8pqt" podUID="b6a0e2ea-eb1f-4f79-8bdd-8ab3e8515f2e" Sep 10 16:14:42.074642 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:14:42.074610 2574 scope.go:117] "RemoveContainer" containerID="645f28441df04de262000865b7b03ffb93fb8cff4676dc856e93163622e69a6b" Sep 10 16:14:42.377605 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:14:42.377572 2574 generic.go:356] "Generic (PLEG): container finished" podID="a557ef2f-ee80-4404-a5e3-004f9b802fd6" containerID="8ef558eb442bde0e1464933f76ae346e04286b1a0d916701efc41578b50f98e9" exitCode=0 Sep 10 16:14:42.377753 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:14:42.377638 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-wfqsm" event={"ID":"a557ef2f-ee80-4404-a5e3-004f9b802fd6","Type":"ContainerDied","Data":"8ef558eb442bde0e1464933f76ae346e04286b1a0d916701efc41578b50f98e9"} Sep 10 16:14:42.377753 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:14:42.377682 2574 scope.go:117] "RemoveContainer" containerID="645f28441df04de262000865b7b03ffb93fb8cff4676dc856e93163622e69a6b" Sep 10 16:14:42.378004 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:14:42.377983 2574 scope.go:117] "RemoveContainer" containerID="8ef558eb442bde0e1464933f76ae346e04286b1a0d916701efc41578b50f98e9" Sep 10 16:14:42.378182 ip-10-0-135-53 kubenswrapper[2574]: E0910 16:14:42.378157 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 20s restarting failed container=main pod=facebook-opt-125m-simulated-kserve-64dfc7b8f-wfqsm_llm(a557ef2f-ee80-4404-a5e3-004f9b802fd6)\"" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-wfqsm" podUID="a557ef2f-ee80-4404-a5e3-004f9b802fd6" Sep 10 16:14:45.428212 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:14:45.428179 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-b8pqt" Sep 10 16:14:45.428699 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:14:45.428226 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-b8pqt" Sep 10 16:14:45.428699 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:14:45.428236 2574 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-b8pqt" Sep 10 16:14:45.428699 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:14:45.428245 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-b8pqt" Sep 10 16:14:45.428862 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:14:45.428706 2574 scope.go:117] "RemoveContainer" containerID="f110a9a3597315256a38fff9e17cedada275f5d31140e0835c123eef814aaf07" Sep 10 16:14:45.428939 ip-10-0-135-53 kubenswrapper[2574]: E0910 16:14:45.428916 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 10s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-b8pqt_llm(b6a0e2ea-eb1f-4f79-8bdd-8ab3e8515f2e)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-b8pqt" podUID="b6a0e2ea-eb1f-4f79-8bdd-8ab3e8515f2e" Sep 10 16:14:46.399336 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:14:46.399307 2574 scope.go:117] "RemoveContainer" containerID="f110a9a3597315256a38fff9e17cedada275f5d31140e0835c123eef814aaf07" Sep 10 16:14:46.399505 ip-10-0-135-53 kubenswrapper[2574]: E0910 16:14:46.399479 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 10s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-b8pqt_llm(b6a0e2ea-eb1f-4f79-8bdd-8ab3e8515f2e)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-b8pqt" podUID="b6a0e2ea-eb1f-4f79-8bdd-8ab3e8515f2e" Sep 10 16:14:47.040946 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:14:47.040908 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-wfqsm" Sep 10 16:14:47.041326 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:14:47.040972 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-wfqsm" Sep 10 16:14:47.041326 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:14:47.040988 2574 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-wfqsm" Sep 10 16:14:47.041326 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:14:47.041001 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-wfqsm" Sep 10 16:14:47.041431 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:14:47.041353 2574 scope.go:117] "RemoveContainer" containerID="8ef558eb442bde0e1464933f76ae346e04286b1a0d916701efc41578b50f98e9" Sep 10 16:14:47.041528 ip-10-0-135-53 kubenswrapper[2574]: E0910 16:14:47.041510 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 20s restarting failed container=main pod=facebook-opt-125m-simulated-kserve-64dfc7b8f-wfqsm_llm(a557ef2f-ee80-4404-a5e3-004f9b802fd6)\"" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-wfqsm" podUID="a557ef2f-ee80-4404-a5e3-004f9b802fd6" Sep 10 16:14:47.074815 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:14:47.074782 2574 scope.go:117] "RemoveContainer" containerID="1abb4a2379b42b967af23d6a278e9e6f517ead2a7a3e81e1d82ca432d6d15225" Sep 10 16:14:47.074974 ip-10-0-135-53 kubenswrapper[2574]: E0910 16:14:47.074955 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-jrnjn_llm(20ce5068-6bc5-43d0-b6ef-92efd6ef0c64)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-jrnjn" podUID="20ce5068-6bc5-43d0-b6ef-92efd6ef0c64" Sep 10 16:14:57.075147 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:14:57.075067 2574 scope.go:117] "RemoveContainer" containerID="f110a9a3597315256a38fff9e17cedada275f5d31140e0835c123eef814aaf07" Sep 10 16:14:57.455336 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:14:57.455300 2574 generic.go:356] "Generic (PLEG): container finished" podID="b6a0e2ea-eb1f-4f79-8bdd-8ab3e8515f2e" containerID="13f28301e04c0355ccdbe1c3fe52c199d74a9b29f0ac33961e6a95368ecca122" exitCode=0 Sep 10 16:14:57.455498 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:14:57.455372 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-b8pqt" event={"ID":"b6a0e2ea-eb1f-4f79-8bdd-8ab3e8515f2e","Type":"ContainerDied","Data":"13f28301e04c0355ccdbe1c3fe52c199d74a9b29f0ac33961e6a95368ecca122"} Sep 10 16:14:57.455498 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:14:57.455422 2574 scope.go:117] "RemoveContainer" containerID="f110a9a3597315256a38fff9e17cedada275f5d31140e0835c123eef814aaf07" Sep 10 16:14:57.455759 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:14:57.455737 2574 scope.go:117] "RemoveContainer" containerID="13f28301e04c0355ccdbe1c3fe52c199d74a9b29f0ac33961e6a95368ecca122" Sep 10 16:14:57.455956 ip-10-0-135-53 kubenswrapper[2574]: E0910 16:14:57.455932 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 20s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-b8pqt_llm(b6a0e2ea-eb1f-4f79-8bdd-8ab3e8515f2e)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-b8pqt" podUID="b6a0e2ea-eb1f-4f79-8bdd-8ab3e8515f2e" Sep 10 16:14:59.075363 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:14:59.075326 2574 scope.go:117] "RemoveContainer" containerID="8ef558eb442bde0e1464933f76ae346e04286b1a0d916701efc41578b50f98e9" Sep 10 16:14:59.075767 ip-10-0-135-53 kubenswrapper[2574]: E0910 16:14:59.075512 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 20s restarting failed container=main pod=facebook-opt-125m-simulated-kserve-64dfc7b8f-wfqsm_llm(a557ef2f-ee80-4404-a5e3-004f9b802fd6)\"" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-wfqsm" podUID="a557ef2f-ee80-4404-a5e3-004f9b802fd6" Sep 10 16:15:01.074929 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:15:01.074895 2574 scope.go:117] "RemoveContainer" containerID="1abb4a2379b42b967af23d6a278e9e6f517ead2a7a3e81e1d82ca432d6d15225" Sep 10 16:15:01.075339 ip-10-0-135-53 kubenswrapper[2574]: E0910 16:15:01.075086 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-jrnjn_llm(20ce5068-6bc5-43d0-b6ef-92efd6ef0c64)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-jrnjn" podUID="20ce5068-6bc5-43d0-b6ef-92efd6ef0c64" Sep 10 16:15:05.428057 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:15:05.428023 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-b8pqt" Sep 10 16:15:05.428057 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:15:05.428070 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-b8pqt" Sep 10 16:15:05.428677 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:15:05.428080 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-b8pqt" Sep 10 16:15:05.428677 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:15:05.428089 2574 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-b8pqt" Sep 10 16:15:05.428677 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:15:05.428473 2574 scope.go:117] "RemoveContainer" containerID="13f28301e04c0355ccdbe1c3fe52c199d74a9b29f0ac33961e6a95368ecca122" Sep 10 16:15:05.428677 ip-10-0-135-53 kubenswrapper[2574]: E0910 16:15:05.428652 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 20s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-b8pqt_llm(b6a0e2ea-eb1f-4f79-8bdd-8ab3e8515f2e)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-b8pqt" podUID="b6a0e2ea-eb1f-4f79-8bdd-8ab3e8515f2e" Sep 10 16:15:12.074519 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:15:12.074488 2574 scope.go:117] "RemoveContainer" containerID="8ef558eb442bde0e1464933f76ae346e04286b1a0d916701efc41578b50f98e9" Sep 10 16:15:12.532117 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:15:12.532085 2574 generic.go:356] "Generic (PLEG): container finished" podID="a557ef2f-ee80-4404-a5e3-004f9b802fd6" containerID="34ed3625331cc7743ed1273c75151efc665e0bc86ddc65b8025220b87b40a3a4" exitCode=0 Sep 10 16:15:12.532299 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:15:12.532165 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-wfqsm" event={"ID":"a557ef2f-ee80-4404-a5e3-004f9b802fd6","Type":"ContainerDied","Data":"34ed3625331cc7743ed1273c75151efc665e0bc86ddc65b8025220b87b40a3a4"} Sep 10 16:15:12.532299 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:15:12.532239 2574 scope.go:117] "RemoveContainer" containerID="8ef558eb442bde0e1464933f76ae346e04286b1a0d916701efc41578b50f98e9" Sep 10 16:15:12.532613 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:15:12.532593 2574 scope.go:117] "RemoveContainer" containerID="34ed3625331cc7743ed1273c75151efc665e0bc86ddc65b8025220b87b40a3a4" Sep 10 16:15:12.532820 ip-10-0-135-53 kubenswrapper[2574]: E0910 16:15:12.532797 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 40s restarting failed container=main pod=facebook-opt-125m-simulated-kserve-64dfc7b8f-wfqsm_llm(a557ef2f-ee80-4404-a5e3-004f9b802fd6)\"" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-wfqsm" podUID="a557ef2f-ee80-4404-a5e3-004f9b802fd6" Sep 10 16:15:16.077473 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:15:16.077440 2574 scope.go:117] "RemoveContainer" containerID="1abb4a2379b42b967af23d6a278e9e6f517ead2a7a3e81e1d82ca432d6d15225" Sep 10 16:15:16.078072 ip-10-0-135-53 kubenswrapper[2574]: E0910 16:15:16.077632 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-jrnjn_llm(20ce5068-6bc5-43d0-b6ef-92efd6ef0c64)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-jrnjn" podUID="20ce5068-6bc5-43d0-b6ef-92efd6ef0c64" Sep 10 16:15:17.041367 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:15:17.041329 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-wfqsm" Sep 10 16:15:17.041540 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:15:17.041395 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-wfqsm" Sep 10 16:15:17.041540 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:15:17.041411 2574 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-wfqsm" Sep 10 16:15:17.041540 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:15:17.041424 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-wfqsm" Sep 10 16:15:17.041782 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:15:17.041770 2574 scope.go:117] "RemoveContainer" containerID="34ed3625331cc7743ed1273c75151efc665e0bc86ddc65b8025220b87b40a3a4" Sep 10 16:15:17.041948 ip-10-0-135-53 kubenswrapper[2574]: E0910 16:15:17.041929 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 40s restarting failed container=main pod=facebook-opt-125m-simulated-kserve-64dfc7b8f-wfqsm_llm(a557ef2f-ee80-4404-a5e3-004f9b802fd6)\"" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-wfqsm" podUID="a557ef2f-ee80-4404-a5e3-004f9b802fd6" Sep 10 16:15:17.074533 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:15:17.074497 2574 scope.go:117] "RemoveContainer" containerID="13f28301e04c0355ccdbe1c3fe52c199d74a9b29f0ac33961e6a95368ecca122" Sep 10 16:15:17.074694 ip-10-0-135-53 kubenswrapper[2574]: E0910 16:15:17.074658 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 20s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-b8pqt_llm(b6a0e2ea-eb1f-4f79-8bdd-8ab3e8515f2e)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-b8pqt" podUID="b6a0e2ea-eb1f-4f79-8bdd-8ab3e8515f2e" Sep 10 16:15:30.075296 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:15:30.075221 2574 scope.go:117] "RemoveContainer" containerID="1abb4a2379b42b967af23d6a278e9e6f517ead2a7a3e81e1d82ca432d6d15225" Sep 10 16:15:30.075777 ip-10-0-135-53 kubenswrapper[2574]: E0910 16:15:30.075507 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-jrnjn_llm(20ce5068-6bc5-43d0-b6ef-92efd6ef0c64)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-jrnjn" podUID="20ce5068-6bc5-43d0-b6ef-92efd6ef0c64" Sep 10 16:15:31.074324 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:15:31.074288 2574 scope.go:117] "RemoveContainer" containerID="34ed3625331cc7743ed1273c75151efc665e0bc86ddc65b8025220b87b40a3a4" Sep 10 16:15:31.074508 ip-10-0-135-53 kubenswrapper[2574]: E0910 16:15:31.074472 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 40s restarting failed container=main pod=facebook-opt-125m-simulated-kserve-64dfc7b8f-wfqsm_llm(a557ef2f-ee80-4404-a5e3-004f9b802fd6)\"" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-wfqsm" podUID="a557ef2f-ee80-4404-a5e3-004f9b802fd6" Sep 10 16:15:32.074705 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:15:32.074671 2574 scope.go:117] "RemoveContainer" containerID="13f28301e04c0355ccdbe1c3fe52c199d74a9b29f0ac33961e6a95368ecca122" Sep 10 16:15:32.634857 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:15:32.634760 2574 generic.go:356] "Generic (PLEG): container finished" podID="b6a0e2ea-eb1f-4f79-8bdd-8ab3e8515f2e" containerID="d343a6998cb69f00f1a906dd8d557a8438846884fdc915184e6b421051fc6af7" exitCode=0 Sep 10 16:15:32.634857 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:15:32.634834 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-b8pqt" event={"ID":"b6a0e2ea-eb1f-4f79-8bdd-8ab3e8515f2e","Type":"ContainerDied","Data":"d343a6998cb69f00f1a906dd8d557a8438846884fdc915184e6b421051fc6af7"} Sep 10 16:15:32.635069 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:15:32.634891 2574 scope.go:117] "RemoveContainer" containerID="13f28301e04c0355ccdbe1c3fe52c199d74a9b29f0ac33961e6a95368ecca122" Sep 10 16:15:32.635238 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:15:32.635207 2574 scope.go:117] "RemoveContainer" containerID="d343a6998cb69f00f1a906dd8d557a8438846884fdc915184e6b421051fc6af7" Sep 10 16:15:32.635524 ip-10-0-135-53 kubenswrapper[2574]: E0910 16:15:32.635415 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 40s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-b8pqt_llm(b6a0e2ea-eb1f-4f79-8bdd-8ab3e8515f2e)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-b8pqt" podUID="b6a0e2ea-eb1f-4f79-8bdd-8ab3e8515f2e" Sep 10 16:15:35.428219 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:15:35.428131 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-b8pqt" Sep 10 16:15:35.428219 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:15:35.428177 2574 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-b8pqt" Sep 10 16:15:35.428652 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:15:35.428214 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-b8pqt" Sep 10 16:15:35.428652 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:15:35.428248 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-b8pqt" Sep 10 16:15:35.428652 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:15:35.428535 2574 scope.go:117] "RemoveContainer" containerID="d343a6998cb69f00f1a906dd8d557a8438846884fdc915184e6b421051fc6af7" Sep 10 16:15:35.428768 ip-10-0-135-53 kubenswrapper[2574]: E0910 16:15:35.428690 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 40s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-b8pqt_llm(b6a0e2ea-eb1f-4f79-8bdd-8ab3e8515f2e)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-b8pqt" podUID="b6a0e2ea-eb1f-4f79-8bdd-8ab3e8515f2e" Sep 10 16:15:35.652149 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:15:35.652121 2574 scope.go:117] "RemoveContainer" containerID="d343a6998cb69f00f1a906dd8d557a8438846884fdc915184e6b421051fc6af7" Sep 10 16:15:35.652330 ip-10-0-135-53 kubenswrapper[2574]: E0910 16:15:35.652299 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 40s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-b8pqt_llm(b6a0e2ea-eb1f-4f79-8bdd-8ab3e8515f2e)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-b8pqt" podUID="b6a0e2ea-eb1f-4f79-8bdd-8ab3e8515f2e" Sep 10 16:15:43.075171 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:15:43.075129 2574 scope.go:117] "RemoveContainer" containerID="1abb4a2379b42b967af23d6a278e9e6f517ead2a7a3e81e1d82ca432d6d15225" Sep 10 16:15:43.075684 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:15:43.075393 2574 scope.go:117] "RemoveContainer" containerID="34ed3625331cc7743ed1273c75151efc665e0bc86ddc65b8025220b87b40a3a4" Sep 10 16:15:43.075684 ip-10-0-135-53 kubenswrapper[2574]: E0910 16:15:43.075412 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-jrnjn_llm(20ce5068-6bc5-43d0-b6ef-92efd6ef0c64)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-jrnjn" podUID="20ce5068-6bc5-43d0-b6ef-92efd6ef0c64" Sep 10 16:15:43.075684 ip-10-0-135-53 kubenswrapper[2574]: E0910 16:15:43.075572 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 40s restarting failed container=main pod=facebook-opt-125m-simulated-kserve-64dfc7b8f-wfqsm_llm(a557ef2f-ee80-4404-a5e3-004f9b802fd6)\"" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-wfqsm" podUID="a557ef2f-ee80-4404-a5e3-004f9b802fd6" Sep 10 16:15:51.074549 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:15:51.074515 2574 scope.go:117] "RemoveContainer" containerID="d343a6998cb69f00f1a906dd8d557a8438846884fdc915184e6b421051fc6af7" Sep 10 16:15:51.075002 ip-10-0-135-53 kubenswrapper[2574]: E0910 16:15:51.074690 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 40s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-b8pqt_llm(b6a0e2ea-eb1f-4f79-8bdd-8ab3e8515f2e)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-b8pqt" podUID="b6a0e2ea-eb1f-4f79-8bdd-8ab3e8515f2e" Sep 10 16:15:58.074841 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:15:58.074805 2574 scope.go:117] "RemoveContainer" containerID="34ed3625331cc7743ed1273c75151efc665e0bc86ddc65b8025220b87b40a3a4" Sep 10 16:15:58.075240 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:15:58.074911 2574 scope.go:117] "RemoveContainer" containerID="1abb4a2379b42b967af23d6a278e9e6f517ead2a7a3e81e1d82ca432d6d15225" Sep 10 16:15:58.767807 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:15:58.767777 2574 generic.go:356] "Generic (PLEG): container finished" podID="20ce5068-6bc5-43d0-b6ef-92efd6ef0c64" containerID="db15d6cbdf39f49855ccea10670840a5342782665c3c3a89d679652fbfdecc30" exitCode=0 Sep 10 16:15:58.767985 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:15:58.767852 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-jrnjn" event={"ID":"20ce5068-6bc5-43d0-b6ef-92efd6ef0c64","Type":"ContainerDied","Data":"db15d6cbdf39f49855ccea10670840a5342782665c3c3a89d679652fbfdecc30"} Sep 10 16:15:58.767985 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:15:58.767908 2574 scope.go:117] "RemoveContainer" containerID="1abb4a2379b42b967af23d6a278e9e6f517ead2a7a3e81e1d82ca432d6d15225" Sep 10 16:15:58.768327 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:15:58.768306 2574 scope.go:117] "RemoveContainer" containerID="db15d6cbdf39f49855ccea10670840a5342782665c3c3a89d679652fbfdecc30" Sep 10 16:15:58.768551 ip-10-0-135-53 kubenswrapper[2574]: E0910 16:15:58.768526 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-jrnjn_llm(20ce5068-6bc5-43d0-b6ef-92efd6ef0c64)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-jrnjn" podUID="20ce5068-6bc5-43d0-b6ef-92efd6ef0c64" Sep 10 16:15:58.769864 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:15:58.769844 2574 generic.go:356] "Generic (PLEG): container finished" podID="a557ef2f-ee80-4404-a5e3-004f9b802fd6" containerID="d85ffc4456f6cbde98d937ca6d0c00478b964f56dff27caa3899495aa2413f3f" exitCode=0 Sep 10 16:15:58.769945 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:15:58.769925 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-wfqsm" event={"ID":"a557ef2f-ee80-4404-a5e3-004f9b802fd6","Type":"ContainerDied","Data":"d85ffc4456f6cbde98d937ca6d0c00478b964f56dff27caa3899495aa2413f3f"} Sep 10 16:15:58.770203 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:15:58.770192 2574 scope.go:117] "RemoveContainer" containerID="d85ffc4456f6cbde98d937ca6d0c00478b964f56dff27caa3899495aa2413f3f" Sep 10 16:15:58.770365 ip-10-0-135-53 kubenswrapper[2574]: E0910 16:15:58.770350 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=facebook-opt-125m-simulated-kserve-64dfc7b8f-wfqsm_llm(a557ef2f-ee80-4404-a5e3-004f9b802fd6)\"" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-wfqsm" podUID="a557ef2f-ee80-4404-a5e3-004f9b802fd6" Sep 10 16:15:58.779296 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:15:58.779278 2574 scope.go:117] "RemoveContainer" containerID="34ed3625331cc7743ed1273c75151efc665e0bc86ddc65b8025220b87b40a3a4" Sep 10 16:16:02.074370 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:16:02.074334 2574 scope.go:117] "RemoveContainer" containerID="d343a6998cb69f00f1a906dd8d557a8438846884fdc915184e6b421051fc6af7" Sep 10 16:16:02.074751 ip-10-0-135-53 kubenswrapper[2574]: E0910 16:16:02.074508 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 40s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-b8pqt_llm(b6a0e2ea-eb1f-4f79-8bdd-8ab3e8515f2e)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-b8pqt" podUID="b6a0e2ea-eb1f-4f79-8bdd-8ab3e8515f2e" Sep 10 16:16:04.945667 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:16:04.945620 2574 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-jrnjn" Sep 10 16:16:04.946025 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:16:04.945693 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-jrnjn" Sep 10 16:16:04.946025 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:16:04.945711 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-jrnjn" Sep 10 16:16:04.946025 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:16:04.945724 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-jrnjn" Sep 10 16:16:04.946142 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:16:04.946114 2574 scope.go:117] "RemoveContainer" containerID="db15d6cbdf39f49855ccea10670840a5342782665c3c3a89d679652fbfdecc30" Sep 10 16:16:04.946361 ip-10-0-135-53 kubenswrapper[2574]: E0910 16:16:04.946341 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-jrnjn_llm(20ce5068-6bc5-43d0-b6ef-92efd6ef0c64)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-jrnjn" podUID="20ce5068-6bc5-43d0-b6ef-92efd6ef0c64" Sep 10 16:16:07.041472 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:16:07.041428 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-wfqsm" Sep 10 16:16:07.041862 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:16:07.041525 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-wfqsm" Sep 10 16:16:07.041862 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:16:07.041544 2574 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-wfqsm" Sep 10 16:16:07.041862 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:16:07.041558 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-wfqsm" Sep 10 16:16:07.041960 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:16:07.041939 2574 scope.go:117] "RemoveContainer" containerID="d85ffc4456f6cbde98d937ca6d0c00478b964f56dff27caa3899495aa2413f3f" Sep 10 16:16:07.042156 ip-10-0-135-53 kubenswrapper[2574]: E0910 16:16:07.042135 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=facebook-opt-125m-simulated-kserve-64dfc7b8f-wfqsm_llm(a557ef2f-ee80-4404-a5e3-004f9b802fd6)\"" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-wfqsm" podUID="a557ef2f-ee80-4404-a5e3-004f9b802fd6" Sep 10 16:16:13.075194 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:16:13.075160 2574 scope.go:117] "RemoveContainer" containerID="d343a6998cb69f00f1a906dd8d557a8438846884fdc915184e6b421051fc6af7" Sep 10 16:16:13.849218 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:16:13.849184 2574 generic.go:356] "Generic (PLEG): container finished" podID="b6a0e2ea-eb1f-4f79-8bdd-8ab3e8515f2e" containerID="2bed0bc4bec9879f9ec05c5ca4f0705c37315e9c25ddb4243d139a2b3b760f15" exitCode=0 Sep 10 16:16:13.849401 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:16:13.849274 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-b8pqt" event={"ID":"b6a0e2ea-eb1f-4f79-8bdd-8ab3e8515f2e","Type":"ContainerDied","Data":"2bed0bc4bec9879f9ec05c5ca4f0705c37315e9c25ddb4243d139a2b3b760f15"} Sep 10 16:16:13.849401 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:16:13.849324 2574 scope.go:117] "RemoveContainer" containerID="d343a6998cb69f00f1a906dd8d557a8438846884fdc915184e6b421051fc6af7" Sep 10 16:16:13.849749 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:16:13.849733 2574 scope.go:117] "RemoveContainer" containerID="2bed0bc4bec9879f9ec05c5ca4f0705c37315e9c25ddb4243d139a2b3b760f15" Sep 10 16:16:13.849932 ip-10-0-135-53 kubenswrapper[2574]: E0910 16:16:13.849914 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-b8pqt_llm(b6a0e2ea-eb1f-4f79-8bdd-8ab3e8515f2e)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-b8pqt" podUID="b6a0e2ea-eb1f-4f79-8bdd-8ab3e8515f2e" Sep 10 16:16:15.428168 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:16:15.428129 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-b8pqt" Sep 10 16:16:15.428643 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:16:15.428211 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-b8pqt" Sep 10 16:16:15.428643 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:16:15.428245 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-b8pqt" Sep 10 16:16:15.428643 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:16:15.428255 2574 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-b8pqt" Sep 10 16:16:15.428643 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:16:15.428614 2574 scope.go:117] "RemoveContainer" containerID="2bed0bc4bec9879f9ec05c5ca4f0705c37315e9c25ddb4243d139a2b3b760f15" Sep 10 16:16:15.428803 ip-10-0-135-53 kubenswrapper[2574]: E0910 16:16:15.428788 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-b8pqt_llm(b6a0e2ea-eb1f-4f79-8bdd-8ab3e8515f2e)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-b8pqt" podUID="b6a0e2ea-eb1f-4f79-8bdd-8ab3e8515f2e" Sep 10 16:16:15.862329 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:16:15.862300 2574 scope.go:117] "RemoveContainer" containerID="2bed0bc4bec9879f9ec05c5ca4f0705c37315e9c25ddb4243d139a2b3b760f15" Sep 10 16:16:15.862502 ip-10-0-135-53 kubenswrapper[2574]: E0910 16:16:15.862461 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-b8pqt_llm(b6a0e2ea-eb1f-4f79-8bdd-8ab3e8515f2e)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-b8pqt" podUID="b6a0e2ea-eb1f-4f79-8bdd-8ab3e8515f2e" Sep 10 16:16:16.077446 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:16:16.077411 2574 scope.go:117] "RemoveContainer" containerID="db15d6cbdf39f49855ccea10670840a5342782665c3c3a89d679652fbfdecc30" Sep 10 16:16:16.077644 ip-10-0-135-53 kubenswrapper[2574]: E0910 16:16:16.077619 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-jrnjn_llm(20ce5068-6bc5-43d0-b6ef-92efd6ef0c64)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-jrnjn" podUID="20ce5068-6bc5-43d0-b6ef-92efd6ef0c64" Sep 10 16:16:18.074907 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:16:18.074877 2574 scope.go:117] "RemoveContainer" containerID="d85ffc4456f6cbde98d937ca6d0c00478b964f56dff27caa3899495aa2413f3f" Sep 10 16:16:18.075444 ip-10-0-135-53 kubenswrapper[2574]: E0910 16:16:18.075051 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=facebook-opt-125m-simulated-kserve-64dfc7b8f-wfqsm_llm(a557ef2f-ee80-4404-a5e3-004f9b802fd6)\"" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-wfqsm" podUID="a557ef2f-ee80-4404-a5e3-004f9b802fd6" Sep 10 16:16:28.075392 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:16:28.075353 2574 scope.go:117] "RemoveContainer" containerID="2bed0bc4bec9879f9ec05c5ca4f0705c37315e9c25ddb4243d139a2b3b760f15" Sep 10 16:16:28.075939 ip-10-0-135-53 kubenswrapper[2574]: E0910 16:16:28.075593 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-b8pqt_llm(b6a0e2ea-eb1f-4f79-8bdd-8ab3e8515f2e)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-b8pqt" podUID="b6a0e2ea-eb1f-4f79-8bdd-8ab3e8515f2e" Sep 10 16:16:29.074528 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:16:29.074489 2574 scope.go:117] "RemoveContainer" containerID="db15d6cbdf39f49855ccea10670840a5342782665c3c3a89d679652fbfdecc30" Sep 10 16:16:29.074737 ip-10-0-135-53 kubenswrapper[2574]: E0910 16:16:29.074706 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-jrnjn_llm(20ce5068-6bc5-43d0-b6ef-92efd6ef0c64)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-jrnjn" podUID="20ce5068-6bc5-43d0-b6ef-92efd6ef0c64" Sep 10 16:16:31.074897 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:16:31.074865 2574 scope.go:117] "RemoveContainer" containerID="d85ffc4456f6cbde98d937ca6d0c00478b964f56dff27caa3899495aa2413f3f" Sep 10 16:16:31.075310 ip-10-0-135-53 kubenswrapper[2574]: E0910 16:16:31.075039 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=facebook-opt-125m-simulated-kserve-64dfc7b8f-wfqsm_llm(a557ef2f-ee80-4404-a5e3-004f9b802fd6)\"" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-wfqsm" podUID="a557ef2f-ee80-4404-a5e3-004f9b802fd6" Sep 10 16:16:39.074694 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:16:39.074662 2574 scope.go:117] "RemoveContainer" containerID="2bed0bc4bec9879f9ec05c5ca4f0705c37315e9c25ddb4243d139a2b3b760f15" Sep 10 16:16:39.075090 ip-10-0-135-53 kubenswrapper[2574]: E0910 16:16:39.074852 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-b8pqt_llm(b6a0e2ea-eb1f-4f79-8bdd-8ab3e8515f2e)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-b8pqt" podUID="b6a0e2ea-eb1f-4f79-8bdd-8ab3e8515f2e" Sep 10 16:16:43.075181 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:16:43.075151 2574 scope.go:117] "RemoveContainer" containerID="db15d6cbdf39f49855ccea10670840a5342782665c3c3a89d679652fbfdecc30" Sep 10 16:16:43.075596 ip-10-0-135-53 kubenswrapper[2574]: E0910 16:16:43.075381 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-jrnjn_llm(20ce5068-6bc5-43d0-b6ef-92efd6ef0c64)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-jrnjn" podUID="20ce5068-6bc5-43d0-b6ef-92efd6ef0c64" Sep 10 16:16:46.077308 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:16:46.077257 2574 scope.go:117] "RemoveContainer" containerID="d85ffc4456f6cbde98d937ca6d0c00478b964f56dff27caa3899495aa2413f3f" Sep 10 16:16:46.077798 ip-10-0-135-53 kubenswrapper[2574]: E0910 16:16:46.077501 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=facebook-opt-125m-simulated-kserve-64dfc7b8f-wfqsm_llm(a557ef2f-ee80-4404-a5e3-004f9b802fd6)\"" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-wfqsm" podUID="a557ef2f-ee80-4404-a5e3-004f9b802fd6" Sep 10 16:16:53.074744 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:16:53.074707 2574 scope.go:117] "RemoveContainer" containerID="2bed0bc4bec9879f9ec05c5ca4f0705c37315e9c25ddb4243d139a2b3b760f15" Sep 10 16:16:53.075143 ip-10-0-135-53 kubenswrapper[2574]: E0910 16:16:53.074893 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-b8pqt_llm(b6a0e2ea-eb1f-4f79-8bdd-8ab3e8515f2e)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-b8pqt" podUID="b6a0e2ea-eb1f-4f79-8bdd-8ab3e8515f2e" Sep 10 16:16:58.075121 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:16:58.075087 2574 scope.go:117] "RemoveContainer" containerID="db15d6cbdf39f49855ccea10670840a5342782665c3c3a89d679652fbfdecc30" Sep 10 16:16:58.075581 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:16:58.075304 2574 scope.go:117] "RemoveContainer" containerID="d85ffc4456f6cbde98d937ca6d0c00478b964f56dff27caa3899495aa2413f3f" Sep 10 16:16:58.075581 ip-10-0-135-53 kubenswrapper[2574]: E0910 16:16:58.075351 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-jrnjn_llm(20ce5068-6bc5-43d0-b6ef-92efd6ef0c64)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-jrnjn" podUID="20ce5068-6bc5-43d0-b6ef-92efd6ef0c64" Sep 10 16:16:58.075581 ip-10-0-135-53 kubenswrapper[2574]: E0910 16:16:58.075442 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=facebook-opt-125m-simulated-kserve-64dfc7b8f-wfqsm_llm(a557ef2f-ee80-4404-a5e3-004f9b802fd6)\"" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-wfqsm" podUID="a557ef2f-ee80-4404-a5e3-004f9b802fd6" Sep 10 16:17:05.075086 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:17:05.075054 2574 scope.go:117] "RemoveContainer" containerID="2bed0bc4bec9879f9ec05c5ca4f0705c37315e9c25ddb4243d139a2b3b760f15" Sep 10 16:17:05.075573 ip-10-0-135-53 kubenswrapper[2574]: E0910 16:17:05.075188 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-b8pqt_llm(b6a0e2ea-eb1f-4f79-8bdd-8ab3e8515f2e)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-b8pqt" podUID="b6a0e2ea-eb1f-4f79-8bdd-8ab3e8515f2e" Sep 10 16:17:11.074860 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:17:11.074826 2574 scope.go:117] "RemoveContainer" containerID="d85ffc4456f6cbde98d937ca6d0c00478b964f56dff27caa3899495aa2413f3f" Sep 10 16:17:11.075342 ip-10-0-135-53 kubenswrapper[2574]: E0910 16:17:11.075076 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=facebook-opt-125m-simulated-kserve-64dfc7b8f-wfqsm_llm(a557ef2f-ee80-4404-a5e3-004f9b802fd6)\"" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-wfqsm" podUID="a557ef2f-ee80-4404-a5e3-004f9b802fd6" Sep 10 16:17:12.075116 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:17:12.075081 2574 scope.go:117] "RemoveContainer" containerID="db15d6cbdf39f49855ccea10670840a5342782665c3c3a89d679652fbfdecc30" Sep 10 16:17:12.075530 ip-10-0-135-53 kubenswrapper[2574]: E0910 16:17:12.075313 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-jrnjn_llm(20ce5068-6bc5-43d0-b6ef-92efd6ef0c64)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-jrnjn" podUID="20ce5068-6bc5-43d0-b6ef-92efd6ef0c64" Sep 10 16:17:17.074467 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:17:17.074430 2574 scope.go:117] "RemoveContainer" containerID="2bed0bc4bec9879f9ec05c5ca4f0705c37315e9c25ddb4243d139a2b3b760f15" Sep 10 16:17:17.074883 ip-10-0-135-53 kubenswrapper[2574]: E0910 16:17:17.074611 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-b8pqt_llm(b6a0e2ea-eb1f-4f79-8bdd-8ab3e8515f2e)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-b8pqt" podUID="b6a0e2ea-eb1f-4f79-8bdd-8ab3e8515f2e" Sep 10 16:17:24.074930 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:17:24.074892 2574 scope.go:117] "RemoveContainer" containerID="d85ffc4456f6cbde98d937ca6d0c00478b964f56dff27caa3899495aa2413f3f" Sep 10 16:17:24.075451 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:17:24.074969 2574 scope.go:117] "RemoveContainer" containerID="db15d6cbdf39f49855ccea10670840a5342782665c3c3a89d679652fbfdecc30" Sep 10 16:17:24.075451 ip-10-0-135-53 kubenswrapper[2574]: E0910 16:17:24.075188 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-jrnjn_llm(20ce5068-6bc5-43d0-b6ef-92efd6ef0c64)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-jrnjn" podUID="20ce5068-6bc5-43d0-b6ef-92efd6ef0c64" Sep 10 16:17:25.220607 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:17:25.220573 2574 generic.go:356] "Generic (PLEG): container finished" podID="a557ef2f-ee80-4404-a5e3-004f9b802fd6" containerID="9e13bb11aa8b5d2377393307101df6211bf82bb4321b10849b2f8e2187d78bd7" exitCode=0 Sep 10 16:17:25.221069 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:17:25.220652 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-wfqsm" event={"ID":"a557ef2f-ee80-4404-a5e3-004f9b802fd6","Type":"ContainerDied","Data":"9e13bb11aa8b5d2377393307101df6211bf82bb4321b10849b2f8e2187d78bd7"} Sep 10 16:17:25.221069 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:17:25.220729 2574 scope.go:117] "RemoveContainer" containerID="d85ffc4456f6cbde98d937ca6d0c00478b964f56dff27caa3899495aa2413f3f" Sep 10 16:17:25.221169 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:17:25.221121 2574 scope.go:117] "RemoveContainer" containerID="9e13bb11aa8b5d2377393307101df6211bf82bb4321b10849b2f8e2187d78bd7" Sep 10 16:17:25.221360 ip-10-0-135-53 kubenswrapper[2574]: E0910 16:17:25.221342 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=facebook-opt-125m-simulated-kserve-64dfc7b8f-wfqsm_llm(a557ef2f-ee80-4404-a5e3-004f9b802fd6)\"" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-wfqsm" podUID="a557ef2f-ee80-4404-a5e3-004f9b802fd6" Sep 10 16:17:27.041240 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:17:27.041197 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-wfqsm" Sep 10 16:17:27.041657 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:17:27.041290 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-wfqsm" Sep 10 16:17:27.041657 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:17:27.041316 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-wfqsm" Sep 10 16:17:27.041657 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:17:27.041329 2574 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-wfqsm" Sep 10 16:17:27.041657 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:17:27.041656 2574 scope.go:117] "RemoveContainer" containerID="9e13bb11aa8b5d2377393307101df6211bf82bb4321b10849b2f8e2187d78bd7" Sep 10 16:17:27.041835 ip-10-0-135-53 kubenswrapper[2574]: E0910 16:17:27.041816 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=facebook-opt-125m-simulated-kserve-64dfc7b8f-wfqsm_llm(a557ef2f-ee80-4404-a5e3-004f9b802fd6)\"" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-wfqsm" podUID="a557ef2f-ee80-4404-a5e3-004f9b802fd6" Sep 10 16:17:28.075165 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:17:28.075129 2574 scope.go:117] "RemoveContainer" containerID="2bed0bc4bec9879f9ec05c5ca4f0705c37315e9c25ddb4243d139a2b3b760f15" Sep 10 16:17:28.075684 ip-10-0-135-53 kubenswrapper[2574]: E0910 16:17:28.075334 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-b8pqt_llm(b6a0e2ea-eb1f-4f79-8bdd-8ab3e8515f2e)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-b8pqt" podUID="b6a0e2ea-eb1f-4f79-8bdd-8ab3e8515f2e" Sep 10 16:17:37.074513 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:17:37.074478 2574 scope.go:117] "RemoveContainer" containerID="db15d6cbdf39f49855ccea10670840a5342782665c3c3a89d679652fbfdecc30" Sep 10 16:17:37.074971 ip-10-0-135-53 kubenswrapper[2574]: E0910 16:17:37.074660 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-jrnjn_llm(20ce5068-6bc5-43d0-b6ef-92efd6ef0c64)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-jrnjn" podUID="20ce5068-6bc5-43d0-b6ef-92efd6ef0c64" Sep 10 16:17:39.074958 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:17:39.074918 2574 scope.go:117] "RemoveContainer" containerID="9e13bb11aa8b5d2377393307101df6211bf82bb4321b10849b2f8e2187d78bd7" Sep 10 16:17:39.075472 ip-10-0-135-53 kubenswrapper[2574]: E0910 16:17:39.075139 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=facebook-opt-125m-simulated-kserve-64dfc7b8f-wfqsm_llm(a557ef2f-ee80-4404-a5e3-004f9b802fd6)\"" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-wfqsm" podUID="a557ef2f-ee80-4404-a5e3-004f9b802fd6" Sep 10 16:17:41.075314 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:17:41.075254 2574 scope.go:117] "RemoveContainer" containerID="2bed0bc4bec9879f9ec05c5ca4f0705c37315e9c25ddb4243d139a2b3b760f15" Sep 10 16:17:42.306919 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:17:42.306883 2574 generic.go:356] "Generic (PLEG): container finished" podID="b6a0e2ea-eb1f-4f79-8bdd-8ab3e8515f2e" containerID="a493e8488713109d5dacd57ca64cb526e7ff3f54fa0cd6918a042517af5c0cea" exitCode=0 Sep 10 16:17:42.307386 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:17:42.306924 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-b8pqt" event={"ID":"b6a0e2ea-eb1f-4f79-8bdd-8ab3e8515f2e","Type":"ContainerDied","Data":"a493e8488713109d5dacd57ca64cb526e7ff3f54fa0cd6918a042517af5c0cea"} Sep 10 16:17:42.307386 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:17:42.306972 2574 scope.go:117] "RemoveContainer" containerID="2bed0bc4bec9879f9ec05c5ca4f0705c37315e9c25ddb4243d139a2b3b760f15" Sep 10 16:17:42.307386 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:17:42.307371 2574 scope.go:117] "RemoveContainer" containerID="a493e8488713109d5dacd57ca64cb526e7ff3f54fa0cd6918a042517af5c0cea" Sep 10 16:17:42.307615 ip-10-0-135-53 kubenswrapper[2574]: E0910 16:17:42.307591 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-b8pqt_llm(b6a0e2ea-eb1f-4f79-8bdd-8ab3e8515f2e)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-b8pqt" podUID="b6a0e2ea-eb1f-4f79-8bdd-8ab3e8515f2e" Sep 10 16:17:42.722572 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:17:42.722492 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-64dfc7b8f-wfqsm_a557ef2f-ee80-4404-a5e3-004f9b802fd6/main/5.log" Sep 10 16:17:42.831539 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:17:42.831507 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-64dfc7b8f-wfqsm_a557ef2f-ee80-4404-a5e3-004f9b802fd6/main/5.log" Sep 10 16:17:43.895848 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:17:43.895817 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-78466cb655-zbcp6_01db95f1-ff66-46ec-9d4e-dc6f68d8e003/authorino/0.log" Sep 10 16:17:45.427834 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:17:45.427799 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-b8pqt" Sep 10 16:17:45.427834 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:17:45.427845 2574 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-b8pqt" Sep 10 16:17:45.428306 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:17:45.427886 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-b8pqt" Sep 10 16:17:45.428306 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:17:45.428032 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-b8pqt" Sep 10 16:17:45.428306 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:17:45.428178 2574 scope.go:117] "RemoveContainer" containerID="a493e8488713109d5dacd57ca64cb526e7ff3f54fa0cd6918a042517af5c0cea" Sep 10 16:17:45.428419 ip-10-0-135-53 kubenswrapper[2574]: E0910 16:17:45.428358 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-b8pqt_llm(b6a0e2ea-eb1f-4f79-8bdd-8ab3e8515f2e)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-b8pqt" podUID="b6a0e2ea-eb1f-4f79-8bdd-8ab3e8515f2e" Sep 10 16:17:46.328787 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:17:46.328758 2574 scope.go:117] "RemoveContainer" containerID="a493e8488713109d5dacd57ca64cb526e7ff3f54fa0cd6918a042517af5c0cea" Sep 10 16:17:46.328953 ip-10-0-135-53 kubenswrapper[2574]: E0910 16:17:46.328933 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-b8pqt_llm(b6a0e2ea-eb1f-4f79-8bdd-8ab3e8515f2e)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-b8pqt" podUID="b6a0e2ea-eb1f-4f79-8bdd-8ab3e8515f2e" Sep 10 16:17:49.901048 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:17:49.900976 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6ff9c7664b-n9v44_361e46df-94e7-425a-9226-f76be9c67917/copy-manifests/0.log" Sep 10 16:17:49.908864 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:17:49.908840 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6ff9c7664b-n9v44_361e46df-94e7-425a-9226-f76be9c67917/manager/0.log" Sep 10 16:17:51.074788 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:17:51.074752 2574 scope.go:117] "RemoveContainer" containerID="db15d6cbdf39f49855ccea10670840a5342782665c3c3a89d679652fbfdecc30" Sep 10 16:17:51.075211 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:17:51.074846 2574 scope.go:117] "RemoveContainer" containerID="9e13bb11aa8b5d2377393307101df6211bf82bb4321b10849b2f8e2187d78bd7" Sep 10 16:17:51.075211 ip-10-0-135-53 kubenswrapper[2574]: E0910 16:17:51.074927 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-jrnjn_llm(20ce5068-6bc5-43d0-b6ef-92efd6ef0c64)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-jrnjn" podUID="20ce5068-6bc5-43d0-b6ef-92efd6ef0c64" Sep 10 16:17:51.075211 ip-10-0-135-53 kubenswrapper[2574]: E0910 16:17:51.074987 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=facebook-opt-125m-simulated-kserve-64dfc7b8f-wfqsm_llm(a557ef2f-ee80-4404-a5e3-004f9b802fd6)\"" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-wfqsm" podUID="a557ef2f-ee80-4404-a5e3-004f9b802fd6" Sep 10 16:17:51.402922 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:17:51.402830 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-78466cb655-zbcp6_01db95f1-ff66-46ec-9d4e-dc6f68d8e003/authorino/0.log" Sep 10 16:17:51.754259 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:17:51.754178 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-fbdd4f445-6xz94_55a41cd9-4356-4be2-9e70-a49dc683ca82/kuadrant-console-plugin/0.log" Sep 10 16:17:52.742327 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:17:52.742287 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5468b79cc4-4l9t6_7eaab891-6169-4c8c-b6eb-2f0bc525a05b/kube-auth-proxy/0.log" Sep 10 16:17:53.095117 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:17:53.095070 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59fbc47bf8-5gf4t_d4518659-7bcb-4412-8a62-6d6155c630af/payload-pre-processing/0.log" Sep 10 16:17:53.323329 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:17:53.323296 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-64969f7776-5mx24_6e9a2956-c6be-44d6-b063-e8134e21bc27/router/0.log" Sep 10 16:17:53.683109 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:17:53.683073 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-859856b874-jrnjn_20ce5068-6bc5-43d0-b6ef-92efd6ef0c64/main/5.log" Sep 10 16:17:54.036167 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:17:54.036108 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-j8hn6_47163db1-5817-41a7-8d5b-1ee15cc28ed6/main/0.log" Sep 10 16:17:54.270971 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:17:54.270943 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-64dfc7b8f-wfqsm_a557ef2f-ee80-4404-a5e3-004f9b802fd6/main/5.log" Sep 10 16:17:54.382185 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:17:54.382104 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-5758cf6949-b8pqt_b6a0e2ea-eb1f-4f79-8bdd-8ab3e8515f2e/main/5.log" Sep 10 16:17:55.920589 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:17:55.920559 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-frshx_9baedfdd-1384-4da1-b9c0-58dea49d3ae0/console-operator/1.log" Sep 10 16:17:55.921519 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:17:55.921498 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-frshx_9baedfdd-1384-4da1-b9c0-58dea49d3ae0/console-operator/1.log" Sep 10 16:17:58.074859 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:17:58.074819 2574 scope.go:117] "RemoveContainer" containerID="a493e8488713109d5dacd57ca64cb526e7ff3f54fa0cd6918a042517af5c0cea" Sep 10 16:17:58.075369 ip-10-0-135-53 kubenswrapper[2574]: E0910 16:17:58.075043 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-b8pqt_llm(b6a0e2ea-eb1f-4f79-8bdd-8ab3e8515f2e)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-b8pqt" podUID="b6a0e2ea-eb1f-4f79-8bdd-8ab3e8515f2e" Sep 10 16:18:02.074704 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:18:02.074661 2574 scope.go:117] "RemoveContainer" containerID="db15d6cbdf39f49855ccea10670840a5342782665c3c3a89d679652fbfdecc30" Sep 10 16:18:02.075165 ip-10-0-135-53 kubenswrapper[2574]: E0910 16:18:02.074865 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-jrnjn_llm(20ce5068-6bc5-43d0-b6ef-92efd6ef0c64)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-jrnjn" podUID="20ce5068-6bc5-43d0-b6ef-92efd6ef0c64" Sep 10 16:18:02.958570 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:18:02.958530 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-pcsbz_aa29ebca-e469-4e43-abda-06f75d9c0a11/global-pull-secret-syncer/0.log" Sep 10 16:18:03.099133 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:18:03.099104 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-7vxsg_9f57ca5e-844f-4390-a8e5-07abcea64cb2/konnectivity-agent/0.log" Sep 10 16:18:03.213527 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:18:03.213444 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-135-53.ec2.internal_7c67acd93839c8ffd6aac841aa4d9962/haproxy/0.log" Sep 10 16:18:06.079081 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:18:06.079049 2574 scope.go:117] "RemoveContainer" containerID="9e13bb11aa8b5d2377393307101df6211bf82bb4321b10849b2f8e2187d78bd7" Sep 10 16:18:06.079504 ip-10-0-135-53 kubenswrapper[2574]: E0910 16:18:06.079238 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=facebook-opt-125m-simulated-kserve-64dfc7b8f-wfqsm_llm(a557ef2f-ee80-4404-a5e3-004f9b802fd6)\"" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-wfqsm" podUID="a557ef2f-ee80-4404-a5e3-004f9b802fd6" Sep 10 16:18:07.642975 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:18:07.642930 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-78466cb655-zbcp6_01db95f1-ff66-46ec-9d4e-dc6f68d8e003/authorino/0.log" Sep 10 16:18:07.739896 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:18:07.739867 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-fbdd4f445-6xz94_55a41cd9-4356-4be2-9e70-a49dc683ca82/kuadrant-console-plugin/0.log" Sep 10 16:18:09.494843 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:18:09.494809 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-6cdcc96965-9rfn8_e3e9b71b-d2dc-483e-a5fa-5a5054914933/cluster-monitoring-operator/0.log" Sep 10 16:18:09.652741 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:18:09.652703 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-lgqgv_3dcd2d32-6126-4ae9-bf52-e762874b2a05/node-exporter/0.log" Sep 10 16:18:09.678156 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:18:09.678125 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-lgqgv_3dcd2d32-6126-4ae9-bf52-e762874b2a05/kube-rbac-proxy/0.log" Sep 10 16:18:09.699516 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:18:09.699490 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-lgqgv_3dcd2d32-6126-4ae9-bf52-e762874b2a05/init-textfile/0.log" Sep 10 16:18:10.074670 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:18:10.074635 2574 scope.go:117] "RemoveContainer" containerID="a493e8488713109d5dacd57ca64cb526e7ff3f54fa0cd6918a042517af5c0cea" Sep 10 16:18:10.074844 ip-10-0-135-53 kubenswrapper[2574]: E0910 16:18:10.074821 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-b8pqt_llm(b6a0e2ea-eb1f-4f79-8bdd-8ab3e8515f2e)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-b8pqt" podUID="b6a0e2ea-eb1f-4f79-8bdd-8ab3e8515f2e" Sep 10 16:18:12.087127 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:18:12.087088 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-79977f9844-mc2tj_cd37132d-a266-4224-a64d-85abbb9cf070/networking-console-plugin/0.log" Sep 10 16:18:12.685656 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:18:12.685616 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-frshx_9baedfdd-1384-4da1-b9c0-58dea49d3ae0/console-operator/1.log" Sep 10 16:18:12.695100 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:18:12.695074 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-frshx_9baedfdd-1384-4da1-b9c0-58dea49d3ae0/console-operator/2.log" Sep 10 16:18:13.220176 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:18:13.220138 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-lfcr8/perf-node-gather-daemonset-shzvf"] Sep 10 16:18:13.223572 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:18:13.223548 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-lfcr8/perf-node-gather-daemonset-shzvf" Sep 10 16:18:13.225995 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:18:13.225970 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-lfcr8\"/\"openshift-service-ca.crt\"" Sep 10 16:18:13.227034 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:18:13.227017 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-lfcr8\"/\"kube-root-ca.crt\"" Sep 10 16:18:13.227103 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:18:13.227022 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-lfcr8\"/\"default-dockercfg-c9bm4\"" Sep 10 16:18:13.236665 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:18:13.236634 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-lfcr8/perf-node-gather-daemonset-shzvf"] Sep 10 16:18:13.269760 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:18:13.269730 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-85d98c998f-kj4z4_97b740c1-94b8-45e8-8f20-41b915f7f2d8/download-server/0.log" Sep 10 16:18:13.337689 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:18:13.337650 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0e70f6a4-c79b-49c3-b760-d6acb59957f7-lib-modules\") pod \"perf-node-gather-daemonset-shzvf\" (UID: \"0e70f6a4-c79b-49c3-b760-d6acb59957f7\") " pod="openshift-must-gather-lfcr8/perf-node-gather-daemonset-shzvf" Sep 10 16:18:13.337689 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:18:13.337686 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/0e70f6a4-c79b-49c3-b760-d6acb59957f7-proc\") pod \"perf-node-gather-daemonset-shzvf\" (UID: \"0e70f6a4-c79b-49c3-b760-d6acb59957f7\") " pod="openshift-must-gather-lfcr8/perf-node-gather-daemonset-shzvf" Sep 10 16:18:13.337898 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:18:13.337716 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0e70f6a4-c79b-49c3-b760-d6acb59957f7-sys\") pod \"perf-node-gather-daemonset-shzvf\" (UID: \"0e70f6a4-c79b-49c3-b760-d6acb59957f7\") " pod="openshift-must-gather-lfcr8/perf-node-gather-daemonset-shzvf" Sep 10 16:18:13.337898 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:18:13.337755 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j24l2\" (UniqueName: \"kubernetes.io/projected/0e70f6a4-c79b-49c3-b760-d6acb59957f7-kube-api-access-j24l2\") pod \"perf-node-gather-daemonset-shzvf\" (UID: \"0e70f6a4-c79b-49c3-b760-d6acb59957f7\") " pod="openshift-must-gather-lfcr8/perf-node-gather-daemonset-shzvf" Sep 10 16:18:13.337898 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:18:13.337789 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/0e70f6a4-c79b-49c3-b760-d6acb59957f7-podres\") pod \"perf-node-gather-daemonset-shzvf\" (UID: \"0e70f6a4-c79b-49c3-b760-d6acb59957f7\") " pod="openshift-must-gather-lfcr8/perf-node-gather-daemonset-shzvf" Sep 10 16:18:13.438904 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:18:13.438861 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0e70f6a4-c79b-49c3-b760-d6acb59957f7-lib-modules\") pod \"perf-node-gather-daemonset-shzvf\" (UID: \"0e70f6a4-c79b-49c3-b760-d6acb59957f7\") " pod="openshift-must-gather-lfcr8/perf-node-gather-daemonset-shzvf" Sep 10 16:18:13.438904 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:18:13.438906 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/0e70f6a4-c79b-49c3-b760-d6acb59957f7-proc\") pod \"perf-node-gather-daemonset-shzvf\" (UID: \"0e70f6a4-c79b-49c3-b760-d6acb59957f7\") " pod="openshift-must-gather-lfcr8/perf-node-gather-daemonset-shzvf" Sep 10 16:18:13.439173 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:18:13.438932 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0e70f6a4-c79b-49c3-b760-d6acb59957f7-sys\") pod \"perf-node-gather-daemonset-shzvf\" (UID: \"0e70f6a4-c79b-49c3-b760-d6acb59957f7\") " pod="openshift-must-gather-lfcr8/perf-node-gather-daemonset-shzvf" Sep 10 16:18:13.439173 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:18:13.438949 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j24l2\" (UniqueName: \"kubernetes.io/projected/0e70f6a4-c79b-49c3-b760-d6acb59957f7-kube-api-access-j24l2\") pod \"perf-node-gather-daemonset-shzvf\" (UID: \"0e70f6a4-c79b-49c3-b760-d6acb59957f7\") " pod="openshift-must-gather-lfcr8/perf-node-gather-daemonset-shzvf" Sep 10 16:18:13.439173 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:18:13.438980 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/0e70f6a4-c79b-49c3-b760-d6acb59957f7-podres\") pod \"perf-node-gather-daemonset-shzvf\" (UID: \"0e70f6a4-c79b-49c3-b760-d6acb59957f7\") " pod="openshift-must-gather-lfcr8/perf-node-gather-daemonset-shzvf" Sep 10 16:18:13.439173 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:18:13.439022 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/0e70f6a4-c79b-49c3-b760-d6acb59957f7-proc\") pod \"perf-node-gather-daemonset-shzvf\" (UID: \"0e70f6a4-c79b-49c3-b760-d6acb59957f7\") " pod="openshift-must-gather-lfcr8/perf-node-gather-daemonset-shzvf" Sep 10 16:18:13.439173 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:18:13.439022 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0e70f6a4-c79b-49c3-b760-d6acb59957f7-sys\") pod \"perf-node-gather-daemonset-shzvf\" (UID: \"0e70f6a4-c79b-49c3-b760-d6acb59957f7\") " pod="openshift-must-gather-lfcr8/perf-node-gather-daemonset-shzvf" Sep 10 16:18:13.439173 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:18:13.439066 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0e70f6a4-c79b-49c3-b760-d6acb59957f7-lib-modules\") pod \"perf-node-gather-daemonset-shzvf\" (UID: \"0e70f6a4-c79b-49c3-b760-d6acb59957f7\") " pod="openshift-must-gather-lfcr8/perf-node-gather-daemonset-shzvf" Sep 10 16:18:13.439173 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:18:13.439073 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/0e70f6a4-c79b-49c3-b760-d6acb59957f7-podres\") pod \"perf-node-gather-daemonset-shzvf\" (UID: \"0e70f6a4-c79b-49c3-b760-d6acb59957f7\") " pod="openshift-must-gather-lfcr8/perf-node-gather-daemonset-shzvf" Sep 10 16:18:13.447590 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:18:13.447562 2574 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j24l2\" (UniqueName: \"kubernetes.io/projected/0e70f6a4-c79b-49c3-b760-d6acb59957f7-kube-api-access-j24l2\") pod \"perf-node-gather-daemonset-shzvf\" (UID: \"0e70f6a4-c79b-49c3-b760-d6acb59957f7\") " pod="openshift-must-gather-lfcr8/perf-node-gather-daemonset-shzvf" Sep 10 16:18:13.533281 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:18:13.533234 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-lfcr8/perf-node-gather-daemonset-shzvf" Sep 10 16:18:13.803606 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:18:13.803569 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-lfcr8/perf-node-gather-daemonset-shzvf"] Sep 10 16:18:13.805572 ip-10-0-135-53 kubenswrapper[2574]: W0910 16:18:13.805542 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod0e70f6a4_c79b_49c3_b760_d6acb59957f7.slice/crio-cb79bc475c3afff890969253476bac5e26543722c3e5cc94685266ddbe821c95 WatchSource:0}: Error finding container cb79bc475c3afff890969253476bac5e26543722c3e5cc94685266ddbe821c95: Status 404 returned error can't find the container with id cb79bc475c3afff890969253476bac5e26543722c3e5cc94685266ddbe821c95 Sep 10 16:18:13.952772 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:18:13.952744 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-695c895bd6-7x4lr_72fae279-5890-4638-9eed-a984b82cf0b5/volume-data-source-validator/0.log" Sep 10 16:18:14.485451 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:18:14.485409 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-lfcr8/perf-node-gather-daemonset-shzvf" event={"ID":"0e70f6a4-c79b-49c3-b760-d6acb59957f7","Type":"ContainerStarted","Data":"56c6950cf118381b9e788b3d0d1f61602b83814d905f4f5c4c59bd477fc88d9f"} Sep 10 16:18:14.485834 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:18:14.485469 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-lfcr8/perf-node-gather-daemonset-shzvf" event={"ID":"0e70f6a4-c79b-49c3-b760-d6acb59957f7","Type":"ContainerStarted","Data":"cb79bc475c3afff890969253476bac5e26543722c3e5cc94685266ddbe821c95"} Sep 10 16:18:14.485834 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:18:14.485495 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-lfcr8/perf-node-gather-daemonset-shzvf" Sep 10 16:18:14.502886 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:18:14.502836 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-lfcr8/perf-node-gather-daemonset-shzvf" podStartSLOduration=1.502821397 podStartE2EDuration="1.502821397s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 16:18:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 16:18:14.501734835 +0000 UTC m=+919.066938378" watchObservedRunningTime="2026-09-10 16:18:14.502821397 +0000 UTC m=+919.068024941" Sep 10 16:18:15.018674 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:18:15.018637 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-vq7kx_4e31247f-e7e8-4d9b-b3ed-0c18d36131e8/dns/0.log" Sep 10 16:18:15.036633 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:18:15.036599 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-vq7kx_4e31247f-e7e8-4d9b-b3ed-0c18d36131e8/kube-rbac-proxy/0.log" Sep 10 16:18:15.138044 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:18:15.138011 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-zb9sj_9d57d542-a9e9-4565-940e-7fc04c2a0498/dns-node-resolver/0.log" Sep 10 16:18:15.637409 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:18:15.637361 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-dd4774968-lbkkv_ef90b6b0-bfd5-4424-8eb7-7600b3fc10a8/registry/0.log" Sep 10 16:18:15.700741 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:18:15.700710 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-ml9qs_b91acfa6-5fd3-4aba-a679-aa72dc8d2fe2/node-ca/0.log" Sep 10 16:18:16.671785 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:18:16.671757 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5468b79cc4-4l9t6_7eaab891-6169-4c8c-b6eb-2f0bc525a05b/kube-auth-proxy/0.log" Sep 10 16:18:16.745664 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:18:16.745632 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59fbc47bf8-5gf4t_d4518659-7bcb-4412-8a62-6d6155c630af/payload-pre-processing/0.log" Sep 10 16:18:16.797350 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:18:16.797314 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-64969f7776-5mx24_6e9a2956-c6be-44d6-b063-e8134e21bc27/router/0.log" Sep 10 16:18:17.075367 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:18:17.075334 2574 scope.go:117] "RemoveContainer" containerID="9e13bb11aa8b5d2377393307101df6211bf82bb4321b10849b2f8e2187d78bd7" Sep 10 16:18:17.075514 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:18:17.075414 2574 scope.go:117] "RemoveContainer" containerID="db15d6cbdf39f49855ccea10670840a5342782665c3c3a89d679652fbfdecc30" Sep 10 16:18:17.075573 ip-10-0-135-53 kubenswrapper[2574]: E0910 16:18:17.075508 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=facebook-opt-125m-simulated-kserve-64dfc7b8f-wfqsm_llm(a557ef2f-ee80-4404-a5e3-004f9b802fd6)\"" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-wfqsm" podUID="a557ef2f-ee80-4404-a5e3-004f9b802fd6" Sep 10 16:18:17.075573 ip-10-0-135-53 kubenswrapper[2574]: E0910 16:18:17.075560 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-jrnjn_llm(20ce5068-6bc5-43d0-b6ef-92efd6ef0c64)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-jrnjn" podUID="20ce5068-6bc5-43d0-b6ef-92efd6ef0c64" Sep 10 16:18:17.466372 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:18:17.466289 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-2w5j8_5c9960fa-cf35-42ce-ba26-e4dd86985aa0/serve-healthcheck-canary/0.log" Sep 10 16:18:18.210941 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:18:18.210906 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-z5t9x_7d8d33a6-8125-4b39-b396-5ac74e34703e/kube-rbac-proxy/0.log" Sep 10 16:18:18.236012 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:18:18.235984 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-z5t9x_7d8d33a6-8125-4b39-b396-5ac74e34703e/exporter/0.log" Sep 10 16:18:18.262425 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:18:18.262389 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-z5t9x_7d8d33a6-8125-4b39-b396-5ac74e34703e/extractor/0.log" Sep 10 16:18:20.499739 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:18:20.499711 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-lfcr8/perf-node-gather-daemonset-shzvf" Sep 10 16:18:20.793854 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:18:20.793823 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6ff9c7664b-n9v44_361e46df-94e7-425a-9226-f76be9c67917/manager/0.log" Sep 10 16:18:20.829048 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:18:20.829019 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6ff9c7664b-n9v44_361e46df-94e7-425a-9226-f76be9c67917/copy-manifests/0.log" Sep 10 16:18:22.141719 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:18:22.141685 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-5745f97d58-88nzj_2b65925f-8df9-4dfe-9b5b-3fccf4cec112/manager/0.log" Sep 10 16:18:22.198002 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:18:22.197968 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-frzsd_8ebb6d13-b322-46ed-bce8-9d6137fe8afc/openshift-lws-operator/0.log" Sep 10 16:18:24.028540 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:18:24.028505 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5468b79cc4-4l9t6_7eaab891-6169-4c8c-b6eb-2f0bc525a05b/kube-auth-proxy/0.log" Sep 10 16:18:24.074374 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:18:24.074332 2574 scope.go:117] "RemoveContainer" containerID="a493e8488713109d5dacd57ca64cb526e7ff3f54fa0cd6918a042517af5c0cea" Sep 10 16:18:24.074606 ip-10-0-135-53 kubenswrapper[2574]: E0910 16:18:24.074581 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=premium-simulated-simulated-premium-kserve-5758cf6949-b8pqt_llm(b6a0e2ea-eb1f-4f79-8bdd-8ab3e8515f2e)\"" pod="llm/premium-simulated-simulated-premium-kserve-5758cf6949-b8pqt" podUID="b6a0e2ea-eb1f-4f79-8bdd-8ab3e8515f2e" Sep 10 16:18:24.075573 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:18:24.075545 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59fbc47bf8-5gf4t_d4518659-7bcb-4412-8a62-6d6155c630af/payload-pre-processing/0.log" Sep 10 16:18:24.116496 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:18:24.116460 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-64969f7776-5mx24_6e9a2956-c6be-44d6-b063-e8134e21bc27/router/0.log" Sep 10 16:18:25.370402 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:18:25.370377 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5468b79cc4-4l9t6_7eaab891-6169-4c8c-b6eb-2f0bc525a05b/kube-auth-proxy/0.log" Sep 10 16:18:25.426522 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:18:25.426470 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59fbc47bf8-5gf4t_d4518659-7bcb-4412-8a62-6d6155c630af/payload-pre-processing/0.log" Sep 10 16:18:25.460715 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:18:25.460676 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-64969f7776-5mx24_6e9a2956-c6be-44d6-b063-e8134e21bc27/router/0.log" Sep 10 16:18:28.074551 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:18:28.074516 2574 scope.go:117] "RemoveContainer" containerID="9e13bb11aa8b5d2377393307101df6211bf82bb4321b10849b2f8e2187d78bd7" Sep 10 16:18:28.074934 ip-10-0-135-53 kubenswrapper[2574]: E0910 16:18:28.074741 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=facebook-opt-125m-simulated-kserve-64dfc7b8f-wfqsm_llm(a557ef2f-ee80-4404-a5e3-004f9b802fd6)\"" pod="llm/facebook-opt-125m-simulated-kserve-64dfc7b8f-wfqsm" podUID="a557ef2f-ee80-4404-a5e3-004f9b802fd6" Sep 10 16:18:28.934219 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:18:28.934190 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-dh6tv_699bca8d-6865-43af-b415-6ae212a5decb/kube-multus-additional-cni-plugins/0.log" Sep 10 16:18:28.956472 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:18:28.956437 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-dh6tv_699bca8d-6865-43af-b415-6ae212a5decb/egress-router-binary-copy/0.log" Sep 10 16:18:28.976828 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:18:28.976793 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-dh6tv_699bca8d-6865-43af-b415-6ae212a5decb/cni-plugins/0.log" Sep 10 16:18:29.004406 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:18:29.004348 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-dh6tv_699bca8d-6865-43af-b415-6ae212a5decb/bond-cni-plugin/0.log" Sep 10 16:18:29.030117 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:18:29.030080 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-dh6tv_699bca8d-6865-43af-b415-6ae212a5decb/routeoverride-cni/0.log" Sep 10 16:18:29.052080 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:18:29.052051 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-dh6tv_699bca8d-6865-43af-b415-6ae212a5decb/whereabouts-cni-bincopy/0.log" Sep 10 16:18:29.075579 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:18:29.075548 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-dh6tv_699bca8d-6865-43af-b415-6ae212a5decb/whereabouts-cni/0.log" Sep 10 16:18:29.123063 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:18:29.123036 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-b2tw8_aeb39a1e-eea5-4a70-b486-cbdcfafdd25a/kube-multus/0.log" Sep 10 16:18:29.215900 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:18:29.215809 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-ct85s_cc55b4de-3d22-4d24-bf28-d018afb0e4bc/network-metrics-daemon/0.log" Sep 10 16:18:29.233924 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:18:29.233888 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-ct85s_cc55b4de-3d22-4d24-bf28-d018afb0e4bc/kube-rbac-proxy/0.log" Sep 10 16:18:30.074644 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:18:30.074611 2574 scope.go:117] "RemoveContainer" containerID="db15d6cbdf39f49855ccea10670840a5342782665c3c3a89d679652fbfdecc30" Sep 10 16:18:30.075139 ip-10-0-135-53 kubenswrapper[2574]: E0910 16:18:30.074805 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"main\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=main pod=e2e-distinct-2-simulated-kserve-859856b874-jrnjn_llm(20ce5068-6bc5-43d0-b6ef-92efd6ef0c64)\"" pod="llm/e2e-distinct-2-simulated-kserve-859856b874-jrnjn" podUID="20ce5068-6bc5-43d0-b6ef-92efd6ef0c64" Sep 10 16:18:30.297916 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:18:30.297884 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tmshf_ce502816-6f0c-458c-b83d-bd1488b32d29/ovn-controller/0.log" Sep 10 16:18:30.316433 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:18:30.316407 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tmshf_ce502816-6f0c-458c-b83d-bd1488b32d29/ovn-acl-logging/0.log" Sep 10 16:18:30.350338 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:18:30.350239 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tmshf_ce502816-6f0c-458c-b83d-bd1488b32d29/kube-rbac-proxy-node/0.log" Sep 10 16:18:30.371579 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:18:30.371546 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tmshf_ce502816-6f0c-458c-b83d-bd1488b32d29/kube-rbac-proxy-ovn-metrics/0.log" Sep 10 16:18:30.394805 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:18:30.394770 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tmshf_ce502816-6f0c-458c-b83d-bd1488b32d29/northd/0.log" Sep 10 16:18:30.416037 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:18:30.416005 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tmshf_ce502816-6f0c-458c-b83d-bd1488b32d29/nbdb/0.log" Sep 10 16:18:30.434809 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:18:30.434780 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tmshf_ce502816-6f0c-458c-b83d-bd1488b32d29/sbdb/0.log" Sep 10 16:18:30.487166 ip-10-0-135-53 kubenswrapper[2574]: I0910 16:18:30.487112 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tmshf_ce502816-6f0c-458c-b83d-bd1488b32d29/ovnkube-controller/0.log"