Sep 05 02:17:53.370318 ip-10-0-133-250 systemd[1]: Starting Kubernetes Kubelet... Sep 05 02:17:53.792529 ip-10-0-133-250 kubenswrapper[2555]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 05 02:17:53.792529 ip-10-0-133-250 kubenswrapper[2555]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Sep 05 02:17:53.792529 ip-10-0-133-250 kubenswrapper[2555]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 05 02:17:53.792529 ip-10-0-133-250 kubenswrapper[2555]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Sep 05 02:17:53.792529 ip-10-0-133-250 kubenswrapper[2555]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 05 02:17:53.796073 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:53.795976 2555 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Sep 05 02:17:53.800719 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.800676 2555 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 05 02:17:53.800837 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.800827 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 05 02:17:53.800837 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.800838 2555 feature_gate.go:328] unrecognized feature gate: Example2 Sep 05 02:17:53.800892 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.800841 2555 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 05 02:17:53.800892 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.800845 2555 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 05 02:17:53.800892 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.800849 2555 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 05 02:17:53.800892 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.800852 2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 05 02:17:53.800892 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.800855 2555 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 05 02:17:53.800892 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.800859 2555 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 05 02:17:53.800892 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.800861 2555 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 05 02:17:53.800892 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.800864 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 05 02:17:53.800892 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.800867 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 05 02:17:53.800892 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.800870 2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 05 02:17:53.800892 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.800873 2555 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 05 02:17:53.800892 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.800878 2555 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 05 02:17:53.800892 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.800882 2555 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 05 02:17:53.800892 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.800885 2555 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 05 02:17:53.800892 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.800888 2555 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 05 02:17:53.800892 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.800891 2555 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 05 02:17:53.800892 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.800894 2555 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 05 02:17:53.800892 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.800897 2555 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 05 02:17:53.800892 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.800900 2555 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 05 02:17:53.801355 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.800903 2555 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 05 02:17:53.801355 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.800906 2555 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 05 02:17:53.801355 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.800909 2555 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 05 02:17:53.801355 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.800912 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 05 02:17:53.801355 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.800914 2555 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 05 02:17:53.801355 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.800917 2555 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 05 02:17:53.801355 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.800920 2555 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 05 02:17:53.801355 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.800922 2555 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 05 02:17:53.801355 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.800925 2555 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 05 02:17:53.801355 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.800928 2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 05 02:17:53.801355 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.800930 2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 05 02:17:53.801355 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.800938 2555 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 05 02:17:53.801355 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.800941 2555 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 05 02:17:53.801355 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.800944 2555 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 05 02:17:53.801355 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.800946 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 05 02:17:53.801355 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.800949 2555 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 05 02:17:53.801355 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.800952 2555 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 05 02:17:53.801355 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.800956 2555 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 05 02:17:53.801355 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.800959 2555 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 05 02:17:53.801355 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.800962 2555 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 05 02:17:53.801872 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.800964 2555 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 05 02:17:53.801872 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.800967 2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 05 02:17:53.801872 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.800969 2555 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 05 02:17:53.801872 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.800972 2555 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 05 02:17:53.801872 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.800975 2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 05 02:17:53.801872 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.800977 2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 05 02:17:53.801872 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.800998 2555 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 05 02:17:53.801872 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.801002 2555 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 05 02:17:53.801872 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.801005 2555 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 05 02:17:53.801872 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.801008 2555 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 05 02:17:53.801872 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.801011 2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 05 02:17:53.801872 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.801014 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 05 02:17:53.801872 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.801034 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 05 02:17:53.801872 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.801038 2555 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 05 02:17:53.801872 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.801041 2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 05 02:17:53.801872 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.801044 2555 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 05 02:17:53.801872 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.801046 2555 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 05 02:17:53.801872 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.801050 2555 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 05 02:17:53.801872 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.801053 2555 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 05 02:17:53.802369 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.801055 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 05 02:17:53.802369 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.801058 2555 feature_gate.go:328] unrecognized feature gate: Example Sep 05 02:17:53.802369 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.801061 2555 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 05 02:17:53.802369 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.801064 2555 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 05 02:17:53.802369 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.801068 2555 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 05 02:17:53.802369 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.801072 2555 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 05 02:17:53.802369 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.801076 2555 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 05 02:17:53.802369 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.801079 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 05 02:17:53.802369 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.801082 2555 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 05 02:17:53.802369 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.801087 2555 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 05 02:17:53.802369 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.801090 2555 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 05 02:17:53.802369 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.801093 2555 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 05 02:17:53.802369 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.801096 2555 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 05 02:17:53.802369 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.801098 2555 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 05 02:17:53.802369 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.801101 2555 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 05 02:17:53.802369 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.801104 2555 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 05 02:17:53.802369 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.801106 2555 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 05 02:17:53.802369 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.801109 2555 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 05 02:17:53.802369 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.801112 2555 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 05 02:17:53.802369 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.801114 2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 05 02:17:53.802847 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.801117 2555 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 05 02:17:53.802847 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.801120 2555 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 05 02:17:53.802847 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.801124 2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 05 02:17:53.802847 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.801126 2555 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 05 02:17:53.802847 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.801129 2555 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 05 02:17:53.802847 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.801132 2555 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 05 02:17:53.802847 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.801135 2555 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 05 02:17:53.802847 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.801138 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 05 02:17:53.802847 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.801141 2555 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 05 02:17:53.802847 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.801143 2555 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 05 02:17:53.802847 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.801146 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 05 02:17:53.802847 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.801149 2555 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 05 02:17:53.802847 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.801153 2555 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 05 02:17:53.802847 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.801156 2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 05 02:17:53.802847 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.801159 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 05 02:17:53.802847 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.801162 2555 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 05 02:17:53.802847 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.801165 2555 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 05 02:17:53.802847 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.801168 2555 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 05 02:17:53.802847 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.801864 2555 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 05 02:17:53.803443 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.801871 2555 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 05 02:17:53.803443 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.801875 2555 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 05 02:17:53.803443 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.801878 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 05 02:17:53.803443 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.801881 2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 05 02:17:53.803443 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.801884 2555 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 05 02:17:53.803443 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.801887 2555 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 05 02:17:53.803443 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.801890 2555 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 05 02:17:53.803443 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.801893 2555 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 05 02:17:53.803443 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.801896 2555 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 05 02:17:53.803443 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.801898 2555 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 05 02:17:53.803443 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.801901 2555 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 05 02:17:53.803443 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.801903 2555 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 05 02:17:53.803443 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.801906 2555 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 05 02:17:53.803443 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.801908 2555 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 05 02:17:53.803443 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.801911 2555 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 05 02:17:53.803443 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.801914 2555 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 05 02:17:53.803443 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.801917 2555 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 05 02:17:53.803443 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.801920 2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 05 02:17:53.803443 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.801923 2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 05 02:17:53.803443 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.801926 2555 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 05 02:17:53.803946 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.801929 2555 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 05 02:17:53.803946 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.801932 2555 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 05 02:17:53.803946 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.801934 2555 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 05 02:17:53.803946 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.801937 2555 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 05 02:17:53.803946 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.801939 2555 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 05 02:17:53.803946 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.801942 2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 05 02:17:53.803946 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.801944 2555 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 05 02:17:53.803946 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.801947 2555 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 05 02:17:53.803946 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.801949 2555 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 05 02:17:53.803946 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.801951 2555 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 05 02:17:53.803946 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.801954 2555 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 05 02:17:53.803946 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.801957 2555 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 05 02:17:53.803946 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.801959 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 05 02:17:53.803946 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.801962 2555 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 05 02:17:53.803946 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.801964 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 05 02:17:53.803946 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.801968 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 05 02:17:53.803946 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.801970 2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 05 02:17:53.803946 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.801974 2555 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 05 02:17:53.803946 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.801976 2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 05 02:17:53.803946 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.801979 2555 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 05 02:17:53.804485 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.801981 2555 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 05 02:17:53.804485 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.801983 2555 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 05 02:17:53.804485 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.801987 2555 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 05 02:17:53.804485 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.801990 2555 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 05 02:17:53.804485 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.801992 2555 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 05 02:17:53.804485 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.801995 2555 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 05 02:17:53.804485 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.801997 2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 05 02:17:53.804485 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.801999 2555 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 05 02:17:53.804485 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.802004 2555 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 05 02:17:53.804485 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.802008 2555 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 05 02:17:53.804485 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.802011 2555 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 05 02:17:53.804485 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.802014 2555 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 05 02:17:53.804485 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.802034 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 05 02:17:53.804485 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.802037 2555 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 05 02:17:53.804485 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.802040 2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 05 02:17:53.804485 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.802044 2555 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 05 02:17:53.804485 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.802049 2555 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 05 02:17:53.804485 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.802052 2555 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 05 02:17:53.804485 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.802054 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 05 02:17:53.804485 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.802057 2555 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 05 02:17:53.804982 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.802060 2555 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 05 02:17:53.804982 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.802062 2555 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 05 02:17:53.804982 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.802065 2555 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 05 02:17:53.804982 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.802067 2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 05 02:17:53.804982 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.802070 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 05 02:17:53.804982 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.802072 2555 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 05 02:17:53.804982 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.802074 2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 05 02:17:53.804982 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.802077 2555 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 05 02:17:53.804982 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.802081 2555 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 05 02:17:53.804982 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.802084 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 05 02:17:53.804982 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.802086 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 05 02:17:53.804982 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.802089 2555 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 05 02:17:53.804982 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.802091 2555 feature_gate.go:328] unrecognized feature gate: Example2 Sep 05 02:17:53.804982 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.802094 2555 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 05 02:17:53.804982 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.802097 2555 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 05 02:17:53.804982 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.802099 2555 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 05 02:17:53.804982 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.802102 2555 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 05 02:17:53.804982 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.802105 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 05 02:17:53.804982 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.802107 2555 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 05 02:17:53.804982 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.802110 2555 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 05 02:17:53.805486 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.802112 2555 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 05 02:17:53.805486 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.802115 2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 05 02:17:53.805486 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.802119 2555 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 05 02:17:53.805486 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.802121 2555 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 05 02:17:53.805486 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.802124 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 05 02:17:53.805486 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.802126 2555 feature_gate.go:328] unrecognized feature gate: Example Sep 05 02:17:53.805486 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.802129 2555 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 05 02:17:53.805486 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.802131 2555 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 05 02:17:53.805486 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.802134 2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 05 02:17:53.805486 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.802137 2555 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 05 02:17:53.805486 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.802141 2555 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 05 02:17:53.805486 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.802144 2555 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 05 02:17:53.805486 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.802147 2555 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 05 02:17:53.805486 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.802149 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 05 02:17:53.805486 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.802152 2555 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 05 02:17:53.805486 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.802155 2555 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 05 02:17:53.805486 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.802158 2555 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 05 02:17:53.805486 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.802160 2555 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 05 02:17:53.805486 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.802538 2555 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 05 02:17:53.805953 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.802543 2555 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 05 02:17:53.805953 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.802546 2555 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 05 02:17:53.805953 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.802551 2555 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 05 02:17:53.805953 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.802555 2555 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 05 02:17:53.805953 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.802558 2555 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 05 02:17:53.805953 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.802561 2555 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 05 02:17:53.805953 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.802563 2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 05 02:17:53.805953 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.802567 2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 05 02:17:53.805953 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.802570 2555 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 05 02:17:53.805953 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.802573 2555 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 05 02:17:53.805953 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.802575 2555 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 05 02:17:53.805953 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.802578 2555 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 05 02:17:53.805953 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.802581 2555 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 05 02:17:53.805953 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.802583 2555 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 05 02:17:53.805953 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.802586 2555 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 05 02:17:53.805953 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.802589 2555 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 05 02:17:53.805953 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.802592 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 05 02:17:53.805953 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.802594 2555 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 05 02:17:53.805953 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.802597 2555 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 05 02:17:53.805953 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.802599 2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 05 02:17:53.806446 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.802602 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 05 02:17:53.806446 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.802605 2555 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 05 02:17:53.806446 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.802607 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 05 02:17:53.806446 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.802610 2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 05 02:17:53.806446 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.802612 2555 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 05 02:17:53.806446 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.802615 2555 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 05 02:17:53.806446 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.802618 2555 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 05 02:17:53.806446 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.802620 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 05 02:17:53.806446 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.802624 2555 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 05 02:17:53.806446 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.802627 2555 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 05 02:17:53.806446 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.802630 2555 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 05 02:17:53.806446 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.802633 2555 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 05 02:17:53.806446 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.802636 2555 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 05 02:17:53.806446 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.802639 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 05 02:17:53.806446 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.802641 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 05 02:17:53.806446 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.802643 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 05 02:17:53.806446 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.802646 2555 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 05 02:17:53.806446 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.802648 2555 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 05 02:17:53.806446 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.802651 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 05 02:17:53.806917 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.802654 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 05 02:17:53.806917 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.802657 2555 feature_gate.go:328] unrecognized feature gate: Example Sep 05 02:17:53.806917 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.802660 2555 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 05 02:17:53.806917 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.802662 2555 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 05 02:17:53.806917 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.802665 2555 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 05 02:17:53.806917 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.802668 2555 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 05 02:17:53.806917 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.802670 2555 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 05 02:17:53.806917 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.802673 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 05 02:17:53.806917 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.802675 2555 feature_gate.go:328] unrecognized feature gate: Example2 Sep 05 02:17:53.806917 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.802678 2555 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 05 02:17:53.806917 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.802681 2555 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 05 02:17:53.806917 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.802683 2555 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 05 02:17:53.806917 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.802686 2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 05 02:17:53.806917 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.802688 2555 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 05 02:17:53.806917 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.802691 2555 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 05 02:17:53.806917 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.802693 2555 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 05 02:17:53.806917 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.802695 2555 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 05 02:17:53.806917 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.802698 2555 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 05 02:17:53.806917 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.802700 2555 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 05 02:17:53.806917 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.802704 2555 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 05 02:17:53.807412 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.802707 2555 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 05 02:17:53.807412 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.802710 2555 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 05 02:17:53.807412 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.802713 2555 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 05 02:17:53.807412 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.802716 2555 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 05 02:17:53.807412 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.802718 2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 05 02:17:53.807412 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.802721 2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 05 02:17:53.807412 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.802724 2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 05 02:17:53.807412 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.802726 2555 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 05 02:17:53.807412 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.802728 2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 05 02:17:53.807412 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.802731 2555 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 05 02:17:53.807412 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.802733 2555 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 05 02:17:53.807412 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.802736 2555 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 05 02:17:53.807412 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.802739 2555 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 05 02:17:53.807412 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.802741 2555 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 05 02:17:53.807412 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.802744 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 05 02:17:53.807412 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.802747 2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 05 02:17:53.807412 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.802749 2555 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 05 02:17:53.807412 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.802751 2555 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 05 02:17:53.807412 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.802754 2555 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 05 02:17:53.807865 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.802756 2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 05 02:17:53.807865 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.802758 2555 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 05 02:17:53.807865 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.802761 2555 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 05 02:17:53.807865 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.802764 2555 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 05 02:17:53.807865 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.802766 2555 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 05 02:17:53.807865 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.802769 2555 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 05 02:17:53.807865 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.802772 2555 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 05 02:17:53.807865 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.802775 2555 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 05 02:17:53.807865 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.802777 2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 05 02:17:53.807865 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.802780 2555 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 05 02:17:53.807865 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.802782 2555 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 05 02:17:53.807865 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.802784 2555 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 05 02:17:53.807865 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.802787 2555 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 05 02:17:53.807865 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.802789 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 05 02:17:53.807865 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.802792 2555 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 05 02:17:53.807865 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.802794 2555 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 05 02:17:53.807865 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.802797 2555 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 05 02:17:53.807865 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.802801 2555 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 05 02:17:53.807865 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.802804 2555 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 05 02:17:53.807865 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.802806 2555 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 05 02:17:53.808360 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:53.802878 2555 flags.go:64] FLAG: --address="0.0.0.0" Sep 05 02:17:53.808360 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:53.802914 2555 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Sep 05 02:17:53.808360 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:53.802921 2555 flags.go:64] FLAG: --anonymous-auth="true" Sep 05 02:17:53.808360 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:53.802925 2555 flags.go:64] FLAG: --application-metrics-count-limit="100" Sep 05 02:17:53.808360 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:53.802929 2555 flags.go:64] FLAG: --authentication-token-webhook="false" Sep 05 02:17:53.808360 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:53.802933 2555 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Sep 05 02:17:53.808360 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:53.802937 2555 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Sep 05 02:17:53.808360 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:53.802941 2555 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Sep 05 02:17:53.808360 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:53.802944 2555 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Sep 05 02:17:53.808360 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:53.802947 2555 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Sep 05 02:17:53.808360 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:53.802950 2555 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Sep 05 02:17:53.808360 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:53.802954 2555 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Sep 05 02:17:53.808360 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:53.802957 2555 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Sep 05 02:17:53.808360 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:53.802960 2555 flags.go:64] FLAG: --cgroup-root="" Sep 05 02:17:53.808360 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:53.802963 2555 flags.go:64] FLAG: --cgroups-per-qos="true" Sep 05 02:17:53.808360 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:53.802966 2555 flags.go:64] FLAG: --client-ca-file="" Sep 05 02:17:53.808360 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:53.802976 2555 flags.go:64] FLAG: --cloud-provider="external" Sep 05 02:17:53.808360 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:53.802979 2555 flags.go:64] FLAG: --cluster-dns="[]" Sep 05 02:17:53.808360 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:53.802984 2555 flags.go:64] FLAG: --cluster-domain="" Sep 05 02:17:53.808360 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:53.802986 2555 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Sep 05 02:17:53.808360 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:53.802990 2555 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Sep 05 02:17:53.808360 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:53.802993 2555 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Sep 05 02:17:53.808360 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:53.802996 2555 flags.go:64] FLAG: --container-log-max-files="5" Sep 05 02:17:53.808360 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:53.803004 2555 flags.go:64] FLAG: --container-log-max-size="10Mi" Sep 05 02:17:53.808934 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:53.803007 2555 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Sep 05 02:17:53.808934 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:53.803010 2555 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Sep 05 02:17:53.808934 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:53.803014 2555 flags.go:64] FLAG: --containerd-namespace="k8s.io" Sep 05 02:17:53.808934 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:53.803033 2555 flags.go:64] FLAG: --contention-profiling="false" Sep 05 02:17:53.808934 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:53.803037 2555 flags.go:64] FLAG: --cpu-cfs-quota="true" Sep 05 02:17:53.808934 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:53.803041 2555 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Sep 05 02:17:53.808934 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:53.803045 2555 flags.go:64] FLAG: --cpu-manager-policy="none" Sep 05 02:17:53.808934 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:53.803047 2555 flags.go:64] FLAG: --cpu-manager-policy-options="" Sep 05 02:17:53.808934 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:53.803051 2555 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Sep 05 02:17:53.808934 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:53.803055 2555 flags.go:64] FLAG: --enable-controller-attach-detach="true" Sep 05 02:17:53.808934 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:53.803057 2555 flags.go:64] FLAG: --enable-debugging-handlers="true" Sep 05 02:17:53.808934 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:53.803060 2555 flags.go:64] FLAG: --enable-load-reader="false" Sep 05 02:17:53.808934 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:53.803063 2555 flags.go:64] FLAG: --enable-server="true" Sep 05 02:17:53.808934 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:53.803066 2555 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Sep 05 02:17:53.808934 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:53.803070 2555 flags.go:64] FLAG: --event-burst="100" Sep 05 02:17:53.808934 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:53.803073 2555 flags.go:64] FLAG: --event-qps="50" Sep 05 02:17:53.808934 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:53.803076 2555 flags.go:64] FLAG: --event-storage-age-limit="default=0" Sep 05 02:17:53.808934 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:53.803079 2555 flags.go:64] FLAG: --event-storage-event-limit="default=0" Sep 05 02:17:53.808934 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:53.803082 2555 flags.go:64] FLAG: --eviction-hard="" Sep 05 02:17:53.808934 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:53.803085 2555 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Sep 05 02:17:53.808934 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:53.803088 2555 flags.go:64] FLAG: --eviction-minimum-reclaim="" Sep 05 02:17:53.808934 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:53.803091 2555 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Sep 05 02:17:53.808934 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:53.803094 2555 flags.go:64] FLAG: --eviction-soft="" Sep 05 02:17:53.808934 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:53.803097 2555 flags.go:64] FLAG: --eviction-soft-grace-period="" Sep 05 02:17:53.808934 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:53.803100 2555 flags.go:64] FLAG: --exit-on-lock-contention="false" Sep 05 02:17:53.809610 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:53.803103 2555 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Sep 05 02:17:53.809610 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:53.803106 2555 flags.go:64] FLAG: --experimental-mounter-path="" Sep 05 02:17:53.809610 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:53.803109 2555 flags.go:64] FLAG: --fail-cgroupv1="false" Sep 05 02:17:53.809610 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:53.803112 2555 flags.go:64] FLAG: --fail-swap-on="true" Sep 05 02:17:53.809610 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:53.803114 2555 flags.go:64] FLAG: --feature-gates="" Sep 05 02:17:53.809610 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:53.803118 2555 flags.go:64] FLAG: --file-check-frequency="20s" Sep 05 02:17:53.809610 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:53.803134 2555 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Sep 05 02:17:53.809610 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:53.803138 2555 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Sep 05 02:17:53.809610 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:53.803141 2555 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Sep 05 02:17:53.809610 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:53.803145 2555 flags.go:64] FLAG: --healthz-port="10248" Sep 05 02:17:53.809610 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:53.803148 2555 flags.go:64] FLAG: --help="false" Sep 05 02:17:53.809610 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:53.803151 2555 flags.go:64] FLAG: --hostname-override="ip-10-0-133-250.ec2.internal" Sep 05 02:17:53.809610 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:53.803155 2555 flags.go:64] FLAG: --housekeeping-interval="10s" Sep 05 02:17:53.809610 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:53.803158 2555 flags.go:64] FLAG: --http-check-frequency="20s" Sep 05 02:17:53.809610 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:53.803161 2555 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Sep 05 02:17:53.809610 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:53.803165 2555 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Sep 05 02:17:53.809610 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:53.803168 2555 flags.go:64] FLAG: --image-gc-high-threshold="85" Sep 05 02:17:53.809610 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:53.803171 2555 flags.go:64] FLAG: --image-gc-low-threshold="80" Sep 05 02:17:53.809610 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:53.803174 2555 flags.go:64] FLAG: --image-service-endpoint="" Sep 05 02:17:53.809610 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:53.803176 2555 flags.go:64] FLAG: --kernel-memcg-notification="false" Sep 05 02:17:53.809610 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:53.803179 2555 flags.go:64] FLAG: --kube-api-burst="100" Sep 05 02:17:53.809610 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:53.803182 2555 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Sep 05 02:17:53.809610 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:53.803185 2555 flags.go:64] FLAG: --kube-api-qps="50" Sep 05 02:17:53.809610 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:53.803188 2555 flags.go:64] FLAG: --kube-reserved="" Sep 05 02:17:53.810214 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:53.803191 2555 flags.go:64] FLAG: --kube-reserved-cgroup="" Sep 05 02:17:53.810214 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:53.803193 2555 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Sep 05 02:17:53.810214 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:53.803196 2555 flags.go:64] FLAG: --kubelet-cgroups="" Sep 05 02:17:53.810214 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:53.803199 2555 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Sep 05 02:17:53.810214 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:53.803202 2555 flags.go:64] FLAG: --lock-file="" Sep 05 02:17:53.810214 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:53.803204 2555 flags.go:64] FLAG: --log-cadvisor-usage="false" Sep 05 02:17:53.810214 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:53.803207 2555 flags.go:64] FLAG: --log-flush-frequency="5s" Sep 05 02:17:53.810214 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:53.803210 2555 flags.go:64] FLAG: --log-json-info-buffer-size="0" Sep 05 02:17:53.810214 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:53.803215 2555 flags.go:64] FLAG: --log-json-split-stream="false" Sep 05 02:17:53.810214 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:53.803219 2555 flags.go:64] FLAG: --log-text-info-buffer-size="0" Sep 05 02:17:53.810214 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:53.803222 2555 flags.go:64] FLAG: --log-text-split-stream="false" Sep 05 02:17:53.810214 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:53.803224 2555 flags.go:64] FLAG: --logging-format="text" Sep 05 02:17:53.810214 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:53.803227 2555 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Sep 05 02:17:53.810214 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:53.803230 2555 flags.go:64] FLAG: --make-iptables-util-chains="true" Sep 05 02:17:53.810214 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:53.803233 2555 flags.go:64] FLAG: --manifest-url="" Sep 05 02:17:53.810214 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:53.803237 2555 flags.go:64] FLAG: --manifest-url-header="" Sep 05 02:17:53.810214 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:53.803241 2555 flags.go:64] FLAG: --max-housekeeping-interval="15s" Sep 05 02:17:53.810214 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:53.803244 2555 flags.go:64] FLAG: --max-open-files="1000000" Sep 05 02:17:53.810214 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:53.803248 2555 flags.go:64] FLAG: --max-pods="110" Sep 05 02:17:53.810214 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:53.803251 2555 flags.go:64] FLAG: --maximum-dead-containers="-1" Sep 05 02:17:53.810214 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:53.803259 2555 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Sep 05 02:17:53.810214 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:53.803262 2555 flags.go:64] FLAG: --memory-manager-policy="None" Sep 05 02:17:53.810214 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:53.803265 2555 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Sep 05 02:17:53.810214 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:53.803268 2555 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Sep 05 02:17:53.810214 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:53.803271 2555 flags.go:64] FLAG: --node-ip="0.0.0.0" Sep 05 02:17:53.810819 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:53.803274 2555 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Sep 05 02:17:53.810819 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:53.803281 2555 flags.go:64] FLAG: --node-status-max-images="50" Sep 05 02:17:53.810819 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:53.803284 2555 flags.go:64] FLAG: --node-status-update-frequency="10s" Sep 05 02:17:53.810819 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:53.803287 2555 flags.go:64] FLAG: --oom-score-adj="-999" Sep 05 02:17:53.810819 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:53.803291 2555 flags.go:64] FLAG: --pod-cidr="" Sep 05 02:17:53.810819 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:53.803294 2555 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8ccbacc999dbf9abad8f4009240188312b683f36ced4763eed166c1500c164b1" Sep 05 02:17:53.810819 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:53.803299 2555 flags.go:64] FLAG: --pod-manifest-path="" Sep 05 02:17:53.810819 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:53.803302 2555 flags.go:64] FLAG: --pod-max-pids="-1" Sep 05 02:17:53.810819 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:53.803305 2555 flags.go:64] FLAG: --pods-per-core="0" Sep 05 02:17:53.810819 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:53.803308 2555 flags.go:64] FLAG: --port="10250" Sep 05 02:17:53.810819 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:53.803311 2555 flags.go:64] FLAG: --protect-kernel-defaults="false" Sep 05 02:17:53.810819 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:53.803314 2555 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0ec08c8dd4b47cb4d" Sep 05 02:17:53.810819 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:53.803317 2555 flags.go:64] FLAG: --qos-reserved="" Sep 05 02:17:53.810819 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:53.803320 2555 flags.go:64] FLAG: --read-only-port="10255" Sep 05 02:17:53.810819 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:53.803323 2555 flags.go:64] FLAG: --register-node="true" Sep 05 02:17:53.810819 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:53.803326 2555 flags.go:64] FLAG: --register-with-taints="" Sep 05 02:17:53.810819 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:53.803329 2555 flags.go:64] FLAG: --registry-burst="10" Sep 05 02:17:53.810819 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:53.803333 2555 flags.go:64] FLAG: --registry-qps="5" Sep 05 02:17:53.810819 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:53.803336 2555 flags.go:64] FLAG: --reserved-cpus="" Sep 05 02:17:53.810819 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:53.803339 2555 flags.go:64] FLAG: --reserved-memory="" Sep 05 02:17:53.810819 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:53.803342 2555 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Sep 05 02:17:53.810819 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:53.803346 2555 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Sep 05 02:17:53.810819 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:53.803348 2555 flags.go:64] FLAG: --rotate-certificates="false" Sep 05 02:17:53.810819 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:53.803352 2555 flags.go:64] FLAG: --rotate-server-certificates="false" Sep 05 02:17:53.810819 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:53.803355 2555 flags.go:64] FLAG: --runonce="false" Sep 05 02:17:53.811435 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:53.803358 2555 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Sep 05 02:17:53.811435 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:53.803360 2555 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Sep 05 02:17:53.811435 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:53.803365 2555 flags.go:64] FLAG: --seccomp-default="false" Sep 05 02:17:53.811435 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:53.803368 2555 flags.go:64] FLAG: --serialize-image-pulls="true" Sep 05 02:17:53.811435 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:53.803371 2555 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Sep 05 02:17:53.811435 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:53.803374 2555 flags.go:64] FLAG: --storage-driver-db="cadvisor" Sep 05 02:17:53.811435 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:53.803377 2555 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Sep 05 02:17:53.811435 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:53.803380 2555 flags.go:64] FLAG: --storage-driver-password="root" Sep 05 02:17:53.811435 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:53.803382 2555 flags.go:64] FLAG: --storage-driver-secure="false" Sep 05 02:17:53.811435 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:53.803385 2555 flags.go:64] FLAG: --storage-driver-table="stats" Sep 05 02:17:53.811435 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:53.803388 2555 flags.go:64] FLAG: --storage-driver-user="root" Sep 05 02:17:53.811435 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:53.803391 2555 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Sep 05 02:17:53.811435 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:53.803394 2555 flags.go:64] FLAG: --sync-frequency="1m0s" Sep 05 02:17:53.811435 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:53.803397 2555 flags.go:64] FLAG: --system-cgroups="" Sep 05 02:17:53.811435 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:53.803400 2555 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Sep 05 02:17:53.811435 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:53.803405 2555 flags.go:64] FLAG: --system-reserved-cgroup="" Sep 05 02:17:53.811435 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:53.803407 2555 flags.go:64] FLAG: --tls-cert-file="" Sep 05 02:17:53.811435 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:53.803410 2555 flags.go:64] FLAG: --tls-cipher-suites="[]" Sep 05 02:17:53.811435 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:53.803415 2555 flags.go:64] FLAG: --tls-min-version="" Sep 05 02:17:53.811435 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:53.803418 2555 flags.go:64] FLAG: --tls-private-key-file="" Sep 05 02:17:53.811435 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:53.803420 2555 flags.go:64] FLAG: --topology-manager-policy="none" Sep 05 02:17:53.811435 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:53.803423 2555 flags.go:64] FLAG: --topology-manager-policy-options="" Sep 05 02:17:53.811435 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:53.803426 2555 flags.go:64] FLAG: --topology-manager-scope="container" Sep 05 02:17:53.811435 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:53.803429 2555 flags.go:64] FLAG: --v="2" Sep 05 02:17:53.811435 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:53.803432 2555 flags.go:64] FLAG: --version="false" Sep 05 02:17:53.812071 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:53.803437 2555 flags.go:64] FLAG: --vmodule="" Sep 05 02:17:53.812071 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:53.803441 2555 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Sep 05 02:17:53.812071 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:53.803444 2555 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Sep 05 02:17:53.812071 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.803559 2555 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 05 02:17:53.812071 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.803563 2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 05 02:17:53.812071 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.803566 2555 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 05 02:17:53.812071 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.803572 2555 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 05 02:17:53.812071 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.803575 2555 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 05 02:17:53.812071 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.803578 2555 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 05 02:17:53.812071 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.803581 2555 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 05 02:17:53.812071 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.803584 2555 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 05 02:17:53.812071 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.803587 2555 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 05 02:17:53.812071 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.803589 2555 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 05 02:17:53.812071 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.803592 2555 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 05 02:17:53.812071 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.803595 2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 05 02:17:53.812071 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.803598 2555 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 05 02:17:53.812071 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.803600 2555 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 05 02:17:53.812071 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.803603 2555 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 05 02:17:53.812071 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.803606 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 05 02:17:53.812071 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.803608 2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 05 02:17:53.812071 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.803611 2555 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 05 02:17:53.812580 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.803613 2555 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 05 02:17:53.812580 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.803616 2555 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 05 02:17:53.812580 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.803619 2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 05 02:17:53.812580 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.803621 2555 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 05 02:17:53.812580 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.803624 2555 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 05 02:17:53.812580 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.803627 2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 05 02:17:53.812580 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.803629 2555 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 05 02:17:53.812580 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.803632 2555 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 05 02:17:53.812580 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.803634 2555 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 05 02:17:53.812580 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.803637 2555 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 05 02:17:53.812580 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.803640 2555 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 05 02:17:53.812580 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.803642 2555 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 05 02:17:53.812580 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.803645 2555 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 05 02:17:53.812580 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.803648 2555 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 05 02:17:53.812580 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.803650 2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 05 02:17:53.812580 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.803653 2555 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 05 02:17:53.812580 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.803655 2555 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 05 02:17:53.812580 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.803659 2555 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 05 02:17:53.812580 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.803661 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 05 02:17:53.812580 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.803664 2555 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 05 02:17:53.813083 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.803668 2555 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 05 02:17:53.813083 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.803671 2555 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 05 02:17:53.813083 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.803674 2555 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 05 02:17:53.813083 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.803676 2555 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 05 02:17:53.813083 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.803679 2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 05 02:17:53.813083 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.803681 2555 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 05 02:17:53.813083 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.803684 2555 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 05 02:17:53.813083 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.803687 2555 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 05 02:17:53.813083 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.803689 2555 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 05 02:17:53.813083 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.803692 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 05 02:17:53.813083 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.803694 2555 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 05 02:17:53.813083 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.803697 2555 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 05 02:17:53.813083 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.803699 2555 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 05 02:17:53.813083 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.803702 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 05 02:17:53.813083 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.803704 2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 05 02:17:53.813083 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.803707 2555 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 05 02:17:53.813083 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.803710 2555 feature_gate.go:328] unrecognized feature gate: Example2 Sep 05 02:17:53.813083 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.803712 2555 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 05 02:17:53.813083 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.803715 2555 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 05 02:17:53.813083 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.803717 2555 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 05 02:17:53.813599 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.803720 2555 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 05 02:17:53.813599 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.803722 2555 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 05 02:17:53.813599 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.803726 2555 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 05 02:17:53.813599 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.803731 2555 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 05 02:17:53.813599 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.803734 2555 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 05 02:17:53.813599 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.803737 2555 feature_gate.go:328] unrecognized feature gate: Example Sep 05 02:17:53.813599 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.803740 2555 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 05 02:17:53.813599 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.803743 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 05 02:17:53.813599 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.803746 2555 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 05 02:17:53.813599 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.803750 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 05 02:17:53.813599 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.803753 2555 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 05 02:17:53.813599 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.803756 2555 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 05 02:17:53.813599 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.803759 2555 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 05 02:17:53.813599 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.803762 2555 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 05 02:17:53.813599 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.803764 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 05 02:17:53.813599 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.803767 2555 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 05 02:17:53.813599 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.803770 2555 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 05 02:17:53.813599 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.803772 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 05 02:17:53.813599 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.803775 2555 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 05 02:17:53.814135 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.803778 2555 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 05 02:17:53.814135 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.803780 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 05 02:17:53.814135 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.803783 2555 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 05 02:17:53.814135 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.803785 2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 05 02:17:53.814135 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.803788 2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 05 02:17:53.814135 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.803790 2555 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 05 02:17:53.814135 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.803793 2555 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 05 02:17:53.814135 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.803796 2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 05 02:17:53.814135 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.803798 2555 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 05 02:17:53.814135 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.803802 2555 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 05 02:17:53.814135 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.803805 2555 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 05 02:17:53.814135 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.803808 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 05 02:17:53.814135 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.803811 2555 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 05 02:17:53.814135 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.803813 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 05 02:17:53.814135 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.803816 2555 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 05 02:17:53.814135 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.803818 2555 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 05 02:17:53.814135 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.803820 2555 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 05 02:17:53.814135 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.803823 2555 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 05 02:17:53.814135 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.803826 2555 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 05 02:17:53.814615 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.803829 2555 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 05 02:17:53.814615 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.803831 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 05 02:17:53.814615 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.803834 2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 05 02:17:53.814615 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:53.803843 2555 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 05 02:17:53.814615 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:53.811061 2555 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Sep 05 02:17:53.814615 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:53.811078 2555 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Sep 05 02:17:53.814615 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:53.811097 2555 watchdog_linux.go:95] "Systemd watchdog is not enabled" Sep 05 02:17:53.814615 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:53.811102 2555 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Sep 05 02:17:53.814615 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.811157 2555 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 05 02:17:53.814615 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.811162 2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 05 02:17:53.814615 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.811165 2555 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 05 02:17:53.814615 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.811168 2555 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 05 02:17:53.814615 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.811170 2555 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 05 02:17:53.814615 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.811173 2555 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 05 02:17:53.815000 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.811176 2555 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 05 02:17:53.815000 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.811179 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 05 02:17:53.815000 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.811181 2555 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 05 02:17:53.815000 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.811184 2555 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 05 02:17:53.815000 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.811186 2555 feature_gate.go:328] unrecognized feature gate: Example Sep 05 02:17:53.815000 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.811189 2555 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 05 02:17:53.815000 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.811192 2555 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 05 02:17:53.815000 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.811194 2555 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 05 02:17:53.815000 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.811197 2555 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 05 02:17:53.815000 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.811200 2555 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 05 02:17:53.815000 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.811202 2555 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 05 02:17:53.815000 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.811205 2555 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 05 02:17:53.815000 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.811207 2555 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 05 02:17:53.815000 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.811210 2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 05 02:17:53.815000 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.811213 2555 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 05 02:17:53.815000 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.811215 2555 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 05 02:17:53.815000 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.811218 2555 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 05 02:17:53.815000 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.811220 2555 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 05 02:17:53.815000 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.811223 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 05 02:17:53.815000 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.811226 2555 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 05 02:17:53.815699 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.811228 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 05 02:17:53.815699 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.811231 2555 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 05 02:17:53.815699 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.811234 2555 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 05 02:17:53.815699 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.811239 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 05 02:17:53.815699 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.811242 2555 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 05 02:17:53.815699 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.811244 2555 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 05 02:17:53.815699 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.811247 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 05 02:17:53.815699 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.811249 2555 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 05 02:17:53.815699 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.811252 2555 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 05 02:17:53.815699 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.811254 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 05 02:17:53.815699 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.811257 2555 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 05 02:17:53.815699 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.811260 2555 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 05 02:17:53.815699 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.811262 2555 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 05 02:17:53.815699 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.811265 2555 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 05 02:17:53.815699 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.811268 2555 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 05 02:17:53.815699 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.811271 2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 05 02:17:53.815699 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.811273 2555 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 05 02:17:53.815699 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.811276 2555 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 05 02:17:53.815699 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.811279 2555 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 05 02:17:53.815699 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.811281 2555 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 05 02:17:53.816392 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.811284 2555 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 05 02:17:53.816392 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.811287 2555 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 05 02:17:53.816392 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.811290 2555 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 05 02:17:53.816392 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.811293 2555 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 05 02:17:53.816392 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.811296 2555 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 05 02:17:53.816392 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.811299 2555 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 05 02:17:53.816392 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.811301 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 05 02:17:53.816392 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.811304 2555 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 05 02:17:53.816392 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.811307 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 05 02:17:53.816392 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.811309 2555 feature_gate.go:328] unrecognized feature gate: Example2 Sep 05 02:17:53.816392 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.811312 2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 05 02:17:53.816392 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.811315 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 05 02:17:53.816392 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.811319 2555 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 05 02:17:53.816392 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.811322 2555 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 05 02:17:53.816392 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.811326 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 05 02:17:53.816392 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.811329 2555 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 05 02:17:53.816392 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.811333 2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 05 02:17:53.816392 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.811336 2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 05 02:17:53.816392 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.811338 2555 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 05 02:17:53.817068 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.811341 2555 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 05 02:17:53.817068 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.811344 2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 05 02:17:53.817068 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.811346 2555 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 05 02:17:53.817068 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.811349 2555 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 05 02:17:53.817068 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.811352 2555 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 05 02:17:53.817068 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.811354 2555 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 05 02:17:53.817068 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.811357 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 05 02:17:53.817068 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.811359 2555 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 05 02:17:53.817068 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.811362 2555 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 05 02:17:53.817068 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.811365 2555 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 05 02:17:53.817068 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.811367 2555 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 05 02:17:53.817068 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.811370 2555 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 05 02:17:53.817068 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.811372 2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 05 02:17:53.817068 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.811375 2555 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 05 02:17:53.817068 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.811378 2555 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 05 02:17:53.817068 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.811380 2555 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 05 02:17:53.817068 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.811383 2555 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 05 02:17:53.817068 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.811385 2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 05 02:17:53.817068 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.811388 2555 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 05 02:17:53.817671 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.811392 2555 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 05 02:17:53.817671 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.811395 2555 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 05 02:17:53.817671 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.811398 2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 05 02:17:53.817671 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.811401 2555 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 05 02:17:53.817671 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.811404 2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 05 02:17:53.817671 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.811407 2555 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 05 02:17:53.817671 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.811410 2555 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 05 02:17:53.817671 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.811413 2555 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 05 02:17:53.817671 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.811417 2555 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 05 02:17:53.817671 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.811421 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 05 02:17:53.817671 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.811424 2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 05 02:17:53.817671 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.811427 2555 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 05 02:17:53.817671 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.811430 2555 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 05 02:17:53.817671 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.811433 2555 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 05 02:17:53.817671 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.811435 2555 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 05 02:17:53.818097 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:53.811441 2555 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 05 02:17:53.818097 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.811556 2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 05 02:17:53.818097 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.811560 2555 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 05 02:17:53.818097 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.811563 2555 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 05 02:17:53.818097 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.811566 2555 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 05 02:17:53.818097 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.811569 2555 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 05 02:17:53.818097 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.811572 2555 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 05 02:17:53.818097 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.811575 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 05 02:17:53.818097 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.811578 2555 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 05 02:17:53.818097 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.811580 2555 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 05 02:17:53.818097 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.811583 2555 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 05 02:17:53.818097 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.811586 2555 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 05 02:17:53.818097 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.811588 2555 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 05 02:17:53.818097 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.811591 2555 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 05 02:17:53.818097 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.811593 2555 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 05 02:17:53.818476 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.811596 2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 05 02:17:53.818476 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.811598 2555 feature_gate.go:328] unrecognized feature gate: Example2 Sep 05 02:17:53.818476 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.811601 2555 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 05 02:17:53.818476 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.811604 2555 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 05 02:17:53.818476 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.811606 2555 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 05 02:17:53.818476 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.811609 2555 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 05 02:17:53.818476 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.811611 2555 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 05 02:17:53.818476 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.811614 2555 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 05 02:17:53.818476 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.811617 2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 05 02:17:53.818476 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.811620 2555 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 05 02:17:53.818476 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.811622 2555 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 05 02:17:53.818476 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.811625 2555 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 05 02:17:53.818476 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.811627 2555 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 05 02:17:53.818476 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.811630 2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 05 02:17:53.818476 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.811633 2555 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 05 02:17:53.818476 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.811635 2555 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 05 02:17:53.818476 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.811638 2555 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 05 02:17:53.818476 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.811641 2555 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 05 02:17:53.818476 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.811644 2555 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 05 02:17:53.819210 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.811648 2555 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 05 02:17:53.819210 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.811651 2555 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 05 02:17:53.819210 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.811653 2555 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 05 02:17:53.819210 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.811656 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 05 02:17:53.819210 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.811659 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 05 02:17:53.819210 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.811661 2555 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 05 02:17:53.819210 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.811664 2555 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 05 02:17:53.819210 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.811666 2555 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 05 02:17:53.819210 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.811669 2555 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 05 02:17:53.819210 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.811671 2555 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 05 02:17:53.819210 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.811673 2555 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 05 02:17:53.819210 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.811676 2555 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 05 02:17:53.819210 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.811679 2555 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 05 02:17:53.819210 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.811681 2555 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 05 02:17:53.819210 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.811684 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 05 02:17:53.819210 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.811686 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 05 02:17:53.819210 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.811688 2555 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 05 02:17:53.819210 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.811691 2555 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 05 02:17:53.819210 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.811694 2555 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 05 02:17:53.819210 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.811697 2555 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 05 02:17:53.819812 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.811699 2555 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 05 02:17:53.819812 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.811702 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 05 02:17:53.819812 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.811704 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 05 02:17:53.819812 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.811707 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 05 02:17:53.819812 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.811710 2555 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 05 02:17:53.819812 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.811712 2555 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 05 02:17:53.819812 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.811716 2555 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 05 02:17:53.819812 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.811719 2555 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 05 02:17:53.819812 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.811723 2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 05 02:17:53.819812 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.811726 2555 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 05 02:17:53.819812 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.811729 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 05 02:17:53.819812 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.811731 2555 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 05 02:17:53.819812 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.811734 2555 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 05 02:17:53.819812 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.811737 2555 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 05 02:17:53.819812 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.811739 2555 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 05 02:17:53.819812 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.811742 2555 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 05 02:17:53.819812 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.811744 2555 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 05 02:17:53.819812 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.811747 2555 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 05 02:17:53.819812 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.811749 2555 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 05 02:17:53.819812 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.811752 2555 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 05 02:17:53.820624 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.811754 2555 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 05 02:17:53.820624 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.811757 2555 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 05 02:17:53.820624 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.811760 2555 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 05 02:17:53.820624 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.811762 2555 feature_gate.go:328] unrecognized feature gate: Example Sep 05 02:17:53.820624 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.811765 2555 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 05 02:17:53.820624 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.811768 2555 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 05 02:17:53.820624 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.811771 2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 05 02:17:53.820624 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.811773 2555 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 05 02:17:53.820624 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.811776 2555 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 05 02:17:53.820624 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.811778 2555 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 05 02:17:53.820624 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.811781 2555 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 05 02:17:53.820624 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.811783 2555 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 05 02:17:53.820624 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.811786 2555 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 05 02:17:53.820624 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.811789 2555 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 05 02:17:53.820624 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.811791 2555 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 05 02:17:53.820624 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.811794 2555 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 05 02:17:53.820624 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.811797 2555 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 05 02:17:53.820624 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.811799 2555 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 05 02:17:53.820624 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.811802 2555 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 05 02:17:53.820624 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.811804 2555 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 05 02:17:53.821317 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.811807 2555 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 05 02:17:53.821317 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.811810 2555 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 05 02:17:53.821317 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.811813 2555 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 05 02:17:53.821317 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.811817 2555 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 05 02:17:53.821317 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.811820 2555 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 05 02:17:53.821317 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:53.811822 2555 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 05 02:17:53.821317 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:53.811827 2555 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 05 02:17:53.821317 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:53.811922 2555 server.go:962] "Client rotation is on, will bootstrap in background" Sep 05 02:17:53.821317 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:53.813839 2555 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Sep 05 02:17:53.821317 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:53.814864 2555 server.go:1019] "Starting client certificate rotation" Sep 05 02:17:53.821317 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:53.814976 2555 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Sep 05 02:17:53.821317 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:53.815083 2555 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Sep 05 02:17:53.821317 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:53.817489 2555 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Sep 05 02:17:53.821656 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:53.818547 2555 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Sep 05 02:17:53.834183 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:53.834164 2555 log.go:25] "Validated CRI v1 runtime API" Sep 05 02:17:53.837826 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:53.837812 2555 log.go:25] "Validated CRI v1 image API" Sep 05 02:17:53.838770 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:53.838747 2555 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Sep 05 02:17:53.845122 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:53.845101 2555 fs.go:135] Filesystem UUIDs: map[46dcd29d-99e3-4459-b9dd-01ea9933b76c:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 f21e0f7c-c163-4cb4-9fd3-529bd606d663:/dev/nvme0n1p3] Sep 05 02:17:53.845213 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:53.845121 2555 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Sep 05 02:17:53.846371 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:53.846350 2555 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Sep 05 02:17:53.850235 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:53.850121 2555 manager.go:216] Machine: {Timestamp:2026-09-05 02:17:53.848788092 +0000 UTC m=+0.350925700 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3098642 MemoryCapacity:33164484608 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2511a5abf106098e01ef3843a20c38 SystemUUID:ec2511a5-abf1-0609-8e01-ef3843a20c38 BootID:13d3aa5c-f492-4ffc-bb7c-1519fed6b467 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582242304 Type:vfs Inodes:4048399 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582242304 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:d0:a1:8c:f3:2b Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:d0:a1:8c:f3:2b Speed:0 Mtu:9001} {Name:ovs-system MacAddress:3e:4f:ce:79:53:12 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164484608 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Sep 05 02:17:53.850235 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:53.850225 2555 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Sep 05 02:17:53.850390 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:53.850327 2555 manager.go:232] Version: {KernelVersion:5.14.0-570.138.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260901-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Sep 05 02:17:53.853830 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:53.853807 2555 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Sep 05 02:17:53.853967 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:53.853832 2555 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-133-250.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Sep 05 02:17:53.855159 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:53.855150 2555 topology_manager.go:138] "Creating topology manager with none policy" Sep 05 02:17:53.855193 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:53.855162 2555 container_manager_linux.go:309] "Creating device plugin manager" Sep 05 02:17:53.855193 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:53.855170 2555 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Sep 05 02:17:53.855940 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:53.855931 2555 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Sep 05 02:17:53.866506 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:53.866482 2555 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-nftkq" Sep 05 02:17:53.873640 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:53.873622 2555 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-nftkq" Sep 05 02:17:53.921540 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:53.921524 2555 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Sep 05 02:17:53.926442 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:53.926428 2555 state_mem.go:36] "Initialized new in-memory state store" Sep 05 02:17:53.926574 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:53.926564 2555 server.go:1240] "Using root directory" path="/var/lib/kubelet" Sep 05 02:17:53.926611 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:53.926594 2555 kubelet.go:486] "Attempting to sync node with API server" Sep 05 02:17:53.926611 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:53.926607 2555 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Sep 05 02:17:53.926665 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:53.926622 2555 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Sep 05 02:17:53.926665 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:53.926634 2555 kubelet.go:398] "Adding apiserver pod source" Sep 05 02:17:53.926665 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:53.926646 2555 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Sep 05 02:17:53.927012 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:53.927000 2555 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Sep 05 02:17:53.927087 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:53.927057 2555 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Sep 05 02:17:53.929697 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:53.929679 2555 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.12-5.rhaos4.21.gitd1ec63c.el9" apiVersion="v1" Sep 05 02:17:53.931936 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:53.931920 2555 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Sep 05 02:17:53.931999 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:53.931951 2555 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Sep 05 02:17:53.932122 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:53.932110 2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Sep 05 02:17:53.932173 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:53.932125 2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Sep 05 02:17:53.932173 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:53.932133 2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Sep 05 02:17:53.932173 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:53.932141 2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Sep 05 02:17:53.932173 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:53.932151 2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Sep 05 02:17:53.932173 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:53.932160 2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Sep 05 02:17:53.932707 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:53.932694 2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Sep 05 02:17:53.932707 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:53.932704 2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Sep 05 02:17:53.932707 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:53.932711 2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Sep 05 02:17:53.932872 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:53.932717 2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Sep 05 02:17:53.932872 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:53.932731 2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Sep 05 02:17:53.932872 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:53.932739 2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Sep 05 02:17:53.934327 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:53.934313 2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Sep 05 02:17:53.934327 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:53.934324 2555 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Sep 05 02:17:53.938087 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:53.938068 2555 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Sep 05 02:17:53.938087 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:53.938087 2555 server.go:1268] "Started kubelet" Sep 05 02:17:53.938211 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:53.938168 2555 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Sep 05 02:17:53.941471 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:53.941430 2555 server_v1.go:49] "podresources" method="list" useActivePods=true Sep 05 02:17:53.942403 ip-10-0-133-250 systemd[1]: Started Kubernetes Kubelet. Sep 05 02:17:53.942733 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:53.942671 2555 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Sep 05 02:17:53.942788 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:53.942758 2555 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Sep 05 02:17:53.945724 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:53.945702 2555 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-133-250.ec2.internal" not found Sep 05 02:17:53.946945 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:53.946921 2555 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Sep 05 02:17:53.947186 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:53.947173 2555 server.go:310] "Adding debug handlers to kubelet server" Sep 05 02:17:53.947394 ip-10-0-133-250 kubenswrapper[2555]: E0905 02:17:53.947376 2555 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Sep 05 02:17:53.949396 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:53.949381 2555 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Sep 05 02:17:53.949843 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:53.949830 2555 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Sep 05 02:17:53.949917 ip-10-0-133-250 kubenswrapper[2555]: E0905 02:17:53.949897 2555 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-250.ec2.internal\" not found" Sep 05 02:17:53.950575 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:53.950557 2555 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Sep 05 02:17:53.950654 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:53.950560 2555 volume_manager.go:311] "The desired_state_of_world populator starts" Sep 05 02:17:53.950654 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:53.950582 2555 factory.go:55] Registering systemd factory Sep 05 02:17:53.950654 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:53.950594 2555 factory.go:223] Registration of the systemd container factory successfully Sep 05 02:17:53.950654 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:53.950587 2555 volume_manager.go:313] "Starting Kubelet Volume Manager" Sep 05 02:17:53.950787 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:53.950741 2555 reconstruct.go:97] "Volume reconstruction finished" Sep 05 02:17:53.950787 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:53.950749 2555 reconciler.go:29] "Reconciler: start to sync state" Sep 05 02:17:53.950847 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:53.950790 2555 factory.go:153] Registering CRI-O factory Sep 05 02:17:53.950847 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:53.950804 2555 factory.go:223] Registration of the crio container factory successfully Sep 05 02:17:53.950902 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:53.950856 2555 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Sep 05 02:17:53.950902 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:53.950869 2555 factory.go:103] Registering Raw factory Sep 05 02:17:53.950902 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:53.950879 2555 manager.go:1196] Started watching for new ooms in manager Sep 05 02:17:53.951254 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:53.951243 2555 manager.go:349] Starting recovery of all containers Sep 05 02:17:53.952010 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:53.951984 2555 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Sep 05 02:17:53.955124 ip-10-0-133-250 kubenswrapper[2555]: E0905 02:17:53.954952 2555 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-133-250.ec2.internal\" not found" node="ip-10-0-133-250.ec2.internal" Sep 05 02:17:53.961101 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:53.961039 2555 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-133-250.ec2.internal" not found Sep 05 02:17:53.962153 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:53.962135 2555 manager.go:354] Recovery completed Sep 05 02:17:53.966453 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:53.966440 2555 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 05 02:17:53.968354 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:53.968339 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-250.ec2.internal" event="NodeHasSufficientMemory" Sep 05 02:17:53.968630 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:53.968616 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-250.ec2.internal" event="NodeHasNoDiskPressure" Sep 05 02:17:53.968665 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:53.968637 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-250.ec2.internal" event="NodeHasSufficientPID" Sep 05 02:17:53.969299 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:53.969280 2555 cpu_manager.go:222] "Starting CPU manager" policy="none" Sep 05 02:17:53.969299 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:53.969297 2555 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 05 02:17:53.969448 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:53.969296 2555 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Sep 05 02:17:53.969448 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:53.969375 2555 state_mem.go:36] "Initialized new in-memory state store" Sep 05 02:17:53.970031 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:53.970000 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-250.ec2.internal" event="NodeHasSufficientMemory" Sep 05 02:17:53.970091 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:53.970055 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-250.ec2.internal" event="NodeHasNoDiskPressure" Sep 05 02:17:53.970091 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:53.970068 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-250.ec2.internal" event="NodeHasSufficientPID" Sep 05 02:17:53.971231 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:53.971220 2555 policy_none.go:49] "None policy: Start" Sep 05 02:17:53.971269 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:53.971236 2555 memory_manager.go:187] "Starting memorymanager" policy="None" Sep 05 02:17:53.971269 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:53.971245 2555 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Sep 05 02:17:53.973004 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:53.972994 2555 policy_none.go:47] "Start" Sep 05 02:17:54.004560 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:54.004544 2555 manager.go:337] "Starting Device Plugin manager" Sep 05 02:17:54.030877 ip-10-0-133-250 kubenswrapper[2555]: E0905 02:17:54.004600 2555 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Sep 05 02:17:54.030877 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:54.004614 2555 server.go:87] "Starting device plugin registration server" Sep 05 02:17:54.030877 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:54.004885 2555 eviction_manager.go:189] "Eviction manager: starting control loop" Sep 05 02:17:54.030877 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:54.004895 2555 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Sep 05 02:17:54.030877 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:54.004985 2555 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Sep 05 02:17:54.030877 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:54.005090 2555 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Sep 05 02:17:54.030877 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:54.005100 2555 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Sep 05 02:17:54.030877 ip-10-0-133-250 kubenswrapper[2555]: E0905 02:17:54.005962 2555 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Sep 05 02:17:54.030877 ip-10-0-133-250 kubenswrapper[2555]: E0905 02:17:54.006007 2555 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-133-250.ec2.internal\" not found" Sep 05 02:17:54.030877 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:54.019427 2555 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-133-250.ec2.internal" not found Sep 05 02:17:54.076126 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:54.076056 2555 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Sep 05 02:17:54.077213 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:54.077192 2555 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Sep 05 02:17:54.077290 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:54.077248 2555 status_manager.go:244] "Starting to sync pod status with apiserver" Sep 05 02:17:54.077290 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:54.077272 2555 kubelet.go:2448] "Starting kubelet main sync loop" Sep 05 02:17:54.077384 ip-10-0-133-250 kubenswrapper[2555]: E0905 02:17:54.077316 2555 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Sep 05 02:17:54.079613 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:54.079590 2555 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Sep 05 02:17:54.105417 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:54.105398 2555 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 05 02:17:54.106231 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:54.106217 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-250.ec2.internal" event="NodeHasSufficientMemory" Sep 05 02:17:54.106304 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:54.106243 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-250.ec2.internal" event="NodeHasNoDiskPressure" Sep 05 02:17:54.106304 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:54.106253 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-250.ec2.internal" event="NodeHasSufficientPID" Sep 05 02:17:54.106304 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:54.106276 2555 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-133-250.ec2.internal" Sep 05 02:17:54.114623 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:54.114604 2555 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-133-250.ec2.internal" Sep 05 02:17:54.114714 ip-10-0-133-250 kubenswrapper[2555]: E0905 02:17:54.114626 2555 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-133-250.ec2.internal\": node \"ip-10-0-133-250.ec2.internal\" not found" Sep 05 02:17:54.177731 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:54.177696 2555 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-250.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-133-250.ec2.internal"] Sep 05 02:17:54.180055 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:54.180039 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-250.ec2.internal" Sep 05 02:17:54.181915 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:54.181901 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-250.ec2.internal" Sep 05 02:17:54.198567 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:54.198550 2555 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-250.ec2.internal" Sep 05 02:17:54.202379 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:54.202365 2555 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-250.ec2.internal" Sep 05 02:17:54.213830 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:54.213809 2555 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Sep 05 02:17:54.213955 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:54.213943 2555 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Sep 05 02:17:54.253229 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:54.253204 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ab785fdfa0a233510495d26882d5258b-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-250.ec2.internal\" (UID: \"ab785fdfa0a233510495d26882d5258b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-250.ec2.internal" Sep 05 02:17:54.253337 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:54.253237 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ab785fdfa0a233510495d26882d5258b-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-250.ec2.internal\" (UID: \"ab785fdfa0a233510495d26882d5258b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-250.ec2.internal" Sep 05 02:17:54.253337 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:54.253282 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/ccb165d55e894605f0ca2c828f2460a9-config\") pod \"kube-apiserver-proxy-ip-10-0-133-250.ec2.internal\" (UID: \"ccb165d55e894605f0ca2c828f2460a9\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-250.ec2.internal" Sep 05 02:17:54.354310 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:54.354244 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ab785fdfa0a233510495d26882d5258b-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-250.ec2.internal\" (UID: \"ab785fdfa0a233510495d26882d5258b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-250.ec2.internal" Sep 05 02:17:54.354310 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:54.354271 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ab785fdfa0a233510495d26882d5258b-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-250.ec2.internal\" (UID: \"ab785fdfa0a233510495d26882d5258b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-250.ec2.internal" Sep 05 02:17:54.354442 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:54.354319 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ab785fdfa0a233510495d26882d5258b-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-250.ec2.internal\" (UID: \"ab785fdfa0a233510495d26882d5258b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-250.ec2.internal" Sep 05 02:17:54.354442 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:54.354348 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/ccb165d55e894605f0ca2c828f2460a9-config\") pod \"kube-apiserver-proxy-ip-10-0-133-250.ec2.internal\" (UID: \"ccb165d55e894605f0ca2c828f2460a9\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-250.ec2.internal" Sep 05 02:17:54.354442 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:54.354357 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ab785fdfa0a233510495d26882d5258b-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-250.ec2.internal\" (UID: \"ab785fdfa0a233510495d26882d5258b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-250.ec2.internal" Sep 05 02:17:54.354442 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:54.354393 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/ccb165d55e894605f0ca2c828f2460a9-config\") pod \"kube-apiserver-proxy-ip-10-0-133-250.ec2.internal\" (UID: \"ccb165d55e894605f0ca2c828f2460a9\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-250.ec2.internal" Sep 05 02:17:54.516822 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:54.516782 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-250.ec2.internal" Sep 05 02:17:54.517924 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:54.517908 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-250.ec2.internal" Sep 05 02:17:54.814554 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:54.814527 2555 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Sep 05 02:17:54.815052 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:54.814680 2555 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Sep 05 02:17:54.815052 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:54.814705 2555 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Sep 05 02:17:54.815052 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:54.814749 2555 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Sep 05 02:17:54.925195 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:54.925120 2555 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-04 02:12:54 +0000 UTC" deadline="2028-05-01 00:49:25.456834627 +0000 UTC" Sep 05 02:17:54.925195 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:54.925192 2555 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14494h31m30.531645934s" Sep 05 02:17:54.927280 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:54.927264 2555 apiserver.go:52] "Watching apiserver" Sep 05 02:17:54.934090 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:54.934071 2555 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Sep 05 02:17:54.935544 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:54.935514 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-ghjcr","kube-system/konnectivity-agent-nvjx5","kube-system/kube-apiserver-proxy-ip-10-0-133-250.ec2.internal","openshift-cluster-node-tuning-operator/tuned-qf6xm","openshift-image-registry/node-ca-4gpmf","openshift-multus/multus-additional-cni-plugins-v4hcb","openshift-multus/network-metrics-daemon-2x2gr","openshift-network-diagnostics/network-check-target-zt7r6","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h9kcl","openshift-dns/node-resolver-lq8k6","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-250.ec2.internal","openshift-multus/multus-n5fs5","openshift-network-operator/iptables-alerter-bz7s2","openshift-ovn-kubernetes/ovnkube-node-mz2wx"] Sep 05 02:17:54.938138 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:54.938119 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ghjcr" Sep 05 02:17:54.938217 ip-10-0-133-250 kubenswrapper[2555]: E0905 02:17:54.938182 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ghjcr" podUID="bd4a3b61-19e3-4177-b012-e8ec8048aed1" Sep 05 02:17:54.940100 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:54.940086 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-nvjx5" Sep 05 02:17:54.942158 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:54.942139 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-qf6xm" Sep 05 02:17:54.942553 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:54.942535 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-jqjw2\"" Sep 05 02:17:54.942617 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:54.942580 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Sep 05 02:17:54.942670 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:54.942617 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Sep 05 02:17:54.944270 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:54.944253 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-4gpmf" Sep 05 02:17:54.944654 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:54.944637 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Sep 05 02:17:54.944759 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:54.944680 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Sep 05 02:17:54.944901 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:54.944886 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-2lmgp\"" Sep 05 02:17:54.946314 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:54.946299 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-v4hcb" Sep 05 02:17:54.946396 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:54.946362 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Sep 05 02:17:54.946719 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:54.946703 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-hppp9\"" Sep 05 02:17:54.946784 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:54.946752 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Sep 05 02:17:54.946861 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:54.946846 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Sep 05 02:17:54.948498 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:54.948484 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2x2gr" Sep 05 02:17:54.948561 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:54.948523 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Sep 05 02:17:54.948561 ip-10-0-133-250 kubenswrapper[2555]: E0905 02:17:54.948546 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2x2gr" podUID="2fc3d6af-c656-4be0-8188-317d2dde7a6b" Sep 05 02:17:54.948561 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:54.948487 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Sep 05 02:17:54.948877 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:54.948863 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Sep 05 02:17:54.948996 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:54.948980 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Sep 05 02:17:54.948996 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:54.948990 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Sep 05 02:17:54.949148 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:54.949135 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-5gjhl\"" Sep 05 02:17:54.950087 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:54.950073 2555 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Sep 05 02:17:54.950752 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:54.950738 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zt7r6" Sep 05 02:17:54.950860 ip-10-0-133-250 kubenswrapper[2555]: E0905 02:17:54.950844 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zt7r6" podUID="ba04f298-aebd-463b-940e-8a446b160645" Sep 05 02:17:54.952942 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:54.952926 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h9kcl" Sep 05 02:17:54.955396 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:54.955376 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Sep 05 02:17:54.955512 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:54.955406 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Sep 05 02:17:54.955512 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:54.955427 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Sep 05 02:17:54.955621 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:54.955561 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-xs6k7\"" Sep 05 02:17:54.955691 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:54.955675 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-lq8k6" Sep 05 02:17:54.956397 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:54.956174 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/3f060a3e-d7fc-4886-bca4-7564087e02ac-konnectivity-ca\") pod \"konnectivity-agent-nvjx5\" (UID: \"3f060a3e-d7fc-4886-bca4-7564087e02ac\") " pod="kube-system/konnectivity-agent-nvjx5" Sep 05 02:17:54.956397 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:54.956195 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2fc3d6af-c656-4be0-8188-317d2dde7a6b-metrics-certs\") pod \"network-metrics-daemon-2x2gr\" (UID: \"2fc3d6af-c656-4be0-8188-317d2dde7a6b\") " pod="openshift-multus/network-metrics-daemon-2x2gr" Sep 05 02:17:54.956397 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:54.956211 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/bd4a3b61-19e3-4177-b012-e8ec8048aed1-kubelet-config\") pod \"global-pull-secret-syncer-ghjcr\" (UID: \"bd4a3b61-19e3-4177-b012-e8ec8048aed1\") " pod="kube-system/global-pull-secret-syncer-ghjcr" Sep 05 02:17:54.956397 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:54.956226 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4ddfb9fd-38a7-4b2d-bb70-5e5c4494a02d-lib-modules\") pod \"tuned-qf6xm\" (UID: \"4ddfb9fd-38a7-4b2d-bb70-5e5c4494a02d\") " pod="openshift-cluster-node-tuning-operator/tuned-qf6xm" Sep 05 02:17:54.956397 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:54.956255 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zg66l\" (UniqueName: \"kubernetes.io/projected/4ddfb9fd-38a7-4b2d-bb70-5e5c4494a02d-kube-api-access-zg66l\") pod \"tuned-qf6xm\" (UID: \"4ddfb9fd-38a7-4b2d-bb70-5e5c4494a02d\") " pod="openshift-cluster-node-tuning-operator/tuned-qf6xm" Sep 05 02:17:54.956397 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:54.956280 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/9fccb273-b727-42f4-8e22-50f62446778f-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-v4hcb\" (UID: \"9fccb273-b727-42f4-8e22-50f62446778f\") " pod="openshift-multus/multus-additional-cni-plugins-v4hcb" Sep 05 02:17:54.956397 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:54.956308 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/7ff62e18-55f4-4bdf-83b2-5e0a4f419ad4-etc-selinux\") pod \"aws-ebs-csi-driver-node-h9kcl\" (UID: \"7ff62e18-55f4-4bdf-83b2-5e0a4f419ad4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h9kcl" Sep 05 02:17:54.956397 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:54.956331 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/7ff62e18-55f4-4bdf-83b2-5e0a4f419ad4-sys-fs\") pod \"aws-ebs-csi-driver-node-h9kcl\" (UID: \"7ff62e18-55f4-4bdf-83b2-5e0a4f419ad4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h9kcl" Sep 05 02:17:54.956397 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:54.956351 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/3f060a3e-d7fc-4886-bca4-7564087e02ac-agent-certs\") pod \"konnectivity-agent-nvjx5\" (UID: \"3f060a3e-d7fc-4886-bca4-7564087e02ac\") " pod="kube-system/konnectivity-agent-nvjx5" Sep 05 02:17:54.956397 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:54.956388 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/bd4a3b61-19e3-4177-b012-e8ec8048aed1-dbus\") pod \"global-pull-secret-syncer-ghjcr\" (UID: \"bd4a3b61-19e3-4177-b012-e8ec8048aed1\") " pod="kube-system/global-pull-secret-syncer-ghjcr" Sep 05 02:17:54.956819 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:54.956410 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/4ddfb9fd-38a7-4b2d-bb70-5e5c4494a02d-etc-sysconfig\") pod \"tuned-qf6xm\" (UID: \"4ddfb9fd-38a7-4b2d-bb70-5e5c4494a02d\") " pod="openshift-cluster-node-tuning-operator/tuned-qf6xm" Sep 05 02:17:54.956885 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:54.956427 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9fccb273-b727-42f4-8e22-50f62446778f-tuning-conf-dir\") pod \"multus-additional-cni-plugins-v4hcb\" (UID: \"9fccb273-b727-42f4-8e22-50f62446778f\") " pod="openshift-multus/multus-additional-cni-plugins-v4hcb" Sep 05 02:17:54.956924 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:54.956910 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/9fccb273-b727-42f4-8e22-50f62446778f-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-v4hcb\" (UID: \"9fccb273-b727-42f4-8e22-50f62446778f\") " pod="openshift-multus/multus-additional-cni-plugins-v4hcb" Sep 05 02:17:54.956953 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:54.956935 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4cdt9\" (UniqueName: \"kubernetes.io/projected/c2dc61db-cd5c-4972-b21e-633ad3b71ef5-kube-api-access-4cdt9\") pod \"node-ca-4gpmf\" (UID: \"c2dc61db-cd5c-4972-b21e-633ad3b71ef5\") " pod="openshift-image-registry/node-ca-4gpmf" Sep 05 02:17:54.956991 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:54.956959 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/bd4a3b61-19e3-4177-b012-e8ec8048aed1-original-pull-secret\") pod \"global-pull-secret-syncer-ghjcr\" (UID: \"bd4a3b61-19e3-4177-b012-e8ec8048aed1\") " pod="kube-system/global-pull-secret-syncer-ghjcr" Sep 05 02:17:54.956991 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:54.956982 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/4ddfb9fd-38a7-4b2d-bb70-5e5c4494a02d-run\") pod \"tuned-qf6xm\" (UID: \"4ddfb9fd-38a7-4b2d-bb70-5e5c4494a02d\") " pod="openshift-cluster-node-tuning-operator/tuned-qf6xm" Sep 05 02:17:54.957079 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:54.957005 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9fccb273-b727-42f4-8e22-50f62446778f-system-cni-dir\") pod \"multus-additional-cni-plugins-v4hcb\" (UID: \"9fccb273-b727-42f4-8e22-50f62446778f\") " pod="openshift-multus/multus-additional-cni-plugins-v4hcb" Sep 05 02:17:54.957079 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:54.957045 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/7ff62e18-55f4-4bdf-83b2-5e0a4f419ad4-kubelet-dir\") pod \"aws-ebs-csi-driver-node-h9kcl\" (UID: \"7ff62e18-55f4-4bdf-83b2-5e0a4f419ad4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h9kcl" Sep 05 02:17:54.957079 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:54.957069 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5tk2r\" (UniqueName: \"kubernetes.io/projected/7ff62e18-55f4-4bdf-83b2-5e0a4f419ad4-kube-api-access-5tk2r\") pod \"aws-ebs-csi-driver-node-h9kcl\" (UID: \"7ff62e18-55f4-4bdf-83b2-5e0a4f419ad4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h9kcl" Sep 05 02:17:54.957202 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:54.957095 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2gt66\" (UniqueName: \"kubernetes.io/projected/2fc3d6af-c656-4be0-8188-317d2dde7a6b-kube-api-access-2gt66\") pod \"network-metrics-daemon-2x2gr\" (UID: \"2fc3d6af-c656-4be0-8188-317d2dde7a6b\") " pod="openshift-multus/network-metrics-daemon-2x2gr" Sep 05 02:17:54.957202 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:54.957119 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/4ddfb9fd-38a7-4b2d-bb70-5e5c4494a02d-etc-sysctl-d\") pod \"tuned-qf6xm\" (UID: \"4ddfb9fd-38a7-4b2d-bb70-5e5c4494a02d\") " pod="openshift-cluster-node-tuning-operator/tuned-qf6xm" Sep 05 02:17:54.957202 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:54.957140 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/4ddfb9fd-38a7-4b2d-bb70-5e5c4494a02d-etc-systemd\") pod \"tuned-qf6xm\" (UID: \"4ddfb9fd-38a7-4b2d-bb70-5e5c4494a02d\") " pod="openshift-cluster-node-tuning-operator/tuned-qf6xm" Sep 05 02:17:54.957202 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:54.957160 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4ddfb9fd-38a7-4b2d-bb70-5e5c4494a02d-sys\") pod \"tuned-qf6xm\" (UID: \"4ddfb9fd-38a7-4b2d-bb70-5e5c4494a02d\") " pod="openshift-cluster-node-tuning-operator/tuned-qf6xm" Sep 05 02:17:54.957375 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:54.957197 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/4ddfb9fd-38a7-4b2d-bb70-5e5c4494a02d-etc-tuned\") pod \"tuned-qf6xm\" (UID: \"4ddfb9fd-38a7-4b2d-bb70-5e5c4494a02d\") " pod="openshift-cluster-node-tuning-operator/tuned-qf6xm" Sep 05 02:17:54.957375 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:54.957224 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4ddfb9fd-38a7-4b2d-bb70-5e5c4494a02d-tmp\") pod \"tuned-qf6xm\" (UID: \"4ddfb9fd-38a7-4b2d-bb70-5e5c4494a02d\") " pod="openshift-cluster-node-tuning-operator/tuned-qf6xm" Sep 05 02:17:54.957375 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:54.957254 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wqnrh\" (UniqueName: \"kubernetes.io/projected/ba04f298-aebd-463b-940e-8a446b160645-kube-api-access-wqnrh\") pod \"network-check-target-zt7r6\" (UID: \"ba04f298-aebd-463b-940e-8a446b160645\") " pod="openshift-network-diagnostics/network-check-target-zt7r6" Sep 05 02:17:54.957375 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:54.957275 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c2dc61db-cd5c-4972-b21e-633ad3b71ef5-host\") pod \"node-ca-4gpmf\" (UID: \"c2dc61db-cd5c-4972-b21e-633ad3b71ef5\") " pod="openshift-image-registry/node-ca-4gpmf" Sep 05 02:17:54.957375 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:54.957291 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/4ddfb9fd-38a7-4b2d-bb70-5e5c4494a02d-etc-modprobe-d\") pod \"tuned-qf6xm\" (UID: \"4ddfb9fd-38a7-4b2d-bb70-5e5c4494a02d\") " pod="openshift-cluster-node-tuning-operator/tuned-qf6xm" Sep 05 02:17:54.957375 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:54.957319 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4ddfb9fd-38a7-4b2d-bb70-5e5c4494a02d-etc-kubernetes\") pod \"tuned-qf6xm\" (UID: \"4ddfb9fd-38a7-4b2d-bb70-5e5c4494a02d\") " pod="openshift-cluster-node-tuning-operator/tuned-qf6xm" Sep 05 02:17:54.957375 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:54.957357 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zlkm9\" (UniqueName: \"kubernetes.io/projected/9fccb273-b727-42f4-8e22-50f62446778f-kube-api-access-zlkm9\") pod \"multus-additional-cni-plugins-v4hcb\" (UID: \"9fccb273-b727-42f4-8e22-50f62446778f\") " pod="openshift-multus/multus-additional-cni-plugins-v4hcb" Sep 05 02:17:54.957673 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:54.957400 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/7ff62e18-55f4-4bdf-83b2-5e0a4f419ad4-socket-dir\") pod \"aws-ebs-csi-driver-node-h9kcl\" (UID: \"7ff62e18-55f4-4bdf-83b2-5e0a4f419ad4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h9kcl" Sep 05 02:17:54.957673 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:54.957425 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/7ff62e18-55f4-4bdf-83b2-5e0a4f419ad4-registration-dir\") pod \"aws-ebs-csi-driver-node-h9kcl\" (UID: \"7ff62e18-55f4-4bdf-83b2-5e0a4f419ad4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h9kcl" Sep 05 02:17:54.957673 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:54.957460 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/c2dc61db-cd5c-4972-b21e-633ad3b71ef5-serviceca\") pod \"node-ca-4gpmf\" (UID: \"c2dc61db-cd5c-4972-b21e-633ad3b71ef5\") " pod="openshift-image-registry/node-ca-4gpmf" Sep 05 02:17:54.957673 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:54.957503 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/4ddfb9fd-38a7-4b2d-bb70-5e5c4494a02d-etc-sysctl-conf\") pod \"tuned-qf6xm\" (UID: \"4ddfb9fd-38a7-4b2d-bb70-5e5c4494a02d\") " pod="openshift-cluster-node-tuning-operator/tuned-qf6xm" Sep 05 02:17:54.957673 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:54.957528 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4ddfb9fd-38a7-4b2d-bb70-5e5c4494a02d-var-lib-kubelet\") pod \"tuned-qf6xm\" (UID: \"4ddfb9fd-38a7-4b2d-bb70-5e5c4494a02d\") " pod="openshift-cluster-node-tuning-operator/tuned-qf6xm" Sep 05 02:17:54.957673 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:54.957573 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4ddfb9fd-38a7-4b2d-bb70-5e5c4494a02d-host\") pod \"tuned-qf6xm\" (UID: \"4ddfb9fd-38a7-4b2d-bb70-5e5c4494a02d\") " pod="openshift-cluster-node-tuning-operator/tuned-qf6xm" Sep 05 02:17:54.957673 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:54.957599 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9fccb273-b727-42f4-8e22-50f62446778f-cni-binary-copy\") pod \"multus-additional-cni-plugins-v4hcb\" (UID: \"9fccb273-b727-42f4-8e22-50f62446778f\") " pod="openshift-multus/multus-additional-cni-plugins-v4hcb" Sep 05 02:17:54.957673 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:54.957628 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/7ff62e18-55f4-4bdf-83b2-5e0a4f419ad4-device-dir\") pod \"aws-ebs-csi-driver-node-h9kcl\" (UID: \"7ff62e18-55f4-4bdf-83b2-5e0a4f419ad4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h9kcl" Sep 05 02:17:54.957673 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:54.957656 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9fccb273-b727-42f4-8e22-50f62446778f-cnibin\") pod \"multus-additional-cni-plugins-v4hcb\" (UID: \"9fccb273-b727-42f4-8e22-50f62446778f\") " pod="openshift-multus/multus-additional-cni-plugins-v4hcb" Sep 05 02:17:54.957979 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:54.957944 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-n5fs5" Sep 05 02:17:54.958103 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:54.958085 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Sep 05 02:17:54.958220 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:54.958204 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-7z7q2\"" Sep 05 02:17:54.958307 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:54.958287 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Sep 05 02:17:54.960233 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:54.960213 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-bz7s2" Sep 05 02:17:54.960326 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:54.960237 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Sep 05 02:17:54.960389 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:54.960334 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-dwnwz\"" Sep 05 02:17:54.961505 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:54.961488 2555 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Sep 05 02:17:54.962385 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:54.962365 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Sep 05 02:17:54.962468 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:54.962452 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Sep 05 02:17:54.962534 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:54.962496 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Sep 05 02:17:54.962576 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:54.962550 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-mz2wx" Sep 05 02:17:54.962678 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:54.962665 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-vrp77\"" Sep 05 02:17:54.965307 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:54.965283 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Sep 05 02:17:54.965390 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:54.965293 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Sep 05 02:17:54.965390 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:54.965335 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Sep 05 02:17:54.965514 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:54.965480 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Sep 05 02:17:54.965604 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:54.965588 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Sep 05 02:17:54.965604 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:54.965596 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Sep 05 02:17:54.965678 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:54.965589 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-j4j6n\"" Sep 05 02:17:54.981604 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:54.981585 2555 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-q84x4" Sep 05 02:17:54.989632 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:54.989612 2555 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-q84x4" Sep 05 02:17:55.052464 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:55.052435 2555 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Sep 05 02:17:55.058324 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:55.058307 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c3aed02f-b69d-4743-8089-e6b5f142dbc1-tmp-dir\") pod \"node-resolver-lq8k6\" (UID: \"c3aed02f-b69d-4743-8089-e6b5f142dbc1\") " pod="openshift-dns/node-resolver-lq8k6" Sep 05 02:17:55.058415 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:55.058331 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8de62bad-6e7c-4c9e-bb4a-49914420c1de-host-var-lib-cni-bin\") pod \"multus-n5fs5\" (UID: \"8de62bad-6e7c-4c9e-bb4a-49914420c1de\") " pod="openshift-multus/multus-n5fs5" Sep 05 02:17:55.058415 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:55.058346 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/8de62bad-6e7c-4c9e-bb4a-49914420c1de-multus-daemon-config\") pod \"multus-n5fs5\" (UID: \"8de62bad-6e7c-4c9e-bb4a-49914420c1de\") " pod="openshift-multus/multus-n5fs5" Sep 05 02:17:55.058415 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:55.058360 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/8de62bad-6e7c-4c9e-bb4a-49914420c1de-host-run-multus-certs\") pod \"multus-n5fs5\" (UID: \"8de62bad-6e7c-4c9e-bb4a-49914420c1de\") " pod="openshift-multus/multus-n5fs5" Sep 05 02:17:55.058415 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:55.058379 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/3f060a3e-d7fc-4886-bca4-7564087e02ac-konnectivity-ca\") pod \"konnectivity-agent-nvjx5\" (UID: \"3f060a3e-d7fc-4886-bca4-7564087e02ac\") " pod="kube-system/konnectivity-agent-nvjx5" Sep 05 02:17:55.058415 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:55.058411 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2fc3d6af-c656-4be0-8188-317d2dde7a6b-metrics-certs\") pod \"network-metrics-daemon-2x2gr\" (UID: \"2fc3d6af-c656-4be0-8188-317d2dde7a6b\") " pod="openshift-multus/network-metrics-daemon-2x2gr" Sep 05 02:17:55.058656 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:55.058470 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/45944019-aa1a-49fd-a178-a6a38ad9a139-log-socket\") pod \"ovnkube-node-mz2wx\" (UID: \"45944019-aa1a-49fd-a178-a6a38ad9a139\") " pod="openshift-ovn-kubernetes/ovnkube-node-mz2wx" Sep 05 02:17:55.058656 ip-10-0-133-250 kubenswrapper[2555]: E0905 02:17:55.058500 2555 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 05 02:17:55.058656 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:55.058504 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/bd4a3b61-19e3-4177-b012-e8ec8048aed1-kubelet-config\") pod \"global-pull-secret-syncer-ghjcr\" (UID: \"bd4a3b61-19e3-4177-b012-e8ec8048aed1\") " pod="kube-system/global-pull-secret-syncer-ghjcr" Sep 05 02:17:55.058656 ip-10-0-133-250 kubenswrapper[2555]: E0905 02:17:55.058557 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2fc3d6af-c656-4be0-8188-317d2dde7a6b-metrics-certs podName:2fc3d6af-c656-4be0-8188-317d2dde7a6b nodeName:}" failed. No retries permitted until 2026-09-05 02:17:55.558540096 +0000 UTC m=+2.060677676 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2fc3d6af-c656-4be0-8188-317d2dde7a6b-metrics-certs") pod "network-metrics-daemon-2x2gr" (UID: "2fc3d6af-c656-4be0-8188-317d2dde7a6b") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 05 02:17:55.058656 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:55.058576 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/bd4a3b61-19e3-4177-b012-e8ec8048aed1-kubelet-config\") pod \"global-pull-secret-syncer-ghjcr\" (UID: \"bd4a3b61-19e3-4177-b012-e8ec8048aed1\") " pod="kube-system/global-pull-secret-syncer-ghjcr" Sep 05 02:17:55.058656 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:55.058586 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/7ff62e18-55f4-4bdf-83b2-5e0a4f419ad4-sys-fs\") pod \"aws-ebs-csi-driver-node-h9kcl\" (UID: \"7ff62e18-55f4-4bdf-83b2-5e0a4f419ad4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h9kcl" Sep 05 02:17:55.058656 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:55.058626 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/45944019-aa1a-49fd-a178-a6a38ad9a139-host-slash\") pod \"ovnkube-node-mz2wx\" (UID: \"45944019-aa1a-49fd-a178-a6a38ad9a139\") " pod="openshift-ovn-kubernetes/ovnkube-node-mz2wx" Sep 05 02:17:55.058656 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:55.058654 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/bd4a3b61-19e3-4177-b012-e8ec8048aed1-dbus\") pod \"global-pull-secret-syncer-ghjcr\" (UID: \"bd4a3b61-19e3-4177-b012-e8ec8048aed1\") " pod="kube-system/global-pull-secret-syncer-ghjcr" Sep 05 02:17:55.058656 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:55.058658 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/7ff62e18-55f4-4bdf-83b2-5e0a4f419ad4-sys-fs\") pod \"aws-ebs-csi-driver-node-h9kcl\" (UID: \"7ff62e18-55f4-4bdf-83b2-5e0a4f419ad4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h9kcl" Sep 05 02:17:55.059036 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:55.058678 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/4ddfb9fd-38a7-4b2d-bb70-5e5c4494a02d-etc-sysconfig\") pod \"tuned-qf6xm\" (UID: \"4ddfb9fd-38a7-4b2d-bb70-5e5c4494a02d\") " pod="openshift-cluster-node-tuning-operator/tuned-qf6xm" Sep 05 02:17:55.059036 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:55.058704 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9fccb273-b727-42f4-8e22-50f62446778f-tuning-conf-dir\") pod \"multus-additional-cni-plugins-v4hcb\" (UID: \"9fccb273-b727-42f4-8e22-50f62446778f\") " pod="openshift-multus/multus-additional-cni-plugins-v4hcb" Sep 05 02:17:55.059036 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:55.058717 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/bd4a3b61-19e3-4177-b012-e8ec8048aed1-dbus\") pod \"global-pull-secret-syncer-ghjcr\" (UID: \"bd4a3b61-19e3-4177-b012-e8ec8048aed1\") " pod="kube-system/global-pull-secret-syncer-ghjcr" Sep 05 02:17:55.059036 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:55.058741 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/9fccb273-b727-42f4-8e22-50f62446778f-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-v4hcb\" (UID: \"9fccb273-b727-42f4-8e22-50f62446778f\") " pod="openshift-multus/multus-additional-cni-plugins-v4hcb" Sep 05 02:17:55.059036 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:55.058767 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/45944019-aa1a-49fd-a178-a6a38ad9a139-ovn-node-metrics-cert\") pod \"ovnkube-node-mz2wx\" (UID: \"45944019-aa1a-49fd-a178-a6a38ad9a139\") " pod="openshift-ovn-kubernetes/ovnkube-node-mz2wx" Sep 05 02:17:55.059036 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:55.058783 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/4ddfb9fd-38a7-4b2d-bb70-5e5c4494a02d-etc-sysconfig\") pod \"tuned-qf6xm\" (UID: \"4ddfb9fd-38a7-4b2d-bb70-5e5c4494a02d\") " pod="openshift-cluster-node-tuning-operator/tuned-qf6xm" Sep 05 02:17:55.059036 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:55.058789 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/4ddfb9fd-38a7-4b2d-bb70-5e5c4494a02d-run\") pod \"tuned-qf6xm\" (UID: \"4ddfb9fd-38a7-4b2d-bb70-5e5c4494a02d\") " pod="openshift-cluster-node-tuning-operator/tuned-qf6xm" Sep 05 02:17:55.059036 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:55.058842 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/4ddfb9fd-38a7-4b2d-bb70-5e5c4494a02d-run\") pod \"tuned-qf6xm\" (UID: \"4ddfb9fd-38a7-4b2d-bb70-5e5c4494a02d\") " pod="openshift-cluster-node-tuning-operator/tuned-qf6xm" Sep 05 02:17:55.059036 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:55.058842 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/3f060a3e-d7fc-4886-bca4-7564087e02ac-konnectivity-ca\") pod \"konnectivity-agent-nvjx5\" (UID: \"3f060a3e-d7fc-4886-bca4-7564087e02ac\") " pod="kube-system/konnectivity-agent-nvjx5" Sep 05 02:17:55.059036 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:55.058854 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9fccb273-b727-42f4-8e22-50f62446778f-tuning-conf-dir\") pod \"multus-additional-cni-plugins-v4hcb\" (UID: \"9fccb273-b727-42f4-8e22-50f62446778f\") " pod="openshift-multus/multus-additional-cni-plugins-v4hcb" Sep 05 02:17:55.059036 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:55.058858 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9fccb273-b727-42f4-8e22-50f62446778f-system-cni-dir\") pod \"multus-additional-cni-plugins-v4hcb\" (UID: \"9fccb273-b727-42f4-8e22-50f62446778f\") " pod="openshift-multus/multus-additional-cni-plugins-v4hcb" Sep 05 02:17:55.059036 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:55.058890 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8de62bad-6e7c-4c9e-bb4a-49914420c1de-cni-binary-copy\") pod \"multus-n5fs5\" (UID: \"8de62bad-6e7c-4c9e-bb4a-49914420c1de\") " pod="openshift-multus/multus-n5fs5" Sep 05 02:17:55.059036 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:55.058916 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/45944019-aa1a-49fd-a178-a6a38ad9a139-systemd-units\") pod \"ovnkube-node-mz2wx\" (UID: \"45944019-aa1a-49fd-a178-a6a38ad9a139\") " pod="openshift-ovn-kubernetes/ovnkube-node-mz2wx" Sep 05 02:17:55.059036 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:55.058917 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9fccb273-b727-42f4-8e22-50f62446778f-system-cni-dir\") pod \"multus-additional-cni-plugins-v4hcb\" (UID: \"9fccb273-b727-42f4-8e22-50f62446778f\") " pod="openshift-multus/multus-additional-cni-plugins-v4hcb" Sep 05 02:17:55.059036 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:55.058948 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/4ddfb9fd-38a7-4b2d-bb70-5e5c4494a02d-etc-sysctl-d\") pod \"tuned-qf6xm\" (UID: \"4ddfb9fd-38a7-4b2d-bb70-5e5c4494a02d\") " pod="openshift-cluster-node-tuning-operator/tuned-qf6xm" Sep 05 02:17:55.059036 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:55.058971 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4ddfb9fd-38a7-4b2d-bb70-5e5c4494a02d-sys\") pod \"tuned-qf6xm\" (UID: \"4ddfb9fd-38a7-4b2d-bb70-5e5c4494a02d\") " pod="openshift-cluster-node-tuning-operator/tuned-qf6xm" Sep 05 02:17:55.059036 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:55.058988 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/4ddfb9fd-38a7-4b2d-bb70-5e5c4494a02d-etc-tuned\") pod \"tuned-qf6xm\" (UID: \"4ddfb9fd-38a7-4b2d-bb70-5e5c4494a02d\") " pod="openshift-cluster-node-tuning-operator/tuned-qf6xm" Sep 05 02:17:55.059676 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:55.059031 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wqnrh\" (UniqueName: \"kubernetes.io/projected/ba04f298-aebd-463b-940e-8a446b160645-kube-api-access-wqnrh\") pod \"network-check-target-zt7r6\" (UID: \"ba04f298-aebd-463b-940e-8a446b160645\") " pod="openshift-network-diagnostics/network-check-target-zt7r6" Sep 05 02:17:55.059676 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:55.059062 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/86874f7b-fd54-4c79-9346-2c3f6d1e8508-iptables-alerter-script\") pod \"iptables-alerter-bz7s2\" (UID: \"86874f7b-fd54-4c79-9346-2c3f6d1e8508\") " pod="openshift-network-operator/iptables-alerter-bz7s2" Sep 05 02:17:55.059676 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:55.059089 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8de62bad-6e7c-4c9e-bb4a-49914420c1de-cnibin\") pod \"multus-n5fs5\" (UID: \"8de62bad-6e7c-4c9e-bb4a-49914420c1de\") " pod="openshift-multus/multus-n5fs5" Sep 05 02:17:55.059676 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:55.059114 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/4ddfb9fd-38a7-4b2d-bb70-5e5c4494a02d-etc-modprobe-d\") pod \"tuned-qf6xm\" (UID: \"4ddfb9fd-38a7-4b2d-bb70-5e5c4494a02d\") " pod="openshift-cluster-node-tuning-operator/tuned-qf6xm" Sep 05 02:17:55.059676 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:55.059134 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4ddfb9fd-38a7-4b2d-bb70-5e5c4494a02d-sys\") pod \"tuned-qf6xm\" (UID: \"4ddfb9fd-38a7-4b2d-bb70-5e5c4494a02d\") " pod="openshift-cluster-node-tuning-operator/tuned-qf6xm" Sep 05 02:17:55.059676 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:55.059140 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/7ff62e18-55f4-4bdf-83b2-5e0a4f419ad4-socket-dir\") pod \"aws-ebs-csi-driver-node-h9kcl\" (UID: \"7ff62e18-55f4-4bdf-83b2-5e0a4f419ad4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h9kcl" Sep 05 02:17:55.059676 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:55.059164 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8de62bad-6e7c-4c9e-bb4a-49914420c1de-multus-conf-dir\") pod \"multus-n5fs5\" (UID: \"8de62bad-6e7c-4c9e-bb4a-49914420c1de\") " pod="openshift-multus/multus-n5fs5" Sep 05 02:17:55.059676 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:55.059178 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/45944019-aa1a-49fd-a178-a6a38ad9a139-host-cni-netd\") pod \"ovnkube-node-mz2wx\" (UID: \"45944019-aa1a-49fd-a178-a6a38ad9a139\") " pod="openshift-ovn-kubernetes/ovnkube-node-mz2wx" Sep 05 02:17:55.059676 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:55.059181 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/4ddfb9fd-38a7-4b2d-bb70-5e5c4494a02d-etc-sysctl-d\") pod \"tuned-qf6xm\" (UID: \"4ddfb9fd-38a7-4b2d-bb70-5e5c4494a02d\") " pod="openshift-cluster-node-tuning-operator/tuned-qf6xm" Sep 05 02:17:55.059676 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:55.059200 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/c2dc61db-cd5c-4972-b21e-633ad3b71ef5-serviceca\") pod \"node-ca-4gpmf\" (UID: \"c2dc61db-cd5c-4972-b21e-633ad3b71ef5\") " pod="openshift-image-registry/node-ca-4gpmf" Sep 05 02:17:55.059676 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:55.059225 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4ddfb9fd-38a7-4b2d-bb70-5e5c4494a02d-var-lib-kubelet\") pod \"tuned-qf6xm\" (UID: \"4ddfb9fd-38a7-4b2d-bb70-5e5c4494a02d\") " pod="openshift-cluster-node-tuning-operator/tuned-qf6xm" Sep 05 02:17:55.059676 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:55.059239 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/4ddfb9fd-38a7-4b2d-bb70-5e5c4494a02d-etc-modprobe-d\") pod \"tuned-qf6xm\" (UID: \"4ddfb9fd-38a7-4b2d-bb70-5e5c4494a02d\") " pod="openshift-cluster-node-tuning-operator/tuned-qf6xm" Sep 05 02:17:55.059676 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:55.059247 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9fccb273-b727-42f4-8e22-50f62446778f-cnibin\") pod \"multus-additional-cni-plugins-v4hcb\" (UID: \"9fccb273-b727-42f4-8e22-50f62446778f\") " pod="openshift-multus/multus-additional-cni-plugins-v4hcb" Sep 05 02:17:55.059676 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:55.059271 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/8de62bad-6e7c-4c9e-bb4a-49914420c1de-multus-socket-dir-parent\") pod \"multus-n5fs5\" (UID: \"8de62bad-6e7c-4c9e-bb4a-49914420c1de\") " pod="openshift-multus/multus-n5fs5" Sep 05 02:17:55.059676 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:55.059278 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/7ff62e18-55f4-4bdf-83b2-5e0a4f419ad4-socket-dir\") pod \"aws-ebs-csi-driver-node-h9kcl\" (UID: \"7ff62e18-55f4-4bdf-83b2-5e0a4f419ad4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h9kcl" Sep 05 02:17:55.059676 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:55.059280 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/9fccb273-b727-42f4-8e22-50f62446778f-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-v4hcb\" (UID: \"9fccb273-b727-42f4-8e22-50f62446778f\") " pod="openshift-multus/multus-additional-cni-plugins-v4hcb" Sep 05 02:17:55.059676 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:55.059296 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/8de62bad-6e7c-4c9e-bb4a-49914420c1de-host-run-k8s-cni-cncf-io\") pod \"multus-n5fs5\" (UID: \"8de62bad-6e7c-4c9e-bb4a-49914420c1de\") " pod="openshift-multus/multus-n5fs5" Sep 05 02:17:55.060454 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:55.059321 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9fccb273-b727-42f4-8e22-50f62446778f-cnibin\") pod \"multus-additional-cni-plugins-v4hcb\" (UID: \"9fccb273-b727-42f4-8e22-50f62446778f\") " pod="openshift-multus/multus-additional-cni-plugins-v4hcb" Sep 05 02:17:55.060454 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:55.059324 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8de62bad-6e7c-4c9e-bb4a-49914420c1de-host-run-netns\") pod \"multus-n5fs5\" (UID: \"8de62bad-6e7c-4c9e-bb4a-49914420c1de\") " pod="openshift-multus/multus-n5fs5" Sep 05 02:17:55.060454 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:55.059322 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4ddfb9fd-38a7-4b2d-bb70-5e5c4494a02d-var-lib-kubelet\") pod \"tuned-qf6xm\" (UID: \"4ddfb9fd-38a7-4b2d-bb70-5e5c4494a02d\") " pod="openshift-cluster-node-tuning-operator/tuned-qf6xm" Sep 05 02:17:55.060454 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:55.059353 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/45944019-aa1a-49fd-a178-a6a38ad9a139-host-kubelet\") pod \"ovnkube-node-mz2wx\" (UID: \"45944019-aa1a-49fd-a178-a6a38ad9a139\") " pod="openshift-ovn-kubernetes/ovnkube-node-mz2wx" Sep 05 02:17:55.060454 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:55.059353 2555 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Sep 05 02:17:55.060454 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:55.059375 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/45944019-aa1a-49fd-a178-a6a38ad9a139-env-overrides\") pod \"ovnkube-node-mz2wx\" (UID: \"45944019-aa1a-49fd-a178-a6a38ad9a139\") " pod="openshift-ovn-kubernetes/ovnkube-node-mz2wx" Sep 05 02:17:55.060454 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:55.059391 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/86874f7b-fd54-4c79-9346-2c3f6d1e8508-host-slash\") pod \"iptables-alerter-bz7s2\" (UID: \"86874f7b-fd54-4c79-9346-2c3f6d1e8508\") " pod="openshift-network-operator/iptables-alerter-bz7s2" Sep 05 02:17:55.060454 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:55.059424 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8sfjq\" (UniqueName: \"kubernetes.io/projected/86874f7b-fd54-4c79-9346-2c3f6d1e8508-kube-api-access-8sfjq\") pod \"iptables-alerter-bz7s2\" (UID: \"86874f7b-fd54-4c79-9346-2c3f6d1e8508\") " pod="openshift-network-operator/iptables-alerter-bz7s2" Sep 05 02:17:55.060454 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:55.059458 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/45944019-aa1a-49fd-a178-a6a38ad9a139-var-lib-openvswitch\") pod \"ovnkube-node-mz2wx\" (UID: \"45944019-aa1a-49fd-a178-a6a38ad9a139\") " pod="openshift-ovn-kubernetes/ovnkube-node-mz2wx" Sep 05 02:17:55.060454 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:55.059483 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/45944019-aa1a-49fd-a178-a6a38ad9a139-node-log\") pod \"ovnkube-node-mz2wx\" (UID: \"45944019-aa1a-49fd-a178-a6a38ad9a139\") " pod="openshift-ovn-kubernetes/ovnkube-node-mz2wx" Sep 05 02:17:55.060454 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:55.059516 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/45944019-aa1a-49fd-a178-a6a38ad9a139-ovnkube-config\") pod \"ovnkube-node-mz2wx\" (UID: \"45944019-aa1a-49fd-a178-a6a38ad9a139\") " pod="openshift-ovn-kubernetes/ovnkube-node-mz2wx" Sep 05 02:17:55.060454 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:55.059551 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4ddfb9fd-38a7-4b2d-bb70-5e5c4494a02d-lib-modules\") pod \"tuned-qf6xm\" (UID: \"4ddfb9fd-38a7-4b2d-bb70-5e5c4494a02d\") " pod="openshift-cluster-node-tuning-operator/tuned-qf6xm" Sep 05 02:17:55.060454 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:55.059575 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zg66l\" (UniqueName: \"kubernetes.io/projected/4ddfb9fd-38a7-4b2d-bb70-5e5c4494a02d-kube-api-access-zg66l\") pod \"tuned-qf6xm\" (UID: \"4ddfb9fd-38a7-4b2d-bb70-5e5c4494a02d\") " pod="openshift-cluster-node-tuning-operator/tuned-qf6xm" Sep 05 02:17:55.060454 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:55.059580 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/c2dc61db-cd5c-4972-b21e-633ad3b71ef5-serviceca\") pod \"node-ca-4gpmf\" (UID: \"c2dc61db-cd5c-4972-b21e-633ad3b71ef5\") " pod="openshift-image-registry/node-ca-4gpmf" Sep 05 02:17:55.060454 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:55.059599 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/9fccb273-b727-42f4-8e22-50f62446778f-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-v4hcb\" (UID: \"9fccb273-b727-42f4-8e22-50f62446778f\") " pod="openshift-multus/multus-additional-cni-plugins-v4hcb" Sep 05 02:17:55.060454 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:55.059623 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/7ff62e18-55f4-4bdf-83b2-5e0a4f419ad4-etc-selinux\") pod \"aws-ebs-csi-driver-node-h9kcl\" (UID: \"7ff62e18-55f4-4bdf-83b2-5e0a4f419ad4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h9kcl" Sep 05 02:17:55.060454 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:55.059643 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/8de62bad-6e7c-4c9e-bb4a-49914420c1de-host-var-lib-cni-multus\") pod \"multus-n5fs5\" (UID: \"8de62bad-6e7c-4c9e-bb4a-49914420c1de\") " pod="openshift-multus/multus-n5fs5" Sep 05 02:17:55.061225 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:55.059663 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/8de62bad-6e7c-4c9e-bb4a-49914420c1de-hostroot\") pod \"multus-n5fs5\" (UID: \"8de62bad-6e7c-4c9e-bb4a-49914420c1de\") " pod="openshift-multus/multus-n5fs5" Sep 05 02:17:55.061225 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:55.059684 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/45944019-aa1a-49fd-a178-a6a38ad9a139-run-systemd\") pod \"ovnkube-node-mz2wx\" (UID: \"45944019-aa1a-49fd-a178-a6a38ad9a139\") " pod="openshift-ovn-kubernetes/ovnkube-node-mz2wx" Sep 05 02:17:55.061225 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:55.059707 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/45944019-aa1a-49fd-a178-a6a38ad9a139-ovnkube-script-lib\") pod \"ovnkube-node-mz2wx\" (UID: \"45944019-aa1a-49fd-a178-a6a38ad9a139\") " pod="openshift-ovn-kubernetes/ovnkube-node-mz2wx" Sep 05 02:17:55.061225 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:55.059711 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4ddfb9fd-38a7-4b2d-bb70-5e5c4494a02d-lib-modules\") pod \"tuned-qf6xm\" (UID: \"4ddfb9fd-38a7-4b2d-bb70-5e5c4494a02d\") " pod="openshift-cluster-node-tuning-operator/tuned-qf6xm" Sep 05 02:17:55.061225 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:55.059737 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/7ff62e18-55f4-4bdf-83b2-5e0a4f419ad4-etc-selinux\") pod \"aws-ebs-csi-driver-node-h9kcl\" (UID: \"7ff62e18-55f4-4bdf-83b2-5e0a4f419ad4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h9kcl" Sep 05 02:17:55.061225 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:55.059742 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/3f060a3e-d7fc-4886-bca4-7564087e02ac-agent-certs\") pod \"konnectivity-agent-nvjx5\" (UID: \"3f060a3e-d7fc-4886-bca4-7564087e02ac\") " pod="kube-system/konnectivity-agent-nvjx5" Sep 05 02:17:55.061225 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:55.059785 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/c3aed02f-b69d-4743-8089-e6b5f142dbc1-hosts-file\") pod \"node-resolver-lq8k6\" (UID: \"c3aed02f-b69d-4743-8089-e6b5f142dbc1\") " pod="openshift-dns/node-resolver-lq8k6" Sep 05 02:17:55.061225 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:55.059810 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8de62bad-6e7c-4c9e-bb4a-49914420c1de-host-var-lib-kubelet\") pod \"multus-n5fs5\" (UID: \"8de62bad-6e7c-4c9e-bb4a-49914420c1de\") " pod="openshift-multus/multus-n5fs5" Sep 05 02:17:55.061225 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:55.059837 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/45944019-aa1a-49fd-a178-a6a38ad9a139-host-run-netns\") pod \"ovnkube-node-mz2wx\" (UID: \"45944019-aa1a-49fd-a178-a6a38ad9a139\") " pod="openshift-ovn-kubernetes/ovnkube-node-mz2wx" Sep 05 02:17:55.061225 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:55.059861 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/45944019-aa1a-49fd-a178-a6a38ad9a139-host-run-ovn-kubernetes\") pod \"ovnkube-node-mz2wx\" (UID: \"45944019-aa1a-49fd-a178-a6a38ad9a139\") " pod="openshift-ovn-kubernetes/ovnkube-node-mz2wx" Sep 05 02:17:55.061225 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:55.059886 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8n4cz\" (UniqueName: \"kubernetes.io/projected/45944019-aa1a-49fd-a178-a6a38ad9a139-kube-api-access-8n4cz\") pod \"ovnkube-node-mz2wx\" (UID: \"45944019-aa1a-49fd-a178-a6a38ad9a139\") " pod="openshift-ovn-kubernetes/ovnkube-node-mz2wx" Sep 05 02:17:55.061225 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:55.059914 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4cdt9\" (UniqueName: \"kubernetes.io/projected/c2dc61db-cd5c-4972-b21e-633ad3b71ef5-kube-api-access-4cdt9\") pod \"node-ca-4gpmf\" (UID: \"c2dc61db-cd5c-4972-b21e-633ad3b71ef5\") " pod="openshift-image-registry/node-ca-4gpmf" Sep 05 02:17:55.061225 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:55.059939 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/bd4a3b61-19e3-4177-b012-e8ec8048aed1-original-pull-secret\") pod \"global-pull-secret-syncer-ghjcr\" (UID: \"bd4a3b61-19e3-4177-b012-e8ec8048aed1\") " pod="kube-system/global-pull-secret-syncer-ghjcr" Sep 05 02:17:55.061225 ip-10-0-133-250 kubenswrapper[2555]: E0905 02:17:55.060050 2555 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 05 02:17:55.061225 ip-10-0-133-250 kubenswrapper[2555]: E0905 02:17:55.060129 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bd4a3b61-19e3-4177-b012-e8ec8048aed1-original-pull-secret podName:bd4a3b61-19e3-4177-b012-e8ec8048aed1 nodeName:}" failed. No retries permitted until 2026-09-05 02:17:55.560096792 +0000 UTC m=+2.062234369 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/bd4a3b61-19e3-4177-b012-e8ec8048aed1-original-pull-secret") pod "global-pull-secret-syncer-ghjcr" (UID: "bd4a3b61-19e3-4177-b012-e8ec8048aed1") : object "kube-system"/"original-pull-secret" not registered Sep 05 02:17:55.061225 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:55.060160 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/7ff62e18-55f4-4bdf-83b2-5e0a4f419ad4-kubelet-dir\") pod \"aws-ebs-csi-driver-node-h9kcl\" (UID: \"7ff62e18-55f4-4bdf-83b2-5e0a4f419ad4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h9kcl" Sep 05 02:17:55.061864 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:55.060189 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5tk2r\" (UniqueName: \"kubernetes.io/projected/7ff62e18-55f4-4bdf-83b2-5e0a4f419ad4-kube-api-access-5tk2r\") pod \"aws-ebs-csi-driver-node-h9kcl\" (UID: \"7ff62e18-55f4-4bdf-83b2-5e0a4f419ad4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h9kcl" Sep 05 02:17:55.061864 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:55.060218 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jpgls\" (UniqueName: \"kubernetes.io/projected/c3aed02f-b69d-4743-8089-e6b5f142dbc1-kube-api-access-jpgls\") pod \"node-resolver-lq8k6\" (UID: \"c3aed02f-b69d-4743-8089-e6b5f142dbc1\") " pod="openshift-dns/node-resolver-lq8k6" Sep 05 02:17:55.061864 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:55.060255 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/7ff62e18-55f4-4bdf-83b2-5e0a4f419ad4-kubelet-dir\") pod \"aws-ebs-csi-driver-node-h9kcl\" (UID: \"7ff62e18-55f4-4bdf-83b2-5e0a4f419ad4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h9kcl" Sep 05 02:17:55.061864 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:55.060240 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/45944019-aa1a-49fd-a178-a6a38ad9a139-run-ovn\") pod \"ovnkube-node-mz2wx\" (UID: \"45944019-aa1a-49fd-a178-a6a38ad9a139\") " pod="openshift-ovn-kubernetes/ovnkube-node-mz2wx" Sep 05 02:17:55.061864 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:55.060307 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2gt66\" (UniqueName: \"kubernetes.io/projected/2fc3d6af-c656-4be0-8188-317d2dde7a6b-kube-api-access-2gt66\") pod \"network-metrics-daemon-2x2gr\" (UID: \"2fc3d6af-c656-4be0-8188-317d2dde7a6b\") " pod="openshift-multus/network-metrics-daemon-2x2gr" Sep 05 02:17:55.061864 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:55.060332 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/4ddfb9fd-38a7-4b2d-bb70-5e5c4494a02d-etc-systemd\") pod \"tuned-qf6xm\" (UID: \"4ddfb9fd-38a7-4b2d-bb70-5e5c4494a02d\") " pod="openshift-cluster-node-tuning-operator/tuned-qf6xm" Sep 05 02:17:55.061864 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:55.060356 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4ddfb9fd-38a7-4b2d-bb70-5e5c4494a02d-tmp\") pod \"tuned-qf6xm\" (UID: \"4ddfb9fd-38a7-4b2d-bb70-5e5c4494a02d\") " pod="openshift-cluster-node-tuning-operator/tuned-qf6xm" Sep 05 02:17:55.061864 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:55.060380 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8de62bad-6e7c-4c9e-bb4a-49914420c1de-system-cni-dir\") pod \"multus-n5fs5\" (UID: \"8de62bad-6e7c-4c9e-bb4a-49914420c1de\") " pod="openshift-multus/multus-n5fs5" Sep 05 02:17:55.061864 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:55.060407 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/45944019-aa1a-49fd-a178-a6a38ad9a139-etc-openvswitch\") pod \"ovnkube-node-mz2wx\" (UID: \"45944019-aa1a-49fd-a178-a6a38ad9a139\") " pod="openshift-ovn-kubernetes/ovnkube-node-mz2wx" Sep 05 02:17:55.061864 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:55.060435 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/45944019-aa1a-49fd-a178-a6a38ad9a139-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-mz2wx\" (UID: \"45944019-aa1a-49fd-a178-a6a38ad9a139\") " pod="openshift-ovn-kubernetes/ovnkube-node-mz2wx" Sep 05 02:17:55.061864 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:55.060439 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/4ddfb9fd-38a7-4b2d-bb70-5e5c4494a02d-etc-systemd\") pod \"tuned-qf6xm\" (UID: \"4ddfb9fd-38a7-4b2d-bb70-5e5c4494a02d\") " pod="openshift-cluster-node-tuning-operator/tuned-qf6xm" Sep 05 02:17:55.061864 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:55.060459 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c2dc61db-cd5c-4972-b21e-633ad3b71ef5-host\") pod \"node-ca-4gpmf\" (UID: \"c2dc61db-cd5c-4972-b21e-633ad3b71ef5\") " pod="openshift-image-registry/node-ca-4gpmf" Sep 05 02:17:55.061864 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:55.060482 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4ddfb9fd-38a7-4b2d-bb70-5e5c4494a02d-etc-kubernetes\") pod \"tuned-qf6xm\" (UID: \"4ddfb9fd-38a7-4b2d-bb70-5e5c4494a02d\") " pod="openshift-cluster-node-tuning-operator/tuned-qf6xm" Sep 05 02:17:55.061864 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:55.060521 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zlkm9\" (UniqueName: \"kubernetes.io/projected/9fccb273-b727-42f4-8e22-50f62446778f-kube-api-access-zlkm9\") pod \"multus-additional-cni-plugins-v4hcb\" (UID: \"9fccb273-b727-42f4-8e22-50f62446778f\") " pod="openshift-multus/multus-additional-cni-plugins-v4hcb" Sep 05 02:17:55.061864 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:55.060524 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/9fccb273-b727-42f4-8e22-50f62446778f-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-v4hcb\" (UID: \"9fccb273-b727-42f4-8e22-50f62446778f\") " pod="openshift-multus/multus-additional-cni-plugins-v4hcb" Sep 05 02:17:55.061864 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:55.060558 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c2dc61db-cd5c-4972-b21e-633ad3b71ef5-host\") pod \"node-ca-4gpmf\" (UID: \"c2dc61db-cd5c-4972-b21e-633ad3b71ef5\") " pod="openshift-image-registry/node-ca-4gpmf" Sep 05 02:17:55.061864 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:55.060578 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4ddfb9fd-38a7-4b2d-bb70-5e5c4494a02d-etc-kubernetes\") pod \"tuned-qf6xm\" (UID: \"4ddfb9fd-38a7-4b2d-bb70-5e5c4494a02d\") " pod="openshift-cluster-node-tuning-operator/tuned-qf6xm" Sep 05 02:17:55.062374 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:55.060603 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/7ff62e18-55f4-4bdf-83b2-5e0a4f419ad4-registration-dir\") pod \"aws-ebs-csi-driver-node-h9kcl\" (UID: \"7ff62e18-55f4-4bdf-83b2-5e0a4f419ad4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h9kcl" Sep 05 02:17:55.062374 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:55.060714 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/45944019-aa1a-49fd-a178-a6a38ad9a139-run-openvswitch\") pod \"ovnkube-node-mz2wx\" (UID: \"45944019-aa1a-49fd-a178-a6a38ad9a139\") " pod="openshift-ovn-kubernetes/ovnkube-node-mz2wx" Sep 05 02:17:55.062374 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:55.060753 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/7ff62e18-55f4-4bdf-83b2-5e0a4f419ad4-registration-dir\") pod \"aws-ebs-csi-driver-node-h9kcl\" (UID: \"7ff62e18-55f4-4bdf-83b2-5e0a4f419ad4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h9kcl" Sep 05 02:17:55.062374 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:55.060769 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/4ddfb9fd-38a7-4b2d-bb70-5e5c4494a02d-etc-sysctl-conf\") pod \"tuned-qf6xm\" (UID: \"4ddfb9fd-38a7-4b2d-bb70-5e5c4494a02d\") " pod="openshift-cluster-node-tuning-operator/tuned-qf6xm" Sep 05 02:17:55.062374 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:55.060813 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4ddfb9fd-38a7-4b2d-bb70-5e5c4494a02d-host\") pod \"tuned-qf6xm\" (UID: \"4ddfb9fd-38a7-4b2d-bb70-5e5c4494a02d\") " pod="openshift-cluster-node-tuning-operator/tuned-qf6xm" Sep 05 02:17:55.062374 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:55.060845 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9fccb273-b727-42f4-8e22-50f62446778f-cni-binary-copy\") pod \"multus-additional-cni-plugins-v4hcb\" (UID: \"9fccb273-b727-42f4-8e22-50f62446778f\") " pod="openshift-multus/multus-additional-cni-plugins-v4hcb" Sep 05 02:17:55.062374 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:55.060858 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/4ddfb9fd-38a7-4b2d-bb70-5e5c4494a02d-etc-sysctl-conf\") pod \"tuned-qf6xm\" (UID: \"4ddfb9fd-38a7-4b2d-bb70-5e5c4494a02d\") " pod="openshift-cluster-node-tuning-operator/tuned-qf6xm" Sep 05 02:17:55.062374 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:55.060884 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/7ff62e18-55f4-4bdf-83b2-5e0a4f419ad4-device-dir\") pod \"aws-ebs-csi-driver-node-h9kcl\" (UID: \"7ff62e18-55f4-4bdf-83b2-5e0a4f419ad4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h9kcl" Sep 05 02:17:55.062374 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:55.060931 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4ddfb9fd-38a7-4b2d-bb70-5e5c4494a02d-host\") pod \"tuned-qf6xm\" (UID: \"4ddfb9fd-38a7-4b2d-bb70-5e5c4494a02d\") " pod="openshift-cluster-node-tuning-operator/tuned-qf6xm" Sep 05 02:17:55.062374 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:55.060959 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8de62bad-6e7c-4c9e-bb4a-49914420c1de-multus-cni-dir\") pod \"multus-n5fs5\" (UID: \"8de62bad-6e7c-4c9e-bb4a-49914420c1de\") " pod="openshift-multus/multus-n5fs5" Sep 05 02:17:55.062374 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:55.060974 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/7ff62e18-55f4-4bdf-83b2-5e0a4f419ad4-device-dir\") pod \"aws-ebs-csi-driver-node-h9kcl\" (UID: \"7ff62e18-55f4-4bdf-83b2-5e0a4f419ad4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h9kcl" Sep 05 02:17:55.062374 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:55.060991 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8de62bad-6e7c-4c9e-bb4a-49914420c1de-etc-kubernetes\") pod \"multus-n5fs5\" (UID: \"8de62bad-6e7c-4c9e-bb4a-49914420c1de\") " pod="openshift-multus/multus-n5fs5" Sep 05 02:17:55.062374 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:55.061085 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bgg5b\" (UniqueName: \"kubernetes.io/projected/8de62bad-6e7c-4c9e-bb4a-49914420c1de-kube-api-access-bgg5b\") pod \"multus-n5fs5\" (UID: \"8de62bad-6e7c-4c9e-bb4a-49914420c1de\") " pod="openshift-multus/multus-n5fs5" Sep 05 02:17:55.062374 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:55.061119 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/45944019-aa1a-49fd-a178-a6a38ad9a139-host-cni-bin\") pod \"ovnkube-node-mz2wx\" (UID: \"45944019-aa1a-49fd-a178-a6a38ad9a139\") " pod="openshift-ovn-kubernetes/ovnkube-node-mz2wx" Sep 05 02:17:55.062374 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:55.061547 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9fccb273-b727-42f4-8e22-50f62446778f-cni-binary-copy\") pod \"multus-additional-cni-plugins-v4hcb\" (UID: \"9fccb273-b727-42f4-8e22-50f62446778f\") " pod="openshift-multus/multus-additional-cni-plugins-v4hcb" Sep 05 02:17:55.062773 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:55.062579 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/4ddfb9fd-38a7-4b2d-bb70-5e5c4494a02d-etc-tuned\") pod \"tuned-qf6xm\" (UID: \"4ddfb9fd-38a7-4b2d-bb70-5e5c4494a02d\") " pod="openshift-cluster-node-tuning-operator/tuned-qf6xm" Sep 05 02:17:55.062773 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:55.062705 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4ddfb9fd-38a7-4b2d-bb70-5e5c4494a02d-tmp\") pod \"tuned-qf6xm\" (UID: \"4ddfb9fd-38a7-4b2d-bb70-5e5c4494a02d\") " pod="openshift-cluster-node-tuning-operator/tuned-qf6xm" Sep 05 02:17:55.063057 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:55.063036 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/3f060a3e-d7fc-4886-bca4-7564087e02ac-agent-certs\") pod \"konnectivity-agent-nvjx5\" (UID: \"3f060a3e-d7fc-4886-bca4-7564087e02ac\") " pod="kube-system/konnectivity-agent-nvjx5" Sep 05 02:17:55.065282 ip-10-0-133-250 kubenswrapper[2555]: E0905 02:17:55.065239 2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 05 02:17:55.065282 ip-10-0-133-250 kubenswrapper[2555]: E0905 02:17:55.065264 2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 05 02:17:55.065282 ip-10-0-133-250 kubenswrapper[2555]: E0905 02:17:55.065277 2555 projected.go:196] Error preparing data for projected volume kube-api-access-wqnrh for pod openshift-network-diagnostics/network-check-target-zt7r6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 05 02:17:55.065463 ip-10-0-133-250 kubenswrapper[2555]: E0905 02:17:55.065339 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ba04f298-aebd-463b-940e-8a446b160645-kube-api-access-wqnrh podName:ba04f298-aebd-463b-940e-8a446b160645 nodeName:}" failed. No retries permitted until 2026-09-05 02:17:55.565324864 +0000 UTC m=+2.067462470 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-wqnrh" (UniqueName: "kubernetes.io/projected/ba04f298-aebd-463b-940e-8a446b160645-kube-api-access-wqnrh") pod "network-check-target-zt7r6" (UID: "ba04f298-aebd-463b-940e-8a446b160645") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 05 02:17:55.068428 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:55.068400 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4cdt9\" (UniqueName: \"kubernetes.io/projected/c2dc61db-cd5c-4972-b21e-633ad3b71ef5-kube-api-access-4cdt9\") pod \"node-ca-4gpmf\" (UID: \"c2dc61db-cd5c-4972-b21e-633ad3b71ef5\") " pod="openshift-image-registry/node-ca-4gpmf" Sep 05 02:17:55.070045 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:55.069414 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2gt66\" (UniqueName: \"kubernetes.io/projected/2fc3d6af-c656-4be0-8188-317d2dde7a6b-kube-api-access-2gt66\") pod \"network-metrics-daemon-2x2gr\" (UID: \"2fc3d6af-c656-4be0-8188-317d2dde7a6b\") " pod="openshift-multus/network-metrics-daemon-2x2gr" Sep 05 02:17:55.071738 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:55.071714 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zg66l\" (UniqueName: \"kubernetes.io/projected/4ddfb9fd-38a7-4b2d-bb70-5e5c4494a02d-kube-api-access-zg66l\") pod \"tuned-qf6xm\" (UID: \"4ddfb9fd-38a7-4b2d-bb70-5e5c4494a02d\") " pod="openshift-cluster-node-tuning-operator/tuned-qf6xm" Sep 05 02:17:55.072960 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:55.072941 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5tk2r\" (UniqueName: \"kubernetes.io/projected/7ff62e18-55f4-4bdf-83b2-5e0a4f419ad4-kube-api-access-5tk2r\") pod \"aws-ebs-csi-driver-node-h9kcl\" (UID: \"7ff62e18-55f4-4bdf-83b2-5e0a4f419ad4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h9kcl" Sep 05 02:17:55.073059 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:55.072945 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zlkm9\" (UniqueName: \"kubernetes.io/projected/9fccb273-b727-42f4-8e22-50f62446778f-kube-api-access-zlkm9\") pod \"multus-additional-cni-plugins-v4hcb\" (UID: \"9fccb273-b727-42f4-8e22-50f62446778f\") " pod="openshift-multus/multus-additional-cni-plugins-v4hcb" Sep 05 02:17:55.161630 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:55.161604 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/86874f7b-fd54-4c79-9346-2c3f6d1e8508-iptables-alerter-script\") pod \"iptables-alerter-bz7s2\" (UID: \"86874f7b-fd54-4c79-9346-2c3f6d1e8508\") " pod="openshift-network-operator/iptables-alerter-bz7s2" Sep 05 02:17:55.161630 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:55.161629 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8de62bad-6e7c-4c9e-bb4a-49914420c1de-cnibin\") pod \"multus-n5fs5\" (UID: \"8de62bad-6e7c-4c9e-bb4a-49914420c1de\") " pod="openshift-multus/multus-n5fs5" Sep 05 02:17:55.161801 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:55.161647 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8de62bad-6e7c-4c9e-bb4a-49914420c1de-multus-conf-dir\") pod \"multus-n5fs5\" (UID: \"8de62bad-6e7c-4c9e-bb4a-49914420c1de\") " pod="openshift-multus/multus-n5fs5" Sep 05 02:17:55.161801 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:55.161660 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/45944019-aa1a-49fd-a178-a6a38ad9a139-host-cni-netd\") pod \"ovnkube-node-mz2wx\" (UID: \"45944019-aa1a-49fd-a178-a6a38ad9a139\") " pod="openshift-ovn-kubernetes/ovnkube-node-mz2wx" Sep 05 02:17:55.161801 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:55.161683 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/8de62bad-6e7c-4c9e-bb4a-49914420c1de-multus-socket-dir-parent\") pod \"multus-n5fs5\" (UID: \"8de62bad-6e7c-4c9e-bb4a-49914420c1de\") " pod="openshift-multus/multus-n5fs5" Sep 05 02:17:55.161801 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:55.161705 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/8de62bad-6e7c-4c9e-bb4a-49914420c1de-host-run-k8s-cni-cncf-io\") pod \"multus-n5fs5\" (UID: \"8de62bad-6e7c-4c9e-bb4a-49914420c1de\") " pod="openshift-multus/multus-n5fs5" Sep 05 02:17:55.161801 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:55.161717 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8de62bad-6e7c-4c9e-bb4a-49914420c1de-cnibin\") pod \"multus-n5fs5\" (UID: \"8de62bad-6e7c-4c9e-bb4a-49914420c1de\") " pod="openshift-multus/multus-n5fs5" Sep 05 02:17:55.161801 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:55.161720 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8de62bad-6e7c-4c9e-bb4a-49914420c1de-multus-conf-dir\") pod \"multus-n5fs5\" (UID: \"8de62bad-6e7c-4c9e-bb4a-49914420c1de\") " pod="openshift-multus/multus-n5fs5" Sep 05 02:17:55.161801 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:55.161727 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8de62bad-6e7c-4c9e-bb4a-49914420c1de-host-run-netns\") pod \"multus-n5fs5\" (UID: \"8de62bad-6e7c-4c9e-bb4a-49914420c1de\") " pod="openshift-multus/multus-n5fs5" Sep 05 02:17:55.161801 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:55.161752 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/45944019-aa1a-49fd-a178-a6a38ad9a139-host-cni-netd\") pod \"ovnkube-node-mz2wx\" (UID: \"45944019-aa1a-49fd-a178-a6a38ad9a139\") " pod="openshift-ovn-kubernetes/ovnkube-node-mz2wx" Sep 05 02:17:55.161801 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:55.161786 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/8de62bad-6e7c-4c9e-bb4a-49914420c1de-multus-socket-dir-parent\") pod \"multus-n5fs5\" (UID: \"8de62bad-6e7c-4c9e-bb4a-49914420c1de\") " pod="openshift-multus/multus-n5fs5" Sep 05 02:17:55.161801 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:55.161796 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/8de62bad-6e7c-4c9e-bb4a-49914420c1de-host-run-k8s-cni-cncf-io\") pod \"multus-n5fs5\" (UID: \"8de62bad-6e7c-4c9e-bb4a-49914420c1de\") " pod="openshift-multus/multus-n5fs5" Sep 05 02:17:55.162238 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:55.161832 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8de62bad-6e7c-4c9e-bb4a-49914420c1de-host-run-netns\") pod \"multus-n5fs5\" (UID: \"8de62bad-6e7c-4c9e-bb4a-49914420c1de\") " pod="openshift-multus/multus-n5fs5" Sep 05 02:17:55.162238 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:55.161845 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/45944019-aa1a-49fd-a178-a6a38ad9a139-host-kubelet\") pod \"ovnkube-node-mz2wx\" (UID: \"45944019-aa1a-49fd-a178-a6a38ad9a139\") " pod="openshift-ovn-kubernetes/ovnkube-node-mz2wx" Sep 05 02:17:55.162238 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:55.161866 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/45944019-aa1a-49fd-a178-a6a38ad9a139-env-overrides\") pod \"ovnkube-node-mz2wx\" (UID: \"45944019-aa1a-49fd-a178-a6a38ad9a139\") " pod="openshift-ovn-kubernetes/ovnkube-node-mz2wx" Sep 05 02:17:55.162238 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:55.161881 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/86874f7b-fd54-4c79-9346-2c3f6d1e8508-host-slash\") pod \"iptables-alerter-bz7s2\" (UID: \"86874f7b-fd54-4c79-9346-2c3f6d1e8508\") " pod="openshift-network-operator/iptables-alerter-bz7s2" Sep 05 02:17:55.162238 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:55.161895 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8sfjq\" (UniqueName: \"kubernetes.io/projected/86874f7b-fd54-4c79-9346-2c3f6d1e8508-kube-api-access-8sfjq\") pod \"iptables-alerter-bz7s2\" (UID: \"86874f7b-fd54-4c79-9346-2c3f6d1e8508\") " pod="openshift-network-operator/iptables-alerter-bz7s2" Sep 05 02:17:55.162238 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:55.161912 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/45944019-aa1a-49fd-a178-a6a38ad9a139-var-lib-openvswitch\") pod \"ovnkube-node-mz2wx\" (UID: \"45944019-aa1a-49fd-a178-a6a38ad9a139\") " pod="openshift-ovn-kubernetes/ovnkube-node-mz2wx" Sep 05 02:17:55.162238 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:55.161921 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/45944019-aa1a-49fd-a178-a6a38ad9a139-host-kubelet\") pod \"ovnkube-node-mz2wx\" (UID: \"45944019-aa1a-49fd-a178-a6a38ad9a139\") " pod="openshift-ovn-kubernetes/ovnkube-node-mz2wx" Sep 05 02:17:55.162238 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:55.161934 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/45944019-aa1a-49fd-a178-a6a38ad9a139-node-log\") pod \"ovnkube-node-mz2wx\" (UID: \"45944019-aa1a-49fd-a178-a6a38ad9a139\") " pod="openshift-ovn-kubernetes/ovnkube-node-mz2wx" Sep 05 02:17:55.162238 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:55.161946 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/86874f7b-fd54-4c79-9346-2c3f6d1e8508-host-slash\") pod \"iptables-alerter-bz7s2\" (UID: \"86874f7b-fd54-4c79-9346-2c3f6d1e8508\") " pod="openshift-network-operator/iptables-alerter-bz7s2" Sep 05 02:17:55.162238 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:55.161966 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/45944019-aa1a-49fd-a178-a6a38ad9a139-node-log\") pod \"ovnkube-node-mz2wx\" (UID: \"45944019-aa1a-49fd-a178-a6a38ad9a139\") " pod="openshift-ovn-kubernetes/ovnkube-node-mz2wx" Sep 05 02:17:55.162238 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:55.162047 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/45944019-aa1a-49fd-a178-a6a38ad9a139-var-lib-openvswitch\") pod \"ovnkube-node-mz2wx\" (UID: \"45944019-aa1a-49fd-a178-a6a38ad9a139\") " pod="openshift-ovn-kubernetes/ovnkube-node-mz2wx" Sep 05 02:17:55.162238 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:55.162055 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/45944019-aa1a-49fd-a178-a6a38ad9a139-ovnkube-config\") pod \"ovnkube-node-mz2wx\" (UID: \"45944019-aa1a-49fd-a178-a6a38ad9a139\") " pod="openshift-ovn-kubernetes/ovnkube-node-mz2wx" Sep 05 02:17:55.162238 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:55.162079 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/8de62bad-6e7c-4c9e-bb4a-49914420c1de-host-var-lib-cni-multus\") pod \"multus-n5fs5\" (UID: \"8de62bad-6e7c-4c9e-bb4a-49914420c1de\") " pod="openshift-multus/multus-n5fs5" Sep 05 02:17:55.162238 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:55.162094 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/8de62bad-6e7c-4c9e-bb4a-49914420c1de-hostroot\") pod \"multus-n5fs5\" (UID: \"8de62bad-6e7c-4c9e-bb4a-49914420c1de\") " pod="openshift-multus/multus-n5fs5" Sep 05 02:17:55.162238 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:55.162125 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/45944019-aa1a-49fd-a178-a6a38ad9a139-run-systemd\") pod \"ovnkube-node-mz2wx\" (UID: \"45944019-aa1a-49fd-a178-a6a38ad9a139\") " pod="openshift-ovn-kubernetes/ovnkube-node-mz2wx" Sep 05 02:17:55.162992 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:55.162249 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/86874f7b-fd54-4c79-9346-2c3f6d1e8508-iptables-alerter-script\") pod \"iptables-alerter-bz7s2\" (UID: \"86874f7b-fd54-4c79-9346-2c3f6d1e8508\") " pod="openshift-network-operator/iptables-alerter-bz7s2" Sep 05 02:17:55.162992 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:55.162277 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/8de62bad-6e7c-4c9e-bb4a-49914420c1de-host-var-lib-cni-multus\") pod \"multus-n5fs5\" (UID: \"8de62bad-6e7c-4c9e-bb4a-49914420c1de\") " pod="openshift-multus/multus-n5fs5" Sep 05 02:17:55.162992 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:55.162314 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/45944019-aa1a-49fd-a178-a6a38ad9a139-ovnkube-script-lib\") pod \"ovnkube-node-mz2wx\" (UID: \"45944019-aa1a-49fd-a178-a6a38ad9a139\") " pod="openshift-ovn-kubernetes/ovnkube-node-mz2wx" Sep 05 02:17:55.162992 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:55.162346 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/c3aed02f-b69d-4743-8089-e6b5f142dbc1-hosts-file\") pod \"node-resolver-lq8k6\" (UID: \"c3aed02f-b69d-4743-8089-e6b5f142dbc1\") " pod="openshift-dns/node-resolver-lq8k6" Sep 05 02:17:55.162992 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:55.162347 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/45944019-aa1a-49fd-a178-a6a38ad9a139-env-overrides\") pod \"ovnkube-node-mz2wx\" (UID: \"45944019-aa1a-49fd-a178-a6a38ad9a139\") " pod="openshift-ovn-kubernetes/ovnkube-node-mz2wx" Sep 05 02:17:55.162992 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:55.162382 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/45944019-aa1a-49fd-a178-a6a38ad9a139-run-systemd\") pod \"ovnkube-node-mz2wx\" (UID: \"45944019-aa1a-49fd-a178-a6a38ad9a139\") " pod="openshift-ovn-kubernetes/ovnkube-node-mz2wx" Sep 05 02:17:55.162992 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:55.162403 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8de62bad-6e7c-4c9e-bb4a-49914420c1de-host-var-lib-kubelet\") pod \"multus-n5fs5\" (UID: \"8de62bad-6e7c-4c9e-bb4a-49914420c1de\") " pod="openshift-multus/multus-n5fs5" Sep 05 02:17:55.162992 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:55.162419 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/45944019-aa1a-49fd-a178-a6a38ad9a139-host-run-netns\") pod \"ovnkube-node-mz2wx\" (UID: \"45944019-aa1a-49fd-a178-a6a38ad9a139\") " pod="openshift-ovn-kubernetes/ovnkube-node-mz2wx" Sep 05 02:17:55.162992 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:55.162442 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/45944019-aa1a-49fd-a178-a6a38ad9a139-host-run-ovn-kubernetes\") pod \"ovnkube-node-mz2wx\" (UID: \"45944019-aa1a-49fd-a178-a6a38ad9a139\") " pod="openshift-ovn-kubernetes/ovnkube-node-mz2wx" Sep 05 02:17:55.162992 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:55.162383 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/8de62bad-6e7c-4c9e-bb4a-49914420c1de-hostroot\") pod \"multus-n5fs5\" (UID: \"8de62bad-6e7c-4c9e-bb4a-49914420c1de\") " pod="openshift-multus/multus-n5fs5" Sep 05 02:17:55.162992 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:55.162451 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8de62bad-6e7c-4c9e-bb4a-49914420c1de-host-var-lib-kubelet\") pod \"multus-n5fs5\" (UID: \"8de62bad-6e7c-4c9e-bb4a-49914420c1de\") " pod="openshift-multus/multus-n5fs5" Sep 05 02:17:55.162992 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:55.162467 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8n4cz\" (UniqueName: \"kubernetes.io/projected/45944019-aa1a-49fd-a178-a6a38ad9a139-kube-api-access-8n4cz\") pod \"ovnkube-node-mz2wx\" (UID: \"45944019-aa1a-49fd-a178-a6a38ad9a139\") " pod="openshift-ovn-kubernetes/ovnkube-node-mz2wx" Sep 05 02:17:55.162992 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:55.162479 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/c3aed02f-b69d-4743-8089-e6b5f142dbc1-hosts-file\") pod \"node-resolver-lq8k6\" (UID: \"c3aed02f-b69d-4743-8089-e6b5f142dbc1\") " pod="openshift-dns/node-resolver-lq8k6" Sep 05 02:17:55.162992 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:55.162498 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/45944019-aa1a-49fd-a178-a6a38ad9a139-host-run-ovn-kubernetes\") pod \"ovnkube-node-mz2wx\" (UID: \"45944019-aa1a-49fd-a178-a6a38ad9a139\") " pod="openshift-ovn-kubernetes/ovnkube-node-mz2wx" Sep 05 02:17:55.162992 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:55.162505 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jpgls\" (UniqueName: \"kubernetes.io/projected/c3aed02f-b69d-4743-8089-e6b5f142dbc1-kube-api-access-jpgls\") pod \"node-resolver-lq8k6\" (UID: \"c3aed02f-b69d-4743-8089-e6b5f142dbc1\") " pod="openshift-dns/node-resolver-lq8k6" Sep 05 02:17:55.162992 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:55.162504 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/45944019-aa1a-49fd-a178-a6a38ad9a139-host-run-netns\") pod \"ovnkube-node-mz2wx\" (UID: \"45944019-aa1a-49fd-a178-a6a38ad9a139\") " pod="openshift-ovn-kubernetes/ovnkube-node-mz2wx" Sep 05 02:17:55.162992 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:55.162612 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/45944019-aa1a-49fd-a178-a6a38ad9a139-run-ovn\") pod \"ovnkube-node-mz2wx\" (UID: \"45944019-aa1a-49fd-a178-a6a38ad9a139\") " pod="openshift-ovn-kubernetes/ovnkube-node-mz2wx" Sep 05 02:17:55.162992 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:55.162633 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8de62bad-6e7c-4c9e-bb4a-49914420c1de-system-cni-dir\") pod \"multus-n5fs5\" (UID: \"8de62bad-6e7c-4c9e-bb4a-49914420c1de\") " pod="openshift-multus/multus-n5fs5" Sep 05 02:17:55.163762 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:55.162654 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/45944019-aa1a-49fd-a178-a6a38ad9a139-etc-openvswitch\") pod \"ovnkube-node-mz2wx\" (UID: \"45944019-aa1a-49fd-a178-a6a38ad9a139\") " pod="openshift-ovn-kubernetes/ovnkube-node-mz2wx" Sep 05 02:17:55.163762 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:55.162661 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/45944019-aa1a-49fd-a178-a6a38ad9a139-run-ovn\") pod \"ovnkube-node-mz2wx\" (UID: \"45944019-aa1a-49fd-a178-a6a38ad9a139\") " pod="openshift-ovn-kubernetes/ovnkube-node-mz2wx" Sep 05 02:17:55.163762 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:55.162686 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/45944019-aa1a-49fd-a178-a6a38ad9a139-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-mz2wx\" (UID: \"45944019-aa1a-49fd-a178-a6a38ad9a139\") " pod="openshift-ovn-kubernetes/ovnkube-node-mz2wx" Sep 05 02:17:55.163762 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:55.162707 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/45944019-aa1a-49fd-a178-a6a38ad9a139-etc-openvswitch\") pod \"ovnkube-node-mz2wx\" (UID: \"45944019-aa1a-49fd-a178-a6a38ad9a139\") " pod="openshift-ovn-kubernetes/ovnkube-node-mz2wx" Sep 05 02:17:55.163762 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:55.162716 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/45944019-aa1a-49fd-a178-a6a38ad9a139-run-openvswitch\") pod \"ovnkube-node-mz2wx\" (UID: \"45944019-aa1a-49fd-a178-a6a38ad9a139\") " pod="openshift-ovn-kubernetes/ovnkube-node-mz2wx" Sep 05 02:17:55.163762 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:55.162720 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8de62bad-6e7c-4c9e-bb4a-49914420c1de-system-cni-dir\") pod \"multus-n5fs5\" (UID: \"8de62bad-6e7c-4c9e-bb4a-49914420c1de\") " pod="openshift-multus/multus-n5fs5" Sep 05 02:17:55.163762 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:55.162742 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8de62bad-6e7c-4c9e-bb4a-49914420c1de-multus-cni-dir\") pod \"multus-n5fs5\" (UID: \"8de62bad-6e7c-4c9e-bb4a-49914420c1de\") " pod="openshift-multus/multus-n5fs5" Sep 05 02:17:55.163762 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:55.162748 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/45944019-aa1a-49fd-a178-a6a38ad9a139-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-mz2wx\" (UID: \"45944019-aa1a-49fd-a178-a6a38ad9a139\") " pod="openshift-ovn-kubernetes/ovnkube-node-mz2wx" Sep 05 02:17:55.163762 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:55.162766 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8de62bad-6e7c-4c9e-bb4a-49914420c1de-etc-kubernetes\") pod \"multus-n5fs5\" (UID: \"8de62bad-6e7c-4c9e-bb4a-49914420c1de\") " pod="openshift-multus/multus-n5fs5" Sep 05 02:17:55.163762 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:55.162790 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bgg5b\" (UniqueName: \"kubernetes.io/projected/8de62bad-6e7c-4c9e-bb4a-49914420c1de-kube-api-access-bgg5b\") pod \"multus-n5fs5\" (UID: \"8de62bad-6e7c-4c9e-bb4a-49914420c1de\") " pod="openshift-multus/multus-n5fs5" Sep 05 02:17:55.163762 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:55.162805 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8de62bad-6e7c-4c9e-bb4a-49914420c1de-multus-cni-dir\") pod \"multus-n5fs5\" (UID: \"8de62bad-6e7c-4c9e-bb4a-49914420c1de\") " pod="openshift-multus/multus-n5fs5" Sep 05 02:17:55.163762 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:55.162766 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/45944019-aa1a-49fd-a178-a6a38ad9a139-run-openvswitch\") pod \"ovnkube-node-mz2wx\" (UID: \"45944019-aa1a-49fd-a178-a6a38ad9a139\") " pod="openshift-ovn-kubernetes/ovnkube-node-mz2wx" Sep 05 02:17:55.163762 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:55.162811 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8de62bad-6e7c-4c9e-bb4a-49914420c1de-etc-kubernetes\") pod \"multus-n5fs5\" (UID: \"8de62bad-6e7c-4c9e-bb4a-49914420c1de\") " pod="openshift-multus/multus-n5fs5" Sep 05 02:17:55.163762 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:55.162818 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/45944019-aa1a-49fd-a178-a6a38ad9a139-ovnkube-script-lib\") pod \"ovnkube-node-mz2wx\" (UID: \"45944019-aa1a-49fd-a178-a6a38ad9a139\") " pod="openshift-ovn-kubernetes/ovnkube-node-mz2wx" Sep 05 02:17:55.163762 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:55.162813 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/45944019-aa1a-49fd-a178-a6a38ad9a139-host-cni-bin\") pod \"ovnkube-node-mz2wx\" (UID: \"45944019-aa1a-49fd-a178-a6a38ad9a139\") " pod="openshift-ovn-kubernetes/ovnkube-node-mz2wx" Sep 05 02:17:55.163762 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:55.162861 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c3aed02f-b69d-4743-8089-e6b5f142dbc1-tmp-dir\") pod \"node-resolver-lq8k6\" (UID: \"c3aed02f-b69d-4743-8089-e6b5f142dbc1\") " pod="openshift-dns/node-resolver-lq8k6" Sep 05 02:17:55.163762 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:55.162865 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/45944019-aa1a-49fd-a178-a6a38ad9a139-host-cni-bin\") pod \"ovnkube-node-mz2wx\" (UID: \"45944019-aa1a-49fd-a178-a6a38ad9a139\") " pod="openshift-ovn-kubernetes/ovnkube-node-mz2wx" Sep 05 02:17:55.163762 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:55.162882 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8de62bad-6e7c-4c9e-bb4a-49914420c1de-host-var-lib-cni-bin\") pod \"multus-n5fs5\" (UID: \"8de62bad-6e7c-4c9e-bb4a-49914420c1de\") " pod="openshift-multus/multus-n5fs5" Sep 05 02:17:55.164329 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:55.162920 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8de62bad-6e7c-4c9e-bb4a-49914420c1de-host-var-lib-cni-bin\") pod \"multus-n5fs5\" (UID: \"8de62bad-6e7c-4c9e-bb4a-49914420c1de\") " pod="openshift-multus/multus-n5fs5" Sep 05 02:17:55.164329 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:55.162922 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/8de62bad-6e7c-4c9e-bb4a-49914420c1de-multus-daemon-config\") pod \"multus-n5fs5\" (UID: \"8de62bad-6e7c-4c9e-bb4a-49914420c1de\") " pod="openshift-multus/multus-n5fs5" Sep 05 02:17:55.164329 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:55.162951 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/8de62bad-6e7c-4c9e-bb4a-49914420c1de-host-run-multus-certs\") pod \"multus-n5fs5\" (UID: \"8de62bad-6e7c-4c9e-bb4a-49914420c1de\") " pod="openshift-multus/multus-n5fs5" Sep 05 02:17:55.164329 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:55.162989 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/45944019-aa1a-49fd-a178-a6a38ad9a139-log-socket\") pod \"ovnkube-node-mz2wx\" (UID: \"45944019-aa1a-49fd-a178-a6a38ad9a139\") " pod="openshift-ovn-kubernetes/ovnkube-node-mz2wx" Sep 05 02:17:55.164329 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:55.163042 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/8de62bad-6e7c-4c9e-bb4a-49914420c1de-host-run-multus-certs\") pod \"multus-n5fs5\" (UID: \"8de62bad-6e7c-4c9e-bb4a-49914420c1de\") " pod="openshift-multus/multus-n5fs5" Sep 05 02:17:55.164329 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:55.163045 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/45944019-aa1a-49fd-a178-a6a38ad9a139-host-slash\") pod \"ovnkube-node-mz2wx\" (UID: \"45944019-aa1a-49fd-a178-a6a38ad9a139\") " pod="openshift-ovn-kubernetes/ovnkube-node-mz2wx" Sep 05 02:17:55.164329 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:55.163083 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/45944019-aa1a-49fd-a178-a6a38ad9a139-ovn-node-metrics-cert\") pod \"ovnkube-node-mz2wx\" (UID: \"45944019-aa1a-49fd-a178-a6a38ad9a139\") " pod="openshift-ovn-kubernetes/ovnkube-node-mz2wx" Sep 05 02:17:55.164329 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:55.163043 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/45944019-aa1a-49fd-a178-a6a38ad9a139-log-socket\") pod \"ovnkube-node-mz2wx\" (UID: \"45944019-aa1a-49fd-a178-a6a38ad9a139\") " pod="openshift-ovn-kubernetes/ovnkube-node-mz2wx" Sep 05 02:17:55.164329 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:55.163086 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/45944019-aa1a-49fd-a178-a6a38ad9a139-host-slash\") pod \"ovnkube-node-mz2wx\" (UID: \"45944019-aa1a-49fd-a178-a6a38ad9a139\") " pod="openshift-ovn-kubernetes/ovnkube-node-mz2wx" Sep 05 02:17:55.164329 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:55.163109 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8de62bad-6e7c-4c9e-bb4a-49914420c1de-cni-binary-copy\") pod \"multus-n5fs5\" (UID: \"8de62bad-6e7c-4c9e-bb4a-49914420c1de\") " pod="openshift-multus/multus-n5fs5" Sep 05 02:17:55.164329 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:55.163152 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/45944019-aa1a-49fd-a178-a6a38ad9a139-systemd-units\") pod \"ovnkube-node-mz2wx\" (UID: \"45944019-aa1a-49fd-a178-a6a38ad9a139\") " pod="openshift-ovn-kubernetes/ovnkube-node-mz2wx" Sep 05 02:17:55.164329 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:55.163181 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c3aed02f-b69d-4743-8089-e6b5f142dbc1-tmp-dir\") pod \"node-resolver-lq8k6\" (UID: \"c3aed02f-b69d-4743-8089-e6b5f142dbc1\") " pod="openshift-dns/node-resolver-lq8k6" Sep 05 02:17:55.164329 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:55.163208 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/45944019-aa1a-49fd-a178-a6a38ad9a139-systemd-units\") pod \"ovnkube-node-mz2wx\" (UID: \"45944019-aa1a-49fd-a178-a6a38ad9a139\") " pod="openshift-ovn-kubernetes/ovnkube-node-mz2wx" Sep 05 02:17:55.164329 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:55.163428 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/45944019-aa1a-49fd-a178-a6a38ad9a139-ovnkube-config\") pod \"ovnkube-node-mz2wx\" (UID: \"45944019-aa1a-49fd-a178-a6a38ad9a139\") " pod="openshift-ovn-kubernetes/ovnkube-node-mz2wx" Sep 05 02:17:55.164329 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:55.163458 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/8de62bad-6e7c-4c9e-bb4a-49914420c1de-multus-daemon-config\") pod \"multus-n5fs5\" (UID: \"8de62bad-6e7c-4c9e-bb4a-49914420c1de\") " pod="openshift-multus/multus-n5fs5" Sep 05 02:17:55.164329 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:55.163602 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8de62bad-6e7c-4c9e-bb4a-49914420c1de-cni-binary-copy\") pod \"multus-n5fs5\" (UID: \"8de62bad-6e7c-4c9e-bb4a-49914420c1de\") " pod="openshift-multus/multus-n5fs5" Sep 05 02:17:55.165146 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:55.165131 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/45944019-aa1a-49fd-a178-a6a38ad9a139-ovn-node-metrics-cert\") pod \"ovnkube-node-mz2wx\" (UID: \"45944019-aa1a-49fd-a178-a6a38ad9a139\") " pod="openshift-ovn-kubernetes/ovnkube-node-mz2wx" Sep 05 02:17:55.169825 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:55.169805 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jpgls\" (UniqueName: \"kubernetes.io/projected/c3aed02f-b69d-4743-8089-e6b5f142dbc1-kube-api-access-jpgls\") pod \"node-resolver-lq8k6\" (UID: \"c3aed02f-b69d-4743-8089-e6b5f142dbc1\") " pod="openshift-dns/node-resolver-lq8k6" Sep 05 02:17:55.170066 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:55.170041 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bgg5b\" (UniqueName: \"kubernetes.io/projected/8de62bad-6e7c-4c9e-bb4a-49914420c1de-kube-api-access-bgg5b\") pod \"multus-n5fs5\" (UID: \"8de62bad-6e7c-4c9e-bb4a-49914420c1de\") " pod="openshift-multus/multus-n5fs5" Sep 05 02:17:55.170720 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:55.170704 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8sfjq\" (UniqueName: \"kubernetes.io/projected/86874f7b-fd54-4c79-9346-2c3f6d1e8508-kube-api-access-8sfjq\") pod \"iptables-alerter-bz7s2\" (UID: \"86874f7b-fd54-4c79-9346-2c3f6d1e8508\") " pod="openshift-network-operator/iptables-alerter-bz7s2" Sep 05 02:17:55.170787 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:55.170755 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8n4cz\" (UniqueName: \"kubernetes.io/projected/45944019-aa1a-49fd-a178-a6a38ad9a139-kube-api-access-8n4cz\") pod \"ovnkube-node-mz2wx\" (UID: \"45944019-aa1a-49fd-a178-a6a38ad9a139\") " pod="openshift-ovn-kubernetes/ovnkube-node-mz2wx" Sep 05 02:17:55.178216 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:55.178185 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podab785fdfa0a233510495d26882d5258b.slice/crio-d204852e896999ea014856f0979455d9ee2b4a2db7f6171d0b1c5069442a4691 WatchSource:0}: Error finding container d204852e896999ea014856f0979455d9ee2b4a2db7f6171d0b1c5069442a4691: Status 404 returned error can't find the container with id d204852e896999ea014856f0979455d9ee2b4a2db7f6171d0b1c5069442a4691 Sep 05 02:17:55.179292 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:55.179274 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podccb165d55e894605f0ca2c828f2460a9.slice/crio-ed4e08fe072c7c85c24fbdcc0852995315071e7ddafe558c646e8adcd1f0cc44 WatchSource:0}: Error finding container ed4e08fe072c7c85c24fbdcc0852995315071e7ddafe558c646e8adcd1f0cc44: Status 404 returned error can't find the container with id ed4e08fe072c7c85c24fbdcc0852995315071e7ddafe558c646e8adcd1f0cc44 Sep 05 02:17:55.183785 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:55.183769 2555 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 05 02:17:55.260105 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:55.260085 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-nvjx5" Sep 05 02:17:55.269667 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:55.269646 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3f060a3e_d7fc_4886_bca4_7564087e02ac.slice/crio-c2d582cbbea99c751f951088ef969a8373eb033a32a6bdeb4f3fcd725159ff93 WatchSource:0}: Error finding container c2d582cbbea99c751f951088ef969a8373eb033a32a6bdeb4f3fcd725159ff93: Status 404 returned error can't find the container with id c2d582cbbea99c751f951088ef969a8373eb033a32a6bdeb4f3fcd725159ff93 Sep 05 02:17:55.272562 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:55.272549 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-qf6xm" Sep 05 02:17:55.280933 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:55.280915 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4ddfb9fd_38a7_4b2d_bb70_5e5c4494a02d.slice/crio-3d68c8155383169161f8fba2b218d75a2d0170fd883d5fcf6551468a866ca4ec WatchSource:0}: Error finding container 3d68c8155383169161f8fba2b218d75a2d0170fd883d5fcf6551468a866ca4ec: Status 404 returned error can't find the container with id 3d68c8155383169161f8fba2b218d75a2d0170fd883d5fcf6551468a866ca4ec Sep 05 02:17:55.295149 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:55.295129 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-4gpmf" Sep 05 02:17:55.298865 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:55.298847 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-v4hcb" Sep 05 02:17:55.308597 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:55.308579 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9fccb273_b727_42f4_8e22_50f62446778f.slice/crio-e85361a172661b525e2761870bf137575500638701fcc24cb9c8ea03e080bc5c WatchSource:0}: Error finding container e85361a172661b525e2761870bf137575500638701fcc24cb9c8ea03e080bc5c: Status 404 returned error can't find the container with id e85361a172661b525e2761870bf137575500638701fcc24cb9c8ea03e080bc5c Sep 05 02:17:55.335726 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:55.335674 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h9kcl" Sep 05 02:17:55.341417 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:55.341401 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-lq8k6" Sep 05 02:17:55.343865 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:55.343839 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7ff62e18_55f4_4bdf_83b2_5e0a4f419ad4.slice/crio-3d0a833b69dbf4feb15abac05cda8c6fdd72d264191e46df722c77ad97d09f95 WatchSource:0}: Error finding container 3d0a833b69dbf4feb15abac05cda8c6fdd72d264191e46df722c77ad97d09f95: Status 404 returned error can't find the container with id 3d0a833b69dbf4feb15abac05cda8c6fdd72d264191e46df722c77ad97d09f95 Sep 05 02:17:55.349158 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:55.348996 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc3aed02f_b69d_4743_8089_e6b5f142dbc1.slice/crio-b483824eb88be515063920bcc463734ecab916d303edad4a38de81146d78c1ec WatchSource:0}: Error finding container b483824eb88be515063920bcc463734ecab916d303edad4a38de81146d78c1ec: Status 404 returned error can't find the container with id b483824eb88be515063920bcc463734ecab916d303edad4a38de81146d78c1ec Sep 05 02:17:55.364336 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:55.364322 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-n5fs5" Sep 05 02:17:55.372929 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:55.372903 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8de62bad_6e7c_4c9e_bb4a_49914420c1de.slice/crio-0fc4b858db5ea254bf62ae2d08b5eaac00b010de9f6e387529f474dfd166a666 WatchSource:0}: Error finding container 0fc4b858db5ea254bf62ae2d08b5eaac00b010de9f6e387529f474dfd166a666: Status 404 returned error can't find the container with id 0fc4b858db5ea254bf62ae2d08b5eaac00b010de9f6e387529f474dfd166a666 Sep 05 02:17:55.384481 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:55.384465 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-bz7s2" Sep 05 02:17:55.391843 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:55.391825 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod86874f7b_fd54_4c79_9346_2c3f6d1e8508.slice/crio-8aa6f6a0f921321ea249872826d12069f2249035fff249c93c24031c64e7c0bd WatchSource:0}: Error finding container 8aa6f6a0f921321ea249872826d12069f2249035fff249c93c24031c64e7c0bd: Status 404 returned error can't find the container with id 8aa6f6a0f921321ea249872826d12069f2249035fff249c93c24031c64e7c0bd Sep 05 02:17:55.402329 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:55.402313 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-mz2wx" Sep 05 02:17:55.413149 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:17:55.413127 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod45944019_aa1a_49fd_a178_a6a38ad9a139.slice/crio-829612f08a4660b8f85ba923617daa5a1ea2c8f61031394c56712a9a6fb05571 WatchSource:0}: Error finding container 829612f08a4660b8f85ba923617daa5a1ea2c8f61031394c56712a9a6fb05571: Status 404 returned error can't find the container with id 829612f08a4660b8f85ba923617daa5a1ea2c8f61031394c56712a9a6fb05571 Sep 05 02:17:55.565506 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:55.565477 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2fc3d6af-c656-4be0-8188-317d2dde7a6b-metrics-certs\") pod \"network-metrics-daemon-2x2gr\" (UID: \"2fc3d6af-c656-4be0-8188-317d2dde7a6b\") " pod="openshift-multus/network-metrics-daemon-2x2gr" Sep 05 02:17:55.565649 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:55.565516 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wqnrh\" (UniqueName: \"kubernetes.io/projected/ba04f298-aebd-463b-940e-8a446b160645-kube-api-access-wqnrh\") pod \"network-check-target-zt7r6\" (UID: \"ba04f298-aebd-463b-940e-8a446b160645\") " pod="openshift-network-diagnostics/network-check-target-zt7r6" Sep 05 02:17:55.565649 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:55.565555 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/bd4a3b61-19e3-4177-b012-e8ec8048aed1-original-pull-secret\") pod \"global-pull-secret-syncer-ghjcr\" (UID: \"bd4a3b61-19e3-4177-b012-e8ec8048aed1\") " pod="kube-system/global-pull-secret-syncer-ghjcr" Sep 05 02:17:55.565649 ip-10-0-133-250 kubenswrapper[2555]: E0905 02:17:55.565641 2555 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 05 02:17:55.565765 ip-10-0-133-250 kubenswrapper[2555]: E0905 02:17:55.565650 2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 05 02:17:55.565765 ip-10-0-133-250 kubenswrapper[2555]: E0905 02:17:55.565669 2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 05 02:17:55.565765 ip-10-0-133-250 kubenswrapper[2555]: E0905 02:17:55.565678 2555 projected.go:196] Error preparing data for projected volume kube-api-access-wqnrh for pod openshift-network-diagnostics/network-check-target-zt7r6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 05 02:17:55.565765 ip-10-0-133-250 kubenswrapper[2555]: E0905 02:17:55.565688 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bd4a3b61-19e3-4177-b012-e8ec8048aed1-original-pull-secret podName:bd4a3b61-19e3-4177-b012-e8ec8048aed1 nodeName:}" failed. No retries permitted until 2026-09-05 02:17:56.565674319 +0000 UTC m=+3.067811907 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/bd4a3b61-19e3-4177-b012-e8ec8048aed1-original-pull-secret") pod "global-pull-secret-syncer-ghjcr" (UID: "bd4a3b61-19e3-4177-b012-e8ec8048aed1") : object "kube-system"/"original-pull-secret" not registered Sep 05 02:17:55.565765 ip-10-0-133-250 kubenswrapper[2555]: E0905 02:17:55.565715 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ba04f298-aebd-463b-940e-8a446b160645-kube-api-access-wqnrh podName:ba04f298-aebd-463b-940e-8a446b160645 nodeName:}" failed. No retries permitted until 2026-09-05 02:17:56.565703272 +0000 UTC m=+3.067840860 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-wqnrh" (UniqueName: "kubernetes.io/projected/ba04f298-aebd-463b-940e-8a446b160645-kube-api-access-wqnrh") pod "network-check-target-zt7r6" (UID: "ba04f298-aebd-463b-940e-8a446b160645") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 05 02:17:55.565765 ip-10-0-133-250 kubenswrapper[2555]: E0905 02:17:55.565641 2555 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 05 02:17:55.565765 ip-10-0-133-250 kubenswrapper[2555]: E0905 02:17:55.565763 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2fc3d6af-c656-4be0-8188-317d2dde7a6b-metrics-certs podName:2fc3d6af-c656-4be0-8188-317d2dde7a6b nodeName:}" failed. No retries permitted until 2026-09-05 02:17:56.565750992 +0000 UTC m=+3.067888573 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2fc3d6af-c656-4be0-8188-317d2dde7a6b-metrics-certs") pod "network-metrics-daemon-2x2gr" (UID: "2fc3d6af-c656-4be0-8188-317d2dde7a6b") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 05 02:17:55.895682 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:55.895649 2555 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Sep 05 02:17:55.993255 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:55.993147 2555 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-04 02:12:55 +0000 UTC" deadline="2028-02-01 02:18:42.721453791 +0000 UTC" Sep 05 02:17:55.993255 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:55.993206 2555 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12336h0m46.72825211s" Sep 05 02:17:56.067637 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:56.067602 2555 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Sep 05 02:17:56.092057 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:56.091770 2555 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Sep 05 02:17:56.122439 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:56.122332 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-4gpmf" event={"ID":"c2dc61db-cd5c-4972-b21e-633ad3b71ef5","Type":"ContainerStarted","Data":"af0062238594e3f19b3fd954d0397c431c4c1d32b16c46117be482eabf1ff572"} Sep 05 02:17:56.137928 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:56.137890 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-nvjx5" event={"ID":"3f060a3e-d7fc-4886-bca4-7564087e02ac","Type":"ContainerStarted","Data":"c2d582cbbea99c751f951088ef969a8373eb033a32a6bdeb4f3fcd725159ff93"} Sep 05 02:17:56.149543 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:56.149341 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mz2wx" event={"ID":"45944019-aa1a-49fd-a178-a6a38ad9a139","Type":"ContainerStarted","Data":"829612f08a4660b8f85ba923617daa5a1ea2c8f61031394c56712a9a6fb05571"} Sep 05 02:17:56.166253 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:56.164551 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-bz7s2" event={"ID":"86874f7b-fd54-4c79-9346-2c3f6d1e8508","Type":"ContainerStarted","Data":"8aa6f6a0f921321ea249872826d12069f2249035fff249c93c24031c64e7c0bd"} Sep 05 02:17:56.186757 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:56.186721 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-v4hcb" event={"ID":"9fccb273-b727-42f4-8e22-50f62446778f","Type":"ContainerStarted","Data":"e85361a172661b525e2761870bf137575500638701fcc24cb9c8ea03e080bc5c"} Sep 05 02:17:56.204738 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:56.204640 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-qf6xm" event={"ID":"4ddfb9fd-38a7-4b2d-bb70-5e5c4494a02d","Type":"ContainerStarted","Data":"3d68c8155383169161f8fba2b218d75a2d0170fd883d5fcf6551468a866ca4ec"} Sep 05 02:17:56.218573 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:56.218342 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-250.ec2.internal" event={"ID":"ccb165d55e894605f0ca2c828f2460a9","Type":"ContainerStarted","Data":"ed4e08fe072c7c85c24fbdcc0852995315071e7ddafe558c646e8adcd1f0cc44"} Sep 05 02:17:56.238513 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:56.238478 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-250.ec2.internal" event={"ID":"ab785fdfa0a233510495d26882d5258b","Type":"ContainerStarted","Data":"d204852e896999ea014856f0979455d9ee2b4a2db7f6171d0b1c5069442a4691"} Sep 05 02:17:56.252049 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:56.252004 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-n5fs5" event={"ID":"8de62bad-6e7c-4c9e-bb4a-49914420c1de","Type":"ContainerStarted","Data":"0fc4b858db5ea254bf62ae2d08b5eaac00b010de9f6e387529f474dfd166a666"} Sep 05 02:17:56.257719 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:56.257692 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-lq8k6" event={"ID":"c3aed02f-b69d-4743-8089-e6b5f142dbc1","Type":"ContainerStarted","Data":"b483824eb88be515063920bcc463734ecab916d303edad4a38de81146d78c1ec"} Sep 05 02:17:56.270993 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:56.270965 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h9kcl" event={"ID":"7ff62e18-55f4-4bdf-83b2-5e0a4f419ad4","Type":"ContainerStarted","Data":"3d0a833b69dbf4feb15abac05cda8c6fdd72d264191e46df722c77ad97d09f95"} Sep 05 02:17:56.573500 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:56.573428 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2fc3d6af-c656-4be0-8188-317d2dde7a6b-metrics-certs\") pod \"network-metrics-daemon-2x2gr\" (UID: \"2fc3d6af-c656-4be0-8188-317d2dde7a6b\") " pod="openshift-multus/network-metrics-daemon-2x2gr" Sep 05 02:17:56.573500 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:56.573491 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wqnrh\" (UniqueName: \"kubernetes.io/projected/ba04f298-aebd-463b-940e-8a446b160645-kube-api-access-wqnrh\") pod \"network-check-target-zt7r6\" (UID: \"ba04f298-aebd-463b-940e-8a446b160645\") " pod="openshift-network-diagnostics/network-check-target-zt7r6" Sep 05 02:17:56.573746 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:56.573540 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/bd4a3b61-19e3-4177-b012-e8ec8048aed1-original-pull-secret\") pod \"global-pull-secret-syncer-ghjcr\" (UID: \"bd4a3b61-19e3-4177-b012-e8ec8048aed1\") " pod="kube-system/global-pull-secret-syncer-ghjcr" Sep 05 02:17:56.573746 ip-10-0-133-250 kubenswrapper[2555]: E0905 02:17:56.573665 2555 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 05 02:17:56.573746 ip-10-0-133-250 kubenswrapper[2555]: E0905 02:17:56.573727 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bd4a3b61-19e3-4177-b012-e8ec8048aed1-original-pull-secret podName:bd4a3b61-19e3-4177-b012-e8ec8048aed1 nodeName:}" failed. No retries permitted until 2026-09-05 02:17:58.573706784 +0000 UTC m=+5.075844390 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/bd4a3b61-19e3-4177-b012-e8ec8048aed1-original-pull-secret") pod "global-pull-secret-syncer-ghjcr" (UID: "bd4a3b61-19e3-4177-b012-e8ec8048aed1") : object "kube-system"/"original-pull-secret" not registered Sep 05 02:17:56.573914 ip-10-0-133-250 kubenswrapper[2555]: E0905 02:17:56.573753 2555 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 05 02:17:56.573914 ip-10-0-133-250 kubenswrapper[2555]: E0905 02:17:56.573793 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2fc3d6af-c656-4be0-8188-317d2dde7a6b-metrics-certs podName:2fc3d6af-c656-4be0-8188-317d2dde7a6b nodeName:}" failed. No retries permitted until 2026-09-05 02:17:58.573780847 +0000 UTC m=+5.075918427 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2fc3d6af-c656-4be0-8188-317d2dde7a6b-metrics-certs") pod "network-metrics-daemon-2x2gr" (UID: "2fc3d6af-c656-4be0-8188-317d2dde7a6b") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 05 02:17:56.573914 ip-10-0-133-250 kubenswrapper[2555]: E0905 02:17:56.573882 2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 05 02:17:56.573914 ip-10-0-133-250 kubenswrapper[2555]: E0905 02:17:56.573899 2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 05 02:17:56.573914 ip-10-0-133-250 kubenswrapper[2555]: E0905 02:17:56.573912 2555 projected.go:196] Error preparing data for projected volume kube-api-access-wqnrh for pod openshift-network-diagnostics/network-check-target-zt7r6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 05 02:17:56.574199 ip-10-0-133-250 kubenswrapper[2555]: E0905 02:17:56.573962 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ba04f298-aebd-463b-940e-8a446b160645-kube-api-access-wqnrh podName:ba04f298-aebd-463b-940e-8a446b160645 nodeName:}" failed. No retries permitted until 2026-09-05 02:17:58.573949987 +0000 UTC m=+5.076087572 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-wqnrh" (UniqueName: "kubernetes.io/projected/ba04f298-aebd-463b-940e-8a446b160645-kube-api-access-wqnrh") pod "network-check-target-zt7r6" (UID: "ba04f298-aebd-463b-940e-8a446b160645") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 05 02:17:56.993808 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:56.993733 2555 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-04 02:12:55 +0000 UTC" deadline="2028-05-19 06:11:39.602511844 +0000 UTC" Sep 05 02:17:56.993808 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:56.993772 2555 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14931h53m42.60874494s" Sep 05 02:17:57.077779 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:57.077739 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2x2gr" Sep 05 02:17:57.078047 ip-10-0-133-250 kubenswrapper[2555]: E0905 02:17:57.077986 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2x2gr" podUID="2fc3d6af-c656-4be0-8188-317d2dde7a6b" Sep 05 02:17:57.078502 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:57.078481 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ghjcr" Sep 05 02:17:57.078642 ip-10-0-133-250 kubenswrapper[2555]: E0905 02:17:57.078586 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ghjcr" podUID="bd4a3b61-19e3-4177-b012-e8ec8048aed1" Sep 05 02:17:57.078719 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:57.078648 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zt7r6" Sep 05 02:17:57.078784 ip-10-0-133-250 kubenswrapper[2555]: E0905 02:17:57.078717 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zt7r6" podUID="ba04f298-aebd-463b-940e-8a446b160645" Sep 05 02:17:58.596613 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:58.595620 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/bd4a3b61-19e3-4177-b012-e8ec8048aed1-original-pull-secret\") pod \"global-pull-secret-syncer-ghjcr\" (UID: \"bd4a3b61-19e3-4177-b012-e8ec8048aed1\") " pod="kube-system/global-pull-secret-syncer-ghjcr" Sep 05 02:17:58.596613 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:58.595683 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2fc3d6af-c656-4be0-8188-317d2dde7a6b-metrics-certs\") pod \"network-metrics-daemon-2x2gr\" (UID: \"2fc3d6af-c656-4be0-8188-317d2dde7a6b\") " pod="openshift-multus/network-metrics-daemon-2x2gr" Sep 05 02:17:58.596613 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:58.595725 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wqnrh\" (UniqueName: \"kubernetes.io/projected/ba04f298-aebd-463b-940e-8a446b160645-kube-api-access-wqnrh\") pod \"network-check-target-zt7r6\" (UID: \"ba04f298-aebd-463b-940e-8a446b160645\") " pod="openshift-network-diagnostics/network-check-target-zt7r6" Sep 05 02:17:58.596613 ip-10-0-133-250 kubenswrapper[2555]: E0905 02:17:58.595893 2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 05 02:17:58.596613 ip-10-0-133-250 kubenswrapper[2555]: E0905 02:17:58.595917 2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 05 02:17:58.596613 ip-10-0-133-250 kubenswrapper[2555]: E0905 02:17:58.595930 2555 projected.go:196] Error preparing data for projected volume kube-api-access-wqnrh for pod openshift-network-diagnostics/network-check-target-zt7r6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 05 02:17:58.596613 ip-10-0-133-250 kubenswrapper[2555]: E0905 02:17:58.595991 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ba04f298-aebd-463b-940e-8a446b160645-kube-api-access-wqnrh podName:ba04f298-aebd-463b-940e-8a446b160645 nodeName:}" failed. No retries permitted until 2026-09-05 02:18:02.595971304 +0000 UTC m=+9.098108897 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-wqnrh" (UniqueName: "kubernetes.io/projected/ba04f298-aebd-463b-940e-8a446b160645-kube-api-access-wqnrh") pod "network-check-target-zt7r6" (UID: "ba04f298-aebd-463b-940e-8a446b160645") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 05 02:17:58.596613 ip-10-0-133-250 kubenswrapper[2555]: E0905 02:17:58.596393 2555 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 05 02:17:58.596613 ip-10-0-133-250 kubenswrapper[2555]: E0905 02:17:58.596459 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2fc3d6af-c656-4be0-8188-317d2dde7a6b-metrics-certs podName:2fc3d6af-c656-4be0-8188-317d2dde7a6b nodeName:}" failed. No retries permitted until 2026-09-05 02:18:02.596440232 +0000 UTC m=+9.098577826 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2fc3d6af-c656-4be0-8188-317d2dde7a6b-metrics-certs") pod "network-metrics-daemon-2x2gr" (UID: "2fc3d6af-c656-4be0-8188-317d2dde7a6b") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 05 02:17:58.596613 ip-10-0-133-250 kubenswrapper[2555]: E0905 02:17:58.596505 2555 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 05 02:17:58.596613 ip-10-0-133-250 kubenswrapper[2555]: E0905 02:17:58.596559 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bd4a3b61-19e3-4177-b012-e8ec8048aed1-original-pull-secret podName:bd4a3b61-19e3-4177-b012-e8ec8048aed1 nodeName:}" failed. No retries permitted until 2026-09-05 02:18:02.596542109 +0000 UTC m=+9.098679702 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/bd4a3b61-19e3-4177-b012-e8ec8048aed1-original-pull-secret") pod "global-pull-secret-syncer-ghjcr" (UID: "bd4a3b61-19e3-4177-b012-e8ec8048aed1") : object "kube-system"/"original-pull-secret" not registered Sep 05 02:17:59.077723 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:59.077688 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ghjcr" Sep 05 02:17:59.077723 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:59.077688 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2x2gr" Sep 05 02:17:59.077989 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:17:59.077699 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zt7r6" Sep 05 02:17:59.077989 ip-10-0-133-250 kubenswrapper[2555]: E0905 02:17:59.077839 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ghjcr" podUID="bd4a3b61-19e3-4177-b012-e8ec8048aed1" Sep 05 02:17:59.077989 ip-10-0-133-250 kubenswrapper[2555]: E0905 02:17:59.077899 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zt7r6" podUID="ba04f298-aebd-463b-940e-8a446b160645" Sep 05 02:17:59.078171 ip-10-0-133-250 kubenswrapper[2555]: E0905 02:17:59.078044 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2x2gr" podUID="2fc3d6af-c656-4be0-8188-317d2dde7a6b" Sep 05 02:18:01.079178 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:18:01.078251 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2x2gr" Sep 05 02:18:01.079178 ip-10-0-133-250 kubenswrapper[2555]: E0905 02:18:01.078410 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2x2gr" podUID="2fc3d6af-c656-4be0-8188-317d2dde7a6b" Sep 05 02:18:01.079178 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:18:01.078876 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ghjcr" Sep 05 02:18:01.079178 ip-10-0-133-250 kubenswrapper[2555]: E0905 02:18:01.078976 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ghjcr" podUID="bd4a3b61-19e3-4177-b012-e8ec8048aed1" Sep 05 02:18:01.079178 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:18:01.079039 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zt7r6" Sep 05 02:18:01.079178 ip-10-0-133-250 kubenswrapper[2555]: E0905 02:18:01.079131 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zt7r6" podUID="ba04f298-aebd-463b-940e-8a446b160645" Sep 05 02:18:02.637062 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:18:02.637007 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/bd4a3b61-19e3-4177-b012-e8ec8048aed1-original-pull-secret\") pod \"global-pull-secret-syncer-ghjcr\" (UID: \"bd4a3b61-19e3-4177-b012-e8ec8048aed1\") " pod="kube-system/global-pull-secret-syncer-ghjcr" Sep 05 02:18:02.637633 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:18:02.637094 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2fc3d6af-c656-4be0-8188-317d2dde7a6b-metrics-certs\") pod \"network-metrics-daemon-2x2gr\" (UID: \"2fc3d6af-c656-4be0-8188-317d2dde7a6b\") " pod="openshift-multus/network-metrics-daemon-2x2gr" Sep 05 02:18:02.637633 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:18:02.637143 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wqnrh\" (UniqueName: \"kubernetes.io/projected/ba04f298-aebd-463b-940e-8a446b160645-kube-api-access-wqnrh\") pod \"network-check-target-zt7r6\" (UID: \"ba04f298-aebd-463b-940e-8a446b160645\") " pod="openshift-network-diagnostics/network-check-target-zt7r6" Sep 05 02:18:02.637633 ip-10-0-133-250 kubenswrapper[2555]: E0905 02:18:02.637303 2555 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 05 02:18:02.637633 ip-10-0-133-250 kubenswrapper[2555]: E0905 02:18:02.637390 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bd4a3b61-19e3-4177-b012-e8ec8048aed1-original-pull-secret podName:bd4a3b61-19e3-4177-b012-e8ec8048aed1 nodeName:}" failed. No retries permitted until 2026-09-05 02:18:10.637364528 +0000 UTC m=+17.139502125 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/bd4a3b61-19e3-4177-b012-e8ec8048aed1-original-pull-secret") pod "global-pull-secret-syncer-ghjcr" (UID: "bd4a3b61-19e3-4177-b012-e8ec8048aed1") : object "kube-system"/"original-pull-secret" not registered Sep 05 02:18:02.637633 ip-10-0-133-250 kubenswrapper[2555]: E0905 02:18:02.637307 2555 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 05 02:18:02.637633 ip-10-0-133-250 kubenswrapper[2555]: E0905 02:18:02.637464 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2fc3d6af-c656-4be0-8188-317d2dde7a6b-metrics-certs podName:2fc3d6af-c656-4be0-8188-317d2dde7a6b nodeName:}" failed. No retries permitted until 2026-09-05 02:18:10.63744786 +0000 UTC m=+17.139585449 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2fc3d6af-c656-4be0-8188-317d2dde7a6b-metrics-certs") pod "network-metrics-daemon-2x2gr" (UID: "2fc3d6af-c656-4be0-8188-317d2dde7a6b") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 05 02:18:02.637633 ip-10-0-133-250 kubenswrapper[2555]: E0905 02:18:02.637311 2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 05 02:18:02.637633 ip-10-0-133-250 kubenswrapper[2555]: E0905 02:18:02.637492 2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 05 02:18:02.637633 ip-10-0-133-250 kubenswrapper[2555]: E0905 02:18:02.637506 2555 projected.go:196] Error preparing data for projected volume kube-api-access-wqnrh for pod openshift-network-diagnostics/network-check-target-zt7r6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 05 02:18:02.637633 ip-10-0-133-250 kubenswrapper[2555]: E0905 02:18:02.637541 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ba04f298-aebd-463b-940e-8a446b160645-kube-api-access-wqnrh podName:ba04f298-aebd-463b-940e-8a446b160645 nodeName:}" failed. No retries permitted until 2026-09-05 02:18:10.63752887 +0000 UTC m=+17.139666447 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-wqnrh" (UniqueName: "kubernetes.io/projected/ba04f298-aebd-463b-940e-8a446b160645-kube-api-access-wqnrh") pod "network-check-target-zt7r6" (UID: "ba04f298-aebd-463b-940e-8a446b160645") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 05 02:18:03.078451 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:18:03.078377 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ghjcr" Sep 05 02:18:03.078451 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:18:03.078406 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zt7r6" Sep 05 02:18:03.078690 ip-10-0-133-250 kubenswrapper[2555]: E0905 02:18:03.078499 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ghjcr" podUID="bd4a3b61-19e3-4177-b012-e8ec8048aed1" Sep 05 02:18:03.078690 ip-10-0-133-250 kubenswrapper[2555]: E0905 02:18:03.078569 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zt7r6" podUID="ba04f298-aebd-463b-940e-8a446b160645" Sep 05 02:18:03.078690 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:18:03.078630 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2x2gr" Sep 05 02:18:03.078828 ip-10-0-133-250 kubenswrapper[2555]: E0905 02:18:03.078746 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2x2gr" podUID="2fc3d6af-c656-4be0-8188-317d2dde7a6b" Sep 05 02:18:05.077747 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:18:05.077714 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zt7r6" Sep 05 02:18:05.078196 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:18:05.077774 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2x2gr" Sep 05 02:18:05.078196 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:18:05.077777 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ghjcr" Sep 05 02:18:05.078196 ip-10-0-133-250 kubenswrapper[2555]: E0905 02:18:05.077873 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zt7r6" podUID="ba04f298-aebd-463b-940e-8a446b160645" Sep 05 02:18:05.078196 ip-10-0-133-250 kubenswrapper[2555]: E0905 02:18:05.077972 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2x2gr" podUID="2fc3d6af-c656-4be0-8188-317d2dde7a6b" Sep 05 02:18:05.078196 ip-10-0-133-250 kubenswrapper[2555]: E0905 02:18:05.078077 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ghjcr" podUID="bd4a3b61-19e3-4177-b012-e8ec8048aed1" Sep 05 02:18:07.078011 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:18:07.077976 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zt7r6" Sep 05 02:18:07.078011 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:18:07.077996 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2x2gr" Sep 05 02:18:07.078011 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:18:07.078013 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ghjcr" Sep 05 02:18:07.078551 ip-10-0-133-250 kubenswrapper[2555]: E0905 02:18:07.078113 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zt7r6" podUID="ba04f298-aebd-463b-940e-8a446b160645" Sep 05 02:18:07.078551 ip-10-0-133-250 kubenswrapper[2555]: E0905 02:18:07.078182 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2x2gr" podUID="2fc3d6af-c656-4be0-8188-317d2dde7a6b" Sep 05 02:18:07.078551 ip-10-0-133-250 kubenswrapper[2555]: E0905 02:18:07.078276 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ghjcr" podUID="bd4a3b61-19e3-4177-b012-e8ec8048aed1" Sep 05 02:18:09.078299 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:18:09.078262 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ghjcr" Sep 05 02:18:09.078299 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:18:09.078291 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zt7r6" Sep 05 02:18:09.078923 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:18:09.078302 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2x2gr" Sep 05 02:18:09.078923 ip-10-0-133-250 kubenswrapper[2555]: E0905 02:18:09.078387 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ghjcr" podUID="bd4a3b61-19e3-4177-b012-e8ec8048aed1" Sep 05 02:18:09.078923 ip-10-0-133-250 kubenswrapper[2555]: E0905 02:18:09.078488 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zt7r6" podUID="ba04f298-aebd-463b-940e-8a446b160645" Sep 05 02:18:09.078923 ip-10-0-133-250 kubenswrapper[2555]: E0905 02:18:09.078596 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2x2gr" podUID="2fc3d6af-c656-4be0-8188-317d2dde7a6b" Sep 05 02:18:10.694445 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:18:10.694354 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/bd4a3b61-19e3-4177-b012-e8ec8048aed1-original-pull-secret\") pod \"global-pull-secret-syncer-ghjcr\" (UID: \"bd4a3b61-19e3-4177-b012-e8ec8048aed1\") " pod="kube-system/global-pull-secret-syncer-ghjcr" Sep 05 02:18:10.694445 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:18:10.694418 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2fc3d6af-c656-4be0-8188-317d2dde7a6b-metrics-certs\") pod \"network-metrics-daemon-2x2gr\" (UID: \"2fc3d6af-c656-4be0-8188-317d2dde7a6b\") " pod="openshift-multus/network-metrics-daemon-2x2gr" Sep 05 02:18:10.694917 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:18:10.694455 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wqnrh\" (UniqueName: \"kubernetes.io/projected/ba04f298-aebd-463b-940e-8a446b160645-kube-api-access-wqnrh\") pod \"network-check-target-zt7r6\" (UID: \"ba04f298-aebd-463b-940e-8a446b160645\") " pod="openshift-network-diagnostics/network-check-target-zt7r6" Sep 05 02:18:10.694917 ip-10-0-133-250 kubenswrapper[2555]: E0905 02:18:10.694511 2555 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 05 02:18:10.694917 ip-10-0-133-250 kubenswrapper[2555]: E0905 02:18:10.694567 2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 05 02:18:10.694917 ip-10-0-133-250 kubenswrapper[2555]: E0905 02:18:10.694581 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bd4a3b61-19e3-4177-b012-e8ec8048aed1-original-pull-secret podName:bd4a3b61-19e3-4177-b012-e8ec8048aed1 nodeName:}" failed. No retries permitted until 2026-09-05 02:18:26.694560603 +0000 UTC m=+33.196698195 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/bd4a3b61-19e3-4177-b012-e8ec8048aed1-original-pull-secret") pod "global-pull-secret-syncer-ghjcr" (UID: "bd4a3b61-19e3-4177-b012-e8ec8048aed1") : object "kube-system"/"original-pull-secret" not registered Sep 05 02:18:10.694917 ip-10-0-133-250 kubenswrapper[2555]: E0905 02:18:10.694584 2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 05 02:18:10.694917 ip-10-0-133-250 kubenswrapper[2555]: E0905 02:18:10.694599 2555 projected.go:196] Error preparing data for projected volume kube-api-access-wqnrh for pod openshift-network-diagnostics/network-check-target-zt7r6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 05 02:18:10.694917 ip-10-0-133-250 kubenswrapper[2555]: E0905 02:18:10.694580 2555 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 05 02:18:10.694917 ip-10-0-133-250 kubenswrapper[2555]: E0905 02:18:10.694634 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ba04f298-aebd-463b-940e-8a446b160645-kube-api-access-wqnrh podName:ba04f298-aebd-463b-940e-8a446b160645 nodeName:}" failed. No retries permitted until 2026-09-05 02:18:26.694623251 +0000 UTC m=+33.196760842 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-wqnrh" (UniqueName: "kubernetes.io/projected/ba04f298-aebd-463b-940e-8a446b160645-kube-api-access-wqnrh") pod "network-check-target-zt7r6" (UID: "ba04f298-aebd-463b-940e-8a446b160645") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 05 02:18:10.694917 ip-10-0-133-250 kubenswrapper[2555]: E0905 02:18:10.694722 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2fc3d6af-c656-4be0-8188-317d2dde7a6b-metrics-certs podName:2fc3d6af-c656-4be0-8188-317d2dde7a6b nodeName:}" failed. No retries permitted until 2026-09-05 02:18:26.694697606 +0000 UTC m=+33.196835196 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2fc3d6af-c656-4be0-8188-317d2dde7a6b-metrics-certs") pod "network-metrics-daemon-2x2gr" (UID: "2fc3d6af-c656-4be0-8188-317d2dde7a6b") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 05 02:18:11.077905 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:18:11.077845 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ghjcr" Sep 05 02:18:11.078131 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:18:11.077977 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zt7r6" Sep 05 02:18:11.078131 ip-10-0-133-250 kubenswrapper[2555]: E0905 02:18:11.078090 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zt7r6" podUID="ba04f298-aebd-463b-940e-8a446b160645" Sep 05 02:18:11.078131 ip-10-0-133-250 kubenswrapper[2555]: E0905 02:18:11.077977 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ghjcr" podUID="bd4a3b61-19e3-4177-b012-e8ec8048aed1" Sep 05 02:18:11.078131 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:18:11.077983 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2x2gr" Sep 05 02:18:11.078354 ip-10-0-133-250 kubenswrapper[2555]: E0905 02:18:11.078209 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2x2gr" podUID="2fc3d6af-c656-4be0-8188-317d2dde7a6b" Sep 05 02:18:13.077959 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:18:13.077920 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2x2gr" Sep 05 02:18:13.078517 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:18:13.077921 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ghjcr" Sep 05 02:18:13.078517 ip-10-0-133-250 kubenswrapper[2555]: E0905 02:18:13.078060 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2x2gr" podUID="2fc3d6af-c656-4be0-8188-317d2dde7a6b" Sep 05 02:18:13.078517 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:18:13.077924 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zt7r6" Sep 05 02:18:13.078517 ip-10-0-133-250 kubenswrapper[2555]: E0905 02:18:13.078151 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ghjcr" podUID="bd4a3b61-19e3-4177-b012-e8ec8048aed1" Sep 05 02:18:13.078517 ip-10-0-133-250 kubenswrapper[2555]: E0905 02:18:13.078215 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zt7r6" podUID="ba04f298-aebd-463b-940e-8a446b160645" Sep 05 02:18:15.078067 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:18:15.077757 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2x2gr" Sep 05 02:18:15.078656 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:18:15.077757 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zt7r6" Sep 05 02:18:15.078656 ip-10-0-133-250 kubenswrapper[2555]: E0905 02:18:15.078376 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2x2gr" podUID="2fc3d6af-c656-4be0-8188-317d2dde7a6b" Sep 05 02:18:15.078656 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:18:15.077797 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ghjcr" Sep 05 02:18:15.078807 ip-10-0-133-250 kubenswrapper[2555]: E0905 02:18:15.078681 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zt7r6" podUID="ba04f298-aebd-463b-940e-8a446b160645" Sep 05 02:18:15.078872 ip-10-0-133-250 kubenswrapper[2555]: E0905 02:18:15.078800 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ghjcr" podUID="bd4a3b61-19e3-4177-b012-e8ec8048aed1" Sep 05 02:18:15.324453 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:18:15.324371 2555 generic.go:356] "Generic (PLEG): container finished" podID="9fccb273-b727-42f4-8e22-50f62446778f" containerID="3228c212ee598a58e3578c4da2590f73e67e444bd6d9bcf5acf75c9d42a6d47b" exitCode=0 Sep 05 02:18:15.324600 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:18:15.324465 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-v4hcb" event={"ID":"9fccb273-b727-42f4-8e22-50f62446778f","Type":"ContainerDied","Data":"3228c212ee598a58e3578c4da2590f73e67e444bd6d9bcf5acf75c9d42a6d47b"} Sep 05 02:18:15.326341 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:18:15.326241 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-qf6xm" event={"ID":"4ddfb9fd-38a7-4b2d-bb70-5e5c4494a02d","Type":"ContainerStarted","Data":"7abaafa805b5bf3322e55bb7296dd92dde5a9c32b5b69a219c6fcaea33113a49"} Sep 05 02:18:15.328054 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:18:15.328003 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-250.ec2.internal" event={"ID":"ccb165d55e894605f0ca2c828f2460a9","Type":"ContainerStarted","Data":"cfb8a33a07fcb3da8ed3cfe6c7a899aedfd18001006c82f2bbf64376404cdc06"} Sep 05 02:18:15.329634 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:18:15.329610 2555 generic.go:356] "Generic (PLEG): container finished" podID="ab785fdfa0a233510495d26882d5258b" containerID="e618b0f36fe30215862da3956d0b1b8fbf714d22ce4fb1b7408369685623556e" exitCode=0 Sep 05 02:18:15.329733 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:18:15.329691 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-250.ec2.internal" event={"ID":"ab785fdfa0a233510495d26882d5258b","Type":"ContainerDied","Data":"e618b0f36fe30215862da3956d0b1b8fbf714d22ce4fb1b7408369685623556e"} Sep 05 02:18:15.331418 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:18:15.331396 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-n5fs5" event={"ID":"8de62bad-6e7c-4c9e-bb4a-49914420c1de","Type":"ContainerStarted","Data":"7d8155eb30cb45896920b1e45c08c9494299fd37449f28db48dea4e13bedacd3"} Sep 05 02:18:15.333218 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:18:15.333190 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-lq8k6" event={"ID":"c3aed02f-b69d-4743-8089-e6b5f142dbc1","Type":"ContainerStarted","Data":"85c58f7c296d83d78484c009a50d268f2caa34c22410b2cb4d04c7841be3680b"} Sep 05 02:18:15.334835 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:18:15.334812 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h9kcl" event={"ID":"7ff62e18-55f4-4bdf-83b2-5e0a4f419ad4","Type":"ContainerStarted","Data":"67e486992dab4104cb1b98b878b21326c94468c0d5f4db1132d2f02d526d5bf4"} Sep 05 02:18:15.336303 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:18:15.336282 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-4gpmf" event={"ID":"c2dc61db-cd5c-4972-b21e-633ad3b71ef5","Type":"ContainerStarted","Data":"a09fb75808d3720b6df2e48f365b46eed446e7170946b51ea5ca29d9f2709d5c"} Sep 05 02:18:15.338147 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:18:15.338123 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-nvjx5" event={"ID":"3f060a3e-d7fc-4886-bca4-7564087e02ac","Type":"ContainerStarted","Data":"3af930ce0c5022b7e3fa8f85ade25dd429b224c1d46b1164b436dbd7aa5d2fff"} Sep 05 02:18:15.341537 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:18:15.341520 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mz2wx" event={"ID":"45944019-aa1a-49fd-a178-a6a38ad9a139","Type":"ContainerStarted","Data":"3767986e412611d36edb78276869e379a12c993abec17b9f50f1c3a7a077cd11"} Sep 05 02:18:15.341640 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:18:15.341568 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mz2wx" event={"ID":"45944019-aa1a-49fd-a178-a6a38ad9a139","Type":"ContainerStarted","Data":"daac30a9cf2d0e36a81f27778ce771d8b2f673200044f3589850103baaa16fe6"} Sep 05 02:18:15.341640 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:18:15.341600 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mz2wx" event={"ID":"45944019-aa1a-49fd-a178-a6a38ad9a139","Type":"ContainerStarted","Data":"033d4976339899bb77839e9efc9e61e05b8e813013d8aab3c75c247b82de0756"} Sep 05 02:18:15.341640 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:18:15.341628 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mz2wx" event={"ID":"45944019-aa1a-49fd-a178-a6a38ad9a139","Type":"ContainerStarted","Data":"05be59f2da49bacee68cc6d9288e503c93ce1d61f8444f57c6e0633c15b74de4"} Sep 05 02:18:15.341800 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:18:15.341665 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mz2wx" event={"ID":"45944019-aa1a-49fd-a178-a6a38ad9a139","Type":"ContainerStarted","Data":"9098e2fac926c6ed4db647a15b13e1335ba8341fa33749980de8e462bea0745a"} Sep 05 02:18:15.341800 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:18:15.341699 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mz2wx" event={"ID":"45944019-aa1a-49fd-a178-a6a38ad9a139","Type":"ContainerStarted","Data":"5d68038e323d324441bff57f25655eabd14d204aa2f3a38ccd782dd1fab01d44"} Sep 05 02:18:15.364517 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:18:15.364465 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-lq8k6" podStartSLOduration=2.378533546 podStartE2EDuration="21.364447876s" totalImagesPullingTime="18.98591433s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-05 02:17:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-05 02:18:15.363561091 +0000 UTC m=+21.865698688" watchObservedRunningTime="2026-09-05 02:18:15.364447876 +0000 UTC m=+21.866585474" Sep 05 02:18:15.385044 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:18:15.384707 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-n5fs5" podStartSLOduration=2.389259091 podStartE2EDuration="21.384690541s" totalImagesPullingTime="18.99543145s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-05 02:17:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-05 02:18:15.384631522 +0000 UTC m=+21.886769121" watchObservedRunningTime="2026-09-05 02:18:15.384690541 +0000 UTC m=+21.886828140" Sep 05 02:18:15.424080 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:18:15.424032 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-250.ec2.internal" podStartSLOduration=21.423999449 podStartE2EDuration="21.423999449s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-05 02:17:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-05 02:18:15.423430283 +0000 UTC m=+21.925567881" watchObservedRunningTime="2026-09-05 02:18:15.423999449 +0000 UTC m=+21.926137048" Sep 05 02:18:15.439517 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:18:15.439465 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-nvjx5" podStartSLOduration=2.404456743 podStartE2EDuration="21.439450615s" totalImagesPullingTime="19.034993872s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-05 02:17:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-05 02:18:15.439188522 +0000 UTC m=+21.941326122" watchObservedRunningTime="2026-09-05 02:18:15.439450615 +0000 UTC m=+21.941588213" Sep 05 02:18:15.460363 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:18:15.460313 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-qf6xm" podStartSLOduration=2.4059194919999998 podStartE2EDuration="21.460294174s" totalImagesPullingTime="19.054374682s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-05 02:17:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-05 02:18:15.460293491 +0000 UTC m=+21.962431089" watchObservedRunningTime="2026-09-05 02:18:15.460294174 +0000 UTC m=+21.962431772" Sep 05 02:18:15.479237 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:18:15.479194 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-4gpmf" podStartSLOduration=2.449398025 podStartE2EDuration="21.479181212s" totalImagesPullingTime="19.029783187s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-05 02:17:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-05 02:18:15.478872853 +0000 UTC m=+21.981010432" watchObservedRunningTime="2026-09-05 02:18:15.479181212 +0000 UTC m=+21.981318809" Sep 05 02:18:15.769643 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:18:15.769620 2555 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Sep 05 02:18:16.019262 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:18:16.019130 2555 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-05T02:18:15.769639419Z","UUID":"5da7ae0e-62be-48ef-821a-333ecc579811","Handler":null,"Name":"","Endpoint":""} Sep 05 02:18:16.020944 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:18:16.020920 2555 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Sep 05 02:18:16.021083 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:18:16.020955 2555 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Sep 05 02:18:16.346804 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:18:16.346714 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-250.ec2.internal" event={"ID":"ab785fdfa0a233510495d26882d5258b","Type":"ContainerStarted","Data":"d26213502faeee6c60ff0d25ce169c8ac13acccb3079f45430758022b6b13090"} Sep 05 02:18:16.349362 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:18:16.349327 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h9kcl" event={"ID":"7ff62e18-55f4-4bdf-83b2-5e0a4f419ad4","Type":"ContainerStarted","Data":"ac71874a719ece8fce5bbfb2099b256d08f5c7c2c8793459199239090a07c91b"} Sep 05 02:18:16.351751 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:18:16.351726 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-bz7s2" event={"ID":"86874f7b-fd54-4c79-9346-2c3f6d1e8508","Type":"ContainerStarted","Data":"7de80e086376a46ff3fdf46e20c9f6ac9cf56aef8a374563ffbffa0ec4265b70"} Sep 05 02:18:16.366190 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:18:16.366142 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-250.ec2.internal" podStartSLOduration=22.366122641 podStartE2EDuration="22.366122641s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-05 02:17:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-05 02:18:16.365369737 +0000 UTC m=+22.867507338" watchObservedRunningTime="2026-09-05 02:18:16.366122641 +0000 UTC m=+22.868260240" Sep 05 02:18:16.380583 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:18:16.380533 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-bz7s2" podStartSLOduration=3.437237931 podStartE2EDuration="22.380513828s" totalImagesPullingTime="18.943275897s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-05 02:17:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-05 02:18:16.380134177 +0000 UTC m=+22.882271776" watchObservedRunningTime="2026-09-05 02:18:16.380513828 +0000 UTC m=+22.882651427" Sep 05 02:18:17.077967 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:18:17.077745 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2x2gr" Sep 05 02:18:17.078092 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:18:17.077767 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ghjcr" Sep 05 02:18:17.078092 ip-10-0-133-250 kubenswrapper[2555]: E0905 02:18:17.078077 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2x2gr" podUID="2fc3d6af-c656-4be0-8188-317d2dde7a6b" Sep 05 02:18:17.078183 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:18:17.077794 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zt7r6" Sep 05 02:18:17.078183 ip-10-0-133-250 kubenswrapper[2555]: E0905 02:18:17.078119 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ghjcr" podUID="bd4a3b61-19e3-4177-b012-e8ec8048aed1" Sep 05 02:18:17.078270 ip-10-0-133-250 kubenswrapper[2555]: E0905 02:18:17.078216 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zt7r6" podUID="ba04f298-aebd-463b-940e-8a446b160645" Sep 05 02:18:17.356132 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:18:17.356047 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h9kcl" event={"ID":"7ff62e18-55f4-4bdf-83b2-5e0a4f419ad4","Type":"ContainerStarted","Data":"67b5f1ffad26428123e55af9d081e53aea9be267f96b7a26f939a16745dddf6e"} Sep 05 02:18:17.360221 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:18:17.360193 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mz2wx" event={"ID":"45944019-aa1a-49fd-a178-a6a38ad9a139","Type":"ContainerStarted","Data":"cb0ef3cdf3ba1303a747f2e188921ad4ebbc242b913c055481b3c177411cb7f7"} Sep 05 02:18:17.377399 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:18:17.377358 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-h9kcl" podStartSLOduration=2.733060635 podStartE2EDuration="23.377343077s" totalImagesPullingTime="20.644282442s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-05 02:17:54 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-05 02:18:17.375780653 +0000 UTC m=+23.877918269" watchObservedRunningTime="2026-09-05 02:18:17.377343077 +0000 UTC m=+23.879480673" Sep 05 02:18:19.078066 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:18:19.078033 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2x2gr" Sep 05 02:18:19.078502 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:18:19.078074 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zt7r6" Sep 05 02:18:19.078502 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:18:19.078032 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ghjcr" Sep 05 02:18:19.078502 ip-10-0-133-250 kubenswrapper[2555]: E0905 02:18:19.078169 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2x2gr" podUID="2fc3d6af-c656-4be0-8188-317d2dde7a6b" Sep 05 02:18:19.078502 ip-10-0-133-250 kubenswrapper[2555]: E0905 02:18:19.078252 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ghjcr" podUID="bd4a3b61-19e3-4177-b012-e8ec8048aed1" Sep 05 02:18:19.078502 ip-10-0-133-250 kubenswrapper[2555]: E0905 02:18:19.078318 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zt7r6" podUID="ba04f298-aebd-463b-940e-8a446b160645" Sep 05 02:18:19.439730 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:18:19.439700 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-nvjx5" Sep 05 02:18:19.844546 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:18:19.844357 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-nvjx5" Sep 05 02:18:19.844938 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:18:19.844922 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-nvjx5" Sep 05 02:18:20.370476 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:18:20.370443 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mz2wx" event={"ID":"45944019-aa1a-49fd-a178-a6a38ad9a139","Type":"ContainerStarted","Data":"9eae89688acbd574e6a6a3b14ee23cc11ed7455bfb6ca903e083cffd0b02fbbb"} Sep 05 02:18:20.370961 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:18:20.370853 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-mz2wx" Sep 05 02:18:20.370961 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:18:20.370936 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-mz2wx" Sep 05 02:18:20.371106 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:18:20.370989 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-mz2wx" Sep 05 02:18:20.372726 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:18:20.372697 2555 generic.go:356] "Generic (PLEG): container finished" podID="9fccb273-b727-42f4-8e22-50f62446778f" containerID="0e90b75182ee0600efc0f30de7f620728f699648cb0ce2a534aeba5d66021189" exitCode=0 Sep 05 02:18:20.372853 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:18:20.372780 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-v4hcb" event={"ID":"9fccb273-b727-42f4-8e22-50f62446778f","Type":"ContainerDied","Data":"0e90b75182ee0600efc0f30de7f620728f699648cb0ce2a534aeba5d66021189"} Sep 05 02:18:20.374012 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:18:20.373400 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-nvjx5" Sep 05 02:18:20.386215 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:18:20.386196 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-mz2wx" Sep 05 02:18:20.386340 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:18:20.386330 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-mz2wx" Sep 05 02:18:20.400209 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:18:20.400175 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-mz2wx" podStartSLOduration=7.335332416 podStartE2EDuration="26.40016376s" totalImagesPullingTime="19.064831344s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-05 02:17:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-05 02:18:20.398520712 +0000 UTC m=+26.900658321" watchObservedRunningTime="2026-09-05 02:18:20.40016376 +0000 UTC m=+26.902301356" Sep 05 02:18:21.078604 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:18:21.078526 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zt7r6" Sep 05 02:18:21.078694 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:18:21.078659 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2x2gr" Sep 05 02:18:21.078694 ip-10-0-133-250 kubenswrapper[2555]: E0905 02:18:21.078664 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zt7r6" podUID="ba04f298-aebd-463b-940e-8a446b160645" Sep 05 02:18:21.078694 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:18:21.078692 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ghjcr" Sep 05 02:18:21.078832 ip-10-0-133-250 kubenswrapper[2555]: E0905 02:18:21.078800 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2x2gr" podUID="2fc3d6af-c656-4be0-8188-317d2dde7a6b" Sep 05 02:18:21.078898 ip-10-0-133-250 kubenswrapper[2555]: E0905 02:18:21.078875 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ghjcr" podUID="bd4a3b61-19e3-4177-b012-e8ec8048aed1" Sep 05 02:18:21.293196 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:18:21.293156 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-ghjcr"] Sep 05 02:18:21.293739 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:18:21.293721 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-2x2gr"] Sep 05 02:18:21.294283 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:18:21.294261 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-zt7r6"] Sep 05 02:18:21.377156 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:18:21.377086 2555 generic.go:356] "Generic (PLEG): container finished" podID="9fccb273-b727-42f4-8e22-50f62446778f" containerID="eaea3582d74bd99740a121540643abe33ba1db02e0253ffcc53308a8b1d07867" exitCode=0 Sep 05 02:18:21.377156 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:18:21.377144 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-v4hcb" event={"ID":"9fccb273-b727-42f4-8e22-50f62446778f","Type":"ContainerDied","Data":"eaea3582d74bd99740a121540643abe33ba1db02e0253ffcc53308a8b1d07867"} Sep 05 02:18:21.377985 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:18:21.377391 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zt7r6" Sep 05 02:18:21.377985 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:18:21.377384 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2x2gr" Sep 05 02:18:21.377985 ip-10-0-133-250 kubenswrapper[2555]: E0905 02:18:21.377481 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zt7r6" podUID="ba04f298-aebd-463b-940e-8a446b160645" Sep 05 02:18:21.377985 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:18:21.377492 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ghjcr" Sep 05 02:18:21.377985 ip-10-0-133-250 kubenswrapper[2555]: E0905 02:18:21.377584 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ghjcr" podUID="bd4a3b61-19e3-4177-b012-e8ec8048aed1" Sep 05 02:18:21.377985 ip-10-0-133-250 kubenswrapper[2555]: E0905 02:18:21.377965 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2x2gr" podUID="2fc3d6af-c656-4be0-8188-317d2dde7a6b" Sep 05 02:18:22.382237 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:18:22.382203 2555 generic.go:356] "Generic (PLEG): container finished" podID="9fccb273-b727-42f4-8e22-50f62446778f" containerID="a9ed9177f53aadbff7b549b73a5e76c6b0161212f42ba4e314ad9456ac120c16" exitCode=0 Sep 05 02:18:22.382657 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:18:22.382288 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-v4hcb" event={"ID":"9fccb273-b727-42f4-8e22-50f62446778f","Type":"ContainerDied","Data":"a9ed9177f53aadbff7b549b73a5e76c6b0161212f42ba4e314ad9456ac120c16"} Sep 05 02:18:23.078566 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:18:23.078368 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2x2gr" Sep 05 02:18:23.078742 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:18:23.078396 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zt7r6" Sep 05 02:18:23.078742 ip-10-0-133-250 kubenswrapper[2555]: E0905 02:18:23.078676 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2x2gr" podUID="2fc3d6af-c656-4be0-8188-317d2dde7a6b" Sep 05 02:18:23.078742 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:18:23.078445 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ghjcr" Sep 05 02:18:23.078742 ip-10-0-133-250 kubenswrapper[2555]: E0905 02:18:23.078731 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zt7r6" podUID="ba04f298-aebd-463b-940e-8a446b160645" Sep 05 02:18:23.078966 ip-10-0-133-250 kubenswrapper[2555]: E0905 02:18:23.078783 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ghjcr" podUID="bd4a3b61-19e3-4177-b012-e8ec8048aed1" Sep 05 02:18:25.077726 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:18:25.077693 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zt7r6" Sep 05 02:18:25.077726 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:18:25.077726 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2x2gr" Sep 05 02:18:25.078235 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:18:25.077726 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ghjcr" Sep 05 02:18:25.078235 ip-10-0-133-250 kubenswrapper[2555]: E0905 02:18:25.077817 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zt7r6" podUID="ba04f298-aebd-463b-940e-8a446b160645" Sep 05 02:18:25.078235 ip-10-0-133-250 kubenswrapper[2555]: E0905 02:18:25.077920 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2x2gr" podUID="2fc3d6af-c656-4be0-8188-317d2dde7a6b" Sep 05 02:18:25.078235 ip-10-0-133-250 kubenswrapper[2555]: E0905 02:18:25.078005 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ghjcr" podUID="bd4a3b61-19e3-4177-b012-e8ec8048aed1" Sep 05 02:18:26.712877 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:18:26.712845 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/bd4a3b61-19e3-4177-b012-e8ec8048aed1-original-pull-secret\") pod \"global-pull-secret-syncer-ghjcr\" (UID: \"bd4a3b61-19e3-4177-b012-e8ec8048aed1\") " pod="kube-system/global-pull-secret-syncer-ghjcr" Sep 05 02:18:26.713289 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:18:26.712887 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2fc3d6af-c656-4be0-8188-317d2dde7a6b-metrics-certs\") pod \"network-metrics-daemon-2x2gr\" (UID: \"2fc3d6af-c656-4be0-8188-317d2dde7a6b\") " pod="openshift-multus/network-metrics-daemon-2x2gr" Sep 05 02:18:26.713289 ip-10-0-133-250 kubenswrapper[2555]: E0905 02:18:26.712976 2555 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 05 02:18:26.713289 ip-10-0-133-250 kubenswrapper[2555]: E0905 02:18:26.712977 2555 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 05 02:18:26.713289 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:18:26.713013 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wqnrh\" (UniqueName: \"kubernetes.io/projected/ba04f298-aebd-463b-940e-8a446b160645-kube-api-access-wqnrh\") pod \"network-check-target-zt7r6\" (UID: \"ba04f298-aebd-463b-940e-8a446b160645\") " pod="openshift-network-diagnostics/network-check-target-zt7r6" Sep 05 02:18:26.713289 ip-10-0-133-250 kubenswrapper[2555]: E0905 02:18:26.713041 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2fc3d6af-c656-4be0-8188-317d2dde7a6b-metrics-certs podName:2fc3d6af-c656-4be0-8188-317d2dde7a6b nodeName:}" failed. No retries permitted until 2026-09-05 02:18:58.713008747 +0000 UTC m=+65.215146322 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2fc3d6af-c656-4be0-8188-317d2dde7a6b-metrics-certs") pod "network-metrics-daemon-2x2gr" (UID: "2fc3d6af-c656-4be0-8188-317d2dde7a6b") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 05 02:18:26.713289 ip-10-0-133-250 kubenswrapper[2555]: E0905 02:18:26.713057 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bd4a3b61-19e3-4177-b012-e8ec8048aed1-original-pull-secret podName:bd4a3b61-19e3-4177-b012-e8ec8048aed1 nodeName:}" failed. No retries permitted until 2026-09-05 02:18:58.713050602 +0000 UTC m=+65.215188176 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/bd4a3b61-19e3-4177-b012-e8ec8048aed1-original-pull-secret") pod "global-pull-secret-syncer-ghjcr" (UID: "bd4a3b61-19e3-4177-b012-e8ec8048aed1") : object "kube-system"/"original-pull-secret" not registered Sep 05 02:18:26.713289 ip-10-0-133-250 kubenswrapper[2555]: E0905 02:18:26.713100 2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 05 02:18:26.713289 ip-10-0-133-250 kubenswrapper[2555]: E0905 02:18:26.713120 2555 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 05 02:18:26.713289 ip-10-0-133-250 kubenswrapper[2555]: E0905 02:18:26.713129 2555 projected.go:196] Error preparing data for projected volume kube-api-access-wqnrh for pod openshift-network-diagnostics/network-check-target-zt7r6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 05 02:18:26.713289 ip-10-0-133-250 kubenswrapper[2555]: E0905 02:18:26.713169 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ba04f298-aebd-463b-940e-8a446b160645-kube-api-access-wqnrh podName:ba04f298-aebd-463b-940e-8a446b160645 nodeName:}" failed. No retries permitted until 2026-09-05 02:18:58.713155919 +0000 UTC m=+65.215293499 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-wqnrh" (UniqueName: "kubernetes.io/projected/ba04f298-aebd-463b-940e-8a446b160645-kube-api-access-wqnrh") pod "network-check-target-zt7r6" (UID: "ba04f298-aebd-463b-940e-8a446b160645") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 05 02:18:27.077532 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:18:27.077482 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2x2gr" Sep 05 02:18:27.077532 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:18:27.077520 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zt7r6" Sep 05 02:18:27.077532 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:18:27.077528 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ghjcr" Sep 05 02:18:27.077767 ip-10-0-133-250 kubenswrapper[2555]: E0905 02:18:27.077613 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2x2gr" podUID="2fc3d6af-c656-4be0-8188-317d2dde7a6b" Sep 05 02:18:27.077767 ip-10-0-133-250 kubenswrapper[2555]: E0905 02:18:27.077720 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zt7r6" podUID="ba04f298-aebd-463b-940e-8a446b160645" Sep 05 02:18:27.077871 ip-10-0-133-250 kubenswrapper[2555]: E0905 02:18:27.077830 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ghjcr" podUID="bd4a3b61-19e3-4177-b012-e8ec8048aed1" Sep 05 02:18:27.179191 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:18:27.179166 2555 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-250.ec2.internal" event="NodeReady" Sep 05 02:18:27.179315 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:18:27.179300 2555 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Sep 05 02:18:27.231787 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:18:27.231718 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-5pbzk"] Sep 05 02:18:27.251258 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:18:27.251232 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-mckdq"] Sep 05 02:18:27.251383 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:18:27.251343 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-5pbzk" Sep 05 02:18:27.254074 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:18:27.254048 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Sep 05 02:18:27.254206 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:18:27.254182 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Sep 05 02:18:27.254331 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:18:27.254314 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-2vlql\"" Sep 05 02:18:27.254377 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:18:27.254344 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Sep 05 02:18:27.273095 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:18:27.273050 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-5pbzk"] Sep 05 02:18:27.273095 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:18:27.273084 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-mckdq"] Sep 05 02:18:27.273172 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:18:27.273097 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-mckdq" Sep 05 02:18:27.275551 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:18:27.275535 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Sep 05 02:18:27.275634 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:18:27.275539 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Sep 05 02:18:27.275684 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:18:27.275639 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-l69pm\"" Sep 05 02:18:27.396385 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:18:27.396354 2555 generic.go:356] "Generic (PLEG): container finished" podID="9fccb273-b727-42f4-8e22-50f62446778f" containerID="0c16c585f2963812d15a2dd8ff817627585d9e1c2636c6a3efef2edf9522745f" exitCode=0 Sep 05 02:18:27.396534 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:18:27.396392 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-v4hcb" event={"ID":"9fccb273-b727-42f4-8e22-50f62446778f","Type":"ContainerDied","Data":"0c16c585f2963812d15a2dd8ff817627585d9e1c2636c6a3efef2edf9522745f"} Sep 05 02:18:27.418491 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:18:27.418470 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/fd1b28f1-f463-4135-8776-fd0ceff545ca-config-volume\") pod \"dns-default-mckdq\" (UID: \"fd1b28f1-f463-4135-8776-fd0ceff545ca\") " pod="openshift-dns/dns-default-mckdq" Sep 05 02:18:27.418605 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:18:27.418507 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fd1b28f1-f463-4135-8776-fd0ceff545ca-tmp-dir\") pod \"dns-default-mckdq\" (UID: \"fd1b28f1-f463-4135-8776-fd0ceff545ca\") " pod="openshift-dns/dns-default-mckdq" Sep 05 02:18:27.418605 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:18:27.418539 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s2j8d\" (UniqueName: \"kubernetes.io/projected/0f87c1ae-2aab-484b-9483-aa5aa41bbf2a-kube-api-access-s2j8d\") pod \"ingress-canary-5pbzk\" (UID: \"0f87c1ae-2aab-484b-9483-aa5aa41bbf2a\") " pod="openshift-ingress-canary/ingress-canary-5pbzk" Sep 05 02:18:27.418605 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:18:27.418591 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0f87c1ae-2aab-484b-9483-aa5aa41bbf2a-cert\") pod \"ingress-canary-5pbzk\" (UID: \"0f87c1ae-2aab-484b-9483-aa5aa41bbf2a\") " pod="openshift-ingress-canary/ingress-canary-5pbzk" Sep 05 02:18:27.418791 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:18:27.418626 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/fd1b28f1-f463-4135-8776-fd0ceff545ca-metrics-tls\") pod \"dns-default-mckdq\" (UID: \"fd1b28f1-f463-4135-8776-fd0ceff545ca\") " pod="openshift-dns/dns-default-mckdq" Sep 05 02:18:27.418791 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:18:27.418651 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-72sqt\" (UniqueName: \"kubernetes.io/projected/fd1b28f1-f463-4135-8776-fd0ceff545ca-kube-api-access-72sqt\") pod \"dns-default-mckdq\" (UID: \"fd1b28f1-f463-4135-8776-fd0ceff545ca\") " pod="openshift-dns/dns-default-mckdq" Sep 05 02:18:27.519654 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:18:27.519635 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/fd1b28f1-f463-4135-8776-fd0ceff545ca-config-volume\") pod \"dns-default-mckdq\" (UID: \"fd1b28f1-f463-4135-8776-fd0ceff545ca\") " pod="openshift-dns/dns-default-mckdq" Sep 05 02:18:27.519893 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:18:27.519870 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fd1b28f1-f463-4135-8776-fd0ceff545ca-tmp-dir\") pod \"dns-default-mckdq\" (UID: \"fd1b28f1-f463-4135-8776-fd0ceff545ca\") " pod="openshift-dns/dns-default-mckdq" Sep 05 02:18:27.519973 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:18:27.519942 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s2j8d\" (UniqueName: \"kubernetes.io/projected/0f87c1ae-2aab-484b-9483-aa5aa41bbf2a-kube-api-access-s2j8d\") pod \"ingress-canary-5pbzk\" (UID: \"0f87c1ae-2aab-484b-9483-aa5aa41bbf2a\") " pod="openshift-ingress-canary/ingress-canary-5pbzk" Sep 05 02:18:27.520049 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:18:27.519987 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0f87c1ae-2aab-484b-9483-aa5aa41bbf2a-cert\") pod \"ingress-canary-5pbzk\" (UID: \"0f87c1ae-2aab-484b-9483-aa5aa41bbf2a\") " pod="openshift-ingress-canary/ingress-canary-5pbzk" Sep 05 02:18:27.520112 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:18:27.520044 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/fd1b28f1-f463-4135-8776-fd0ceff545ca-metrics-tls\") pod \"dns-default-mckdq\" (UID: \"fd1b28f1-f463-4135-8776-fd0ceff545ca\") " pod="openshift-dns/dns-default-mckdq" Sep 05 02:18:27.520112 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:18:27.520069 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-72sqt\" (UniqueName: \"kubernetes.io/projected/fd1b28f1-f463-4135-8776-fd0ceff545ca-kube-api-access-72sqt\") pod \"dns-default-mckdq\" (UID: \"fd1b28f1-f463-4135-8776-fd0ceff545ca\") " pod="openshift-dns/dns-default-mckdq" Sep 05 02:18:27.520285 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:18:27.520262 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fd1b28f1-f463-4135-8776-fd0ceff545ca-tmp-dir\") pod \"dns-default-mckdq\" (UID: \"fd1b28f1-f463-4135-8776-fd0ceff545ca\") " pod="openshift-dns/dns-default-mckdq" Sep 05 02:18:27.520349 ip-10-0-133-250 kubenswrapper[2555]: E0905 02:18:27.520294 2555 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 05 02:18:27.520349 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:18:27.520295 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/fd1b28f1-f463-4135-8776-fd0ceff545ca-config-volume\") pod \"dns-default-mckdq\" (UID: \"fd1b28f1-f463-4135-8776-fd0ceff545ca\") " pod="openshift-dns/dns-default-mckdq" Sep 05 02:18:27.520427 ip-10-0-133-250 kubenswrapper[2555]: E0905 02:18:27.520355 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fd1b28f1-f463-4135-8776-fd0ceff545ca-metrics-tls podName:fd1b28f1-f463-4135-8776-fd0ceff545ca nodeName:}" failed. No retries permitted until 2026-09-05 02:18:28.020336554 +0000 UTC m=+34.522474133 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/fd1b28f1-f463-4135-8776-fd0ceff545ca-metrics-tls") pod "dns-default-mckdq" (UID: "fd1b28f1-f463-4135-8776-fd0ceff545ca") : secret "dns-default-metrics-tls" not found Sep 05 02:18:27.524230 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:18:27.524119 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0f87c1ae-2aab-484b-9483-aa5aa41bbf2a-cert\") pod \"ingress-canary-5pbzk\" (UID: \"0f87c1ae-2aab-484b-9483-aa5aa41bbf2a\") " pod="openshift-ingress-canary/ingress-canary-5pbzk" Sep 05 02:18:27.528689 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:18:27.528662 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s2j8d\" (UniqueName: \"kubernetes.io/projected/0f87c1ae-2aab-484b-9483-aa5aa41bbf2a-kube-api-access-s2j8d\") pod \"ingress-canary-5pbzk\" (UID: \"0f87c1ae-2aab-484b-9483-aa5aa41bbf2a\") " pod="openshift-ingress-canary/ingress-canary-5pbzk" Sep 05 02:18:27.529111 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:18:27.529086 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-72sqt\" (UniqueName: \"kubernetes.io/projected/fd1b28f1-f463-4135-8776-fd0ceff545ca-kube-api-access-72sqt\") pod \"dns-default-mckdq\" (UID: \"fd1b28f1-f463-4135-8776-fd0ceff545ca\") " pod="openshift-dns/dns-default-mckdq" Sep 05 02:18:27.560267 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:18:27.560245 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-5pbzk" Sep 05 02:18:27.868538 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:18:27.868470 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-5pbzk"] Sep 05 02:18:27.871894 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:18:27.871867 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0f87c1ae_2aab_484b_9483_aa5aa41bbf2a.slice/crio-7b3a4d5f60bb133ec603d3066eabd81c1924da52d689832016f2e09844e19867 WatchSource:0}: Error finding container 7b3a4d5f60bb133ec603d3066eabd81c1924da52d689832016f2e09844e19867: Status 404 returned error can't find the container with id 7b3a4d5f60bb133ec603d3066eabd81c1924da52d689832016f2e09844e19867 Sep 05 02:18:28.024193 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:18:28.024163 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/fd1b28f1-f463-4135-8776-fd0ceff545ca-metrics-tls\") pod \"dns-default-mckdq\" (UID: \"fd1b28f1-f463-4135-8776-fd0ceff545ca\") " pod="openshift-dns/dns-default-mckdq" Sep 05 02:18:28.024373 ip-10-0-133-250 kubenswrapper[2555]: E0905 02:18:28.024287 2555 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 05 02:18:28.024373 ip-10-0-133-250 kubenswrapper[2555]: E0905 02:18:28.024341 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fd1b28f1-f463-4135-8776-fd0ceff545ca-metrics-tls podName:fd1b28f1-f463-4135-8776-fd0ceff545ca nodeName:}" failed. No retries permitted until 2026-09-05 02:18:29.024327924 +0000 UTC m=+35.526465499 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/fd1b28f1-f463-4135-8776-fd0ceff545ca-metrics-tls") pod "dns-default-mckdq" (UID: "fd1b28f1-f463-4135-8776-fd0ceff545ca") : secret "dns-default-metrics-tls" not found Sep 05 02:18:28.402828 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:18:28.402790 2555 generic.go:356] "Generic (PLEG): container finished" podID="9fccb273-b727-42f4-8e22-50f62446778f" containerID="6e5e9653f368bf3d1a1bc4a9eae5af6bbd750915294c56f1a1a5dc44e0f20e05" exitCode=0 Sep 05 02:18:28.403091 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:18:28.402876 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-v4hcb" event={"ID":"9fccb273-b727-42f4-8e22-50f62446778f","Type":"ContainerDied","Data":"6e5e9653f368bf3d1a1bc4a9eae5af6bbd750915294c56f1a1a5dc44e0f20e05"} Sep 05 02:18:28.404476 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:18:28.404455 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-5pbzk" event={"ID":"0f87c1ae-2aab-484b-9483-aa5aa41bbf2a","Type":"ContainerStarted","Data":"7b3a4d5f60bb133ec603d3066eabd81c1924da52d689832016f2e09844e19867"} Sep 05 02:18:29.033117 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:18:29.033083 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/fd1b28f1-f463-4135-8776-fd0ceff545ca-metrics-tls\") pod \"dns-default-mckdq\" (UID: \"fd1b28f1-f463-4135-8776-fd0ceff545ca\") " pod="openshift-dns/dns-default-mckdq" Sep 05 02:18:29.033816 ip-10-0-133-250 kubenswrapper[2555]: E0905 02:18:29.033216 2555 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 05 02:18:29.033816 ip-10-0-133-250 kubenswrapper[2555]: E0905 02:18:29.033283 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fd1b28f1-f463-4135-8776-fd0ceff545ca-metrics-tls podName:fd1b28f1-f463-4135-8776-fd0ceff545ca nodeName:}" failed. No retries permitted until 2026-09-05 02:18:31.033264173 +0000 UTC m=+37.535401765 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/fd1b28f1-f463-4135-8776-fd0ceff545ca-metrics-tls") pod "dns-default-mckdq" (UID: "fd1b28f1-f463-4135-8776-fd0ceff545ca") : secret "dns-default-metrics-tls" not found Sep 05 02:18:29.078050 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:18:29.078011 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zt7r6" Sep 05 02:18:29.078232 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:18:29.078011 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ghjcr" Sep 05 02:18:29.078289 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:18:29.078031 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2x2gr" Sep 05 02:18:29.080847 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:18:29.080810 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Sep 05 02:18:29.080985 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:18:29.080811 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Sep 05 02:18:29.080985 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:18:29.080929 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-4hwbs\"" Sep 05 02:18:29.081754 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:18:29.081733 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Sep 05 02:18:29.081865 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:18:29.081736 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Sep 05 02:18:29.081865 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:18:29.081736 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-66tlm\"" Sep 05 02:18:29.411223 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:18:29.411134 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-v4hcb" event={"ID":"9fccb273-b727-42f4-8e22-50f62446778f","Type":"ContainerStarted","Data":"bc392193cfb5fc7f72e1df5caeaf244d3dfb99ac07f560865f4ac63d5f056471"} Sep 05 02:18:29.434108 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:18:29.433992 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-v4hcb" podStartSLOduration=6.391847053 podStartE2EDuration="35.433973405s" totalImagesPullingTime="29.042126352s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-05 02:17:54 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-05 02:18:29.432749524 +0000 UTC m=+35.934887142" watchObservedRunningTime="2026-09-05 02:18:29.433973405 +0000 UTC m=+35.936111002" Sep 05 02:18:30.415389 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:18:30.415203 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-5pbzk" event={"ID":"0f87c1ae-2aab-484b-9483-aa5aa41bbf2a","Type":"ContainerStarted","Data":"dc3534caf6a1da8ef2f3a4f382ff78f70de6ea663fc6c7cf585d092435801b01"} Sep 05 02:18:30.433404 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:18:30.433358 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-5pbzk" podStartSLOduration=1.02730516 podStartE2EDuration="3.433341273s" totalImagesPullingTime="2.406036113s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-05 02:18:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-05 02:18:30.432751257 +0000 UTC m=+36.934888860" watchObservedRunningTime="2026-09-05 02:18:30.433341273 +0000 UTC m=+36.935478903" Sep 05 02:18:31.048244 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:18:31.048207 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/fd1b28f1-f463-4135-8776-fd0ceff545ca-metrics-tls\") pod \"dns-default-mckdq\" (UID: \"fd1b28f1-f463-4135-8776-fd0ceff545ca\") " pod="openshift-dns/dns-default-mckdq" Sep 05 02:18:31.048399 ip-10-0-133-250 kubenswrapper[2555]: E0905 02:18:31.048326 2555 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 05 02:18:31.048399 ip-10-0-133-250 kubenswrapper[2555]: E0905 02:18:31.048376 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fd1b28f1-f463-4135-8776-fd0ceff545ca-metrics-tls podName:fd1b28f1-f463-4135-8776-fd0ceff545ca nodeName:}" failed. No retries permitted until 2026-09-05 02:18:35.04836348 +0000 UTC m=+41.550501055 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/fd1b28f1-f463-4135-8776-fd0ceff545ca-metrics-tls") pod "dns-default-mckdq" (UID: "fd1b28f1-f463-4135-8776-fd0ceff545ca") : secret "dns-default-metrics-tls" not found Sep 05 02:18:35.077853 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:18:35.077806 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/fd1b28f1-f463-4135-8776-fd0ceff545ca-metrics-tls\") pod \"dns-default-mckdq\" (UID: \"fd1b28f1-f463-4135-8776-fd0ceff545ca\") " pod="openshift-dns/dns-default-mckdq" Sep 05 02:18:35.078239 ip-10-0-133-250 kubenswrapper[2555]: E0905 02:18:35.077949 2555 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 05 02:18:35.078239 ip-10-0-133-250 kubenswrapper[2555]: E0905 02:18:35.078008 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fd1b28f1-f463-4135-8776-fd0ceff545ca-metrics-tls podName:fd1b28f1-f463-4135-8776-fd0ceff545ca nodeName:}" failed. No retries permitted until 2026-09-05 02:18:43.077993595 +0000 UTC m=+49.580131169 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/fd1b28f1-f463-4135-8776-fd0ceff545ca-metrics-tls") pod "dns-default-mckdq" (UID: "fd1b28f1-f463-4135-8776-fd0ceff545ca") : secret "dns-default-metrics-tls" not found Sep 05 02:18:43.132449 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:18:43.132410 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/fd1b28f1-f463-4135-8776-fd0ceff545ca-metrics-tls\") pod \"dns-default-mckdq\" (UID: \"fd1b28f1-f463-4135-8776-fd0ceff545ca\") " pod="openshift-dns/dns-default-mckdq" Sep 05 02:18:43.132830 ip-10-0-133-250 kubenswrapper[2555]: E0905 02:18:43.132563 2555 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 05 02:18:43.132830 ip-10-0-133-250 kubenswrapper[2555]: E0905 02:18:43.132672 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fd1b28f1-f463-4135-8776-fd0ceff545ca-metrics-tls podName:fd1b28f1-f463-4135-8776-fd0ceff545ca nodeName:}" failed. No retries permitted until 2026-09-05 02:18:59.132651959 +0000 UTC m=+65.634789550 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/fd1b28f1-f463-4135-8776-fd0ceff545ca-metrics-tls") pod "dns-default-mckdq" (UID: "fd1b28f1-f463-4135-8776-fd0ceff545ca") : secret "dns-default-metrics-tls" not found Sep 05 02:18:44.699085 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:18:44.699054 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-qsp8m"] Sep 05 02:18:44.700908 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:18:44.700889 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-qsp8m" Sep 05 02:18:44.703333 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:18:44.703311 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Sep 05 02:18:44.704378 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:18:44.704351 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Sep 05 02:18:44.704464 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:18:44.704358 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-m5dk9\"" Sep 05 02:18:44.712435 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:18:44.712415 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-qsp8m"] Sep 05 02:18:44.844089 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:18:44.844051 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kf844\" (UniqueName: \"kubernetes.io/projected/5232a6e8-2284-4488-ba83-55a96de9935d-kube-api-access-kf844\") pod \"volume-data-source-validator-695c895bd6-qsp8m\" (UID: \"5232a6e8-2284-4488-ba83-55a96de9935d\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-qsp8m" Sep 05 02:18:44.945626 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:18:44.945587 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kf844\" (UniqueName: \"kubernetes.io/projected/5232a6e8-2284-4488-ba83-55a96de9935d-kube-api-access-kf844\") pod \"volume-data-source-validator-695c895bd6-qsp8m\" (UID: \"5232a6e8-2284-4488-ba83-55a96de9935d\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-qsp8m" Sep 05 02:18:44.954658 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:18:44.954629 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-8g9pd"] Sep 05 02:18:44.956491 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:18:44.956472 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-8g9pd" Sep 05 02:18:44.959702 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:18:44.959617 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Sep 05 02:18:44.959702 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:18:44.959646 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-bhbdc\"" Sep 05 02:18:44.959968 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:18:44.959946 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Sep 05 02:18:44.960753 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:18:44.960735 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Sep 05 02:18:44.961277 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:18:44.961261 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-6679bd9dc8-fdnt5"] Sep 05 02:18:44.961990 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:18:44.961970 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kf844\" (UniqueName: \"kubernetes.io/projected/5232a6e8-2284-4488-ba83-55a96de9935d-kube-api-access-kf844\") pod \"volume-data-source-validator-695c895bd6-qsp8m\" (UID: \"5232a6e8-2284-4488-ba83-55a96de9935d\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-qsp8m" Sep 05 02:18:44.962324 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:18:44.962291 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Sep 05 02:18:44.962953 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:18:44.962936 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6679bd9dc8-fdnt5" Sep 05 02:18:44.965926 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:18:44.965907 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Sep 05 02:18:44.966296 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:18:44.966260 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Sep 05 02:18:44.966296 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:18:44.966268 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Sep 05 02:18:44.966791 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:18:44.966773 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-jn8w8\"" Sep 05 02:18:44.973354 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:18:44.973336 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Sep 05 02:18:44.973861 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:18:44.973839 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-8g9pd"] Sep 05 02:18:44.978003 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:18:44.977986 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6679bd9dc8-fdnt5"] Sep 05 02:18:45.008909 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:18:45.008883 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-qsp8m" Sep 05 02:18:45.052342 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:18:45.052115 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-85b454874b-k2cdf"] Sep 05 02:18:45.054249 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:18:45.054218 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-85b454874b-k2cdf" Sep 05 02:18:45.057445 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:18:45.057260 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Sep 05 02:18:45.057944 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:18:45.057925 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Sep 05 02:18:45.058701 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:18:45.058681 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Sep 05 02:18:45.058856 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:18:45.058685 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-8bqwf\"" Sep 05 02:18:45.058965 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:18:45.058950 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Sep 05 02:18:45.064122 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:18:45.063981 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Sep 05 02:18:45.067048 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:18:45.066970 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-85b454874b-k2cdf"] Sep 05 02:18:45.146953 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:18:45.146922 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mqd4g\" (UniqueName: \"kubernetes.io/projected/50207783-b68e-4a93-9da9-eb5cbbb399b8-kube-api-access-mqd4g\") pod \"image-registry-6679bd9dc8-fdnt5\" (UID: \"50207783-b68e-4a93-9da9-eb5cbbb399b8\") " pod="openshift-image-registry/image-registry-6679bd9dc8-fdnt5" Sep 05 02:18:45.147120 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:18:45.147007 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/50207783-b68e-4a93-9da9-eb5cbbb399b8-registry-tls\") pod \"image-registry-6679bd9dc8-fdnt5\" (UID: \"50207783-b68e-4a93-9da9-eb5cbbb399b8\") " pod="openshift-image-registry/image-registry-6679bd9dc8-fdnt5" Sep 05 02:18:45.147120 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:18:45.147052 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/9ac0ce1c-17b0-4dd0-955d-9881b8ee8f22-serving-cert\") pod \"kube-storage-version-migrator-operator-8d7dd4675-8g9pd\" (UID: \"9ac0ce1c-17b0-4dd0-955d-9881b8ee8f22\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-8g9pd" Sep 05 02:18:45.147120 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:18:45.147070 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/9ac0ce1c-17b0-4dd0-955d-9881b8ee8f22-config\") pod \"kube-storage-version-migrator-operator-8d7dd4675-8g9pd\" (UID: \"9ac0ce1c-17b0-4dd0-955d-9881b8ee8f22\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-8g9pd" Sep 05 02:18:45.147120 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:18:45.147095 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/50207783-b68e-4a93-9da9-eb5cbbb399b8-registry-certificates\") pod \"image-registry-6679bd9dc8-fdnt5\" (UID: \"50207783-b68e-4a93-9da9-eb5cbbb399b8\") " pod="openshift-image-registry/image-registry-6679bd9dc8-fdnt5" Sep 05 02:18:45.147277 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:18:45.147125 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/50207783-b68e-4a93-9da9-eb5cbbb399b8-image-registry-private-configuration\") pod \"image-registry-6679bd9dc8-fdnt5\" (UID: \"50207783-b68e-4a93-9da9-eb5cbbb399b8\") " pod="openshift-image-registry/image-registry-6679bd9dc8-fdnt5" Sep 05 02:18:45.147277 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:18:45.147143 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/50207783-b68e-4a93-9da9-eb5cbbb399b8-ca-trust-extracted\") pod \"image-registry-6679bd9dc8-fdnt5\" (UID: \"50207783-b68e-4a93-9da9-eb5cbbb399b8\") " pod="openshift-image-registry/image-registry-6679bd9dc8-fdnt5" Sep 05 02:18:45.147277 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:18:45.147192 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2vqmh\" (UniqueName: \"kubernetes.io/projected/9ac0ce1c-17b0-4dd0-955d-9881b8ee8f22-kube-api-access-2vqmh\") pod \"kube-storage-version-migrator-operator-8d7dd4675-8g9pd\" (UID: \"9ac0ce1c-17b0-4dd0-955d-9881b8ee8f22\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-8g9pd" Sep 05 02:18:45.147277 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:18:45.147211 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/50207783-b68e-4a93-9da9-eb5cbbb399b8-trusted-ca\") pod \"image-registry-6679bd9dc8-fdnt5\" (UID: \"50207783-b68e-4a93-9da9-eb5cbbb399b8\") " pod="openshift-image-registry/image-registry-6679bd9dc8-fdnt5" Sep 05 02:18:45.147277 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:18:45.147227 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/50207783-b68e-4a93-9da9-eb5cbbb399b8-installation-pull-secrets\") pod \"image-registry-6679bd9dc8-fdnt5\" (UID: \"50207783-b68e-4a93-9da9-eb5cbbb399b8\") " pod="openshift-image-registry/image-registry-6679bd9dc8-fdnt5" Sep 05 02:18:45.147277 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:18:45.147247 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/50207783-b68e-4a93-9da9-eb5cbbb399b8-bound-sa-token\") pod \"image-registry-6679bd9dc8-fdnt5\" (UID: \"50207783-b68e-4a93-9da9-eb5cbbb399b8\") " pod="openshift-image-registry/image-registry-6679bd9dc8-fdnt5" Sep 05 02:18:45.247718 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:18:45.247652 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/9ac0ce1c-17b0-4dd0-955d-9881b8ee8f22-config\") pod \"kube-storage-version-migrator-operator-8d7dd4675-8g9pd\" (UID: \"9ac0ce1c-17b0-4dd0-955d-9881b8ee8f22\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-8g9pd" Sep 05 02:18:45.247718 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:18:45.247683 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/50207783-b68e-4a93-9da9-eb5cbbb399b8-registry-certificates\") pod \"image-registry-6679bd9dc8-fdnt5\" (UID: \"50207783-b68e-4a93-9da9-eb5cbbb399b8\") " pod="openshift-image-registry/image-registry-6679bd9dc8-fdnt5" Sep 05 02:18:45.247718 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:18:45.247704 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/2ab9a760-ef7b-48dc-acbe-2694be7274e0-trusted-ca\") pod \"console-operator-85b454874b-k2cdf\" (UID: \"2ab9a760-ef7b-48dc-acbe-2694be7274e0\") " pod="openshift-console-operator/console-operator-85b454874b-k2cdf" Sep 05 02:18:45.247881 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:18:45.247832 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/2ab9a760-ef7b-48dc-acbe-2694be7274e0-config\") pod \"console-operator-85b454874b-k2cdf\" (UID: \"2ab9a760-ef7b-48dc-acbe-2694be7274e0\") " pod="openshift-console-operator/console-operator-85b454874b-k2cdf" Sep 05 02:18:45.247881 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:18:45.247853 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/2ab9a760-ef7b-48dc-acbe-2694be7274e0-serving-cert\") pod \"console-operator-85b454874b-k2cdf\" (UID: \"2ab9a760-ef7b-48dc-acbe-2694be7274e0\") " pod="openshift-console-operator/console-operator-85b454874b-k2cdf" Sep 05 02:18:45.247881 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:18:45.247875 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/50207783-b68e-4a93-9da9-eb5cbbb399b8-image-registry-private-configuration\") pod \"image-registry-6679bd9dc8-fdnt5\" (UID: \"50207783-b68e-4a93-9da9-eb5cbbb399b8\") " pod="openshift-image-registry/image-registry-6679bd9dc8-fdnt5" Sep 05 02:18:45.247988 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:18:45.247894 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/50207783-b68e-4a93-9da9-eb5cbbb399b8-ca-trust-extracted\") pod \"image-registry-6679bd9dc8-fdnt5\" (UID: \"50207783-b68e-4a93-9da9-eb5cbbb399b8\") " pod="openshift-image-registry/image-registry-6679bd9dc8-fdnt5" Sep 05 02:18:45.247988 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:18:45.247919 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v8sd5\" (UniqueName: \"kubernetes.io/projected/2ab9a760-ef7b-48dc-acbe-2694be7274e0-kube-api-access-v8sd5\") pod \"console-operator-85b454874b-k2cdf\" (UID: \"2ab9a760-ef7b-48dc-acbe-2694be7274e0\") " pod="openshift-console-operator/console-operator-85b454874b-k2cdf" Sep 05 02:18:45.247988 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:18:45.247952 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2vqmh\" (UniqueName: \"kubernetes.io/projected/9ac0ce1c-17b0-4dd0-955d-9881b8ee8f22-kube-api-access-2vqmh\") pod \"kube-storage-version-migrator-operator-8d7dd4675-8g9pd\" (UID: \"9ac0ce1c-17b0-4dd0-955d-9881b8ee8f22\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-8g9pd" Sep 05 02:18:45.247988 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:18:45.247976 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/50207783-b68e-4a93-9da9-eb5cbbb399b8-trusted-ca\") pod \"image-registry-6679bd9dc8-fdnt5\" (UID: \"50207783-b68e-4a93-9da9-eb5cbbb399b8\") " pod="openshift-image-registry/image-registry-6679bd9dc8-fdnt5" Sep 05 02:18:45.248201 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:18:45.248010 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/50207783-b68e-4a93-9da9-eb5cbbb399b8-installation-pull-secrets\") pod \"image-registry-6679bd9dc8-fdnt5\" (UID: \"50207783-b68e-4a93-9da9-eb5cbbb399b8\") " pod="openshift-image-registry/image-registry-6679bd9dc8-fdnt5" Sep 05 02:18:45.248201 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:18:45.248061 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/50207783-b68e-4a93-9da9-eb5cbbb399b8-bound-sa-token\") pod \"image-registry-6679bd9dc8-fdnt5\" (UID: \"50207783-b68e-4a93-9da9-eb5cbbb399b8\") " pod="openshift-image-registry/image-registry-6679bd9dc8-fdnt5" Sep 05 02:18:45.248201 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:18:45.248092 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mqd4g\" (UniqueName: \"kubernetes.io/projected/50207783-b68e-4a93-9da9-eb5cbbb399b8-kube-api-access-mqd4g\") pod \"image-registry-6679bd9dc8-fdnt5\" (UID: \"50207783-b68e-4a93-9da9-eb5cbbb399b8\") " pod="openshift-image-registry/image-registry-6679bd9dc8-fdnt5" Sep 05 02:18:45.248201 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:18:45.248176 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/50207783-b68e-4a93-9da9-eb5cbbb399b8-registry-tls\") pod \"image-registry-6679bd9dc8-fdnt5\" (UID: \"50207783-b68e-4a93-9da9-eb5cbbb399b8\") " pod="openshift-image-registry/image-registry-6679bd9dc8-fdnt5" Sep 05 02:18:45.248384 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:18:45.248213 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/9ac0ce1c-17b0-4dd0-955d-9881b8ee8f22-serving-cert\") pod \"kube-storage-version-migrator-operator-8d7dd4675-8g9pd\" (UID: \"9ac0ce1c-17b0-4dd0-955d-9881b8ee8f22\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-8g9pd" Sep 05 02:18:45.248384 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:18:45.248371 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/9ac0ce1c-17b0-4dd0-955d-9881b8ee8f22-config\") pod \"kube-storage-version-migrator-operator-8d7dd4675-8g9pd\" (UID: \"9ac0ce1c-17b0-4dd0-955d-9881b8ee8f22\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-8g9pd" Sep 05 02:18:45.248483 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:18:45.248385 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/50207783-b68e-4a93-9da9-eb5cbbb399b8-registry-certificates\") pod \"image-registry-6679bd9dc8-fdnt5\" (UID: \"50207783-b68e-4a93-9da9-eb5cbbb399b8\") " pod="openshift-image-registry/image-registry-6679bd9dc8-fdnt5" Sep 05 02:18:45.248483 ip-10-0-133-250 kubenswrapper[2555]: E0905 02:18:45.248464 2555 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 05 02:18:45.248580 ip-10-0-133-250 kubenswrapper[2555]: E0905 02:18:45.248478 2555 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6679bd9dc8-fdnt5: secret "image-registry-tls" not found Sep 05 02:18:45.248580 ip-10-0-133-250 kubenswrapper[2555]: E0905 02:18:45.248535 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/50207783-b68e-4a93-9da9-eb5cbbb399b8-registry-tls podName:50207783-b68e-4a93-9da9-eb5cbbb399b8 nodeName:}" failed. No retries permitted until 2026-09-05 02:18:45.748517936 +0000 UTC m=+52.250655526 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/50207783-b68e-4a93-9da9-eb5cbbb399b8-registry-tls") pod "image-registry-6679bd9dc8-fdnt5" (UID: "50207783-b68e-4a93-9da9-eb5cbbb399b8") : secret "image-registry-tls" not found Sep 05 02:18:45.248750 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:18:45.248613 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/50207783-b68e-4a93-9da9-eb5cbbb399b8-ca-trust-extracted\") pod \"image-registry-6679bd9dc8-fdnt5\" (UID: \"50207783-b68e-4a93-9da9-eb5cbbb399b8\") " pod="openshift-image-registry/image-registry-6679bd9dc8-fdnt5" Sep 05 02:18:45.248977 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:18:45.248955 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/50207783-b68e-4a93-9da9-eb5cbbb399b8-trusted-ca\") pod \"image-registry-6679bd9dc8-fdnt5\" (UID: \"50207783-b68e-4a93-9da9-eb5cbbb399b8\") " pod="openshift-image-registry/image-registry-6679bd9dc8-fdnt5" Sep 05 02:18:45.250448 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:18:45.250425 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/50207783-b68e-4a93-9da9-eb5cbbb399b8-image-registry-private-configuration\") pod \"image-registry-6679bd9dc8-fdnt5\" (UID: \"50207783-b68e-4a93-9da9-eb5cbbb399b8\") " pod="openshift-image-registry/image-registry-6679bd9dc8-fdnt5" Sep 05 02:18:45.250539 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:18:45.250472 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/50207783-b68e-4a93-9da9-eb5cbbb399b8-installation-pull-secrets\") pod \"image-registry-6679bd9dc8-fdnt5\" (UID: \"50207783-b68e-4a93-9da9-eb5cbbb399b8\") " pod="openshift-image-registry/image-registry-6679bd9dc8-fdnt5" Sep 05 02:18:45.250539 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:18:45.250485 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/9ac0ce1c-17b0-4dd0-955d-9881b8ee8f22-serving-cert\") pod \"kube-storage-version-migrator-operator-8d7dd4675-8g9pd\" (UID: \"9ac0ce1c-17b0-4dd0-955d-9881b8ee8f22\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-8g9pd" Sep 05 02:18:45.257283 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:18:45.257254 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2vqmh\" (UniqueName: \"kubernetes.io/projected/9ac0ce1c-17b0-4dd0-955d-9881b8ee8f22-kube-api-access-2vqmh\") pod \"kube-storage-version-migrator-operator-8d7dd4675-8g9pd\" (UID: \"9ac0ce1c-17b0-4dd0-955d-9881b8ee8f22\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-8g9pd" Sep 05 02:18:45.257499 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:18:45.257484 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/50207783-b68e-4a93-9da9-eb5cbbb399b8-bound-sa-token\") pod \"image-registry-6679bd9dc8-fdnt5\" (UID: \"50207783-b68e-4a93-9da9-eb5cbbb399b8\") " pod="openshift-image-registry/image-registry-6679bd9dc8-fdnt5" Sep 05 02:18:45.257889 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:18:45.257870 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mqd4g\" (UniqueName: \"kubernetes.io/projected/50207783-b68e-4a93-9da9-eb5cbbb399b8-kube-api-access-mqd4g\") pod \"image-registry-6679bd9dc8-fdnt5\" (UID: \"50207783-b68e-4a93-9da9-eb5cbbb399b8\") " pod="openshift-image-registry/image-registry-6679bd9dc8-fdnt5" Sep 05 02:18:45.272512 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:18:45.272495 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-8g9pd" Sep 05 02:18:45.275097 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:18:45.274927 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-qsp8m"] Sep 05 02:18:45.279200 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:18:45.279180 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5232a6e8_2284_4488_ba83_55a96de9935d.slice/crio-96bb678026772337365737d1f9e7bd6def8438791c05fd8c9c00b796f6c586dd WatchSource:0}: Error finding container 96bb678026772337365737d1f9e7bd6def8438791c05fd8c9c00b796f6c586dd: Status 404 returned error can't find the container with id 96bb678026772337365737d1f9e7bd6def8438791c05fd8c9c00b796f6c586dd Sep 05 02:18:45.349187 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:18:45.349157 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/2ab9a760-ef7b-48dc-acbe-2694be7274e0-trusted-ca\") pod \"console-operator-85b454874b-k2cdf\" (UID: \"2ab9a760-ef7b-48dc-acbe-2694be7274e0\") " pod="openshift-console-operator/console-operator-85b454874b-k2cdf" Sep 05 02:18:45.349302 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:18:45.349193 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/2ab9a760-ef7b-48dc-acbe-2694be7274e0-config\") pod \"console-operator-85b454874b-k2cdf\" (UID: \"2ab9a760-ef7b-48dc-acbe-2694be7274e0\") " pod="openshift-console-operator/console-operator-85b454874b-k2cdf" Sep 05 02:18:45.349302 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:18:45.349208 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/2ab9a760-ef7b-48dc-acbe-2694be7274e0-serving-cert\") pod \"console-operator-85b454874b-k2cdf\" (UID: \"2ab9a760-ef7b-48dc-acbe-2694be7274e0\") " pod="openshift-console-operator/console-operator-85b454874b-k2cdf" Sep 05 02:18:45.349380 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:18:45.349358 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v8sd5\" (UniqueName: \"kubernetes.io/projected/2ab9a760-ef7b-48dc-acbe-2694be7274e0-kube-api-access-v8sd5\") pod \"console-operator-85b454874b-k2cdf\" (UID: \"2ab9a760-ef7b-48dc-acbe-2694be7274e0\") " pod="openshift-console-operator/console-operator-85b454874b-k2cdf" Sep 05 02:18:45.349791 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:18:45.349771 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/2ab9a760-ef7b-48dc-acbe-2694be7274e0-config\") pod \"console-operator-85b454874b-k2cdf\" (UID: \"2ab9a760-ef7b-48dc-acbe-2694be7274e0\") " pod="openshift-console-operator/console-operator-85b454874b-k2cdf" Sep 05 02:18:45.350208 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:18:45.350188 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/2ab9a760-ef7b-48dc-acbe-2694be7274e0-trusted-ca\") pod \"console-operator-85b454874b-k2cdf\" (UID: \"2ab9a760-ef7b-48dc-acbe-2694be7274e0\") " pod="openshift-console-operator/console-operator-85b454874b-k2cdf" Sep 05 02:18:45.351358 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:18:45.351340 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/2ab9a760-ef7b-48dc-acbe-2694be7274e0-serving-cert\") pod \"console-operator-85b454874b-k2cdf\" (UID: \"2ab9a760-ef7b-48dc-acbe-2694be7274e0\") " pod="openshift-console-operator/console-operator-85b454874b-k2cdf" Sep 05 02:18:45.357485 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:18:45.357469 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v8sd5\" (UniqueName: \"kubernetes.io/projected/2ab9a760-ef7b-48dc-acbe-2694be7274e0-kube-api-access-v8sd5\") pod \"console-operator-85b454874b-k2cdf\" (UID: \"2ab9a760-ef7b-48dc-acbe-2694be7274e0\") " pod="openshift-console-operator/console-operator-85b454874b-k2cdf" Sep 05 02:18:45.364343 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:18:45.364319 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-85b454874b-k2cdf" Sep 05 02:18:45.448515 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:18:45.448485 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-qsp8m" event={"ID":"5232a6e8-2284-4488-ba83-55a96de9935d","Type":"ContainerStarted","Data":"96bb678026772337365737d1f9e7bd6def8438791c05fd8c9c00b796f6c586dd"} Sep 05 02:18:45.538672 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:18:45.538601 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-8g9pd"] Sep 05 02:18:45.541848 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:18:45.541824 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9ac0ce1c_17b0_4dd0_955d_9881b8ee8f22.slice/crio-2f33bc2b67505d807247ff93bc2f077faa7f559475af0595f4d388e5ee933f1f WatchSource:0}: Error finding container 2f33bc2b67505d807247ff93bc2f077faa7f559475af0595f4d388e5ee933f1f: Status 404 returned error can't find the container with id 2f33bc2b67505d807247ff93bc2f077faa7f559475af0595f4d388e5ee933f1f Sep 05 02:18:45.632988 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:18:45.632958 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-85b454874b-k2cdf"] Sep 05 02:18:45.636701 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:18:45.636675 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2ab9a760_ef7b_48dc_acbe_2694be7274e0.slice/crio-50601b9d1a559f1f3be18be75b4cef299823af71d2d94c961a4d097121a7e650 WatchSource:0}: Error finding container 50601b9d1a559f1f3be18be75b4cef299823af71d2d94c961a4d097121a7e650: Status 404 returned error can't find the container with id 50601b9d1a559f1f3be18be75b4cef299823af71d2d94c961a4d097121a7e650 Sep 05 02:18:45.752096 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:18:45.752062 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/50207783-b68e-4a93-9da9-eb5cbbb399b8-registry-tls\") pod \"image-registry-6679bd9dc8-fdnt5\" (UID: \"50207783-b68e-4a93-9da9-eb5cbbb399b8\") " pod="openshift-image-registry/image-registry-6679bd9dc8-fdnt5" Sep 05 02:18:45.752462 ip-10-0-133-250 kubenswrapper[2555]: E0905 02:18:45.752177 2555 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 05 02:18:45.752462 ip-10-0-133-250 kubenswrapper[2555]: E0905 02:18:45.752192 2555 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6679bd9dc8-fdnt5: secret "image-registry-tls" not found Sep 05 02:18:45.752462 ip-10-0-133-250 kubenswrapper[2555]: E0905 02:18:45.752244 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/50207783-b68e-4a93-9da9-eb5cbbb399b8-registry-tls podName:50207783-b68e-4a93-9da9-eb5cbbb399b8 nodeName:}" failed. No retries permitted until 2026-09-05 02:18:46.752227905 +0000 UTC m=+53.254365500 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/50207783-b68e-4a93-9da9-eb5cbbb399b8-registry-tls") pod "image-registry-6679bd9dc8-fdnt5" (UID: "50207783-b68e-4a93-9da9-eb5cbbb399b8") : secret "image-registry-tls" not found Sep 05 02:18:46.452389 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:18:46.452364 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-85b454874b-k2cdf" event={"ID":"2ab9a760-ef7b-48dc-acbe-2694be7274e0","Type":"ContainerStarted","Data":"50601b9d1a559f1f3be18be75b4cef299823af71d2d94c961a4d097121a7e650"} Sep 05 02:18:46.453503 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:18:46.453480 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-8g9pd" event={"ID":"9ac0ce1c-17b0-4dd0-955d-9881b8ee8f22","Type":"ContainerStarted","Data":"2f33bc2b67505d807247ff93bc2f077faa7f559475af0595f4d388e5ee933f1f"} Sep 05 02:18:46.758960 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:18:46.758923 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/50207783-b68e-4a93-9da9-eb5cbbb399b8-registry-tls\") pod \"image-registry-6679bd9dc8-fdnt5\" (UID: \"50207783-b68e-4a93-9da9-eb5cbbb399b8\") " pod="openshift-image-registry/image-registry-6679bd9dc8-fdnt5" Sep 05 02:18:46.759419 ip-10-0-133-250 kubenswrapper[2555]: E0905 02:18:46.759124 2555 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 05 02:18:46.759419 ip-10-0-133-250 kubenswrapper[2555]: E0905 02:18:46.759148 2555 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6679bd9dc8-fdnt5: secret "image-registry-tls" not found Sep 05 02:18:46.759419 ip-10-0-133-250 kubenswrapper[2555]: E0905 02:18:46.759220 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/50207783-b68e-4a93-9da9-eb5cbbb399b8-registry-tls podName:50207783-b68e-4a93-9da9-eb5cbbb399b8 nodeName:}" failed. No retries permitted until 2026-09-05 02:18:48.759198065 +0000 UTC m=+55.261335644 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/50207783-b68e-4a93-9da9-eb5cbbb399b8-registry-tls") pod "image-registry-6679bd9dc8-fdnt5" (UID: "50207783-b68e-4a93-9da9-eb5cbbb399b8") : secret "image-registry-tls" not found Sep 05 02:18:47.458006 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:18:47.457965 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-qsp8m" event={"ID":"5232a6e8-2284-4488-ba83-55a96de9935d","Type":"ContainerStarted","Data":"7a22bd8d60b242aeb07c0f28143d0510411a81eff163c94f6b39e0e25b1d4b5a"} Sep 05 02:18:47.473918 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:18:47.473865 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-qsp8m" podStartSLOduration=2.308612053 podStartE2EDuration="3.473846874s" totalImagesPullingTime="1.165234821s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-05 02:18:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-05 02:18:47.473221873 +0000 UTC m=+53.975359473" watchObservedRunningTime="2026-09-05 02:18:47.473846874 +0000 UTC m=+53.975984472" Sep 05 02:18:48.462576 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:18:48.462542 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-k2cdf_2ab9a760-ef7b-48dc-acbe-2694be7274e0/console-operator/0.log" Sep 05 02:18:48.463044 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:18:48.462591 2555 generic.go:356] "Generic (PLEG): container finished" podID="2ab9a760-ef7b-48dc-acbe-2694be7274e0" containerID="722489a81dd23e394bd43b6d8b200576194b8d8d3b3cfffdcbda28b2d0f8033d" exitCode=255 Sep 05 02:18:48.463044 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:18:48.462686 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-85b454874b-k2cdf" event={"ID":"2ab9a760-ef7b-48dc-acbe-2694be7274e0","Type":"ContainerDied","Data":"722489a81dd23e394bd43b6d8b200576194b8d8d3b3cfffdcbda28b2d0f8033d"} Sep 05 02:18:48.463044 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:18:48.462955 2555 scope.go:117] "RemoveContainer" containerID="722489a81dd23e394bd43b6d8b200576194b8d8d3b3cfffdcbda28b2d0f8033d" Sep 05 02:18:48.773598 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:18:48.773515 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/50207783-b68e-4a93-9da9-eb5cbbb399b8-registry-tls\") pod \"image-registry-6679bd9dc8-fdnt5\" (UID: \"50207783-b68e-4a93-9da9-eb5cbbb399b8\") " pod="openshift-image-registry/image-registry-6679bd9dc8-fdnt5" Sep 05 02:18:48.773727 ip-10-0-133-250 kubenswrapper[2555]: E0905 02:18:48.773666 2555 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 05 02:18:48.773727 ip-10-0-133-250 kubenswrapper[2555]: E0905 02:18:48.773688 2555 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6679bd9dc8-fdnt5: secret "image-registry-tls" not found Sep 05 02:18:48.773791 ip-10-0-133-250 kubenswrapper[2555]: E0905 02:18:48.773741 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/50207783-b68e-4a93-9da9-eb5cbbb399b8-registry-tls podName:50207783-b68e-4a93-9da9-eb5cbbb399b8 nodeName:}" failed. No retries permitted until 2026-09-05 02:18:52.773725773 +0000 UTC m=+59.275863372 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/50207783-b68e-4a93-9da9-eb5cbbb399b8-registry-tls") pod "image-registry-6679bd9dc8-fdnt5" (UID: "50207783-b68e-4a93-9da9-eb5cbbb399b8") : secret "image-registry-tls" not found Sep 05 02:18:49.467542 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:18:49.467502 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-k2cdf_2ab9a760-ef7b-48dc-acbe-2694be7274e0/console-operator/1.log" Sep 05 02:18:49.468036 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:18:49.468000 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-k2cdf_2ab9a760-ef7b-48dc-acbe-2694be7274e0/console-operator/0.log" Sep 05 02:18:49.468088 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:18:49.468060 2555 generic.go:356] "Generic (PLEG): container finished" podID="2ab9a760-ef7b-48dc-acbe-2694be7274e0" containerID="cdea25279982e1ba9f45e81f68609ac85662276d5deffac11903749c7e4caf73" exitCode=255 Sep 05 02:18:49.468137 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:18:49.468120 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-85b454874b-k2cdf" event={"ID":"2ab9a760-ef7b-48dc-acbe-2694be7274e0","Type":"ContainerDied","Data":"cdea25279982e1ba9f45e81f68609ac85662276d5deffac11903749c7e4caf73"} Sep 05 02:18:49.468192 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:18:49.468180 2555 scope.go:117] "RemoveContainer" containerID="722489a81dd23e394bd43b6d8b200576194b8d8d3b3cfffdcbda28b2d0f8033d" Sep 05 02:18:49.468578 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:18:49.468552 2555 scope.go:117] "RemoveContainer" containerID="cdea25279982e1ba9f45e81f68609ac85662276d5deffac11903749c7e4caf73" Sep 05 02:18:49.468796 ip-10-0-133-250 kubenswrapper[2555]: E0905 02:18:49.468756 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-85b454874b-k2cdf_openshift-console-operator(2ab9a760-ef7b-48dc-acbe-2694be7274e0)\"" pod="openshift-console-operator/console-operator-85b454874b-k2cdf" podUID="2ab9a760-ef7b-48dc-acbe-2694be7274e0" Sep 05 02:18:50.472576 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:18:50.472538 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-8g9pd" event={"ID":"9ac0ce1c-17b0-4dd0-955d-9881b8ee8f22","Type":"ContainerStarted","Data":"a9bb066a7b3b32867d209df3889899682c758b8e0fffb1c0d7a7169ec742df43"} Sep 05 02:18:50.474193 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:18:50.474172 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-k2cdf_2ab9a760-ef7b-48dc-acbe-2694be7274e0/console-operator/1.log" Sep 05 02:18:50.474479 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:18:50.474462 2555 scope.go:117] "RemoveContainer" containerID="cdea25279982e1ba9f45e81f68609ac85662276d5deffac11903749c7e4caf73" Sep 05 02:18:50.474634 ip-10-0-133-250 kubenswrapper[2555]: E0905 02:18:50.474615 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-85b454874b-k2cdf_openshift-console-operator(2ab9a760-ef7b-48dc-acbe-2694be7274e0)\"" pod="openshift-console-operator/console-operator-85b454874b-k2cdf" podUID="2ab9a760-ef7b-48dc-acbe-2694be7274e0" Sep 05 02:18:50.489310 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:18:50.489263 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-8g9pd" podStartSLOduration=2.249941317 podStartE2EDuration="6.489216599s" totalImagesPullingTime="4.239275282s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-05 02:18:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-05 02:18:50.487674406 +0000 UTC m=+56.989812004" watchObservedRunningTime="2026-09-05 02:18:50.489216599 +0000 UTC m=+56.991354196" Sep 05 02:18:50.828907 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:18:50.828832 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-79977f9844-xz7zr"] Sep 05 02:18:50.887143 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:18:50.887112 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-79977f9844-xz7zr"] Sep 05 02:18:50.887280 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:18:50.887211 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-79977f9844-xz7zr" Sep 05 02:18:50.889804 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:18:50.889780 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Sep 05 02:18:50.889804 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:18:50.889805 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-k6vpd\"" Sep 05 02:18:50.889984 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:18:50.889809 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Sep 05 02:18:50.992719 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:18:50.992681 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/e0bb0aec-dbbe-4026-abd6-ba57cb7f7c7d-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-xz7zr\" (UID: \"e0bb0aec-dbbe-4026-abd6-ba57cb7f7c7d\") " pod="openshift-network-console/networking-console-plugin-79977f9844-xz7zr" Sep 05 02:18:50.992882 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:18:50.992840 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/e0bb0aec-dbbe-4026-abd6-ba57cb7f7c7d-nginx-conf\") pod \"networking-console-plugin-79977f9844-xz7zr\" (UID: \"e0bb0aec-dbbe-4026-abd6-ba57cb7f7c7d\") " pod="openshift-network-console/networking-console-plugin-79977f9844-xz7zr" Sep 05 02:18:51.093810 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:18:51.093740 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/e0bb0aec-dbbe-4026-abd6-ba57cb7f7c7d-nginx-conf\") pod \"networking-console-plugin-79977f9844-xz7zr\" (UID: \"e0bb0aec-dbbe-4026-abd6-ba57cb7f7c7d\") " pod="openshift-network-console/networking-console-plugin-79977f9844-xz7zr" Sep 05 02:18:51.093810 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:18:51.093786 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/e0bb0aec-dbbe-4026-abd6-ba57cb7f7c7d-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-xz7zr\" (UID: \"e0bb0aec-dbbe-4026-abd6-ba57cb7f7c7d\") " pod="openshift-network-console/networking-console-plugin-79977f9844-xz7zr" Sep 05 02:18:51.093970 ip-10-0-133-250 kubenswrapper[2555]: E0905 02:18:51.093933 2555 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Sep 05 02:18:51.094005 ip-10-0-133-250 kubenswrapper[2555]: E0905 02:18:51.093989 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e0bb0aec-dbbe-4026-abd6-ba57cb7f7c7d-networking-console-plugin-cert podName:e0bb0aec-dbbe-4026-abd6-ba57cb7f7c7d nodeName:}" failed. No retries permitted until 2026-09-05 02:18:51.593972518 +0000 UTC m=+58.096110093 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/e0bb0aec-dbbe-4026-abd6-ba57cb7f7c7d-networking-console-plugin-cert") pod "networking-console-plugin-79977f9844-xz7zr" (UID: "e0bb0aec-dbbe-4026-abd6-ba57cb7f7c7d") : secret "networking-console-plugin-cert" not found Sep 05 02:18:51.094537 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:18:51.094511 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/e0bb0aec-dbbe-4026-abd6-ba57cb7f7c7d-nginx-conf\") pod \"networking-console-plugin-79977f9844-xz7zr\" (UID: \"e0bb0aec-dbbe-4026-abd6-ba57cb7f7c7d\") " pod="openshift-network-console/networking-console-plugin-79977f9844-xz7zr" Sep 05 02:18:51.244463 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:18:51.244431 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-75d99c484-q87lg"] Sep 05 02:18:51.268531 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:18:51.268506 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-75d99c484-q87lg"] Sep 05 02:18:51.268670 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:18:51.268602 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-75d99c484-q87lg" Sep 05 02:18:51.271373 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:18:51.271351 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Sep 05 02:18:51.271552 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:18:51.271534 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-4qrxb\"" Sep 05 02:18:51.271612 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:18:51.271596 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Sep 05 02:18:51.271800 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:18:51.271775 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Sep 05 02:18:51.271848 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:18:51.271805 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Sep 05 02:18:51.295727 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:18:51.295703 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mml4g\" (UniqueName: \"kubernetes.io/projected/ce6b3ad8-fbbb-4026-b255-8f9d30bcd571-kube-api-access-mml4g\") pod \"service-ca-75d99c484-q87lg\" (UID: \"ce6b3ad8-fbbb-4026-b255-8f9d30bcd571\") " pod="openshift-service-ca/service-ca-75d99c484-q87lg" Sep 05 02:18:51.295831 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:18:51.295744 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/ce6b3ad8-fbbb-4026-b255-8f9d30bcd571-signing-key\") pod \"service-ca-75d99c484-q87lg\" (UID: \"ce6b3ad8-fbbb-4026-b255-8f9d30bcd571\") " pod="openshift-service-ca/service-ca-75d99c484-q87lg" Sep 05 02:18:51.295831 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:18:51.295766 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/ce6b3ad8-fbbb-4026-b255-8f9d30bcd571-signing-cabundle\") pod \"service-ca-75d99c484-q87lg\" (UID: \"ce6b3ad8-fbbb-4026-b255-8f9d30bcd571\") " pod="openshift-service-ca/service-ca-75d99c484-q87lg" Sep 05 02:18:51.396789 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:18:51.396718 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mml4g\" (UniqueName: \"kubernetes.io/projected/ce6b3ad8-fbbb-4026-b255-8f9d30bcd571-kube-api-access-mml4g\") pod \"service-ca-75d99c484-q87lg\" (UID: \"ce6b3ad8-fbbb-4026-b255-8f9d30bcd571\") " pod="openshift-service-ca/service-ca-75d99c484-q87lg" Sep 05 02:18:51.396789 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:18:51.396774 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/ce6b3ad8-fbbb-4026-b255-8f9d30bcd571-signing-key\") pod \"service-ca-75d99c484-q87lg\" (UID: \"ce6b3ad8-fbbb-4026-b255-8f9d30bcd571\") " pod="openshift-service-ca/service-ca-75d99c484-q87lg" Sep 05 02:18:51.396946 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:18:51.396796 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/ce6b3ad8-fbbb-4026-b255-8f9d30bcd571-signing-cabundle\") pod \"service-ca-75d99c484-q87lg\" (UID: \"ce6b3ad8-fbbb-4026-b255-8f9d30bcd571\") " pod="openshift-service-ca/service-ca-75d99c484-q87lg" Sep 05 02:18:51.397594 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:18:51.397576 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/ce6b3ad8-fbbb-4026-b255-8f9d30bcd571-signing-cabundle\") pod \"service-ca-75d99c484-q87lg\" (UID: \"ce6b3ad8-fbbb-4026-b255-8f9d30bcd571\") " pod="openshift-service-ca/service-ca-75d99c484-q87lg" Sep 05 02:18:51.399268 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:18:51.399251 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/ce6b3ad8-fbbb-4026-b255-8f9d30bcd571-signing-key\") pod \"service-ca-75d99c484-q87lg\" (UID: \"ce6b3ad8-fbbb-4026-b255-8f9d30bcd571\") " pod="openshift-service-ca/service-ca-75d99c484-q87lg" Sep 05 02:18:51.410675 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:18:51.410648 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mml4g\" (UniqueName: \"kubernetes.io/projected/ce6b3ad8-fbbb-4026-b255-8f9d30bcd571-kube-api-access-mml4g\") pod \"service-ca-75d99c484-q87lg\" (UID: \"ce6b3ad8-fbbb-4026-b255-8f9d30bcd571\") " pod="openshift-service-ca/service-ca-75d99c484-q87lg" Sep 05 02:18:51.499182 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:18:51.499148 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-nxqlq"] Sep 05 02:18:51.523745 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:18:51.523718 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-nxqlq"] Sep 05 02:18:51.523883 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:18:51.523829 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-nxqlq" Sep 05 02:18:51.526571 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:18:51.526543 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Sep 05 02:18:51.526685 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:18:51.526546 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Sep 05 02:18:51.526685 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:18:51.526643 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Sep 05 02:18:51.526685 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:18:51.526661 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-zwbbc\"" Sep 05 02:18:51.526825 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:18:51.526551 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Sep 05 02:18:51.577110 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:18:51.577084 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-75d99c484-q87lg" Sep 05 02:18:51.597749 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:18:51.597724 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/ba8f84f4-5dce-49da-81c1-705a209d5f31-data-volume\") pod \"insights-runtime-extractor-nxqlq\" (UID: \"ba8f84f4-5dce-49da-81c1-705a209d5f31\") " pod="openshift-insights/insights-runtime-extractor-nxqlq" Sep 05 02:18:51.597882 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:18:51.597760 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-789hf\" (UniqueName: \"kubernetes.io/projected/ba8f84f4-5dce-49da-81c1-705a209d5f31-kube-api-access-789hf\") pod \"insights-runtime-extractor-nxqlq\" (UID: \"ba8f84f4-5dce-49da-81c1-705a209d5f31\") " pod="openshift-insights/insights-runtime-extractor-nxqlq" Sep 05 02:18:51.597882 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:18:51.597873 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ba8f84f4-5dce-49da-81c1-705a209d5f31-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nxqlq\" (UID: \"ba8f84f4-5dce-49da-81c1-705a209d5f31\") " pod="openshift-insights/insights-runtime-extractor-nxqlq" Sep 05 02:18:51.597989 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:18:51.597907 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/ba8f84f4-5dce-49da-81c1-705a209d5f31-crio-socket\") pod \"insights-runtime-extractor-nxqlq\" (UID: \"ba8f84f4-5dce-49da-81c1-705a209d5f31\") " pod="openshift-insights/insights-runtime-extractor-nxqlq" Sep 05 02:18:51.598056 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:18:51.597992 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/e0bb0aec-dbbe-4026-abd6-ba57cb7f7c7d-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-xz7zr\" (UID: \"e0bb0aec-dbbe-4026-abd6-ba57cb7f7c7d\") " pod="openshift-network-console/networking-console-plugin-79977f9844-xz7zr" Sep 05 02:18:51.598117 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:18:51.598063 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ba8f84f4-5dce-49da-81c1-705a209d5f31-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nxqlq\" (UID: \"ba8f84f4-5dce-49da-81c1-705a209d5f31\") " pod="openshift-insights/insights-runtime-extractor-nxqlq" Sep 05 02:18:51.598117 ip-10-0-133-250 kubenswrapper[2555]: E0905 02:18:51.598095 2555 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Sep 05 02:18:51.598213 ip-10-0-133-250 kubenswrapper[2555]: E0905 02:18:51.598159 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e0bb0aec-dbbe-4026-abd6-ba57cb7f7c7d-networking-console-plugin-cert podName:e0bb0aec-dbbe-4026-abd6-ba57cb7f7c7d nodeName:}" failed. No retries permitted until 2026-09-05 02:18:52.598142381 +0000 UTC m=+59.100279963 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/e0bb0aec-dbbe-4026-abd6-ba57cb7f7c7d-networking-console-plugin-cert") pod "networking-console-plugin-79977f9844-xz7zr" (UID: "e0bb0aec-dbbe-4026-abd6-ba57cb7f7c7d") : secret "networking-console-plugin-cert" not found Sep 05 02:18:51.698724 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:18:51.698645 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ba8f84f4-5dce-49da-81c1-705a209d5f31-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nxqlq\" (UID: \"ba8f84f4-5dce-49da-81c1-705a209d5f31\") " pod="openshift-insights/insights-runtime-extractor-nxqlq" Sep 05 02:18:51.698724 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:18:51.698703 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/ba8f84f4-5dce-49da-81c1-705a209d5f31-data-volume\") pod \"insights-runtime-extractor-nxqlq\" (UID: \"ba8f84f4-5dce-49da-81c1-705a209d5f31\") " pod="openshift-insights/insights-runtime-extractor-nxqlq" Sep 05 02:18:51.698724 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:18:51.698726 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-789hf\" (UniqueName: \"kubernetes.io/projected/ba8f84f4-5dce-49da-81c1-705a209d5f31-kube-api-access-789hf\") pod \"insights-runtime-extractor-nxqlq\" (UID: \"ba8f84f4-5dce-49da-81c1-705a209d5f31\") " pod="openshift-insights/insights-runtime-extractor-nxqlq" Sep 05 02:18:51.698950 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:18:51.698776 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ba8f84f4-5dce-49da-81c1-705a209d5f31-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nxqlq\" (UID: \"ba8f84f4-5dce-49da-81c1-705a209d5f31\") " pod="openshift-insights/insights-runtime-extractor-nxqlq" Sep 05 02:18:51.698950 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:18:51.698796 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/ba8f84f4-5dce-49da-81c1-705a209d5f31-crio-socket\") pod \"insights-runtime-extractor-nxqlq\" (UID: \"ba8f84f4-5dce-49da-81c1-705a209d5f31\") " pod="openshift-insights/insights-runtime-extractor-nxqlq" Sep 05 02:18:51.698950 ip-10-0-133-250 kubenswrapper[2555]: E0905 02:18:51.698802 2555 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 05 02:18:51.698950 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:18:51.698869 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/ba8f84f4-5dce-49da-81c1-705a209d5f31-crio-socket\") pod \"insights-runtime-extractor-nxqlq\" (UID: \"ba8f84f4-5dce-49da-81c1-705a209d5f31\") " pod="openshift-insights/insights-runtime-extractor-nxqlq" Sep 05 02:18:51.698950 ip-10-0-133-250 kubenswrapper[2555]: E0905 02:18:51.698888 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ba8f84f4-5dce-49da-81c1-705a209d5f31-insights-runtime-extractor-tls podName:ba8f84f4-5dce-49da-81c1-705a209d5f31 nodeName:}" failed. No retries permitted until 2026-09-05 02:18:52.198867826 +0000 UTC m=+58.701005406 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/ba8f84f4-5dce-49da-81c1-705a209d5f31-insights-runtime-extractor-tls") pod "insights-runtime-extractor-nxqlq" (UID: "ba8f84f4-5dce-49da-81c1-705a209d5f31") : secret "insights-runtime-extractor-tls" not found Sep 05 02:18:51.698950 ip-10-0-133-250 kubenswrapper[2555]: E0905 02:18:51.698906 2555 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 05 02:18:51.699181 ip-10-0-133-250 kubenswrapper[2555]: E0905 02:18:51.698966 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ba8f84f4-5dce-49da-81c1-705a209d5f31-kube-rbac-proxy-cm podName:ba8f84f4-5dce-49da-81c1-705a209d5f31 nodeName:}" failed. No retries permitted until 2026-09-05 02:18:52.198954698 +0000 UTC m=+58.701092286 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/ba8f84f4-5dce-49da-81c1-705a209d5f31-kube-rbac-proxy-cm") pod "insights-runtime-extractor-nxqlq" (UID: "ba8f84f4-5dce-49da-81c1-705a209d5f31") : configmap "kube-rbac-proxy" not found Sep 05 02:18:51.699181 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:18:51.699127 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/ba8f84f4-5dce-49da-81c1-705a209d5f31-data-volume\") pod \"insights-runtime-extractor-nxqlq\" (UID: \"ba8f84f4-5dce-49da-81c1-705a209d5f31\") " pod="openshift-insights/insights-runtime-extractor-nxqlq" Sep 05 02:18:51.713444 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:18:51.713422 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-789hf\" (UniqueName: \"kubernetes.io/projected/ba8f84f4-5dce-49da-81c1-705a209d5f31-kube-api-access-789hf\") pod \"insights-runtime-extractor-nxqlq\" (UID: \"ba8f84f4-5dce-49da-81c1-705a209d5f31\") " pod="openshift-insights/insights-runtime-extractor-nxqlq" Sep 05 02:18:51.844985 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:18:51.844940 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-75d99c484-q87lg"] Sep 05 02:18:51.850910 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:18:51.850883 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podce6b3ad8_fbbb_4026_b255_8f9d30bcd571.slice/crio-fa541d3a82d13affe3f858ebbc54625a52446a8d99fcef18e491b8e1487eaec2 WatchSource:0}: Error finding container fa541d3a82d13affe3f858ebbc54625a52446a8d99fcef18e491b8e1487eaec2: Status 404 returned error can't find the container with id fa541d3a82d13affe3f858ebbc54625a52446a8d99fcef18e491b8e1487eaec2 Sep 05 02:18:52.203629 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:18:52.203589 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ba8f84f4-5dce-49da-81c1-705a209d5f31-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nxqlq\" (UID: \"ba8f84f4-5dce-49da-81c1-705a209d5f31\") " pod="openshift-insights/insights-runtime-extractor-nxqlq" Sep 05 02:18:52.203792 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:18:52.203658 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ba8f84f4-5dce-49da-81c1-705a209d5f31-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nxqlq\" (UID: \"ba8f84f4-5dce-49da-81c1-705a209d5f31\") " pod="openshift-insights/insights-runtime-extractor-nxqlq" Sep 05 02:18:52.203792 ip-10-0-133-250 kubenswrapper[2555]: E0905 02:18:52.203722 2555 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 05 02:18:52.203792 ip-10-0-133-250 kubenswrapper[2555]: E0905 02:18:52.203743 2555 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 05 02:18:52.203792 ip-10-0-133-250 kubenswrapper[2555]: E0905 02:18:52.203791 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ba8f84f4-5dce-49da-81c1-705a209d5f31-insights-runtime-extractor-tls podName:ba8f84f4-5dce-49da-81c1-705a209d5f31 nodeName:}" failed. No retries permitted until 2026-09-05 02:18:53.203777775 +0000 UTC m=+59.705915350 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/ba8f84f4-5dce-49da-81c1-705a209d5f31-insights-runtime-extractor-tls") pod "insights-runtime-extractor-nxqlq" (UID: "ba8f84f4-5dce-49da-81c1-705a209d5f31") : secret "insights-runtime-extractor-tls" not found Sep 05 02:18:52.203927 ip-10-0-133-250 kubenswrapper[2555]: E0905 02:18:52.203805 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ba8f84f4-5dce-49da-81c1-705a209d5f31-kube-rbac-proxy-cm podName:ba8f84f4-5dce-49da-81c1-705a209d5f31 nodeName:}" failed. No retries permitted until 2026-09-05 02:18:53.203799009 +0000 UTC m=+59.705936583 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/ba8f84f4-5dce-49da-81c1-705a209d5f31-kube-rbac-proxy-cm") pod "insights-runtime-extractor-nxqlq" (UID: "ba8f84f4-5dce-49da-81c1-705a209d5f31") : configmap "kube-rbac-proxy" not found Sep 05 02:18:52.395091 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:18:52.395062 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-mz2wx" Sep 05 02:18:52.481318 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:18:52.481280 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-75d99c484-q87lg" event={"ID":"ce6b3ad8-fbbb-4026-b255-8f9d30bcd571","Type":"ContainerStarted","Data":"fa541d3a82d13affe3f858ebbc54625a52446a8d99fcef18e491b8e1487eaec2"} Sep 05 02:18:52.607474 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:18:52.607440 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/e0bb0aec-dbbe-4026-abd6-ba57cb7f7c7d-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-xz7zr\" (UID: \"e0bb0aec-dbbe-4026-abd6-ba57cb7f7c7d\") " pod="openshift-network-console/networking-console-plugin-79977f9844-xz7zr" Sep 05 02:18:52.607840 ip-10-0-133-250 kubenswrapper[2555]: E0905 02:18:52.607593 2555 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Sep 05 02:18:52.607840 ip-10-0-133-250 kubenswrapper[2555]: E0905 02:18:52.607657 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e0bb0aec-dbbe-4026-abd6-ba57cb7f7c7d-networking-console-plugin-cert podName:e0bb0aec-dbbe-4026-abd6-ba57cb7f7c7d nodeName:}" failed. No retries permitted until 2026-09-05 02:18:54.607641659 +0000 UTC m=+61.109779234 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/e0bb0aec-dbbe-4026-abd6-ba57cb7f7c7d-networking-console-plugin-cert") pod "networking-console-plugin-79977f9844-xz7zr" (UID: "e0bb0aec-dbbe-4026-abd6-ba57cb7f7c7d") : secret "networking-console-plugin-cert" not found Sep 05 02:18:52.809374 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:18:52.809286 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/50207783-b68e-4a93-9da9-eb5cbbb399b8-registry-tls\") pod \"image-registry-6679bd9dc8-fdnt5\" (UID: \"50207783-b68e-4a93-9da9-eb5cbbb399b8\") " pod="openshift-image-registry/image-registry-6679bd9dc8-fdnt5" Sep 05 02:18:52.809529 ip-10-0-133-250 kubenswrapper[2555]: E0905 02:18:52.809462 2555 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 05 02:18:52.809529 ip-10-0-133-250 kubenswrapper[2555]: E0905 02:18:52.809486 2555 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6679bd9dc8-fdnt5: secret "image-registry-tls" not found Sep 05 02:18:52.809618 ip-10-0-133-250 kubenswrapper[2555]: E0905 02:18:52.809554 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/50207783-b68e-4a93-9da9-eb5cbbb399b8-registry-tls podName:50207783-b68e-4a93-9da9-eb5cbbb399b8 nodeName:}" failed. No retries permitted until 2026-09-05 02:19:00.809536821 +0000 UTC m=+67.311674401 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/50207783-b68e-4a93-9da9-eb5cbbb399b8-registry-tls") pod "image-registry-6679bd9dc8-fdnt5" (UID: "50207783-b68e-4a93-9da9-eb5cbbb399b8") : secret "image-registry-tls" not found Sep 05 02:18:53.213040 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:18:53.212985 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ba8f84f4-5dce-49da-81c1-705a209d5f31-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nxqlq\" (UID: \"ba8f84f4-5dce-49da-81c1-705a209d5f31\") " pod="openshift-insights/insights-runtime-extractor-nxqlq" Sep 05 02:18:53.213218 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:18:53.213098 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ba8f84f4-5dce-49da-81c1-705a209d5f31-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nxqlq\" (UID: \"ba8f84f4-5dce-49da-81c1-705a209d5f31\") " pod="openshift-insights/insights-runtime-extractor-nxqlq" Sep 05 02:18:53.213218 ip-10-0-133-250 kubenswrapper[2555]: E0905 02:18:53.213119 2555 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 05 02:18:53.213218 ip-10-0-133-250 kubenswrapper[2555]: E0905 02:18:53.213200 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ba8f84f4-5dce-49da-81c1-705a209d5f31-kube-rbac-proxy-cm podName:ba8f84f4-5dce-49da-81c1-705a209d5f31 nodeName:}" failed. No retries permitted until 2026-09-05 02:18:55.213181971 +0000 UTC m=+61.715319549 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/ba8f84f4-5dce-49da-81c1-705a209d5f31-kube-rbac-proxy-cm") pod "insights-runtime-extractor-nxqlq" (UID: "ba8f84f4-5dce-49da-81c1-705a209d5f31") : configmap "kube-rbac-proxy" not found Sep 05 02:18:53.213371 ip-10-0-133-250 kubenswrapper[2555]: E0905 02:18:53.213238 2555 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 05 02:18:53.213371 ip-10-0-133-250 kubenswrapper[2555]: E0905 02:18:53.213290 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ba8f84f4-5dce-49da-81c1-705a209d5f31-insights-runtime-extractor-tls podName:ba8f84f4-5dce-49da-81c1-705a209d5f31 nodeName:}" failed. No retries permitted until 2026-09-05 02:18:55.213273408 +0000 UTC m=+61.715411001 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/ba8f84f4-5dce-49da-81c1-705a209d5f31-insights-runtime-extractor-tls") pod "insights-runtime-extractor-nxqlq" (UID: "ba8f84f4-5dce-49da-81c1-705a209d5f31") : secret "insights-runtime-extractor-tls" not found Sep 05 02:18:53.620531 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:18:53.620453 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-lq8k6_c3aed02f-b69d-4743-8089-e6b5f142dbc1/dns-node-resolver/0.log" Sep 05 02:18:54.420627 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:18:54.420603 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-4gpmf_c2dc61db-cd5c-4972-b21e-633ad3b71ef5/node-ca/0.log" Sep 05 02:18:54.488530 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:18:54.488493 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-75d99c484-q87lg" event={"ID":"ce6b3ad8-fbbb-4026-b255-8f9d30bcd571","Type":"ContainerStarted","Data":"343db2fc2230681519a5342c2621adab3735026662a9ca184f7bf3a6e8f4639c"} Sep 05 02:18:54.505779 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:18:54.505737 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-75d99c484-q87lg" podStartSLOduration=1.642093035 podStartE2EDuration="3.505722979s" totalImagesPullingTime="1.863629944s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-05 02:18:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-05 02:18:54.504937893 +0000 UTC m=+61.007075491" watchObservedRunningTime="2026-09-05 02:18:54.505722979 +0000 UTC m=+61.007860575" Sep 05 02:18:54.621773 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:18:54.621734 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/e0bb0aec-dbbe-4026-abd6-ba57cb7f7c7d-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-xz7zr\" (UID: \"e0bb0aec-dbbe-4026-abd6-ba57cb7f7c7d\") " pod="openshift-network-console/networking-console-plugin-79977f9844-xz7zr" Sep 05 02:18:54.622146 ip-10-0-133-250 kubenswrapper[2555]: E0905 02:18:54.621873 2555 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Sep 05 02:18:54.622146 ip-10-0-133-250 kubenswrapper[2555]: E0905 02:18:54.621937 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e0bb0aec-dbbe-4026-abd6-ba57cb7f7c7d-networking-console-plugin-cert podName:e0bb0aec-dbbe-4026-abd6-ba57cb7f7c7d nodeName:}" failed. No retries permitted until 2026-09-05 02:18:58.621920001 +0000 UTC m=+65.124057576 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/e0bb0aec-dbbe-4026-abd6-ba57cb7f7c7d-networking-console-plugin-cert") pod "networking-console-plugin-79977f9844-xz7zr" (UID: "e0bb0aec-dbbe-4026-abd6-ba57cb7f7c7d") : secret "networking-console-plugin-cert" not found Sep 05 02:18:55.025044 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:18:55.024952 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-5pbzk_0f87c1ae-2aab-484b-9483-aa5aa41bbf2a/serve-healthcheck-canary/0.log" Sep 05 02:18:55.226759 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:18:55.226721 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ba8f84f4-5dce-49da-81c1-705a209d5f31-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nxqlq\" (UID: \"ba8f84f4-5dce-49da-81c1-705a209d5f31\") " pod="openshift-insights/insights-runtime-extractor-nxqlq" Sep 05 02:18:55.226962 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:18:55.226836 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ba8f84f4-5dce-49da-81c1-705a209d5f31-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nxqlq\" (UID: \"ba8f84f4-5dce-49da-81c1-705a209d5f31\") " pod="openshift-insights/insights-runtime-extractor-nxqlq" Sep 05 02:18:55.226962 ip-10-0-133-250 kubenswrapper[2555]: E0905 02:18:55.226891 2555 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 05 02:18:55.226962 ip-10-0-133-250 kubenswrapper[2555]: E0905 02:18:55.226939 2555 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 05 02:18:55.227137 ip-10-0-133-250 kubenswrapper[2555]: E0905 02:18:55.226973 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ba8f84f4-5dce-49da-81c1-705a209d5f31-insights-runtime-extractor-tls podName:ba8f84f4-5dce-49da-81c1-705a209d5f31 nodeName:}" failed. No retries permitted until 2026-09-05 02:18:59.226952701 +0000 UTC m=+65.729090279 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/ba8f84f4-5dce-49da-81c1-705a209d5f31-insights-runtime-extractor-tls") pod "insights-runtime-extractor-nxqlq" (UID: "ba8f84f4-5dce-49da-81c1-705a209d5f31") : secret "insights-runtime-extractor-tls" not found Sep 05 02:18:55.227137 ip-10-0-133-250 kubenswrapper[2555]: E0905 02:18:55.226995 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ba8f84f4-5dce-49da-81c1-705a209d5f31-kube-rbac-proxy-cm podName:ba8f84f4-5dce-49da-81c1-705a209d5f31 nodeName:}" failed. No retries permitted until 2026-09-05 02:18:59.226983261 +0000 UTC m=+65.729120842 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/ba8f84f4-5dce-49da-81c1-705a209d5f31-kube-rbac-proxy-cm") pod "insights-runtime-extractor-nxqlq" (UID: "ba8f84f4-5dce-49da-81c1-705a209d5f31") : configmap "kube-rbac-proxy" not found Sep 05 02:18:55.364893 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:18:55.364813 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-85b454874b-k2cdf" Sep 05 02:18:55.365063 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:18:55.364913 2555 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-85b454874b-k2cdf" Sep 05 02:18:55.365295 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:18:55.365280 2555 scope.go:117] "RemoveContainer" containerID="cdea25279982e1ba9f45e81f68609ac85662276d5deffac11903749c7e4caf73" Sep 05 02:18:55.365478 ip-10-0-133-250 kubenswrapper[2555]: E0905 02:18:55.365458 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-85b454874b-k2cdf_openshift-console-operator(2ab9a760-ef7b-48dc-acbe-2694be7274e0)\"" pod="openshift-console-operator/console-operator-85b454874b-k2cdf" podUID="2ab9a760-ef7b-48dc-acbe-2694be7274e0" Sep 05 02:18:55.491916 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:18:55.491888 2555 scope.go:117] "RemoveContainer" containerID="cdea25279982e1ba9f45e81f68609ac85662276d5deffac11903749c7e4caf73" Sep 05 02:18:55.492121 ip-10-0-133-250 kubenswrapper[2555]: E0905 02:18:55.492099 2555 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-85b454874b-k2cdf_openshift-console-operator(2ab9a760-ef7b-48dc-acbe-2694be7274e0)\"" pod="openshift-console-operator/console-operator-85b454874b-k2cdf" podUID="2ab9a760-ef7b-48dc-acbe-2694be7274e0" Sep 05 02:18:58.655542 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:18:58.655502 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/e0bb0aec-dbbe-4026-abd6-ba57cb7f7c7d-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-xz7zr\" (UID: \"e0bb0aec-dbbe-4026-abd6-ba57cb7f7c7d\") " pod="openshift-network-console/networking-console-plugin-79977f9844-xz7zr" Sep 05 02:18:58.655920 ip-10-0-133-250 kubenswrapper[2555]: E0905 02:18:58.655654 2555 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Sep 05 02:18:58.655920 ip-10-0-133-250 kubenswrapper[2555]: E0905 02:18:58.655721 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e0bb0aec-dbbe-4026-abd6-ba57cb7f7c7d-networking-console-plugin-cert podName:e0bb0aec-dbbe-4026-abd6-ba57cb7f7c7d nodeName:}" failed. No retries permitted until 2026-09-05 02:19:06.655703989 +0000 UTC m=+73.157841565 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/e0bb0aec-dbbe-4026-abd6-ba57cb7f7c7d-networking-console-plugin-cert") pod "networking-console-plugin-79977f9844-xz7zr" (UID: "e0bb0aec-dbbe-4026-abd6-ba57cb7f7c7d") : secret "networking-console-plugin-cert" not found Sep 05 02:18:58.756736 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:18:58.756702 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/bd4a3b61-19e3-4177-b012-e8ec8048aed1-original-pull-secret\") pod \"global-pull-secret-syncer-ghjcr\" (UID: \"bd4a3b61-19e3-4177-b012-e8ec8048aed1\") " pod="kube-system/global-pull-secret-syncer-ghjcr" Sep 05 02:18:58.756879 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:18:58.756788 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2fc3d6af-c656-4be0-8188-317d2dde7a6b-metrics-certs\") pod \"network-metrics-daemon-2x2gr\" (UID: \"2fc3d6af-c656-4be0-8188-317d2dde7a6b\") " pod="openshift-multus/network-metrics-daemon-2x2gr" Sep 05 02:18:58.756879 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:18:58.756820 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wqnrh\" (UniqueName: \"kubernetes.io/projected/ba04f298-aebd-463b-940e-8a446b160645-kube-api-access-wqnrh\") pod \"network-check-target-zt7r6\" (UID: \"ba04f298-aebd-463b-940e-8a446b160645\") " pod="openshift-network-diagnostics/network-check-target-zt7r6" Sep 05 02:18:58.759398 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:18:58.759378 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Sep 05 02:18:58.759465 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:18:58.759434 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Sep 05 02:18:58.759515 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:18:58.759472 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Sep 05 02:18:58.767598 ip-10-0-133-250 kubenswrapper[2555]: E0905 02:18:58.767576 2555 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Sep 05 02:18:58.767667 ip-10-0-133-250 kubenswrapper[2555]: E0905 02:18:58.767638 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2fc3d6af-c656-4be0-8188-317d2dde7a6b-metrics-certs podName:2fc3d6af-c656-4be0-8188-317d2dde7a6b nodeName:}" failed. No retries permitted until 2026-09-05 02:20:02.767621947 +0000 UTC m=+129.269759527 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2fc3d6af-c656-4be0-8188-317d2dde7a6b-metrics-certs") pod "network-metrics-daemon-2x2gr" (UID: "2fc3d6af-c656-4be0-8188-317d2dde7a6b") : secret "metrics-daemon-secret" not found Sep 05 02:18:58.769728 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:18:58.769711 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/bd4a3b61-19e3-4177-b012-e8ec8048aed1-original-pull-secret\") pod \"global-pull-secret-syncer-ghjcr\" (UID: \"bd4a3b61-19e3-4177-b012-e8ec8048aed1\") " pod="kube-system/global-pull-secret-syncer-ghjcr" Sep 05 02:18:58.769917 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:18:58.769899 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Sep 05 02:18:58.780221 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:18:58.780194 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wqnrh\" (UniqueName: \"kubernetes.io/projected/ba04f298-aebd-463b-940e-8a446b160645-kube-api-access-wqnrh\") pod \"network-check-target-zt7r6\" (UID: \"ba04f298-aebd-463b-940e-8a446b160645\") " pod="openshift-network-diagnostics/network-check-target-zt7r6" Sep 05 02:18:58.792006 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:18:58.791985 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-4hwbs\"" Sep 05 02:18:58.796977 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:18:58.796964 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ghjcr" Sep 05 02:18:58.800239 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:18:58.800225 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zt7r6" Sep 05 02:18:59.072618 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:18:59.072584 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-ghjcr"] Sep 05 02:18:59.076602 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:18:59.076563 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbd4a3b61_19e3_4177_b012_e8ec8048aed1.slice/crio-2a2ca0d0692bcfdbf0c10cbb387b8595d99cd909110893c30bfa89dd3e763376 WatchSource:0}: Error finding container 2a2ca0d0692bcfdbf0c10cbb387b8595d99cd909110893c30bfa89dd3e763376: Status 404 returned error can't find the container with id 2a2ca0d0692bcfdbf0c10cbb387b8595d99cd909110893c30bfa89dd3e763376 Sep 05 02:18:59.078065 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:18:59.077979 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-zt7r6"] Sep 05 02:18:59.080325 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:18:59.080304 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podba04f298_aebd_463b_940e_8a446b160645.slice/crio-1c145e2e16c779041e04265783acf781405f1bb458d922f8b13b4160680e6917 WatchSource:0}: Error finding container 1c145e2e16c779041e04265783acf781405f1bb458d922f8b13b4160680e6917: Status 404 returned error can't find the container with id 1c145e2e16c779041e04265783acf781405f1bb458d922f8b13b4160680e6917 Sep 05 02:18:59.161835 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:18:59.161804 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/fd1b28f1-f463-4135-8776-fd0ceff545ca-metrics-tls\") pod \"dns-default-mckdq\" (UID: \"fd1b28f1-f463-4135-8776-fd0ceff545ca\") " pod="openshift-dns/dns-default-mckdq" Sep 05 02:18:59.163978 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:18:59.163959 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/fd1b28f1-f463-4135-8776-fd0ceff545ca-metrics-tls\") pod \"dns-default-mckdq\" (UID: \"fd1b28f1-f463-4135-8776-fd0ceff545ca\") " pod="openshift-dns/dns-default-mckdq" Sep 05 02:18:59.262966 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:18:59.262929 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ba8f84f4-5dce-49da-81c1-705a209d5f31-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nxqlq\" (UID: \"ba8f84f4-5dce-49da-81c1-705a209d5f31\") " pod="openshift-insights/insights-runtime-extractor-nxqlq" Sep 05 02:18:59.263115 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:18:59.262993 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ba8f84f4-5dce-49da-81c1-705a209d5f31-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nxqlq\" (UID: \"ba8f84f4-5dce-49da-81c1-705a209d5f31\") " pod="openshift-insights/insights-runtime-extractor-nxqlq" Sep 05 02:18:59.263115 ip-10-0-133-250 kubenswrapper[2555]: E0905 02:18:59.263081 2555 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 05 02:18:59.263193 ip-10-0-133-250 kubenswrapper[2555]: E0905 02:18:59.263118 2555 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 05 02:18:59.263193 ip-10-0-133-250 kubenswrapper[2555]: E0905 02:18:59.263164 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ba8f84f4-5dce-49da-81c1-705a209d5f31-kube-rbac-proxy-cm podName:ba8f84f4-5dce-49da-81c1-705a209d5f31 nodeName:}" failed. No retries permitted until 2026-09-05 02:19:07.263143442 +0000 UTC m=+73.765281032 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/ba8f84f4-5dce-49da-81c1-705a209d5f31-kube-rbac-proxy-cm") pod "insights-runtime-extractor-nxqlq" (UID: "ba8f84f4-5dce-49da-81c1-705a209d5f31") : configmap "kube-rbac-proxy" not found Sep 05 02:18:59.263193 ip-10-0-133-250 kubenswrapper[2555]: E0905 02:18:59.263183 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ba8f84f4-5dce-49da-81c1-705a209d5f31-insights-runtime-extractor-tls podName:ba8f84f4-5dce-49da-81c1-705a209d5f31 nodeName:}" failed. No retries permitted until 2026-09-05 02:19:07.263174034 +0000 UTC m=+73.765311616 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/ba8f84f4-5dce-49da-81c1-705a209d5f31-insights-runtime-extractor-tls") pod "insights-runtime-extractor-nxqlq" (UID: "ba8f84f4-5dce-49da-81c1-705a209d5f31") : secret "insights-runtime-extractor-tls" not found Sep 05 02:18:59.383326 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:18:59.383259 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-l69pm\"" Sep 05 02:18:59.391442 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:18:59.391412 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-mckdq" Sep 05 02:18:59.503096 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:18:59.503058 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-zt7r6" event={"ID":"ba04f298-aebd-463b-940e-8a446b160645","Type":"ContainerStarted","Data":"1c145e2e16c779041e04265783acf781405f1bb458d922f8b13b4160680e6917"} Sep 05 02:18:59.504192 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:18:59.504169 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-ghjcr" event={"ID":"bd4a3b61-19e3-4177-b012-e8ec8048aed1","Type":"ContainerStarted","Data":"2a2ca0d0692bcfdbf0c10cbb387b8595d99cd909110893c30bfa89dd3e763376"} Sep 05 02:18:59.662098 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:18:59.662001 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-mckdq"] Sep 05 02:18:59.665349 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:18:59.665320 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfd1b28f1_f463_4135_8776_fd0ceff545ca.slice/crio-6dab47fad6537b15299ac258b551fad240ef524943a50f9a282747619bba869d WatchSource:0}: Error finding container 6dab47fad6537b15299ac258b551fad240ef524943a50f9a282747619bba869d: Status 404 returned error can't find the container with id 6dab47fad6537b15299ac258b551fad240ef524943a50f9a282747619bba869d Sep 05 02:19:00.508888 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:00.508817 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-mckdq" event={"ID":"fd1b28f1-f463-4135-8776-fd0ceff545ca","Type":"ContainerStarted","Data":"6dab47fad6537b15299ac258b551fad240ef524943a50f9a282747619bba869d"} Sep 05 02:19:00.878043 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:00.877681 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/50207783-b68e-4a93-9da9-eb5cbbb399b8-registry-tls\") pod \"image-registry-6679bd9dc8-fdnt5\" (UID: \"50207783-b68e-4a93-9da9-eb5cbbb399b8\") " pod="openshift-image-registry/image-registry-6679bd9dc8-fdnt5" Sep 05 02:19:00.886898 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:00.884787 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/50207783-b68e-4a93-9da9-eb5cbbb399b8-registry-tls\") pod \"image-registry-6679bd9dc8-fdnt5\" (UID: \"50207783-b68e-4a93-9da9-eb5cbbb399b8\") " pod="openshift-image-registry/image-registry-6679bd9dc8-fdnt5" Sep 05 02:19:01.180371 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:01.180253 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-jn8w8\"" Sep 05 02:19:01.187886 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:01.187708 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6679bd9dc8-fdnt5" Sep 05 02:19:01.500329 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:01.500287 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6679bd9dc8-fdnt5"] Sep 05 02:19:02.003103 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:19:02.003062 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod50207783_b68e_4a93_9da9_eb5cbbb399b8.slice/crio-b3a40ee4a4f8cf6a51cd5d156a330bea381a5190029c358e0ee9a75ef822ee7c WatchSource:0}: Error finding container b3a40ee4a4f8cf6a51cd5d156a330bea381a5190029c358e0ee9a75ef822ee7c: Status 404 returned error can't find the container with id b3a40ee4a4f8cf6a51cd5d156a330bea381a5190029c358e0ee9a75ef822ee7c Sep 05 02:19:02.517869 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:02.517829 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6679bd9dc8-fdnt5" event={"ID":"50207783-b68e-4a93-9da9-eb5cbbb399b8","Type":"ContainerStarted","Data":"b3a40ee4a4f8cf6a51cd5d156a330bea381a5190029c358e0ee9a75ef822ee7c"} Sep 05 02:19:05.527974 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:05.527934 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-zt7r6" event={"ID":"ba04f298-aebd-463b-940e-8a446b160645","Type":"ContainerStarted","Data":"7afe48a5fa4ad2425a48fb14cb37810a49ec681d5a327aae52147b78a7e52954"} Sep 05 02:19:05.528444 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:05.528036 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-zt7r6" Sep 05 02:19:05.529785 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:05.529759 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-mckdq" event={"ID":"fd1b28f1-f463-4135-8776-fd0ceff545ca","Type":"ContainerStarted","Data":"ac53711a264d66144ee5478df3694b37246e86fb56e3a467ccf193bbfc6bbf31"} Sep 05 02:19:05.529923 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:05.529802 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-mckdq" event={"ID":"fd1b28f1-f463-4135-8776-fd0ceff545ca","Type":"ContainerStarted","Data":"4fdf41eac2b6c6717eccd0ecda9b6880f31ed588a02ca0b0699c35b13cfc2aa3"} Sep 05 02:19:05.529923 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:05.529823 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-mckdq" Sep 05 02:19:05.531241 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:05.531213 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6679bd9dc8-fdnt5" event={"ID":"50207783-b68e-4a93-9da9-eb5cbbb399b8","Type":"ContainerStarted","Data":"b5558b9db1e79942234fea2187fa2d146b2c590d0cbe6500177573b19a3f5346"} Sep 05 02:19:05.531363 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:05.531274 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-6679bd9dc8-fdnt5" Sep 05 02:19:05.532565 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:05.532547 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-ghjcr" event={"ID":"bd4a3b61-19e3-4177-b012-e8ec8048aed1","Type":"ContainerStarted","Data":"1d4b45a3bb6d947e9c2b607b6c8110a7691b07171faef757eff37bc2433e1053"} Sep 05 02:19:05.546475 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:05.546436 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-zt7r6" podStartSLOduration=65.855847532 podStartE2EDuration="1m11.546423337s" totalImagesPullingTime="5.690575805s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-05 02:17:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-05 02:19:05.545032316 +0000 UTC m=+72.047169915" watchObservedRunningTime="2026-09-05 02:19:05.546423337 +0000 UTC m=+72.048560931" Sep 05 02:19:05.567566 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:05.567520 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-6679bd9dc8-fdnt5" podStartSLOduration=21.567507225 podStartE2EDuration="21.567507225s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-05 02:18:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-05 02:19:05.566642891 +0000 UTC m=+72.068780488" watchObservedRunningTime="2026-09-05 02:19:05.567507225 +0000 UTC m=+72.069644822" Sep 05 02:19:05.585653 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:05.585615 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-ghjcr" podStartSLOduration=65.899229113 podStartE2EDuration="1m11.585602651s" totalImagesPullingTime="5.686373538s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-05 02:17:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-05 02:19:05.584538892 +0000 UTC m=+72.086676488" watchObservedRunningTime="2026-09-05 02:19:05.585602651 +0000 UTC m=+72.087740249" Sep 05 02:19:05.602791 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:05.602754 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-mckdq" podStartSLOduration=33.506978228 podStartE2EDuration="38.602744285s" totalImagesPullingTime="5.095766057s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-05 02:18:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-05 02:19:05.602145932 +0000 UTC m=+72.104283529" watchObservedRunningTime="2026-09-05 02:19:05.602744285 +0000 UTC m=+72.104881881" Sep 05 02:19:06.732304 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:06.732267 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/e0bb0aec-dbbe-4026-abd6-ba57cb7f7c7d-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-xz7zr\" (UID: \"e0bb0aec-dbbe-4026-abd6-ba57cb7f7c7d\") " pod="openshift-network-console/networking-console-plugin-79977f9844-xz7zr" Sep 05 02:19:06.734587 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:06.734568 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/e0bb0aec-dbbe-4026-abd6-ba57cb7f7c7d-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-xz7zr\" (UID: \"e0bb0aec-dbbe-4026-abd6-ba57cb7f7c7d\") " pod="openshift-network-console/networking-console-plugin-79977f9844-xz7zr" Sep 05 02:19:06.798279 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:06.798251 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-k6vpd\"" Sep 05 02:19:06.806417 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:06.806397 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-79977f9844-xz7zr" Sep 05 02:19:07.072579 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:07.072505 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-79977f9844-xz7zr"] Sep 05 02:19:07.076282 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:19:07.076250 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode0bb0aec_dbbe_4026_abd6_ba57cb7f7c7d.slice/crio-26db6c46094f2eaec53b6d0a0d6b7238461aa146534c5622eec91a5fff42ba54 WatchSource:0}: Error finding container 26db6c46094f2eaec53b6d0a0d6b7238461aa146534c5622eec91a5fff42ba54: Status 404 returned error can't find the container with id 26db6c46094f2eaec53b6d0a0d6b7238461aa146534c5622eec91a5fff42ba54 Sep 05 02:19:07.337001 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:07.336901 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ba8f84f4-5dce-49da-81c1-705a209d5f31-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nxqlq\" (UID: \"ba8f84f4-5dce-49da-81c1-705a209d5f31\") " pod="openshift-insights/insights-runtime-extractor-nxqlq" Sep 05 02:19:07.337001 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:07.336950 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ba8f84f4-5dce-49da-81c1-705a209d5f31-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nxqlq\" (UID: \"ba8f84f4-5dce-49da-81c1-705a209d5f31\") " pod="openshift-insights/insights-runtime-extractor-nxqlq" Sep 05 02:19:07.337500 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:07.337477 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ba8f84f4-5dce-49da-81c1-705a209d5f31-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nxqlq\" (UID: \"ba8f84f4-5dce-49da-81c1-705a209d5f31\") " pod="openshift-insights/insights-runtime-extractor-nxqlq" Sep 05 02:19:07.339267 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:07.339248 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ba8f84f4-5dce-49da-81c1-705a209d5f31-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nxqlq\" (UID: \"ba8f84f4-5dce-49da-81c1-705a209d5f31\") " pod="openshift-insights/insights-runtime-extractor-nxqlq" Sep 05 02:19:07.436112 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:07.436084 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-zwbbc\"" Sep 05 02:19:07.444454 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:07.444428 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-nxqlq" Sep 05 02:19:07.540262 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:07.540232 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-79977f9844-xz7zr" event={"ID":"e0bb0aec-dbbe-4026-abd6-ba57cb7f7c7d","Type":"ContainerStarted","Data":"26db6c46094f2eaec53b6d0a0d6b7238461aa146534c5622eec91a5fff42ba54"} Sep 05 02:19:07.712608 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:07.712580 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-nxqlq"] Sep 05 02:19:07.715281 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:19:07.715257 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podba8f84f4_5dce_49da_81c1_705a209d5f31.slice/crio-97d2c121f1c74773c0ca05de3ff26e067996c66c6cdacee35cdf5789a60dd651 WatchSource:0}: Error finding container 97d2c121f1c74773c0ca05de3ff26e067996c66c6cdacee35cdf5789a60dd651: Status 404 returned error can't find the container with id 97d2c121f1c74773c0ca05de3ff26e067996c66c6cdacee35cdf5789a60dd651 Sep 05 02:19:08.545690 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:08.545658 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-nxqlq" event={"ID":"ba8f84f4-5dce-49da-81c1-705a209d5f31","Type":"ContainerStarted","Data":"eb8fede477cc98a70210d3ea0b0d9a59a4db40d469c4bd36238e5b8d9ef495dc"} Sep 05 02:19:08.546059 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:08.545716 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-nxqlq" event={"ID":"ba8f84f4-5dce-49da-81c1-705a209d5f31","Type":"ContainerStarted","Data":"b829f5074bbc9bf510518d1f9250a2a134830c049ff64ae7e54e56cefd6d884c"} Sep 05 02:19:08.546059 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:08.545736 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-nxqlq" event={"ID":"ba8f84f4-5dce-49da-81c1-705a209d5f31","Type":"ContainerStarted","Data":"97d2c121f1c74773c0ca05de3ff26e067996c66c6cdacee35cdf5789a60dd651"} Sep 05 02:19:10.082472 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:10.082444 2555 scope.go:117] "RemoveContainer" containerID="cdea25279982e1ba9f45e81f68609ac85662276d5deffac11903749c7e4caf73" Sep 05 02:19:10.555333 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:10.555306 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-k2cdf_2ab9a760-ef7b-48dc-acbe-2694be7274e0/console-operator/1.log" Sep 05 02:19:10.555534 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:10.555394 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-85b454874b-k2cdf" event={"ID":"2ab9a760-ef7b-48dc-acbe-2694be7274e0","Type":"ContainerStarted","Data":"26d5d0662a21e1e395f741eaf9ddf5019d3019ebebf4aece89791f0148eea2fe"} Sep 05 02:19:10.555878 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:10.555862 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-85b454874b-k2cdf" Sep 05 02:19:10.557293 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:10.557265 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-79977f9844-xz7zr" event={"ID":"e0bb0aec-dbbe-4026-abd6-ba57cb7f7c7d","Type":"ContainerStarted","Data":"c6e94a093ec163a5e607264654718313d082ca6933849461071386638aff8b91"} Sep 05 02:19:10.559339 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:10.559315 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-nxqlq" event={"ID":"ba8f84f4-5dce-49da-81c1-705a209d5f31","Type":"ContainerStarted","Data":"fc1c67d63364d68713d8bb730afcaf2dd72f753abc5df20e51b53aed96526fc5"} Sep 05 02:19:10.577617 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:10.577580 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-85b454874b-k2cdf" podStartSLOduration=23.305039479 podStartE2EDuration="25.577568867s" totalImagesPullingTime="2.272529388s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-05 02:18:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-05 02:19:10.577036127 +0000 UTC m=+77.079173714" watchObservedRunningTime="2026-09-05 02:19:10.577568867 +0000 UTC m=+77.079706463" Sep 05 02:19:10.593263 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:10.592957 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-85b454874b-k2cdf" Sep 05 02:19:10.598271 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:10.598233 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-79977f9844-xz7zr" podStartSLOduration=17.784684051 podStartE2EDuration="20.598220509s" totalImagesPullingTime="2.813536458s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-05 02:18:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-05 02:19:10.597795489 +0000 UTC m=+77.099933085" watchObservedRunningTime="2026-09-05 02:19:10.598220509 +0000 UTC m=+77.100358196" Sep 05 02:19:10.627872 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:10.627828 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-nxqlq" podStartSLOduration=17.559431245 podStartE2EDuration="19.627814215s" totalImagesPullingTime="2.06838297s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-05 02:18:51 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-05 02:19:10.627332632 +0000 UTC m=+77.129470243" watchObservedRunningTime="2026-09-05 02:19:10.627814215 +0000 UTC m=+77.129951813" Sep 05 02:19:14.094783 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:14.093649 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6679bd9dc8-fdnt5"] Sep 05 02:19:14.111569 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:14.111538 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-6df89f7d7-wc8p6"] Sep 05 02:19:14.113650 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:14.113631 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6df89f7d7-wc8p6" Sep 05 02:19:14.117178 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:14.117159 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\"" Sep 05 02:19:14.117288 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:14.117200 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Sep 05 02:19:14.117288 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:14.117200 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Sep 05 02:19:14.117528 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:14.117515 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Sep 05 02:19:14.159950 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:14.159920 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-6df89f7d7-wc8p6"] Sep 05 02:19:14.187887 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:14.187858 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n4wht\" (UniqueName: \"kubernetes.io/projected/61a1db86-4fe8-4742-98cf-762569fdd207-kube-api-access-n4wht\") pod \"klusterlet-addon-workmgr-6df89f7d7-wc8p6\" (UID: \"61a1db86-4fe8-4742-98cf-762569fdd207\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6df89f7d7-wc8p6" Sep 05 02:19:14.188035 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:14.187911 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/61a1db86-4fe8-4742-98cf-762569fdd207-tmp\") pod \"klusterlet-addon-workmgr-6df89f7d7-wc8p6\" (UID: \"61a1db86-4fe8-4742-98cf-762569fdd207\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6df89f7d7-wc8p6" Sep 05 02:19:14.188035 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:14.187961 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/61a1db86-4fe8-4742-98cf-762569fdd207-klusterlet-config\") pod \"klusterlet-addon-workmgr-6df89f7d7-wc8p6\" (UID: \"61a1db86-4fe8-4742-98cf-762569fdd207\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6df89f7d7-wc8p6" Sep 05 02:19:14.189753 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:14.189728 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-77d8dbf4d7-2mzx5"] Sep 05 02:19:14.191712 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:14.191697 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-77d8dbf4d7-2mzx5" Sep 05 02:19:14.208119 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:14.208097 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-77d8dbf4d7-2mzx5"] Sep 05 02:19:14.289305 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:14.289272 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-czk8c\" (UniqueName: \"kubernetes.io/projected/92bd0895-9344-48de-8982-c828ce76b108-kube-api-access-czk8c\") pod \"image-registry-77d8dbf4d7-2mzx5\" (UID: \"92bd0895-9344-48de-8982-c828ce76b108\") " pod="openshift-image-registry/image-registry-77d8dbf4d7-2mzx5" Sep 05 02:19:14.289305 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:14.289304 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/92bd0895-9344-48de-8982-c828ce76b108-trusted-ca\") pod \"image-registry-77d8dbf4d7-2mzx5\" (UID: \"92bd0895-9344-48de-8982-c828ce76b108\") " pod="openshift-image-registry/image-registry-77d8dbf4d7-2mzx5" Sep 05 02:19:14.289493 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:14.289329 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n4wht\" (UniqueName: \"kubernetes.io/projected/61a1db86-4fe8-4742-98cf-762569fdd207-kube-api-access-n4wht\") pod \"klusterlet-addon-workmgr-6df89f7d7-wc8p6\" (UID: \"61a1db86-4fe8-4742-98cf-762569fdd207\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6df89f7d7-wc8p6" Sep 05 02:19:14.289493 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:14.289410 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/92bd0895-9344-48de-8982-c828ce76b108-installation-pull-secrets\") pod \"image-registry-77d8dbf4d7-2mzx5\" (UID: \"92bd0895-9344-48de-8982-c828ce76b108\") " pod="openshift-image-registry/image-registry-77d8dbf4d7-2mzx5" Sep 05 02:19:14.289493 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:14.289436 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/92bd0895-9344-48de-8982-c828ce76b108-bound-sa-token\") pod \"image-registry-77d8dbf4d7-2mzx5\" (UID: \"92bd0895-9344-48de-8982-c828ce76b108\") " pod="openshift-image-registry/image-registry-77d8dbf4d7-2mzx5" Sep 05 02:19:14.289493 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:14.289461 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/92bd0895-9344-48de-8982-c828ce76b108-ca-trust-extracted\") pod \"image-registry-77d8dbf4d7-2mzx5\" (UID: \"92bd0895-9344-48de-8982-c828ce76b108\") " pod="openshift-image-registry/image-registry-77d8dbf4d7-2mzx5" Sep 05 02:19:14.289493 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:14.289489 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/61a1db86-4fe8-4742-98cf-762569fdd207-tmp\") pod \"klusterlet-addon-workmgr-6df89f7d7-wc8p6\" (UID: \"61a1db86-4fe8-4742-98cf-762569fdd207\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6df89f7d7-wc8p6" Sep 05 02:19:14.289667 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:14.289504 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/92bd0895-9344-48de-8982-c828ce76b108-registry-tls\") pod \"image-registry-77d8dbf4d7-2mzx5\" (UID: \"92bd0895-9344-48de-8982-c828ce76b108\") " pod="openshift-image-registry/image-registry-77d8dbf4d7-2mzx5" Sep 05 02:19:14.289667 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:14.289583 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/92bd0895-9344-48de-8982-c828ce76b108-image-registry-private-configuration\") pod \"image-registry-77d8dbf4d7-2mzx5\" (UID: \"92bd0895-9344-48de-8982-c828ce76b108\") " pod="openshift-image-registry/image-registry-77d8dbf4d7-2mzx5" Sep 05 02:19:14.289667 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:14.289616 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/61a1db86-4fe8-4742-98cf-762569fdd207-klusterlet-config\") pod \"klusterlet-addon-workmgr-6df89f7d7-wc8p6\" (UID: \"61a1db86-4fe8-4742-98cf-762569fdd207\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6df89f7d7-wc8p6" Sep 05 02:19:14.289667 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:14.289635 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/92bd0895-9344-48de-8982-c828ce76b108-registry-certificates\") pod \"image-registry-77d8dbf4d7-2mzx5\" (UID: \"92bd0895-9344-48de-8982-c828ce76b108\") " pod="openshift-image-registry/image-registry-77d8dbf4d7-2mzx5" Sep 05 02:19:14.289878 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:14.289857 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/61a1db86-4fe8-4742-98cf-762569fdd207-tmp\") pod \"klusterlet-addon-workmgr-6df89f7d7-wc8p6\" (UID: \"61a1db86-4fe8-4742-98cf-762569fdd207\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6df89f7d7-wc8p6" Sep 05 02:19:14.291937 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:14.291920 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/61a1db86-4fe8-4742-98cf-762569fdd207-klusterlet-config\") pod \"klusterlet-addon-workmgr-6df89f7d7-wc8p6\" (UID: \"61a1db86-4fe8-4742-98cf-762569fdd207\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6df89f7d7-wc8p6" Sep 05 02:19:14.302143 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:14.302115 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n4wht\" (UniqueName: \"kubernetes.io/projected/61a1db86-4fe8-4742-98cf-762569fdd207-kube-api-access-n4wht\") pod \"klusterlet-addon-workmgr-6df89f7d7-wc8p6\" (UID: \"61a1db86-4fe8-4742-98cf-762569fdd207\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6df89f7d7-wc8p6" Sep 05 02:19:14.391005 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:14.390922 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-czk8c\" (UniqueName: \"kubernetes.io/projected/92bd0895-9344-48de-8982-c828ce76b108-kube-api-access-czk8c\") pod \"image-registry-77d8dbf4d7-2mzx5\" (UID: \"92bd0895-9344-48de-8982-c828ce76b108\") " pod="openshift-image-registry/image-registry-77d8dbf4d7-2mzx5" Sep 05 02:19:14.391005 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:14.390966 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/92bd0895-9344-48de-8982-c828ce76b108-trusted-ca\") pod \"image-registry-77d8dbf4d7-2mzx5\" (UID: \"92bd0895-9344-48de-8982-c828ce76b108\") " pod="openshift-image-registry/image-registry-77d8dbf4d7-2mzx5" Sep 05 02:19:14.391222 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:14.391040 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/92bd0895-9344-48de-8982-c828ce76b108-installation-pull-secrets\") pod \"image-registry-77d8dbf4d7-2mzx5\" (UID: \"92bd0895-9344-48de-8982-c828ce76b108\") " pod="openshift-image-registry/image-registry-77d8dbf4d7-2mzx5" Sep 05 02:19:14.391222 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:14.391064 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/92bd0895-9344-48de-8982-c828ce76b108-bound-sa-token\") pod \"image-registry-77d8dbf4d7-2mzx5\" (UID: \"92bd0895-9344-48de-8982-c828ce76b108\") " pod="openshift-image-registry/image-registry-77d8dbf4d7-2mzx5" Sep 05 02:19:14.391222 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:14.391089 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/92bd0895-9344-48de-8982-c828ce76b108-ca-trust-extracted\") pod \"image-registry-77d8dbf4d7-2mzx5\" (UID: \"92bd0895-9344-48de-8982-c828ce76b108\") " pod="openshift-image-registry/image-registry-77d8dbf4d7-2mzx5" Sep 05 02:19:14.391222 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:14.391119 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/92bd0895-9344-48de-8982-c828ce76b108-registry-tls\") pod \"image-registry-77d8dbf4d7-2mzx5\" (UID: \"92bd0895-9344-48de-8982-c828ce76b108\") " pod="openshift-image-registry/image-registry-77d8dbf4d7-2mzx5" Sep 05 02:19:14.391222 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:14.391154 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/92bd0895-9344-48de-8982-c828ce76b108-image-registry-private-configuration\") pod \"image-registry-77d8dbf4d7-2mzx5\" (UID: \"92bd0895-9344-48de-8982-c828ce76b108\") " pod="openshift-image-registry/image-registry-77d8dbf4d7-2mzx5" Sep 05 02:19:14.391467 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:14.391254 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/92bd0895-9344-48de-8982-c828ce76b108-registry-certificates\") pod \"image-registry-77d8dbf4d7-2mzx5\" (UID: \"92bd0895-9344-48de-8982-c828ce76b108\") " pod="openshift-image-registry/image-registry-77d8dbf4d7-2mzx5" Sep 05 02:19:14.391664 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:14.391639 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/92bd0895-9344-48de-8982-c828ce76b108-ca-trust-extracted\") pod \"image-registry-77d8dbf4d7-2mzx5\" (UID: \"92bd0895-9344-48de-8982-c828ce76b108\") " pod="openshift-image-registry/image-registry-77d8dbf4d7-2mzx5" Sep 05 02:19:14.391958 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:14.391937 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/92bd0895-9344-48de-8982-c828ce76b108-registry-certificates\") pod \"image-registry-77d8dbf4d7-2mzx5\" (UID: \"92bd0895-9344-48de-8982-c828ce76b108\") " pod="openshift-image-registry/image-registry-77d8dbf4d7-2mzx5" Sep 05 02:19:14.392107 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:14.392084 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/92bd0895-9344-48de-8982-c828ce76b108-trusted-ca\") pod \"image-registry-77d8dbf4d7-2mzx5\" (UID: \"92bd0895-9344-48de-8982-c828ce76b108\") " pod="openshift-image-registry/image-registry-77d8dbf4d7-2mzx5" Sep 05 02:19:14.393523 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:14.393504 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/92bd0895-9344-48de-8982-c828ce76b108-image-registry-private-configuration\") pod \"image-registry-77d8dbf4d7-2mzx5\" (UID: \"92bd0895-9344-48de-8982-c828ce76b108\") " pod="openshift-image-registry/image-registry-77d8dbf4d7-2mzx5" Sep 05 02:19:14.393605 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:14.393564 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/92bd0895-9344-48de-8982-c828ce76b108-installation-pull-secrets\") pod \"image-registry-77d8dbf4d7-2mzx5\" (UID: \"92bd0895-9344-48de-8982-c828ce76b108\") " pod="openshift-image-registry/image-registry-77d8dbf4d7-2mzx5" Sep 05 02:19:14.393759 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:14.393738 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/92bd0895-9344-48de-8982-c828ce76b108-registry-tls\") pod \"image-registry-77d8dbf4d7-2mzx5\" (UID: \"92bd0895-9344-48de-8982-c828ce76b108\") " pod="openshift-image-registry/image-registry-77d8dbf4d7-2mzx5" Sep 05 02:19:14.406657 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:14.406630 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-czk8c\" (UniqueName: \"kubernetes.io/projected/92bd0895-9344-48de-8982-c828ce76b108-kube-api-access-czk8c\") pod \"image-registry-77d8dbf4d7-2mzx5\" (UID: \"92bd0895-9344-48de-8982-c828ce76b108\") " pod="openshift-image-registry/image-registry-77d8dbf4d7-2mzx5" Sep 05 02:19:14.406909 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:14.406890 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/92bd0895-9344-48de-8982-c828ce76b108-bound-sa-token\") pod \"image-registry-77d8dbf4d7-2mzx5\" (UID: \"92bd0895-9344-48de-8982-c828ce76b108\") " pod="openshift-image-registry/image-registry-77d8dbf4d7-2mzx5" Sep 05 02:19:14.422855 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:14.422831 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6df89f7d7-wc8p6" Sep 05 02:19:14.501382 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:14.501355 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-77d8dbf4d7-2mzx5" Sep 05 02:19:14.690614 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:14.690538 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-6df89f7d7-wc8p6"] Sep 05 02:19:14.693681 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:19:14.693654 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod61a1db86_4fe8_4742_98cf_762569fdd207.slice/crio-872143f31749b2b8dd7944bef94575dca5c1dd4d1809e3398fe9258dec6b468a WatchSource:0}: Error finding container 872143f31749b2b8dd7944bef94575dca5c1dd4d1809e3398fe9258dec6b468a: Status 404 returned error can't find the container with id 872143f31749b2b8dd7944bef94575dca5c1dd4d1809e3398fe9258dec6b468a Sep 05 02:19:14.773129 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:14.773098 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-77d8dbf4d7-2mzx5"] Sep 05 02:19:14.776067 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:19:14.776040 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod92bd0895_9344_48de_8982_c828ce76b108.slice/crio-ccddc4f3c08f925f5243a14a5a8e1c960f8584df693a6da3437cc5ecab16546c WatchSource:0}: Error finding container ccddc4f3c08f925f5243a14a5a8e1c960f8584df693a6da3437cc5ecab16546c: Status 404 returned error can't find the container with id ccddc4f3c08f925f5243a14a5a8e1c960f8584df693a6da3437cc5ecab16546c Sep 05 02:19:15.537481 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:15.537445 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-mckdq" Sep 05 02:19:15.579323 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:15.579281 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6df89f7d7-wc8p6" event={"ID":"61a1db86-4fe8-4742-98cf-762569fdd207","Type":"ContainerStarted","Data":"872143f31749b2b8dd7944bef94575dca5c1dd4d1809e3398fe9258dec6b468a"} Sep 05 02:19:15.581190 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:15.581162 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-77d8dbf4d7-2mzx5" event={"ID":"92bd0895-9344-48de-8982-c828ce76b108","Type":"ContainerStarted","Data":"2cc439b44f23184604764fd1fb4cbcc99434f3a8bc104d8038e48695eef6d19c"} Sep 05 02:19:15.581342 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:15.581208 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-77d8dbf4d7-2mzx5" event={"ID":"92bd0895-9344-48de-8982-c828ce76b108","Type":"ContainerStarted","Data":"ccddc4f3c08f925f5243a14a5a8e1c960f8584df693a6da3437cc5ecab16546c"} Sep 05 02:19:15.581342 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:15.581281 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-77d8dbf4d7-2mzx5" Sep 05 02:19:15.605372 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:15.605198 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-77d8dbf4d7-2mzx5" podStartSLOduration=1.605177323 podStartE2EDuration="1.605177323s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-05 02:19:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-05 02:19:15.603287103 +0000 UTC m=+82.105424701" watchObservedRunningTime="2026-09-05 02:19:15.605177323 +0000 UTC m=+82.107314921" Sep 05 02:19:19.598130 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:19.598095 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6df89f7d7-wc8p6" event={"ID":"61a1db86-4fe8-4742-98cf-762569fdd207","Type":"ContainerStarted","Data":"c6b4a9bbfcbffb8ee0c990ddd5d89300b9b0c4e00ff35cb42d1e5f2cec7e1768"} Sep 05 02:19:19.598547 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:19.598315 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6df89f7d7-wc8p6" Sep 05 02:19:19.600090 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:19.600070 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6df89f7d7-wc8p6" Sep 05 02:19:19.613684 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:19.613633 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6df89f7d7-wc8p6" podStartSLOduration=1.600115578 podStartE2EDuration="5.61361971s" totalImagesPullingTime="4.013504132s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-05 02:19:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-05 02:19:19.612824736 +0000 UTC m=+86.114962333" watchObservedRunningTime="2026-09-05 02:19:19.61361971 +0000 UTC m=+86.115757352" Sep 05 02:19:24.100411 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:24.100376 2555 patch_prober.go:28] interesting pod/image-registry-6679bd9dc8-fdnt5 container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Sep 05 02:19:24.100767 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:24.100435 2555 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-6679bd9dc8-fdnt5" podUID="50207783-b68e-4a93-9da9-eb5cbbb399b8" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Sep 05 02:19:33.326778 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:33.326741 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-6f4946db56-m7bnk"] Sep 05 02:19:33.362968 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:33.362934 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-6f4946db56-m7bnk"] Sep 05 02:19:33.363147 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:33.363075 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-6f4946db56-m7bnk" Sep 05 02:19:33.365939 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:33.365916 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Sep 05 02:19:33.366090 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:33.365944 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Sep 05 02:19:33.366090 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:33.365917 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Sep 05 02:19:33.366090 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:33.365987 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Sep 05 02:19:33.366714 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:33.366693 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Sep 05 02:19:33.366867 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:33.366822 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-w5rpg\"" Sep 05 02:19:33.542508 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:33.542477 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/84e1ef5e-21a2-4e76-a877-c8f387c42603-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-6f4946db56-m7bnk\" (UID: \"84e1ef5e-21a2-4e76-a877-c8f387c42603\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-m7bnk" Sep 05 02:19:33.542508 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:33.542509 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rm5m6\" (UniqueName: \"kubernetes.io/projected/84e1ef5e-21a2-4e76-a877-c8f387c42603-kube-api-access-rm5m6\") pod \"prometheus-operator-6f4946db56-m7bnk\" (UID: \"84e1ef5e-21a2-4e76-a877-c8f387c42603\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-m7bnk" Sep 05 02:19:33.542728 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:33.542587 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/84e1ef5e-21a2-4e76-a877-c8f387c42603-prometheus-operator-tls\") pod \"prometheus-operator-6f4946db56-m7bnk\" (UID: \"84e1ef5e-21a2-4e76-a877-c8f387c42603\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-m7bnk" Sep 05 02:19:33.542728 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:33.542625 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/84e1ef5e-21a2-4e76-a877-c8f387c42603-metrics-client-ca\") pod \"prometheus-operator-6f4946db56-m7bnk\" (UID: \"84e1ef5e-21a2-4e76-a877-c8f387c42603\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-m7bnk" Sep 05 02:19:33.646457 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:33.643990 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/84e1ef5e-21a2-4e76-a877-c8f387c42603-prometheus-operator-tls\") pod \"prometheus-operator-6f4946db56-m7bnk\" (UID: \"84e1ef5e-21a2-4e76-a877-c8f387c42603\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-m7bnk" Sep 05 02:19:33.646457 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:33.644102 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/84e1ef5e-21a2-4e76-a877-c8f387c42603-metrics-client-ca\") pod \"prometheus-operator-6f4946db56-m7bnk\" (UID: \"84e1ef5e-21a2-4e76-a877-c8f387c42603\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-m7bnk" Sep 05 02:19:33.646457 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:33.644148 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/84e1ef5e-21a2-4e76-a877-c8f387c42603-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-6f4946db56-m7bnk\" (UID: \"84e1ef5e-21a2-4e76-a877-c8f387c42603\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-m7bnk" Sep 05 02:19:33.646457 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:33.644179 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rm5m6\" (UniqueName: \"kubernetes.io/projected/84e1ef5e-21a2-4e76-a877-c8f387c42603-kube-api-access-rm5m6\") pod \"prometheus-operator-6f4946db56-m7bnk\" (UID: \"84e1ef5e-21a2-4e76-a877-c8f387c42603\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-m7bnk" Sep 05 02:19:33.646457 ip-10-0-133-250 kubenswrapper[2555]: E0905 02:19:33.645049 2555 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found Sep 05 02:19:33.646457 ip-10-0-133-250 kubenswrapper[2555]: E0905 02:19:33.645130 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/84e1ef5e-21a2-4e76-a877-c8f387c42603-prometheus-operator-tls podName:84e1ef5e-21a2-4e76-a877-c8f387c42603 nodeName:}" failed. No retries permitted until 2026-09-05 02:19:34.145103741 +0000 UTC m=+100.647241316 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/84e1ef5e-21a2-4e76-a877-c8f387c42603-prometheus-operator-tls") pod "prometheus-operator-6f4946db56-m7bnk" (UID: "84e1ef5e-21a2-4e76-a877-c8f387c42603") : secret "prometheus-operator-tls" not found Sep 05 02:19:33.646457 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:33.646034 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/84e1ef5e-21a2-4e76-a877-c8f387c42603-metrics-client-ca\") pod \"prometheus-operator-6f4946db56-m7bnk\" (UID: \"84e1ef5e-21a2-4e76-a877-c8f387c42603\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-m7bnk" Sep 05 02:19:33.649342 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:33.649281 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/84e1ef5e-21a2-4e76-a877-c8f387c42603-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-6f4946db56-m7bnk\" (UID: \"84e1ef5e-21a2-4e76-a877-c8f387c42603\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-m7bnk" Sep 05 02:19:33.656233 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:33.656212 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rm5m6\" (UniqueName: \"kubernetes.io/projected/84e1ef5e-21a2-4e76-a877-c8f387c42603-kube-api-access-rm5m6\") pod \"prometheus-operator-6f4946db56-m7bnk\" (UID: \"84e1ef5e-21a2-4e76-a877-c8f387c42603\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-m7bnk" Sep 05 02:19:34.099178 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:34.099150 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-6679bd9dc8-fdnt5" Sep 05 02:19:34.147925 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:34.147888 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/84e1ef5e-21a2-4e76-a877-c8f387c42603-prometheus-operator-tls\") pod \"prometheus-operator-6f4946db56-m7bnk\" (UID: \"84e1ef5e-21a2-4e76-a877-c8f387c42603\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-m7bnk" Sep 05 02:19:34.148099 ip-10-0-133-250 kubenswrapper[2555]: E0905 02:19:34.148055 2555 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found Sep 05 02:19:34.148161 ip-10-0-133-250 kubenswrapper[2555]: E0905 02:19:34.148129 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/84e1ef5e-21a2-4e76-a877-c8f387c42603-prometheus-operator-tls podName:84e1ef5e-21a2-4e76-a877-c8f387c42603 nodeName:}" failed. No retries permitted until 2026-09-05 02:19:35.148109365 +0000 UTC m=+101.650246960 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/84e1ef5e-21a2-4e76-a877-c8f387c42603-prometheus-operator-tls") pod "prometheus-operator-6f4946db56-m7bnk" (UID: "84e1ef5e-21a2-4e76-a877-c8f387c42603") : secret "prometheus-operator-tls" not found Sep 05 02:19:35.156548 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:35.156517 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/84e1ef5e-21a2-4e76-a877-c8f387c42603-prometheus-operator-tls\") pod \"prometheus-operator-6f4946db56-m7bnk\" (UID: \"84e1ef5e-21a2-4e76-a877-c8f387c42603\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-m7bnk" Sep 05 02:19:35.158971 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:35.158938 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/84e1ef5e-21a2-4e76-a877-c8f387c42603-prometheus-operator-tls\") pod \"prometheus-operator-6f4946db56-m7bnk\" (UID: \"84e1ef5e-21a2-4e76-a877-c8f387c42603\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-m7bnk" Sep 05 02:19:35.173840 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:35.173819 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-6f4946db56-m7bnk" Sep 05 02:19:35.472211 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:35.472181 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-6f4946db56-m7bnk"] Sep 05 02:19:35.475066 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:19:35.475037 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod84e1ef5e_21a2_4e76_a877_c8f387c42603.slice/crio-abe032a417072c10106e25197edd85607ff340a46e50f6ba451fa951ff592b5e WatchSource:0}: Error finding container abe032a417072c10106e25197edd85607ff340a46e50f6ba451fa951ff592b5e: Status 404 returned error can't find the container with id abe032a417072c10106e25197edd85607ff340a46e50f6ba451fa951ff592b5e Sep 05 02:19:35.655559 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:35.655527 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-6f4946db56-m7bnk" event={"ID":"84e1ef5e-21a2-4e76-a877-c8f387c42603","Type":"ContainerStarted","Data":"abe032a417072c10106e25197edd85607ff340a46e50f6ba451fa951ff592b5e"} Sep 05 02:19:36.538540 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:36.538513 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-zt7r6" Sep 05 02:19:36.591874 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:36.591846 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-77d8dbf4d7-2mzx5" Sep 05 02:19:37.665417 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:37.665384 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-6f4946db56-m7bnk" event={"ID":"84e1ef5e-21a2-4e76-a877-c8f387c42603","Type":"ContainerStarted","Data":"f8876f16505b6f0a9dae2e9a206379285a4bbf091b6363848a7e5884dc0bf01c"} Sep 05 02:19:37.665786 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:37.665431 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-6f4946db56-m7bnk" event={"ID":"84e1ef5e-21a2-4e76-a877-c8f387c42603","Type":"ContainerStarted","Data":"e26555985a7c3f705af91af475bde99eb85af1e7a2acb23f8f8e784db237ceea"} Sep 05 02:19:37.686216 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:37.686165 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-6f4946db56-m7bnk" podStartSLOduration=3.086052512 podStartE2EDuration="4.686150207s" totalImagesPullingTime="1.600097695s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-05 02:19:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-05 02:19:37.685834575 +0000 UTC m=+104.187972167" watchObservedRunningTime="2026-09-05 02:19:37.686150207 +0000 UTC m=+104.188287801" Sep 05 02:19:39.113879 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:39.113829 2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-6679bd9dc8-fdnt5" podUID="50207783-b68e-4a93-9da9-eb5cbbb399b8" containerName="registry" containerID="cri-o://b5558b9db1e79942234fea2187fa2d146b2c590d0cbe6500177573b19a3f5346" gracePeriod=30 Sep 05 02:19:39.347828 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:39.347805 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6679bd9dc8-fdnt5" Sep 05 02:19:39.387115 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:39.387042 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/50207783-b68e-4a93-9da9-eb5cbbb399b8-registry-tls\") pod \"50207783-b68e-4a93-9da9-eb5cbbb399b8\" (UID: \"50207783-b68e-4a93-9da9-eb5cbbb399b8\") " Sep 05 02:19:39.387115 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:39.387087 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/50207783-b68e-4a93-9da9-eb5cbbb399b8-bound-sa-token\") pod \"50207783-b68e-4a93-9da9-eb5cbbb399b8\" (UID: \"50207783-b68e-4a93-9da9-eb5cbbb399b8\") " Sep 05 02:19:39.387321 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:39.387120 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/50207783-b68e-4a93-9da9-eb5cbbb399b8-installation-pull-secrets\") pod \"50207783-b68e-4a93-9da9-eb5cbbb399b8\" (UID: \"50207783-b68e-4a93-9da9-eb5cbbb399b8\") " Sep 05 02:19:39.387321 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:39.387220 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/50207783-b68e-4a93-9da9-eb5cbbb399b8-image-registry-private-configuration\") pod \"50207783-b68e-4a93-9da9-eb5cbbb399b8\" (UID: \"50207783-b68e-4a93-9da9-eb5cbbb399b8\") " Sep 05 02:19:39.387321 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:39.387284 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/50207783-b68e-4a93-9da9-eb5cbbb399b8-ca-trust-extracted\") pod \"50207783-b68e-4a93-9da9-eb5cbbb399b8\" (UID: \"50207783-b68e-4a93-9da9-eb5cbbb399b8\") " Sep 05 02:19:39.387321 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:39.387310 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mqd4g\" (UniqueName: \"kubernetes.io/projected/50207783-b68e-4a93-9da9-eb5cbbb399b8-kube-api-access-mqd4g\") pod \"50207783-b68e-4a93-9da9-eb5cbbb399b8\" (UID: \"50207783-b68e-4a93-9da9-eb5cbbb399b8\") " Sep 05 02:19:39.387512 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:39.387351 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/50207783-b68e-4a93-9da9-eb5cbbb399b8-trusted-ca\") pod \"50207783-b68e-4a93-9da9-eb5cbbb399b8\" (UID: \"50207783-b68e-4a93-9da9-eb5cbbb399b8\") " Sep 05 02:19:39.387512 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:39.387393 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/50207783-b68e-4a93-9da9-eb5cbbb399b8-registry-certificates\") pod \"50207783-b68e-4a93-9da9-eb5cbbb399b8\" (UID: \"50207783-b68e-4a93-9da9-eb5cbbb399b8\") " Sep 05 02:19:39.387870 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:39.387838 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/50207783-b68e-4a93-9da9-eb5cbbb399b8-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "50207783-b68e-4a93-9da9-eb5cbbb399b8" (UID: "50207783-b68e-4a93-9da9-eb5cbbb399b8"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 05 02:19:39.387975 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:39.387949 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/50207783-b68e-4a93-9da9-eb5cbbb399b8-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "50207783-b68e-4a93-9da9-eb5cbbb399b8" (UID: "50207783-b68e-4a93-9da9-eb5cbbb399b8"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 05 02:19:39.389786 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:39.389740 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/50207783-b68e-4a93-9da9-eb5cbbb399b8-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "50207783-b68e-4a93-9da9-eb5cbbb399b8" (UID: "50207783-b68e-4a93-9da9-eb5cbbb399b8"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 05 02:19:39.390337 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:39.390305 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/50207783-b68e-4a93-9da9-eb5cbbb399b8-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "50207783-b68e-4a93-9da9-eb5cbbb399b8" (UID: "50207783-b68e-4a93-9da9-eb5cbbb399b8"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 05 02:19:39.390437 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:39.390364 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/50207783-b68e-4a93-9da9-eb5cbbb399b8-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "50207783-b68e-4a93-9da9-eb5cbbb399b8" (UID: "50207783-b68e-4a93-9da9-eb5cbbb399b8"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 05 02:19:39.390492 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:39.390439 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/50207783-b68e-4a93-9da9-eb5cbbb399b8-kube-api-access-mqd4g" (OuterVolumeSpecName: "kube-api-access-mqd4g") pod "50207783-b68e-4a93-9da9-eb5cbbb399b8" (UID: "50207783-b68e-4a93-9da9-eb5cbbb399b8"). InnerVolumeSpecName "kube-api-access-mqd4g". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 05 02:19:39.390663 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:39.390643 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/50207783-b68e-4a93-9da9-eb5cbbb399b8-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "50207783-b68e-4a93-9da9-eb5cbbb399b8" (UID: "50207783-b68e-4a93-9da9-eb5cbbb399b8"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 05 02:19:39.399300 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:39.399257 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/50207783-b68e-4a93-9da9-eb5cbbb399b8-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "50207783-b68e-4a93-9da9-eb5cbbb399b8" (UID: "50207783-b68e-4a93-9da9-eb5cbbb399b8"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 05 02:19:39.488174 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:39.488141 2555 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/50207783-b68e-4a93-9da9-eb5cbbb399b8-ca-trust-extracted\") on node \"ip-10-0-133-250.ec2.internal\" DevicePath \"\"" Sep 05 02:19:39.488174 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:39.488167 2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mqd4g\" (UniqueName: \"kubernetes.io/projected/50207783-b68e-4a93-9da9-eb5cbbb399b8-kube-api-access-mqd4g\") on node \"ip-10-0-133-250.ec2.internal\" DevicePath \"\"" Sep 05 02:19:39.488174 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:39.488177 2555 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/50207783-b68e-4a93-9da9-eb5cbbb399b8-trusted-ca\") on node \"ip-10-0-133-250.ec2.internal\" DevicePath \"\"" Sep 05 02:19:39.488174 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:39.488185 2555 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/50207783-b68e-4a93-9da9-eb5cbbb399b8-registry-certificates\") on node \"ip-10-0-133-250.ec2.internal\" DevicePath \"\"" Sep 05 02:19:39.488510 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:39.488194 2555 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/50207783-b68e-4a93-9da9-eb5cbbb399b8-registry-tls\") on node \"ip-10-0-133-250.ec2.internal\" DevicePath \"\"" Sep 05 02:19:39.488510 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:39.488202 2555 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/50207783-b68e-4a93-9da9-eb5cbbb399b8-bound-sa-token\") on node \"ip-10-0-133-250.ec2.internal\" DevicePath \"\"" Sep 05 02:19:39.488510 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:39.488210 2555 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/50207783-b68e-4a93-9da9-eb5cbbb399b8-installation-pull-secrets\") on node \"ip-10-0-133-250.ec2.internal\" DevicePath \"\"" Sep 05 02:19:39.488510 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:39.488219 2555 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/50207783-b68e-4a93-9da9-eb5cbbb399b8-image-registry-private-configuration\") on node \"ip-10-0-133-250.ec2.internal\" DevicePath \"\"" Sep 05 02:19:39.674290 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:39.674205 2555 generic.go:356] "Generic (PLEG): container finished" podID="50207783-b68e-4a93-9da9-eb5cbbb399b8" containerID="b5558b9db1e79942234fea2187fa2d146b2c590d0cbe6500177573b19a3f5346" exitCode=0 Sep 05 02:19:39.674290 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:39.674268 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6679bd9dc8-fdnt5" Sep 05 02:19:39.674474 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:39.674294 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6679bd9dc8-fdnt5" event={"ID":"50207783-b68e-4a93-9da9-eb5cbbb399b8","Type":"ContainerDied","Data":"b5558b9db1e79942234fea2187fa2d146b2c590d0cbe6500177573b19a3f5346"} Sep 05 02:19:39.674474 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:39.674359 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6679bd9dc8-fdnt5" event={"ID":"50207783-b68e-4a93-9da9-eb5cbbb399b8","Type":"ContainerDied","Data":"b3a40ee4a4f8cf6a51cd5d156a330bea381a5190029c358e0ee9a75ef822ee7c"} Sep 05 02:19:39.674474 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:39.674387 2555 scope.go:117] "RemoveContainer" containerID="b5558b9db1e79942234fea2187fa2d146b2c590d0cbe6500177573b19a3f5346" Sep 05 02:19:39.690778 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:39.690757 2555 scope.go:117] "RemoveContainer" containerID="b5558b9db1e79942234fea2187fa2d146b2c590d0cbe6500177573b19a3f5346" Sep 05 02:19:39.691149 ip-10-0-133-250 kubenswrapper[2555]: E0905 02:19:39.691126 2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b5558b9db1e79942234fea2187fa2d146b2c590d0cbe6500177573b19a3f5346\": container with ID starting with b5558b9db1e79942234fea2187fa2d146b2c590d0cbe6500177573b19a3f5346 not found: ID does not exist" containerID="b5558b9db1e79942234fea2187fa2d146b2c590d0cbe6500177573b19a3f5346" Sep 05 02:19:39.691220 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:39.691157 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b5558b9db1e79942234fea2187fa2d146b2c590d0cbe6500177573b19a3f5346"} err="failed to get container status \"b5558b9db1e79942234fea2187fa2d146b2c590d0cbe6500177573b19a3f5346\": rpc error: code = NotFound desc = could not find container \"b5558b9db1e79942234fea2187fa2d146b2c590d0cbe6500177573b19a3f5346\": container with ID starting with b5558b9db1e79942234fea2187fa2d146b2c590d0cbe6500177573b19a3f5346 not found: ID does not exist" Sep 05 02:19:39.711059 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:39.711034 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6679bd9dc8-fdnt5"] Sep 05 02:19:39.714508 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:39.714486 2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-6679bd9dc8-fdnt5"] Sep 05 02:19:39.821521 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:39.821485 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-c7mrv"] Sep 05 02:19:39.821725 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:39.821713 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="50207783-b68e-4a93-9da9-eb5cbbb399b8" containerName="registry" Sep 05 02:19:39.821786 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:39.821726 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="50207783-b68e-4a93-9da9-eb5cbbb399b8" containerName="registry" Sep 05 02:19:39.821786 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:39.821782 2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="50207783-b68e-4a93-9da9-eb5cbbb399b8" containerName="registry" Sep 05 02:19:39.825072 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:39.825052 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-c7mrv" Sep 05 02:19:39.828770 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:39.828746 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Sep 05 02:19:39.828880 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:39.828858 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Sep 05 02:19:39.829007 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:39.828993 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Sep 05 02:19:39.829115 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:39.829079 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-4v597\"" Sep 05 02:19:39.891326 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:39.891297 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/40a7d562-85f7-4a96-8dfc-a4dbb0d0b9a1-metrics-client-ca\") pod \"node-exporter-c7mrv\" (UID: \"40a7d562-85f7-4a96-8dfc-a4dbb0d0b9a1\") " pod="openshift-monitoring/node-exporter-c7mrv" Sep 05 02:19:39.891326 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:39.891329 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/40a7d562-85f7-4a96-8dfc-a4dbb0d0b9a1-node-exporter-textfile\") pod \"node-exporter-c7mrv\" (UID: \"40a7d562-85f7-4a96-8dfc-a4dbb0d0b9a1\") " pod="openshift-monitoring/node-exporter-c7mrv" Sep 05 02:19:39.891568 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:39.891362 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q296z\" (UniqueName: \"kubernetes.io/projected/40a7d562-85f7-4a96-8dfc-a4dbb0d0b9a1-kube-api-access-q296z\") pod \"node-exporter-c7mrv\" (UID: \"40a7d562-85f7-4a96-8dfc-a4dbb0d0b9a1\") " pod="openshift-monitoring/node-exporter-c7mrv" Sep 05 02:19:39.891568 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:39.891428 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/40a7d562-85f7-4a96-8dfc-a4dbb0d0b9a1-node-exporter-tls\") pod \"node-exporter-c7mrv\" (UID: \"40a7d562-85f7-4a96-8dfc-a4dbb0d0b9a1\") " pod="openshift-monitoring/node-exporter-c7mrv" Sep 05 02:19:39.891568 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:39.891471 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/40a7d562-85f7-4a96-8dfc-a4dbb0d0b9a1-node-exporter-wtmp\") pod \"node-exporter-c7mrv\" (UID: \"40a7d562-85f7-4a96-8dfc-a4dbb0d0b9a1\") " pod="openshift-monitoring/node-exporter-c7mrv" Sep 05 02:19:39.891568 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:39.891493 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/40a7d562-85f7-4a96-8dfc-a4dbb0d0b9a1-root\") pod \"node-exporter-c7mrv\" (UID: \"40a7d562-85f7-4a96-8dfc-a4dbb0d0b9a1\") " pod="openshift-monitoring/node-exporter-c7mrv" Sep 05 02:19:39.891568 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:39.891513 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/40a7d562-85f7-4a96-8dfc-a4dbb0d0b9a1-sys\") pod \"node-exporter-c7mrv\" (UID: \"40a7d562-85f7-4a96-8dfc-a4dbb0d0b9a1\") " pod="openshift-monitoring/node-exporter-c7mrv" Sep 05 02:19:39.891568 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:39.891528 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/40a7d562-85f7-4a96-8dfc-a4dbb0d0b9a1-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-c7mrv\" (UID: \"40a7d562-85f7-4a96-8dfc-a4dbb0d0b9a1\") " pod="openshift-monitoring/node-exporter-c7mrv" Sep 05 02:19:39.891568 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:39.891544 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/40a7d562-85f7-4a96-8dfc-a4dbb0d0b9a1-node-exporter-accelerators-collector-config\") pod \"node-exporter-c7mrv\" (UID: \"40a7d562-85f7-4a96-8dfc-a4dbb0d0b9a1\") " pod="openshift-monitoring/node-exporter-c7mrv" Sep 05 02:19:39.992847 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:39.992810 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/40a7d562-85f7-4a96-8dfc-a4dbb0d0b9a1-metrics-client-ca\") pod \"node-exporter-c7mrv\" (UID: \"40a7d562-85f7-4a96-8dfc-a4dbb0d0b9a1\") " pod="openshift-monitoring/node-exporter-c7mrv" Sep 05 02:19:39.993048 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:39.992855 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/40a7d562-85f7-4a96-8dfc-a4dbb0d0b9a1-node-exporter-textfile\") pod \"node-exporter-c7mrv\" (UID: \"40a7d562-85f7-4a96-8dfc-a4dbb0d0b9a1\") " pod="openshift-monitoring/node-exporter-c7mrv" Sep 05 02:19:39.993048 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:39.992897 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q296z\" (UniqueName: \"kubernetes.io/projected/40a7d562-85f7-4a96-8dfc-a4dbb0d0b9a1-kube-api-access-q296z\") pod \"node-exporter-c7mrv\" (UID: \"40a7d562-85f7-4a96-8dfc-a4dbb0d0b9a1\") " pod="openshift-monitoring/node-exporter-c7mrv" Sep 05 02:19:39.993048 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:39.992932 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/40a7d562-85f7-4a96-8dfc-a4dbb0d0b9a1-node-exporter-tls\") pod \"node-exporter-c7mrv\" (UID: \"40a7d562-85f7-4a96-8dfc-a4dbb0d0b9a1\") " pod="openshift-monitoring/node-exporter-c7mrv" Sep 05 02:19:39.993048 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:39.992957 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/40a7d562-85f7-4a96-8dfc-a4dbb0d0b9a1-node-exporter-wtmp\") pod \"node-exporter-c7mrv\" (UID: \"40a7d562-85f7-4a96-8dfc-a4dbb0d0b9a1\") " pod="openshift-monitoring/node-exporter-c7mrv" Sep 05 02:19:39.993048 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:39.992990 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/40a7d562-85f7-4a96-8dfc-a4dbb0d0b9a1-root\") pod \"node-exporter-c7mrv\" (UID: \"40a7d562-85f7-4a96-8dfc-a4dbb0d0b9a1\") " pod="openshift-monitoring/node-exporter-c7mrv" Sep 05 02:19:39.993048 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:39.993036 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/40a7d562-85f7-4a96-8dfc-a4dbb0d0b9a1-sys\") pod \"node-exporter-c7mrv\" (UID: \"40a7d562-85f7-4a96-8dfc-a4dbb0d0b9a1\") " pod="openshift-monitoring/node-exporter-c7mrv" Sep 05 02:19:39.993353 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:39.993060 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/40a7d562-85f7-4a96-8dfc-a4dbb0d0b9a1-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-c7mrv\" (UID: \"40a7d562-85f7-4a96-8dfc-a4dbb0d0b9a1\") " pod="openshift-monitoring/node-exporter-c7mrv" Sep 05 02:19:39.993353 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:39.993085 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/40a7d562-85f7-4a96-8dfc-a4dbb0d0b9a1-node-exporter-accelerators-collector-config\") pod \"node-exporter-c7mrv\" (UID: \"40a7d562-85f7-4a96-8dfc-a4dbb0d0b9a1\") " pod="openshift-monitoring/node-exporter-c7mrv" Sep 05 02:19:39.993353 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:39.993129 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/40a7d562-85f7-4a96-8dfc-a4dbb0d0b9a1-node-exporter-wtmp\") pod \"node-exporter-c7mrv\" (UID: \"40a7d562-85f7-4a96-8dfc-a4dbb0d0b9a1\") " pod="openshift-monitoring/node-exporter-c7mrv" Sep 05 02:19:39.993353 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:39.993198 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/40a7d562-85f7-4a96-8dfc-a4dbb0d0b9a1-sys\") pod \"node-exporter-c7mrv\" (UID: \"40a7d562-85f7-4a96-8dfc-a4dbb0d0b9a1\") " pod="openshift-monitoring/node-exporter-c7mrv" Sep 05 02:19:39.993353 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:39.993238 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/40a7d562-85f7-4a96-8dfc-a4dbb0d0b9a1-root\") pod \"node-exporter-c7mrv\" (UID: \"40a7d562-85f7-4a96-8dfc-a4dbb0d0b9a1\") " pod="openshift-monitoring/node-exporter-c7mrv" Sep 05 02:19:39.993353 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:39.993302 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/40a7d562-85f7-4a96-8dfc-a4dbb0d0b9a1-node-exporter-textfile\") pod \"node-exporter-c7mrv\" (UID: \"40a7d562-85f7-4a96-8dfc-a4dbb0d0b9a1\") " pod="openshift-monitoring/node-exporter-c7mrv" Sep 05 02:19:39.993647 ip-10-0-133-250 kubenswrapper[2555]: E0905 02:19:39.993416 2555 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Sep 05 02:19:39.993647 ip-10-0-133-250 kubenswrapper[2555]: E0905 02:19:39.993477 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/40a7d562-85f7-4a96-8dfc-a4dbb0d0b9a1-node-exporter-tls podName:40a7d562-85f7-4a96-8dfc-a4dbb0d0b9a1 nodeName:}" failed. No retries permitted until 2026-09-05 02:19:40.49345713 +0000 UTC m=+106.995594707 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/40a7d562-85f7-4a96-8dfc-a4dbb0d0b9a1-node-exporter-tls") pod "node-exporter-c7mrv" (UID: "40a7d562-85f7-4a96-8dfc-a4dbb0d0b9a1") : secret "node-exporter-tls" not found Sep 05 02:19:39.993647 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:39.993525 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/40a7d562-85f7-4a96-8dfc-a4dbb0d0b9a1-metrics-client-ca\") pod \"node-exporter-c7mrv\" (UID: \"40a7d562-85f7-4a96-8dfc-a4dbb0d0b9a1\") " pod="openshift-monitoring/node-exporter-c7mrv" Sep 05 02:19:39.993793 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:39.993726 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/40a7d562-85f7-4a96-8dfc-a4dbb0d0b9a1-node-exporter-accelerators-collector-config\") pod \"node-exporter-c7mrv\" (UID: \"40a7d562-85f7-4a96-8dfc-a4dbb0d0b9a1\") " pod="openshift-monitoring/node-exporter-c7mrv" Sep 05 02:19:39.995636 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:39.995616 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/40a7d562-85f7-4a96-8dfc-a4dbb0d0b9a1-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-c7mrv\" (UID: \"40a7d562-85f7-4a96-8dfc-a4dbb0d0b9a1\") " pod="openshift-monitoring/node-exporter-c7mrv" Sep 05 02:19:40.004233 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:40.004208 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q296z\" (UniqueName: \"kubernetes.io/projected/40a7d562-85f7-4a96-8dfc-a4dbb0d0b9a1-kube-api-access-q296z\") pod \"node-exporter-c7mrv\" (UID: \"40a7d562-85f7-4a96-8dfc-a4dbb0d0b9a1\") " pod="openshift-monitoring/node-exporter-c7mrv" Sep 05 02:19:40.083239 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:40.083202 2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="50207783-b68e-4a93-9da9-eb5cbbb399b8" path="/var/lib/kubelet/pods/50207783-b68e-4a93-9da9-eb5cbbb399b8/volumes" Sep 05 02:19:40.497478 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:40.497444 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/40a7d562-85f7-4a96-8dfc-a4dbb0d0b9a1-node-exporter-tls\") pod \"node-exporter-c7mrv\" (UID: \"40a7d562-85f7-4a96-8dfc-a4dbb0d0b9a1\") " pod="openshift-monitoring/node-exporter-c7mrv" Sep 05 02:19:40.499715 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:40.499694 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/40a7d562-85f7-4a96-8dfc-a4dbb0d0b9a1-node-exporter-tls\") pod \"node-exporter-c7mrv\" (UID: \"40a7d562-85f7-4a96-8dfc-a4dbb0d0b9a1\") " pod="openshift-monitoring/node-exporter-c7mrv" Sep 05 02:19:40.734332 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:40.734304 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-c7mrv" Sep 05 02:19:40.746037 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:19:40.745983 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod40a7d562_85f7_4a96_8dfc_a4dbb0d0b9a1.slice/crio-c4e1256cbb798eb226046e5cc31c9ba8a8a502463736ab37ced914cb4a70067c WatchSource:0}: Error finding container c4e1256cbb798eb226046e5cc31c9ba8a8a502463736ab37ced914cb4a70067c: Status 404 returned error can't find the container with id c4e1256cbb798eb226046e5cc31c9ba8a8a502463736ab37ced914cb4a70067c Sep 05 02:19:40.885736 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:40.885708 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 05 02:19:40.888834 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:40.888815 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 05 02:19:40.891726 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:40.891705 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Sep 05 02:19:40.891840 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:40.891788 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Sep 05 02:19:40.892147 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:40.892094 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Sep 05 02:19:40.892147 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:40.892105 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Sep 05 02:19:40.892314 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:40.892202 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Sep 05 02:19:40.892494 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:40.892477 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Sep 05 02:19:40.892608 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:40.892590 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Sep 05 02:19:40.892848 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:40.892830 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-tj8wp\"" Sep 05 02:19:40.892931 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:40.892877 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Sep 05 02:19:40.893418 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:40.893400 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Sep 05 02:19:40.900058 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:40.900038 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/8ab5921f-af18-4481-9175-7cb222351eaa-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"8ab5921f-af18-4481-9175-7cb222351eaa\") " pod="openshift-monitoring/alertmanager-main-0" Sep 05 02:19:40.900140 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:40.900068 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/8ab5921f-af18-4481-9175-7cb222351eaa-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"8ab5921f-af18-4481-9175-7cb222351eaa\") " pod="openshift-monitoring/alertmanager-main-0" Sep 05 02:19:40.900140 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:40.900087 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8ab5921f-af18-4481-9175-7cb222351eaa-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"8ab5921f-af18-4481-9175-7cb222351eaa\") " pod="openshift-monitoring/alertmanager-main-0" Sep 05 02:19:40.900140 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:40.900107 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8ab5921f-af18-4481-9175-7cb222351eaa-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"8ab5921f-af18-4481-9175-7cb222351eaa\") " pod="openshift-monitoring/alertmanager-main-0" Sep 05 02:19:40.900243 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:40.900178 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8ab5921f-af18-4481-9175-7cb222351eaa-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"8ab5921f-af18-4481-9175-7cb222351eaa\") " pod="openshift-monitoring/alertmanager-main-0" Sep 05 02:19:40.900243 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:40.900200 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8ab5921f-af18-4481-9175-7cb222351eaa-config-out\") pod \"alertmanager-main-0\" (UID: \"8ab5921f-af18-4481-9175-7cb222351eaa\") " pod="openshift-monitoring/alertmanager-main-0" Sep 05 02:19:40.900243 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:40.900236 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8ab5921f-af18-4481-9175-7cb222351eaa-tls-assets\") pod \"alertmanager-main-0\" (UID: \"8ab5921f-af18-4481-9175-7cb222351eaa\") " pod="openshift-monitoring/alertmanager-main-0" Sep 05 02:19:40.900335 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:40.900253 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/8ab5921f-af18-4481-9175-7cb222351eaa-config-volume\") pod \"alertmanager-main-0\" (UID: \"8ab5921f-af18-4481-9175-7cb222351eaa\") " pod="openshift-monitoring/alertmanager-main-0" Sep 05 02:19:40.900335 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:40.900294 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8ab5921f-af18-4481-9175-7cb222351eaa-web-config\") pod \"alertmanager-main-0\" (UID: \"8ab5921f-af18-4481-9175-7cb222351eaa\") " pod="openshift-monitoring/alertmanager-main-0" Sep 05 02:19:40.900335 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:40.900309 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vknx9\" (UniqueName: \"kubernetes.io/projected/8ab5921f-af18-4481-9175-7cb222351eaa-kube-api-access-vknx9\") pod \"alertmanager-main-0\" (UID: \"8ab5921f-af18-4481-9175-7cb222351eaa\") " pod="openshift-monitoring/alertmanager-main-0" Sep 05 02:19:40.900335 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:40.900325 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/8ab5921f-af18-4481-9175-7cb222351eaa-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"8ab5921f-af18-4481-9175-7cb222351eaa\") " pod="openshift-monitoring/alertmanager-main-0" Sep 05 02:19:40.900493 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:40.900376 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8ab5921f-af18-4481-9175-7cb222351eaa-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"8ab5921f-af18-4481-9175-7cb222351eaa\") " pod="openshift-monitoring/alertmanager-main-0" Sep 05 02:19:40.900493 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:40.900411 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/8ab5921f-af18-4481-9175-7cb222351eaa-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"8ab5921f-af18-4481-9175-7cb222351eaa\") " pod="openshift-monitoring/alertmanager-main-0" Sep 05 02:19:40.911557 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:40.911535 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 05 02:19:41.000917 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:41.000843 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8ab5921f-af18-4481-9175-7cb222351eaa-web-config\") pod \"alertmanager-main-0\" (UID: \"8ab5921f-af18-4481-9175-7cb222351eaa\") " pod="openshift-monitoring/alertmanager-main-0" Sep 05 02:19:41.000917 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:41.000875 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vknx9\" (UniqueName: \"kubernetes.io/projected/8ab5921f-af18-4481-9175-7cb222351eaa-kube-api-access-vknx9\") pod \"alertmanager-main-0\" (UID: \"8ab5921f-af18-4481-9175-7cb222351eaa\") " pod="openshift-monitoring/alertmanager-main-0" Sep 05 02:19:41.000917 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:41.000893 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/8ab5921f-af18-4481-9175-7cb222351eaa-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"8ab5921f-af18-4481-9175-7cb222351eaa\") " pod="openshift-monitoring/alertmanager-main-0" Sep 05 02:19:41.001702 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:41.000919 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8ab5921f-af18-4481-9175-7cb222351eaa-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"8ab5921f-af18-4481-9175-7cb222351eaa\") " pod="openshift-monitoring/alertmanager-main-0" Sep 05 02:19:41.001702 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:41.000937 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/8ab5921f-af18-4481-9175-7cb222351eaa-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"8ab5921f-af18-4481-9175-7cb222351eaa\") " pod="openshift-monitoring/alertmanager-main-0" Sep 05 02:19:41.001702 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:41.000961 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/8ab5921f-af18-4481-9175-7cb222351eaa-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"8ab5921f-af18-4481-9175-7cb222351eaa\") " pod="openshift-monitoring/alertmanager-main-0" Sep 05 02:19:41.001702 ip-10-0-133-250 kubenswrapper[2555]: E0905 02:19:41.001052 2555 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found Sep 05 02:19:41.001702 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:41.001072 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/8ab5921f-af18-4481-9175-7cb222351eaa-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"8ab5921f-af18-4481-9175-7cb222351eaa\") " pod="openshift-monitoring/alertmanager-main-0" Sep 05 02:19:41.001702 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:41.001107 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8ab5921f-af18-4481-9175-7cb222351eaa-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"8ab5921f-af18-4481-9175-7cb222351eaa\") " pod="openshift-monitoring/alertmanager-main-0" Sep 05 02:19:41.001702 ip-10-0-133-250 kubenswrapper[2555]: E0905 02:19:41.001123 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8ab5921f-af18-4481-9175-7cb222351eaa-secret-alertmanager-main-tls podName:8ab5921f-af18-4481-9175-7cb222351eaa nodeName:}" failed. No retries permitted until 2026-09-05 02:19:41.501101465 +0000 UTC m=+108.003239059 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/8ab5921f-af18-4481-9175-7cb222351eaa-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "8ab5921f-af18-4481-9175-7cb222351eaa") : secret "alertmanager-main-tls" not found Sep 05 02:19:41.001702 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:41.001154 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8ab5921f-af18-4481-9175-7cb222351eaa-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"8ab5921f-af18-4481-9175-7cb222351eaa\") " pod="openshift-monitoring/alertmanager-main-0" Sep 05 02:19:41.001702 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:41.001192 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8ab5921f-af18-4481-9175-7cb222351eaa-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"8ab5921f-af18-4481-9175-7cb222351eaa\") " pod="openshift-monitoring/alertmanager-main-0" Sep 05 02:19:41.001702 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:41.001223 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8ab5921f-af18-4481-9175-7cb222351eaa-config-out\") pod \"alertmanager-main-0\" (UID: \"8ab5921f-af18-4481-9175-7cb222351eaa\") " pod="openshift-monitoring/alertmanager-main-0" Sep 05 02:19:41.001702 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:41.001264 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8ab5921f-af18-4481-9175-7cb222351eaa-tls-assets\") pod \"alertmanager-main-0\" (UID: \"8ab5921f-af18-4481-9175-7cb222351eaa\") " pod="openshift-monitoring/alertmanager-main-0" Sep 05 02:19:41.001702 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:41.001296 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/8ab5921f-af18-4481-9175-7cb222351eaa-config-volume\") pod \"alertmanager-main-0\" (UID: \"8ab5921f-af18-4481-9175-7cb222351eaa\") " pod="openshift-monitoring/alertmanager-main-0" Sep 05 02:19:41.001702 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:41.001414 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/8ab5921f-af18-4481-9175-7cb222351eaa-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"8ab5921f-af18-4481-9175-7cb222351eaa\") " pod="openshift-monitoring/alertmanager-main-0" Sep 05 02:19:41.002426 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:41.001936 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8ab5921f-af18-4481-9175-7cb222351eaa-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"8ab5921f-af18-4481-9175-7cb222351eaa\") " pod="openshift-monitoring/alertmanager-main-0" Sep 05 02:19:41.002583 ip-10-0-133-250 kubenswrapper[2555]: E0905 02:19:41.002505 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8ab5921f-af18-4481-9175-7cb222351eaa-alertmanager-trusted-ca-bundle podName:8ab5921f-af18-4481-9175-7cb222351eaa nodeName:}" failed. No retries permitted until 2026-09-05 02:19:41.502484561 +0000 UTC m=+108.004622155 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "alertmanager-trusted-ca-bundle" (UniqueName: "kubernetes.io/configmap/8ab5921f-af18-4481-9175-7cb222351eaa-alertmanager-trusted-ca-bundle") pod "alertmanager-main-0" (UID: "8ab5921f-af18-4481-9175-7cb222351eaa") : configmap references non-existent config key: ca-bundle.crt Sep 05 02:19:41.004114 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:41.004056 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/8ab5921f-af18-4481-9175-7cb222351eaa-config-volume\") pod \"alertmanager-main-0\" (UID: \"8ab5921f-af18-4481-9175-7cb222351eaa\") " pod="openshift-monitoring/alertmanager-main-0" Sep 05 02:19:41.004114 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:41.004095 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/8ab5921f-af18-4481-9175-7cb222351eaa-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"8ab5921f-af18-4481-9175-7cb222351eaa\") " pod="openshift-monitoring/alertmanager-main-0" Sep 05 02:19:41.004258 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:41.004095 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8ab5921f-af18-4481-9175-7cb222351eaa-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"8ab5921f-af18-4481-9175-7cb222351eaa\") " pod="openshift-monitoring/alertmanager-main-0" Sep 05 02:19:41.004679 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:41.004652 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/8ab5921f-af18-4481-9175-7cb222351eaa-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"8ab5921f-af18-4481-9175-7cb222351eaa\") " pod="openshift-monitoring/alertmanager-main-0" Sep 05 02:19:41.004882 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:41.004862 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8ab5921f-af18-4481-9175-7cb222351eaa-config-out\") pod \"alertmanager-main-0\" (UID: \"8ab5921f-af18-4481-9175-7cb222351eaa\") " pod="openshift-monitoring/alertmanager-main-0" Sep 05 02:19:41.004938 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:41.004926 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8ab5921f-af18-4481-9175-7cb222351eaa-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"8ab5921f-af18-4481-9175-7cb222351eaa\") " pod="openshift-monitoring/alertmanager-main-0" Sep 05 02:19:41.005290 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:41.005275 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8ab5921f-af18-4481-9175-7cb222351eaa-tls-assets\") pod \"alertmanager-main-0\" (UID: \"8ab5921f-af18-4481-9175-7cb222351eaa\") " pod="openshift-monitoring/alertmanager-main-0" Sep 05 02:19:41.005339 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:41.005299 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8ab5921f-af18-4481-9175-7cb222351eaa-web-config\") pod \"alertmanager-main-0\" (UID: \"8ab5921f-af18-4481-9175-7cb222351eaa\") " pod="openshift-monitoring/alertmanager-main-0" Sep 05 02:19:41.016727 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:41.016704 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vknx9\" (UniqueName: \"kubernetes.io/projected/8ab5921f-af18-4481-9175-7cb222351eaa-kube-api-access-vknx9\") pod \"alertmanager-main-0\" (UID: \"8ab5921f-af18-4481-9175-7cb222351eaa\") " pod="openshift-monitoring/alertmanager-main-0" Sep 05 02:19:41.505282 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:41.505235 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/8ab5921f-af18-4481-9175-7cb222351eaa-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"8ab5921f-af18-4481-9175-7cb222351eaa\") " pod="openshift-monitoring/alertmanager-main-0" Sep 05 02:19:41.505695 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:41.505301 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8ab5921f-af18-4481-9175-7cb222351eaa-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"8ab5921f-af18-4481-9175-7cb222351eaa\") " pod="openshift-monitoring/alertmanager-main-0" Sep 05 02:19:41.506238 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:41.506189 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8ab5921f-af18-4481-9175-7cb222351eaa-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"8ab5921f-af18-4481-9175-7cb222351eaa\") " pod="openshift-monitoring/alertmanager-main-0" Sep 05 02:19:41.508010 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:41.507984 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/8ab5921f-af18-4481-9175-7cb222351eaa-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"8ab5921f-af18-4481-9175-7cb222351eaa\") " pod="openshift-monitoring/alertmanager-main-0" Sep 05 02:19:41.684811 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:41.684782 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-c7mrv" event={"ID":"40a7d562-85f7-4a96-8dfc-a4dbb0d0b9a1","Type":"ContainerStarted","Data":"0fb9a6dc7da3109f482be43976396683b3a3f7a22395d17214e661db0ad2ff90"} Sep 05 02:19:41.684943 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:41.684883 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-c7mrv" event={"ID":"40a7d562-85f7-4a96-8dfc-a4dbb0d0b9a1","Type":"ContainerStarted","Data":"c4e1256cbb798eb226046e5cc31c9ba8a8a502463736ab37ced914cb4a70067c"} Sep 05 02:19:41.798730 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:41.798699 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 05 02:19:41.809186 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:41.809165 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-884bfd544-9h585"] Sep 05 02:19:41.812523 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:41.812506 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-884bfd544-9h585" Sep 05 02:19:41.818632 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:41.818608 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Sep 05 02:19:41.819592 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:41.819228 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Sep 05 02:19:41.819592 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:41.819284 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Sep 05 02:19:41.819592 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:41.819438 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Sep 05 02:19:41.819592 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:41.819516 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-l98qp\"" Sep 05 02:19:41.819989 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:41.819677 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-dtik4t4etvhm7\"" Sep 05 02:19:41.820558 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:41.820497 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Sep 05 02:19:41.833983 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:41.833945 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-884bfd544-9h585"] Sep 05 02:19:41.908903 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:41.908875 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v2f84\" (UniqueName: \"kubernetes.io/projected/7df84300-7490-4118-a2a4-1849523b5ef2-kube-api-access-v2f84\") pod \"thanos-querier-884bfd544-9h585\" (UID: \"7df84300-7490-4118-a2a4-1849523b5ef2\") " pod="openshift-monitoring/thanos-querier-884bfd544-9h585" Sep 05 02:19:41.909087 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:41.908910 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/7df84300-7490-4118-a2a4-1849523b5ef2-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-884bfd544-9h585\" (UID: \"7df84300-7490-4118-a2a4-1849523b5ef2\") " pod="openshift-monitoring/thanos-querier-884bfd544-9h585" Sep 05 02:19:41.909087 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:41.908936 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/7df84300-7490-4118-a2a4-1849523b5ef2-secret-thanos-querier-tls\") pod \"thanos-querier-884bfd544-9h585\" (UID: \"7df84300-7490-4118-a2a4-1849523b5ef2\") " pod="openshift-monitoring/thanos-querier-884bfd544-9h585" Sep 05 02:19:41.909087 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:41.908981 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/7df84300-7490-4118-a2a4-1849523b5ef2-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-884bfd544-9h585\" (UID: \"7df84300-7490-4118-a2a4-1849523b5ef2\") " pod="openshift-monitoring/thanos-querier-884bfd544-9h585" Sep 05 02:19:41.909087 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:41.909010 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7df84300-7490-4118-a2a4-1849523b5ef2-metrics-client-ca\") pod \"thanos-querier-884bfd544-9h585\" (UID: \"7df84300-7490-4118-a2a4-1849523b5ef2\") " pod="openshift-monitoring/thanos-querier-884bfd544-9h585" Sep 05 02:19:41.909300 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:41.909097 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7df84300-7490-4118-a2a4-1849523b5ef2-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-884bfd544-9h585\" (UID: \"7df84300-7490-4118-a2a4-1849523b5ef2\") " pod="openshift-monitoring/thanos-querier-884bfd544-9h585" Sep 05 02:19:41.909300 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:41.909166 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7df84300-7490-4118-a2a4-1849523b5ef2-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-884bfd544-9h585\" (UID: \"7df84300-7490-4118-a2a4-1849523b5ef2\") " pod="openshift-monitoring/thanos-querier-884bfd544-9h585" Sep 05 02:19:41.909300 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:41.909199 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/7df84300-7490-4118-a2a4-1849523b5ef2-secret-grpc-tls\") pod \"thanos-querier-884bfd544-9h585\" (UID: \"7df84300-7490-4118-a2a4-1849523b5ef2\") " pod="openshift-monitoring/thanos-querier-884bfd544-9h585" Sep 05 02:19:42.010551 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:42.010516 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/7df84300-7490-4118-a2a4-1849523b5ef2-secret-thanos-querier-tls\") pod \"thanos-querier-884bfd544-9h585\" (UID: \"7df84300-7490-4118-a2a4-1849523b5ef2\") " pod="openshift-monitoring/thanos-querier-884bfd544-9h585" Sep 05 02:19:42.010551 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:42.010551 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/7df84300-7490-4118-a2a4-1849523b5ef2-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-884bfd544-9h585\" (UID: \"7df84300-7490-4118-a2a4-1849523b5ef2\") " pod="openshift-monitoring/thanos-querier-884bfd544-9h585" Sep 05 02:19:42.010724 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:42.010568 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7df84300-7490-4118-a2a4-1849523b5ef2-metrics-client-ca\") pod \"thanos-querier-884bfd544-9h585\" (UID: \"7df84300-7490-4118-a2a4-1849523b5ef2\") " pod="openshift-monitoring/thanos-querier-884bfd544-9h585" Sep 05 02:19:42.010724 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:42.010696 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7df84300-7490-4118-a2a4-1849523b5ef2-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-884bfd544-9h585\" (UID: \"7df84300-7490-4118-a2a4-1849523b5ef2\") " pod="openshift-monitoring/thanos-querier-884bfd544-9h585" Sep 05 02:19:42.010801 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:42.010758 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7df84300-7490-4118-a2a4-1849523b5ef2-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-884bfd544-9h585\" (UID: \"7df84300-7490-4118-a2a4-1849523b5ef2\") " pod="openshift-monitoring/thanos-querier-884bfd544-9h585" Sep 05 02:19:42.010801 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:42.010788 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/7df84300-7490-4118-a2a4-1849523b5ef2-secret-grpc-tls\") pod \"thanos-querier-884bfd544-9h585\" (UID: \"7df84300-7490-4118-a2a4-1849523b5ef2\") " pod="openshift-monitoring/thanos-querier-884bfd544-9h585" Sep 05 02:19:42.010879 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:42.010851 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v2f84\" (UniqueName: \"kubernetes.io/projected/7df84300-7490-4118-a2a4-1849523b5ef2-kube-api-access-v2f84\") pod \"thanos-querier-884bfd544-9h585\" (UID: \"7df84300-7490-4118-a2a4-1849523b5ef2\") " pod="openshift-monitoring/thanos-querier-884bfd544-9h585" Sep 05 02:19:42.010879 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:42.010873 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/7df84300-7490-4118-a2a4-1849523b5ef2-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-884bfd544-9h585\" (UID: \"7df84300-7490-4118-a2a4-1849523b5ef2\") " pod="openshift-monitoring/thanos-querier-884bfd544-9h585" Sep 05 02:19:42.011409 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:42.011382 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7df84300-7490-4118-a2a4-1849523b5ef2-metrics-client-ca\") pod \"thanos-querier-884bfd544-9h585\" (UID: \"7df84300-7490-4118-a2a4-1849523b5ef2\") " pod="openshift-monitoring/thanos-querier-884bfd544-9h585" Sep 05 02:19:42.013193 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:42.013134 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/7df84300-7490-4118-a2a4-1849523b5ef2-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-884bfd544-9h585\" (UID: \"7df84300-7490-4118-a2a4-1849523b5ef2\") " pod="openshift-monitoring/thanos-querier-884bfd544-9h585" Sep 05 02:19:42.013299 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:42.013208 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7df84300-7490-4118-a2a4-1849523b5ef2-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-884bfd544-9h585\" (UID: \"7df84300-7490-4118-a2a4-1849523b5ef2\") " pod="openshift-monitoring/thanos-querier-884bfd544-9h585" Sep 05 02:19:42.013528 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:42.013509 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/7df84300-7490-4118-a2a4-1849523b5ef2-secret-thanos-querier-tls\") pod \"thanos-querier-884bfd544-9h585\" (UID: \"7df84300-7490-4118-a2a4-1849523b5ef2\") " pod="openshift-monitoring/thanos-querier-884bfd544-9h585" Sep 05 02:19:42.013632 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:42.013612 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7df84300-7490-4118-a2a4-1849523b5ef2-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-884bfd544-9h585\" (UID: \"7df84300-7490-4118-a2a4-1849523b5ef2\") " pod="openshift-monitoring/thanos-querier-884bfd544-9h585" Sep 05 02:19:42.013692 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:42.013645 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/7df84300-7490-4118-a2a4-1849523b5ef2-secret-grpc-tls\") pod \"thanos-querier-884bfd544-9h585\" (UID: \"7df84300-7490-4118-a2a4-1849523b5ef2\") " pod="openshift-monitoring/thanos-querier-884bfd544-9h585" Sep 05 02:19:42.013692 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:42.013615 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/7df84300-7490-4118-a2a4-1849523b5ef2-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-884bfd544-9h585\" (UID: \"7df84300-7490-4118-a2a4-1849523b5ef2\") " pod="openshift-monitoring/thanos-querier-884bfd544-9h585" Sep 05 02:19:42.024257 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:42.024238 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v2f84\" (UniqueName: \"kubernetes.io/projected/7df84300-7490-4118-a2a4-1849523b5ef2-kube-api-access-v2f84\") pod \"thanos-querier-884bfd544-9h585\" (UID: \"7df84300-7490-4118-a2a4-1849523b5ef2\") " pod="openshift-monitoring/thanos-querier-884bfd544-9h585" Sep 05 02:19:42.085709 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:42.085680 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 05 02:19:42.088759 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:19:42.088732 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8ab5921f_af18_4481_9175_7cb222351eaa.slice/crio-8d03cc9ce61f19c74ab65072a71db9fcd0e1a021369f4a0b97c036ff187e62a0 WatchSource:0}: Error finding container 8d03cc9ce61f19c74ab65072a71db9fcd0e1a021369f4a0b97c036ff187e62a0: Status 404 returned error can't find the container with id 8d03cc9ce61f19c74ab65072a71db9fcd0e1a021369f4a0b97c036ff187e62a0 Sep 05 02:19:42.123127 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:42.123100 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-884bfd544-9h585" Sep 05 02:19:42.397506 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:42.397429 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-884bfd544-9h585"] Sep 05 02:19:42.400371 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:19:42.400343 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7df84300_7490_4118_a2a4_1849523b5ef2.slice/crio-e983db1e00729ec877b3d88533589f3f8b89e6e61fdee75fe1cbc78c7efd40c9 WatchSource:0}: Error finding container e983db1e00729ec877b3d88533589f3f8b89e6e61fdee75fe1cbc78c7efd40c9: Status 404 returned error can't find the container with id e983db1e00729ec877b3d88533589f3f8b89e6e61fdee75fe1cbc78c7efd40c9 Sep 05 02:19:42.693643 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:42.693557 2555 generic.go:356] "Generic (PLEG): container finished" podID="40a7d562-85f7-4a96-8dfc-a4dbb0d0b9a1" containerID="0fb9a6dc7da3109f482be43976396683b3a3f7a22395d17214e661db0ad2ff90" exitCode=0 Sep 05 02:19:42.693643 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:42.693608 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-c7mrv" event={"ID":"40a7d562-85f7-4a96-8dfc-a4dbb0d0b9a1","Type":"ContainerDied","Data":"0fb9a6dc7da3109f482be43976396683b3a3f7a22395d17214e661db0ad2ff90"} Sep 05 02:19:42.694130 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:42.693668 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-c7mrv" event={"ID":"40a7d562-85f7-4a96-8dfc-a4dbb0d0b9a1","Type":"ContainerStarted","Data":"e8bb656562981ae799a0c3b72a2ca69c2ce7be1ab735a0f12b251e07e6aa949d"} Sep 05 02:19:42.694130 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:42.693690 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-c7mrv" event={"ID":"40a7d562-85f7-4a96-8dfc-a4dbb0d0b9a1","Type":"ContainerStarted","Data":"81b1da86e5b470ef38813ec391c0313b10e4f18bab255834a2b82dbef0d65508"} Sep 05 02:19:42.695277 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:42.695247 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-884bfd544-9h585" event={"ID":"7df84300-7490-4118-a2a4-1849523b5ef2","Type":"ContainerStarted","Data":"e983db1e00729ec877b3d88533589f3f8b89e6e61fdee75fe1cbc78c7efd40c9"} Sep 05 02:19:42.696583 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:42.696553 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8ab5921f-af18-4481-9175-7cb222351eaa","Type":"ContainerStarted","Data":"8d03cc9ce61f19c74ab65072a71db9fcd0e1a021369f4a0b97c036ff187e62a0"} Sep 05 02:19:42.713239 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:42.713113 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-c7mrv" podStartSLOduration=2.851274703 podStartE2EDuration="3.713096695s" totalImagesPullingTime="796.132278ms" totalInitContainerRuntime="65.689714ms" isStatefulPod=true podCreationTimestamp="2026-09-05 02:19:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-05 02:19:42.712625656 +0000 UTC m=+109.214763254" watchObservedRunningTime="2026-09-05 02:19:42.713096695 +0000 UTC m=+109.215234304" Sep 05 02:19:43.703269 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:43.703186 2555 generic.go:356] "Generic (PLEG): container finished" podID="8ab5921f-af18-4481-9175-7cb222351eaa" containerID="92beaa8e8ac2d08c4daacfe6662f5c7fc45a9e62602630731f433f342b1748b8" exitCode=0 Sep 05 02:19:43.703269 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:43.703227 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8ab5921f-af18-4481-9175-7cb222351eaa","Type":"ContainerDied","Data":"92beaa8e8ac2d08c4daacfe6662f5c7fc45a9e62602630731f433f342b1748b8"} Sep 05 02:19:44.344227 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:44.344192 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-d589b4565-5jb8r"] Sep 05 02:19:44.346395 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:44.346373 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-d589b4565-5jb8r" Sep 05 02:19:44.349061 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:44.349014 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Sep 05 02:19:44.349227 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:44.349210 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-k44rm\"" Sep 05 02:19:44.349289 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:44.349271 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Sep 05 02:19:44.349438 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:44.349418 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Sep 05 02:19:44.349557 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:44.349487 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Sep 05 02:19:44.349557 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:44.349542 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-69gdfd21pr011\"" Sep 05 02:19:44.360142 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:44.360094 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-d589b4565-5jb8r"] Sep 05 02:19:44.431819 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:44.431784 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/816a886c-8197-4b15-add7-901cf4a9c678-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-d589b4565-5jb8r\" (UID: \"816a886c-8197-4b15-add7-901cf4a9c678\") " pod="openshift-monitoring/metrics-server-d589b4565-5jb8r" Sep 05 02:19:44.431819 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:44.431830 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-77vql\" (UniqueName: \"kubernetes.io/projected/816a886c-8197-4b15-add7-901cf4a9c678-kube-api-access-77vql\") pod \"metrics-server-d589b4565-5jb8r\" (UID: \"816a886c-8197-4b15-add7-901cf4a9c678\") " pod="openshift-monitoring/metrics-server-d589b4565-5jb8r" Sep 05 02:19:44.432071 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:44.431893 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/816a886c-8197-4b15-add7-901cf4a9c678-audit-log\") pod \"metrics-server-d589b4565-5jb8r\" (UID: \"816a886c-8197-4b15-add7-901cf4a9c678\") " pod="openshift-monitoring/metrics-server-d589b4565-5jb8r" Sep 05 02:19:44.432071 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:44.431922 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/816a886c-8197-4b15-add7-901cf4a9c678-secret-metrics-server-client-certs\") pod \"metrics-server-d589b4565-5jb8r\" (UID: \"816a886c-8197-4b15-add7-901cf4a9c678\") " pod="openshift-monitoring/metrics-server-d589b4565-5jb8r" Sep 05 02:19:44.432071 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:44.431950 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/816a886c-8197-4b15-add7-901cf4a9c678-metrics-server-audit-profiles\") pod \"metrics-server-d589b4565-5jb8r\" (UID: \"816a886c-8197-4b15-add7-901cf4a9c678\") " pod="openshift-monitoring/metrics-server-d589b4565-5jb8r" Sep 05 02:19:44.432071 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:44.431988 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/816a886c-8197-4b15-add7-901cf4a9c678-secret-metrics-server-tls\") pod \"metrics-server-d589b4565-5jb8r\" (UID: \"816a886c-8197-4b15-add7-901cf4a9c678\") " pod="openshift-monitoring/metrics-server-d589b4565-5jb8r" Sep 05 02:19:44.432228 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:44.432084 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/816a886c-8197-4b15-add7-901cf4a9c678-client-ca-bundle\") pod \"metrics-server-d589b4565-5jb8r\" (UID: \"816a886c-8197-4b15-add7-901cf4a9c678\") " pod="openshift-monitoring/metrics-server-d589b4565-5jb8r" Sep 05 02:19:44.532628 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:44.532592 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/816a886c-8197-4b15-add7-901cf4a9c678-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-d589b4565-5jb8r\" (UID: \"816a886c-8197-4b15-add7-901cf4a9c678\") " pod="openshift-monitoring/metrics-server-d589b4565-5jb8r" Sep 05 02:19:44.532628 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:44.532628 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-77vql\" (UniqueName: \"kubernetes.io/projected/816a886c-8197-4b15-add7-901cf4a9c678-kube-api-access-77vql\") pod \"metrics-server-d589b4565-5jb8r\" (UID: \"816a886c-8197-4b15-add7-901cf4a9c678\") " pod="openshift-monitoring/metrics-server-d589b4565-5jb8r" Sep 05 02:19:44.532855 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:44.532666 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/816a886c-8197-4b15-add7-901cf4a9c678-audit-log\") pod \"metrics-server-d589b4565-5jb8r\" (UID: \"816a886c-8197-4b15-add7-901cf4a9c678\") " pod="openshift-monitoring/metrics-server-d589b4565-5jb8r" Sep 05 02:19:44.532855 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:44.532694 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/816a886c-8197-4b15-add7-901cf4a9c678-secret-metrics-server-client-certs\") pod \"metrics-server-d589b4565-5jb8r\" (UID: \"816a886c-8197-4b15-add7-901cf4a9c678\") " pod="openshift-monitoring/metrics-server-d589b4565-5jb8r" Sep 05 02:19:44.532855 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:44.532721 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/816a886c-8197-4b15-add7-901cf4a9c678-metrics-server-audit-profiles\") pod \"metrics-server-d589b4565-5jb8r\" (UID: \"816a886c-8197-4b15-add7-901cf4a9c678\") " pod="openshift-monitoring/metrics-server-d589b4565-5jb8r" Sep 05 02:19:44.532855 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:44.532836 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/816a886c-8197-4b15-add7-901cf4a9c678-secret-metrics-server-tls\") pod \"metrics-server-d589b4565-5jb8r\" (UID: \"816a886c-8197-4b15-add7-901cf4a9c678\") " pod="openshift-monitoring/metrics-server-d589b4565-5jb8r" Sep 05 02:19:44.533076 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:44.532896 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/816a886c-8197-4b15-add7-901cf4a9c678-client-ca-bundle\") pod \"metrics-server-d589b4565-5jb8r\" (UID: \"816a886c-8197-4b15-add7-901cf4a9c678\") " pod="openshift-monitoring/metrics-server-d589b4565-5jb8r" Sep 05 02:19:44.533468 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:44.533443 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/816a886c-8197-4b15-add7-901cf4a9c678-audit-log\") pod \"metrics-server-d589b4565-5jb8r\" (UID: \"816a886c-8197-4b15-add7-901cf4a9c678\") " pod="openshift-monitoring/metrics-server-d589b4565-5jb8r" Sep 05 02:19:44.533829 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:44.533768 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/816a886c-8197-4b15-add7-901cf4a9c678-metrics-server-audit-profiles\") pod \"metrics-server-d589b4565-5jb8r\" (UID: \"816a886c-8197-4b15-add7-901cf4a9c678\") " pod="openshift-monitoring/metrics-server-d589b4565-5jb8r" Sep 05 02:19:44.533948 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:44.533868 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/816a886c-8197-4b15-add7-901cf4a9c678-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-d589b4565-5jb8r\" (UID: \"816a886c-8197-4b15-add7-901cf4a9c678\") " pod="openshift-monitoring/metrics-server-d589b4565-5jb8r" Sep 05 02:19:44.537005 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:44.536977 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/816a886c-8197-4b15-add7-901cf4a9c678-secret-metrics-server-tls\") pod \"metrics-server-d589b4565-5jb8r\" (UID: \"816a886c-8197-4b15-add7-901cf4a9c678\") " pod="openshift-monitoring/metrics-server-d589b4565-5jb8r" Sep 05 02:19:44.537005 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:44.536998 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/816a886c-8197-4b15-add7-901cf4a9c678-secret-metrics-server-client-certs\") pod \"metrics-server-d589b4565-5jb8r\" (UID: \"816a886c-8197-4b15-add7-901cf4a9c678\") " pod="openshift-monitoring/metrics-server-d589b4565-5jb8r" Sep 05 02:19:44.537179 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:44.537001 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/816a886c-8197-4b15-add7-901cf4a9c678-client-ca-bundle\") pod \"metrics-server-d589b4565-5jb8r\" (UID: \"816a886c-8197-4b15-add7-901cf4a9c678\") " pod="openshift-monitoring/metrics-server-d589b4565-5jb8r" Sep 05 02:19:44.541851 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:44.541830 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-77vql\" (UniqueName: \"kubernetes.io/projected/816a886c-8197-4b15-add7-901cf4a9c678-kube-api-access-77vql\") pod \"metrics-server-d589b4565-5jb8r\" (UID: \"816a886c-8197-4b15-add7-901cf4a9c678\") " pod="openshift-monitoring/metrics-server-d589b4565-5jb8r" Sep 05 02:19:44.658088 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:44.657997 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-d589b4565-5jb8r" Sep 05 02:19:44.709890 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:44.709854 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-884bfd544-9h585" event={"ID":"7df84300-7490-4118-a2a4-1849523b5ef2","Type":"ContainerStarted","Data":"08f35ebd18248a079ad67a181d91c9df0f814e4c3d646c9109522b5c8d59153e"} Sep 05 02:19:44.710300 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:44.709940 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-884bfd544-9h585" event={"ID":"7df84300-7490-4118-a2a4-1849523b5ef2","Type":"ContainerStarted","Data":"a47b69c6cdbde6bd1e21703f65e5dec71c43f9466cf2ea87db829e7459e994df"} Sep 05 02:19:44.710300 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:44.709980 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-884bfd544-9h585" event={"ID":"7df84300-7490-4118-a2a4-1849523b5ef2","Type":"ContainerStarted","Data":"b9355cb1af16b6bab9d8d3d9ff9814a2dbd1f8e00e8d995abd667bacdb894936"} Sep 05 02:19:45.221543 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:45.221383 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-d589b4565-5jb8r"] Sep 05 02:19:45.282203 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:19:45.282167 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod816a886c_8197_4b15_add7_901cf4a9c678.slice/crio-f470c46e77cb8d59e153d84269dcf05547b06458858c4a8f0dfb4ff90c5ddbc4 WatchSource:0}: Error finding container f470c46e77cb8d59e153d84269dcf05547b06458858c4a8f0dfb4ff90c5ddbc4: Status 404 returned error can't find the container with id f470c46e77cb8d59e153d84269dcf05547b06458858c4a8f0dfb4ff90c5ddbc4 Sep 05 02:19:45.718822 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:45.718784 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-884bfd544-9h585" event={"ID":"7df84300-7490-4118-a2a4-1849523b5ef2","Type":"ContainerStarted","Data":"ca4f6b689f882403ca126ff1ecefd2d9ffb66ea7816dad8d8cb0c1d13d491f65"} Sep 05 02:19:45.719308 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:45.718911 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-884bfd544-9h585" Sep 05 02:19:45.719308 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:45.718957 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-884bfd544-9h585" event={"ID":"7df84300-7490-4118-a2a4-1849523b5ef2","Type":"ContainerStarted","Data":"b6b328414e501aa54651981ef61b9f9e0ced05ab4576b37ab11e09580c45ffcd"} Sep 05 02:19:45.719308 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:45.719009 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-884bfd544-9h585" event={"ID":"7df84300-7490-4118-a2a4-1849523b5ef2","Type":"ContainerStarted","Data":"22bee00a5b141c2e4bd2f02fdcd844a7f7e324ed5b8c2185b91cd68b98a8a46b"} Sep 05 02:19:45.722859 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:45.722791 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8ab5921f-af18-4481-9175-7cb222351eaa","Type":"ContainerStarted","Data":"5d56a4df0de3f0b4e629caa95aaa924e093a1bfffe1d7ff24a2d5b536ebcabf8"} Sep 05 02:19:45.722963 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:45.722869 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8ab5921f-af18-4481-9175-7cb222351eaa","Type":"ContainerStarted","Data":"d3d9bd0c844e8469de1dc35cff7ede404d4f58f556056372815710bbb4afc3ca"} Sep 05 02:19:45.722963 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:45.722912 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8ab5921f-af18-4481-9175-7cb222351eaa","Type":"ContainerStarted","Data":"0d2b5af562b7be60b29e7e0799db5811e7b724bbd8c9deb827e024d18d0290be"} Sep 05 02:19:45.722963 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:45.722952 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8ab5921f-af18-4481-9175-7cb222351eaa","Type":"ContainerStarted","Data":"f71e542939df589dc02e61693d7a64d8b0b5f4a135bb489ea148334eb4225bbc"} Sep 05 02:19:45.723158 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:45.722996 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8ab5921f-af18-4481-9175-7cb222351eaa","Type":"ContainerStarted","Data":"ae22924f352ba19afb3344cbfe22bae14caebf21699cfbf5c2d083edef74a8a5"} Sep 05 02:19:45.723158 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:45.723049 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8ab5921f-af18-4481-9175-7cb222351eaa","Type":"ContainerStarted","Data":"9ad2e0d6de8b3d7beba7ab2e7f54a0da15f137b1040c26f0b50cd0597747e58a"} Sep 05 02:19:45.724145 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:45.724102 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-d589b4565-5jb8r" event={"ID":"816a886c-8197-4b15-add7-901cf4a9c678","Type":"ContainerStarted","Data":"f470c46e77cb8d59e153d84269dcf05547b06458858c4a8f0dfb4ff90c5ddbc4"} Sep 05 02:19:45.784216 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:45.784170 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-884bfd544-9h585" podStartSLOduration=2.039971872 podStartE2EDuration="4.784152232s" totalImagesPullingTime="2.74418036s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-05 02:19:41 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-05 02:19:45.781496259 +0000 UTC m=+112.283633857" watchObservedRunningTime="2026-09-05 02:19:45.784152232 +0000 UTC m=+112.286289830" Sep 05 02:19:45.831487 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:45.831425 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=3.559080986 podStartE2EDuration="5.83140594s" totalImagesPullingTime="2.247573497s" totalInitContainerRuntime="24.751457ms" isStatefulPod=false podCreationTimestamp="2026-09-05 02:19:40 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-05 02:19:45.829419667 +0000 UTC m=+112.331557263" watchObservedRunningTime="2026-09-05 02:19:45.83140594 +0000 UTC m=+112.333543537" Sep 05 02:19:46.123035 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:46.122922 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 05 02:19:46.127722 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:46.127689 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 05 02:19:46.132501 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:46.132469 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Sep 05 02:19:46.133456 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:46.132958 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Sep 05 02:19:46.133456 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:46.132771 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Sep 05 02:19:46.133456 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:46.132713 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Sep 05 02:19:46.133456 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:46.133157 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Sep 05 02:19:46.133456 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:46.133195 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-cw9jl\"" Sep 05 02:19:46.133456 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:46.133225 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Sep 05 02:19:46.133456 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:46.133316 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Sep 05 02:19:46.133456 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:46.133343 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Sep 05 02:19:46.133456 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:46.133442 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Sep 05 02:19:46.133456 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:46.133449 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Sep 05 02:19:46.134578 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:46.134245 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Sep 05 02:19:46.134803 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:46.134679 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-b8mcsnr3vclvm\"" Sep 05 02:19:46.138924 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:46.137979 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Sep 05 02:19:46.139815 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:46.139792 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Sep 05 02:19:46.140960 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:46.140941 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Sep 05 02:19:46.145788 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:46.145141 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 05 02:19:46.155946 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:46.155917 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/24f506bf-603c-4bd1-886f-740069e5c1f4-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"24f506bf-603c-4bd1-886f-740069e5c1f4\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 05 02:19:46.156078 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:46.155957 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/24f506bf-603c-4bd1-886f-740069e5c1f4-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"24f506bf-603c-4bd1-886f-740069e5c1f4\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 05 02:19:46.156078 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:46.155995 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/24f506bf-603c-4bd1-886f-740069e5c1f4-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"24f506bf-603c-4bd1-886f-740069e5c1f4\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 05 02:19:46.156215 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:46.156069 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/24f506bf-603c-4bd1-886f-740069e5c1f4-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"24f506bf-603c-4bd1-886f-740069e5c1f4\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 05 02:19:46.156215 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:46.156162 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/24f506bf-603c-4bd1-886f-740069e5c1f4-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"24f506bf-603c-4bd1-886f-740069e5c1f4\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 05 02:19:46.156215 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:46.156195 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/24f506bf-603c-4bd1-886f-740069e5c1f4-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"24f506bf-603c-4bd1-886f-740069e5c1f4\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 05 02:19:46.156359 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:46.156271 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/24f506bf-603c-4bd1-886f-740069e5c1f4-config\") pod \"prometheus-k8s-0\" (UID: \"24f506bf-603c-4bd1-886f-740069e5c1f4\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 05 02:19:46.156359 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:46.156296 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/24f506bf-603c-4bd1-886f-740069e5c1f4-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"24f506bf-603c-4bd1-886f-740069e5c1f4\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 05 02:19:46.156359 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:46.156324 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/24f506bf-603c-4bd1-886f-740069e5c1f4-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"24f506bf-603c-4bd1-886f-740069e5c1f4\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 05 02:19:46.156512 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:46.156391 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/24f506bf-603c-4bd1-886f-740069e5c1f4-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"24f506bf-603c-4bd1-886f-740069e5c1f4\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 05 02:19:46.156512 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:46.156418 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/24f506bf-603c-4bd1-886f-740069e5c1f4-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"24f506bf-603c-4bd1-886f-740069e5c1f4\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 05 02:19:46.156512 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:46.156445 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/24f506bf-603c-4bd1-886f-740069e5c1f4-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"24f506bf-603c-4bd1-886f-740069e5c1f4\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 05 02:19:46.156512 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:46.156471 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6fl6x\" (UniqueName: \"kubernetes.io/projected/24f506bf-603c-4bd1-886f-740069e5c1f4-kube-api-access-6fl6x\") pod \"prometheus-k8s-0\" (UID: \"24f506bf-603c-4bd1-886f-740069e5c1f4\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 05 02:19:46.156512 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:46.156499 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/24f506bf-603c-4bd1-886f-740069e5c1f4-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"24f506bf-603c-4bd1-886f-740069e5c1f4\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 05 02:19:46.156752 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:46.156527 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/24f506bf-603c-4bd1-886f-740069e5c1f4-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"24f506bf-603c-4bd1-886f-740069e5c1f4\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 05 02:19:46.156752 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:46.156559 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/24f506bf-603c-4bd1-886f-740069e5c1f4-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"24f506bf-603c-4bd1-886f-740069e5c1f4\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 05 02:19:46.156752 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:46.156584 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/24f506bf-603c-4bd1-886f-740069e5c1f4-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"24f506bf-603c-4bd1-886f-740069e5c1f4\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 05 02:19:46.156752 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:46.156606 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/24f506bf-603c-4bd1-886f-740069e5c1f4-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"24f506bf-603c-4bd1-886f-740069e5c1f4\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 05 02:19:46.156752 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:46.156638 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/24f506bf-603c-4bd1-886f-740069e5c1f4-config-out\") pod \"prometheus-k8s-0\" (UID: \"24f506bf-603c-4bd1-886f-740069e5c1f4\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 05 02:19:46.158636 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:46.158610 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/24f506bf-603c-4bd1-886f-740069e5c1f4-web-config\") pod \"prometheus-k8s-0\" (UID: \"24f506bf-603c-4bd1-886f-740069e5c1f4\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 05 02:19:46.259515 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:46.259485 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/24f506bf-603c-4bd1-886f-740069e5c1f4-config\") pod \"prometheus-k8s-0\" (UID: \"24f506bf-603c-4bd1-886f-740069e5c1f4\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 05 02:19:46.259515 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:46.259519 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/24f506bf-603c-4bd1-886f-740069e5c1f4-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"24f506bf-603c-4bd1-886f-740069e5c1f4\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 05 02:19:46.259722 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:46.259540 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/24f506bf-603c-4bd1-886f-740069e5c1f4-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"24f506bf-603c-4bd1-886f-740069e5c1f4\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 05 02:19:46.259790 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:46.259766 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/24f506bf-603c-4bd1-886f-740069e5c1f4-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"24f506bf-603c-4bd1-886f-740069e5c1f4\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 05 02:19:46.259839 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:46.259808 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/24f506bf-603c-4bd1-886f-740069e5c1f4-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"24f506bf-603c-4bd1-886f-740069e5c1f4\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 05 02:19:46.259893 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:46.259840 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/24f506bf-603c-4bd1-886f-740069e5c1f4-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"24f506bf-603c-4bd1-886f-740069e5c1f4\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 05 02:19:46.259893 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:46.259864 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6fl6x\" (UniqueName: \"kubernetes.io/projected/24f506bf-603c-4bd1-886f-740069e5c1f4-kube-api-access-6fl6x\") pod \"prometheus-k8s-0\" (UID: \"24f506bf-603c-4bd1-886f-740069e5c1f4\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 05 02:19:46.260038 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:46.259899 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/24f506bf-603c-4bd1-886f-740069e5c1f4-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"24f506bf-603c-4bd1-886f-740069e5c1f4\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 05 02:19:46.260038 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:46.259928 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/24f506bf-603c-4bd1-886f-740069e5c1f4-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"24f506bf-603c-4bd1-886f-740069e5c1f4\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 05 02:19:46.260038 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:46.259966 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/24f506bf-603c-4bd1-886f-740069e5c1f4-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"24f506bf-603c-4bd1-886f-740069e5c1f4\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 05 02:19:46.260038 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:46.259992 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/24f506bf-603c-4bd1-886f-740069e5c1f4-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"24f506bf-603c-4bd1-886f-740069e5c1f4\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 05 02:19:46.260038 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:46.260014 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/24f506bf-603c-4bd1-886f-740069e5c1f4-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"24f506bf-603c-4bd1-886f-740069e5c1f4\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 05 02:19:46.260425 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:46.260068 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/24f506bf-603c-4bd1-886f-740069e5c1f4-config-out\") pod \"prometheus-k8s-0\" (UID: \"24f506bf-603c-4bd1-886f-740069e5c1f4\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 05 02:19:46.260502 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:46.260444 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/24f506bf-603c-4bd1-886f-740069e5c1f4-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"24f506bf-603c-4bd1-886f-740069e5c1f4\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 05 02:19:46.260583 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:46.260510 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/24f506bf-603c-4bd1-886f-740069e5c1f4-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"24f506bf-603c-4bd1-886f-740069e5c1f4\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 05 02:19:46.264473 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:46.260866 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/24f506bf-603c-4bd1-886f-740069e5c1f4-web-config\") pod \"prometheus-k8s-0\" (UID: \"24f506bf-603c-4bd1-886f-740069e5c1f4\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 05 02:19:46.264473 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:46.260916 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/24f506bf-603c-4bd1-886f-740069e5c1f4-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"24f506bf-603c-4bd1-886f-740069e5c1f4\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 05 02:19:46.264473 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:46.260948 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/24f506bf-603c-4bd1-886f-740069e5c1f4-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"24f506bf-603c-4bd1-886f-740069e5c1f4\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 05 02:19:46.264473 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:46.261008 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/24f506bf-603c-4bd1-886f-740069e5c1f4-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"24f506bf-603c-4bd1-886f-740069e5c1f4\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 05 02:19:46.264473 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:46.261061 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/24f506bf-603c-4bd1-886f-740069e5c1f4-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"24f506bf-603c-4bd1-886f-740069e5c1f4\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 05 02:19:46.264473 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:46.261115 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/24f506bf-603c-4bd1-886f-740069e5c1f4-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"24f506bf-603c-4bd1-886f-740069e5c1f4\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 05 02:19:46.264473 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:46.261146 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/24f506bf-603c-4bd1-886f-740069e5c1f4-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"24f506bf-603c-4bd1-886f-740069e5c1f4\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 05 02:19:46.264473 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:46.261181 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/24f506bf-603c-4bd1-886f-740069e5c1f4-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"24f506bf-603c-4bd1-886f-740069e5c1f4\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 05 02:19:46.264473 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:46.261520 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/24f506bf-603c-4bd1-886f-740069e5c1f4-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"24f506bf-603c-4bd1-886f-740069e5c1f4\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 05 02:19:46.264473 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:46.262053 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/24f506bf-603c-4bd1-886f-740069e5c1f4-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"24f506bf-603c-4bd1-886f-740069e5c1f4\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 05 02:19:46.264473 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:46.262472 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/24f506bf-603c-4bd1-886f-740069e5c1f4-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"24f506bf-603c-4bd1-886f-740069e5c1f4\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 05 02:19:46.264473 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:46.263209 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/24f506bf-603c-4bd1-886f-740069e5c1f4-config\") pod \"prometheus-k8s-0\" (UID: \"24f506bf-603c-4bd1-886f-740069e5c1f4\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 05 02:19:46.264473 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:46.263689 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/24f506bf-603c-4bd1-886f-740069e5c1f4-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"24f506bf-603c-4bd1-886f-740069e5c1f4\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 05 02:19:46.264473 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:46.264117 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/24f506bf-603c-4bd1-886f-740069e5c1f4-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"24f506bf-603c-4bd1-886f-740069e5c1f4\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 05 02:19:46.264473 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:46.264179 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/24f506bf-603c-4bd1-886f-740069e5c1f4-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"24f506bf-603c-4bd1-886f-740069e5c1f4\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 05 02:19:46.264473 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:46.264426 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/24f506bf-603c-4bd1-886f-740069e5c1f4-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"24f506bf-603c-4bd1-886f-740069e5c1f4\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 05 02:19:46.265304 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:46.264486 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/24f506bf-603c-4bd1-886f-740069e5c1f4-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"24f506bf-603c-4bd1-886f-740069e5c1f4\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 05 02:19:46.265434 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:46.265412 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/24f506bf-603c-4bd1-886f-740069e5c1f4-config-out\") pod \"prometheus-k8s-0\" (UID: \"24f506bf-603c-4bd1-886f-740069e5c1f4\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 05 02:19:46.266675 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:46.266302 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/24f506bf-603c-4bd1-886f-740069e5c1f4-web-config\") pod \"prometheus-k8s-0\" (UID: \"24f506bf-603c-4bd1-886f-740069e5c1f4\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 05 02:19:46.266675 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:46.266546 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/24f506bf-603c-4bd1-886f-740069e5c1f4-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"24f506bf-603c-4bd1-886f-740069e5c1f4\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 05 02:19:46.266819 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:46.266781 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/24f506bf-603c-4bd1-886f-740069e5c1f4-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"24f506bf-603c-4bd1-886f-740069e5c1f4\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 05 02:19:46.267503 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:46.267453 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/24f506bf-603c-4bd1-886f-740069e5c1f4-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"24f506bf-603c-4bd1-886f-740069e5c1f4\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 05 02:19:46.267615 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:46.267532 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/24f506bf-603c-4bd1-886f-740069e5c1f4-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"24f506bf-603c-4bd1-886f-740069e5c1f4\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 05 02:19:46.268334 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:46.268300 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/24f506bf-603c-4bd1-886f-740069e5c1f4-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"24f506bf-603c-4bd1-886f-740069e5c1f4\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 05 02:19:46.269725 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:46.269700 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6fl6x\" (UniqueName: \"kubernetes.io/projected/24f506bf-603c-4bd1-886f-740069e5c1f4-kube-api-access-6fl6x\") pod \"prometheus-k8s-0\" (UID: \"24f506bf-603c-4bd1-886f-740069e5c1f4\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 05 02:19:46.441303 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:46.441220 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 05 02:19:46.933102 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:46.933076 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 05 02:19:46.934956 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:19:46.934933 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod24f506bf_603c_4bd1_886f_740069e5c1f4.slice/crio-fa2404334e555838f0de2e73122303fb1830d964f2175973e104069793edfd98 WatchSource:0}: Error finding container fa2404334e555838f0de2e73122303fb1830d964f2175973e104069793edfd98: Status 404 returned error can't find the container with id fa2404334e555838f0de2e73122303fb1830d964f2175973e104069793edfd98 Sep 05 02:19:47.737192 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:47.737160 2555 generic.go:356] "Generic (PLEG): container finished" podID="24f506bf-603c-4bd1-886f-740069e5c1f4" containerID="6142176c82d66af2dcd423b5f6d87cb0904796529ffd136aad2cabf67aa03833" exitCode=0 Sep 05 02:19:47.737338 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:47.737241 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"24f506bf-603c-4bd1-886f-740069e5c1f4","Type":"ContainerDied","Data":"6142176c82d66af2dcd423b5f6d87cb0904796529ffd136aad2cabf67aa03833"} Sep 05 02:19:47.737338 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:47.737310 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"24f506bf-603c-4bd1-886f-740069e5c1f4","Type":"ContainerStarted","Data":"fa2404334e555838f0de2e73122303fb1830d964f2175973e104069793edfd98"} Sep 05 02:19:47.738945 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:47.738865 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-d589b4565-5jb8r" event={"ID":"816a886c-8197-4b15-add7-901cf4a9c678","Type":"ContainerStarted","Data":"88d9bdb671c92936913e8dd98664c50bbf1f0f75726db788dbda5d028feb57b7"} Sep 05 02:19:47.786903 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:47.786855 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-d589b4565-5jb8r" podStartSLOduration=2.365906691 podStartE2EDuration="3.786841135s" totalImagesPullingTime="1.420934444s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-05 02:19:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-05 02:19:47.785368277 +0000 UTC m=+114.287505876" watchObservedRunningTime="2026-09-05 02:19:47.786841135 +0000 UTC m=+114.288978732" Sep 05 02:19:51.737590 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:51.737549 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-884bfd544-9h585" Sep 05 02:19:51.761845 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:51.761816 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"24f506bf-603c-4bd1-886f-740069e5c1f4","Type":"ContainerStarted","Data":"dc7d874ff4049bbc313fd1cba40d7b9d322f3218aa699809ba134c417051d33b"} Sep 05 02:19:51.761998 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:51.761873 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"24f506bf-603c-4bd1-886f-740069e5c1f4","Type":"ContainerStarted","Data":"33bf50b0c26541f61b8c7a0ce8c31fa442e65a842b44345251178bc6b597f6ba"} Sep 05 02:19:51.761998 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:51.761902 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"24f506bf-603c-4bd1-886f-740069e5c1f4","Type":"ContainerStarted","Data":"33f21b8e8a661771c31c4e057d000286a1ae442a71d2ce30762ac8af3a649bdc"} Sep 05 02:19:51.761998 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:51.761928 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"24f506bf-603c-4bd1-886f-740069e5c1f4","Type":"ContainerStarted","Data":"524227b41b6aead4fb738ad7280fbbeb50cdab9fe7d35eeaf95fce86039a8a42"} Sep 05 02:19:51.761998 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:51.761950 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"24f506bf-603c-4bd1-886f-740069e5c1f4","Type":"ContainerStarted","Data":"3f8650b200c363f1bdb17c32f18258e79fc695c0c51b8cac7ce43ade6332c90b"} Sep 05 02:19:51.761998 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:51.761977 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"24f506bf-603c-4bd1-886f-740069e5c1f4","Type":"ContainerStarted","Data":"9e175161e67ef2802148260c4cd74d0aa147b307c7b4b74f45d44193696c8d85"} Sep 05 02:19:51.798253 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:51.798198 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.775056692 podStartE2EDuration="5.798177843s" totalImagesPullingTime="3.00486809s" totalInitContainerRuntime="18.253061ms" isStatefulPod=false podCreationTimestamp="2026-09-05 02:19:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-05 02:19:51.796866001 +0000 UTC m=+118.299003598" watchObservedRunningTime="2026-09-05 02:19:51.798177843 +0000 UTC m=+118.300315442" Sep 05 02:19:56.441873 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:19:56.441836 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Sep 05 02:20:02.808713 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:20:02.808674 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2fc3d6af-c656-4be0-8188-317d2dde7a6b-metrics-certs\") pod \"network-metrics-daemon-2x2gr\" (UID: \"2fc3d6af-c656-4be0-8188-317d2dde7a6b\") " pod="openshift-multus/network-metrics-daemon-2x2gr" Sep 05 02:20:02.811077 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:20:02.811051 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2fc3d6af-c656-4be0-8188-317d2dde7a6b-metrics-certs\") pod \"network-metrics-daemon-2x2gr\" (UID: \"2fc3d6af-c656-4be0-8188-317d2dde7a6b\") " pod="openshift-multus/network-metrics-daemon-2x2gr" Sep 05 02:20:03.004887 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:20:03.004857 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-66tlm\"" Sep 05 02:20:03.012468 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:20:03.012446 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2x2gr" Sep 05 02:20:03.282725 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:20:03.282669 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-2x2gr"] Sep 05 02:20:03.285308 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:20:03.285282 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2fc3d6af_c656_4be0_8188_317d2dde7a6b.slice/crio-f72cb4da0355c43d2801ee7791bb34c3e7d16143238e0352d55da2361623acbc WatchSource:0}: Error finding container f72cb4da0355c43d2801ee7791bb34c3e7d16143238e0352d55da2361623acbc: Status 404 returned error can't find the container with id f72cb4da0355c43d2801ee7791bb34c3e7d16143238e0352d55da2361623acbc Sep 05 02:20:03.818114 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:20:03.818051 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-2x2gr" event={"ID":"2fc3d6af-c656-4be0-8188-317d2dde7a6b","Type":"ContainerStarted","Data":"f72cb4da0355c43d2801ee7791bb34c3e7d16143238e0352d55da2361623acbc"} Sep 05 02:20:04.658288 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:20:04.658256 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-d589b4565-5jb8r" Sep 05 02:20:04.658467 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:20:04.658338 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-d589b4565-5jb8r" Sep 05 02:20:04.823957 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:20:04.823925 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-2x2gr" event={"ID":"2fc3d6af-c656-4be0-8188-317d2dde7a6b","Type":"ContainerStarted","Data":"b122cb294e19f9026f1c1e3d2bd1564580e030ce1ae2434743107cac73e93db9"} Sep 05 02:20:04.824322 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:20:04.823974 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-2x2gr" event={"ID":"2fc3d6af-c656-4be0-8188-317d2dde7a6b","Type":"ContainerStarted","Data":"e53f452fe2aa9bf6a07d8facca803fbc5d07cacee021f2984033f2c36b9caa18"} Sep 05 02:20:04.847830 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:20:04.847785 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-2x2gr" podStartSLOduration=130.019567737 podStartE2EDuration="2m10.84776856s" totalImagesPullingTime="828.200823ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-05 02:17:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-05 02:20:04.846597504 +0000 UTC m=+131.348735101" watchObservedRunningTime="2026-09-05 02:20:04.84776856 +0000 UTC m=+131.349906157" Sep 05 02:20:20.891807 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:20:20.891722 2555 generic.go:356] "Generic (PLEG): container finished" podID="9ac0ce1c-17b0-4dd0-955d-9881b8ee8f22" containerID="a9bb066a7b3b32867d209df3889899682c758b8e0fffb1c0d7a7169ec742df43" exitCode=0 Sep 05 02:20:20.891807 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:20:20.891785 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-8g9pd" event={"ID":"9ac0ce1c-17b0-4dd0-955d-9881b8ee8f22","Type":"ContainerDied","Data":"a9bb066a7b3b32867d209df3889899682c758b8e0fffb1c0d7a7169ec742df43"} Sep 05 02:20:20.892353 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:20:20.892190 2555 scope.go:117] "RemoveContainer" containerID="a9bb066a7b3b32867d209df3889899682c758b8e0fffb1c0d7a7169ec742df43" Sep 05 02:20:21.897373 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:20:21.897338 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-8g9pd" event={"ID":"9ac0ce1c-17b0-4dd0-955d-9881b8ee8f22","Type":"ContainerStarted","Data":"0369132216f3d565ec3a7911dc4db1557123f3e94f5393ab5b33f0a81825bdea"} Sep 05 02:20:24.663892 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:20:24.663861 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-d589b4565-5jb8r" Sep 05 02:20:24.667654 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:20:24.667631 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-d589b4565-5jb8r" Sep 05 02:20:46.442540 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:20:46.442439 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Sep 05 02:20:46.462235 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:20:46.462210 2555 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Sep 05 02:20:47.016726 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:20:47.016699 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Sep 05 02:22:53.966378 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:22:53.966347 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-k2cdf_2ab9a760-ef7b-48dc-acbe-2694be7274e0/console-operator/1.log" Sep 05 02:22:53.968593 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:22:53.968569 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-k2cdf_2ab9a760-ef7b-48dc-acbe-2694be7274e0/console-operator/1.log" Sep 05 02:22:53.978114 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:22:53.978094 2555 kubelet.go:1648] "Image garbage collection succeeded" Sep 05 02:26:45.741014 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:26:45.740981 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/s3-init-sn7z7"] Sep 05 02:26:45.744420 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:26:45.744404 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/s3-init-sn7z7" Sep 05 02:26:45.746991 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:26:45.746970 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"mlpipeline-s3-artifact\"" Sep 05 02:26:45.746991 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:26:45.746978 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"hf-token\"" Sep 05 02:26:45.747200 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:26:45.746980 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"kube-root-ca.crt\"" Sep 05 02:26:45.747200 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:26:45.747071 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"default-dockercfg-9qdjn\"" Sep 05 02:26:45.747344 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:26:45.747329 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"openshift-service-ca.crt\"" Sep 05 02:26:45.755180 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:26:45.755158 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/s3-init-sn7z7"] Sep 05 02:26:45.777705 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:26:45.777682 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ttszp\" (UniqueName: \"kubernetes.io/projected/6f08dae8-a141-40a3-99e2-6c8b727f9dcb-kube-api-access-ttszp\") pod \"s3-init-sn7z7\" (UID: \"6f08dae8-a141-40a3-99e2-6c8b727f9dcb\") " pod="kserve/s3-init-sn7z7" Sep 05 02:26:45.777799 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:26:45.777745 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6f08dae8-a141-40a3-99e2-6c8b727f9dcb-model-cache\") pod \"s3-init-sn7z7\" (UID: \"6f08dae8-a141-40a3-99e2-6c8b727f9dcb\") " pod="kserve/s3-init-sn7z7" Sep 05 02:26:45.878830 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:26:45.878752 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6f08dae8-a141-40a3-99e2-6c8b727f9dcb-model-cache\") pod \"s3-init-sn7z7\" (UID: \"6f08dae8-a141-40a3-99e2-6c8b727f9dcb\") " pod="kserve/s3-init-sn7z7" Sep 05 02:26:45.878830 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:26:45.878797 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ttszp\" (UniqueName: \"kubernetes.io/projected/6f08dae8-a141-40a3-99e2-6c8b727f9dcb-kube-api-access-ttszp\") pod \"s3-init-sn7z7\" (UID: \"6f08dae8-a141-40a3-99e2-6c8b727f9dcb\") " pod="kserve/s3-init-sn7z7" Sep 05 02:26:45.879159 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:26:45.879140 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6f08dae8-a141-40a3-99e2-6c8b727f9dcb-model-cache\") pod \"s3-init-sn7z7\" (UID: \"6f08dae8-a141-40a3-99e2-6c8b727f9dcb\") " pod="kserve/s3-init-sn7z7" Sep 05 02:26:45.888438 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:26:45.888408 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ttszp\" (UniqueName: \"kubernetes.io/projected/6f08dae8-a141-40a3-99e2-6c8b727f9dcb-kube-api-access-ttszp\") pod \"s3-init-sn7z7\" (UID: \"6f08dae8-a141-40a3-99e2-6c8b727f9dcb\") " pod="kserve/s3-init-sn7z7" Sep 05 02:26:46.064892 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:26:46.064801 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/s3-init-sn7z7" Sep 05 02:26:46.340932 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:26:46.340856 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/s3-init-sn7z7"] Sep 05 02:26:46.344162 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:26:46.344135 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6f08dae8_a141_40a3_99e2_6c8b727f9dcb.slice/crio-5a672204f23acebef1f9e65a1dd70d8adde3fac9de108b256f0de049ec86ed59 WatchSource:0}: Error finding container 5a672204f23acebef1f9e65a1dd70d8adde3fac9de108b256f0de049ec86ed59: Status 404 returned error can't find the container with id 5a672204f23acebef1f9e65a1dd70d8adde3fac9de108b256f0de049ec86ed59 Sep 05 02:26:46.346040 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:26:46.346002 2555 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 05 02:26:46.431669 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:26:46.431635 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-sn7z7" event={"ID":"6f08dae8-a141-40a3-99e2-6c8b727f9dcb","Type":"ContainerStarted","Data":"5a672204f23acebef1f9e65a1dd70d8adde3fac9de108b256f0de049ec86ed59"} Sep 05 02:26:50.455640 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:26:50.455605 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-sn7z7" event={"ID":"6f08dae8-a141-40a3-99e2-6c8b727f9dcb","Type":"ContainerStarted","Data":"9dd935285e4049ded121169e1936b0a9eefef86711eb3b3cbfbbeea38de38846"} Sep 05 02:26:51.461413 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:26:51.461382 2555 generic.go:356] "Generic (PLEG): container finished" podID="6f08dae8-a141-40a3-99e2-6c8b727f9dcb" containerID="9dd935285e4049ded121169e1936b0a9eefef86711eb3b3cbfbbeea38de38846" exitCode=0 Sep 05 02:26:51.461847 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:26:51.461443 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-sn7z7" event={"ID":"6f08dae8-a141-40a3-99e2-6c8b727f9dcb","Type":"ContainerDied","Data":"9dd935285e4049ded121169e1936b0a9eefef86711eb3b3cbfbbeea38de38846"} Sep 05 02:26:55.949335 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:26:55.949315 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"mlpipeline-s3-artifact\"" Sep 05 02:26:56.486600 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:26:56.486562 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-sn7z7" event={"ID":"6f08dae8-a141-40a3-99e2-6c8b727f9dcb","Type":"ContainerStarted","Data":"1f7d65164283c94b6caf82238167295ee98236a672f7fd9b38d810fa3fbce9ae"} Sep 05 02:26:56.506887 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:26:56.506837 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/s3-init-sn7z7" podStartSLOduration=2.158067912 podStartE2EDuration="11.506822299s" totalImagesPullingTime="7.941870866s" totalInitContainerRuntime="1.406883521s" isStatefulPod=false podCreationTimestamp="2026-09-05 02:26:45 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-05 02:26:56.505062909 +0000 UTC m=+543.007200507" watchObservedRunningTime="2026-09-05 02:26:56.506822299 +0000 UTC m=+543.008959887" Sep 05 02:27:53.996450 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:27:53.996425 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-k2cdf_2ab9a760-ef7b-48dc-acbe-2694be7274e0/console-operator/1.log" Sep 05 02:27:53.996922 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:27:53.996425 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-k2cdf_2ab9a760-ef7b-48dc-acbe-2694be7274e0/console-operator/1.log" Sep 05 02:28:01.749384 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:28:01.749345 2555 generic.go:356] "Generic (PLEG): container finished" podID="6f08dae8-a141-40a3-99e2-6c8b727f9dcb" containerID="1f7d65164283c94b6caf82238167295ee98236a672f7fd9b38d810fa3fbce9ae" exitCode=0 Sep 05 02:28:01.749841 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:28:01.749416 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-sn7z7" event={"ID":"6f08dae8-a141-40a3-99e2-6c8b727f9dcb","Type":"ContainerDied","Data":"1f7d65164283c94b6caf82238167295ee98236a672f7fd9b38d810fa3fbce9ae"} Sep 05 02:28:02.873441 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:28:02.873418 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/s3-init-sn7z7" Sep 05 02:28:02.944944 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:28:02.944914 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ttszp\" (UniqueName: \"kubernetes.io/projected/6f08dae8-a141-40a3-99e2-6c8b727f9dcb-kube-api-access-ttszp\") pod \"6f08dae8-a141-40a3-99e2-6c8b727f9dcb\" (UID: \"6f08dae8-a141-40a3-99e2-6c8b727f9dcb\") " Sep 05 02:28:02.945136 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:28:02.944986 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6f08dae8-a141-40a3-99e2-6c8b727f9dcb-model-cache\") pod \"6f08dae8-a141-40a3-99e2-6c8b727f9dcb\" (UID: \"6f08dae8-a141-40a3-99e2-6c8b727f9dcb\") " Sep 05 02:28:02.947122 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:28:02.947097 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6f08dae8-a141-40a3-99e2-6c8b727f9dcb-kube-api-access-ttszp" (OuterVolumeSpecName: "kube-api-access-ttszp") pod "6f08dae8-a141-40a3-99e2-6c8b727f9dcb" (UID: "6f08dae8-a141-40a3-99e2-6c8b727f9dcb"). InnerVolumeSpecName "kube-api-access-ttszp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 05 02:28:02.963418 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:28:02.963390 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6f08dae8-a141-40a3-99e2-6c8b727f9dcb-model-cache" (OuterVolumeSpecName: "model-cache") pod "6f08dae8-a141-40a3-99e2-6c8b727f9dcb" (UID: "6f08dae8-a141-40a3-99e2-6c8b727f9dcb"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 05 02:28:03.046406 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:28:03.046333 2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ttszp\" (UniqueName: \"kubernetes.io/projected/6f08dae8-a141-40a3-99e2-6c8b727f9dcb-kube-api-access-ttszp\") on node \"ip-10-0-133-250.ec2.internal\" DevicePath \"\"" Sep 05 02:28:03.046406 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:28:03.046361 2555 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6f08dae8-a141-40a3-99e2-6c8b727f9dcb-model-cache\") on node \"ip-10-0-133-250.ec2.internal\" DevicePath \"\"" Sep 05 02:28:03.759802 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:28:03.759770 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/s3-init-sn7z7" Sep 05 02:28:03.759961 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:28:03.759802 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-sn7z7" event={"ID":"6f08dae8-a141-40a3-99e2-6c8b727f9dcb","Type":"ContainerDied","Data":"5a672204f23acebef1f9e65a1dd70d8adde3fac9de108b256f0de049ec86ed59"} Sep 05 02:28:03.759961 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:28:03.759833 2555 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5a672204f23acebef1f9e65a1dd70d8adde3fac9de108b256f0de049ec86ed59" Sep 05 02:28:17.486278 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:28:17.486193 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/isvc-canary-rollback-predictor-76998db6fd-mcm7j"] Sep 05 02:28:17.486673 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:28:17.486519 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6f08dae8-a141-40a3-99e2-6c8b727f9dcb" containerName="s3-init" Sep 05 02:28:17.486673 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:28:17.486533 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="6f08dae8-a141-40a3-99e2-6c8b727f9dcb" containerName="s3-init" Sep 05 02:28:17.486673 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:28:17.486549 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6f08dae8-a141-40a3-99e2-6c8b727f9dcb" containerName="download-hf-model" Sep 05 02:28:17.486673 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:28:17.486555 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="6f08dae8-a141-40a3-99e2-6c8b727f9dcb" containerName="download-hf-model" Sep 05 02:28:17.486673 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:28:17.486619 2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="6f08dae8-a141-40a3-99e2-6c8b727f9dcb" containerName="s3-init" Sep 05 02:28:17.489494 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:28:17.489478 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-76998db6fd-mcm7j" Sep 05 02:28:17.496005 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:28:17.495973 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"default-dockercfg-85bmm\"" Sep 05 02:28:17.496005 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:28:17.495995 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"odh-kserve-custom-ca-bundle\"" Sep 05 02:28:17.496183 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:28:17.495995 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"seaweedfs-s3-creds\"" Sep 05 02:28:17.496183 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:28:17.496077 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-canary-rollback-kube-rbac-proxy-sar-config\"" Sep 05 02:28:17.496183 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:28:17.496085 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"kube-root-ca.crt\"" Sep 05 02:28:17.496792 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:28:17.496774 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-canary-rollback-predictor-serving-cert\"" Sep 05 02:28:17.497244 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:28:17.497231 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"openshift-service-ca.crt\"" Sep 05 02:28:17.559251 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:28:17.559223 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-canary-rollback-predictor-76998db6fd-mcm7j"] Sep 05 02:28:17.568045 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:28:17.568005 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/8ce5162d-f1da-4b72-9cd0-dbdf6e331f9c-kserve-provision-location\") pod \"isvc-canary-rollback-predictor-76998db6fd-mcm7j\" (UID: \"8ce5162d-f1da-4b72-9cd0-dbdf6e331f9c\") " pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-76998db6fd-mcm7j" Sep 05 02:28:17.568121 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:28:17.568068 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/8ce5162d-f1da-4b72-9cd0-dbdf6e331f9c-proxy-tls\") pod \"isvc-canary-rollback-predictor-76998db6fd-mcm7j\" (UID: \"8ce5162d-f1da-4b72-9cd0-dbdf6e331f9c\") " pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-76998db6fd-mcm7j" Sep 05 02:28:17.568121 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:28:17.568111 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/8ce5162d-f1da-4b72-9cd0-dbdf6e331f9c-kube-rbac-proxy-sar-config\") pod \"isvc-canary-rollback-predictor-76998db6fd-mcm7j\" (UID: \"8ce5162d-f1da-4b72-9cd0-dbdf6e331f9c\") " pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-76998db6fd-mcm7j" Sep 05 02:28:17.568190 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:28:17.568167 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/8ce5162d-f1da-4b72-9cd0-dbdf6e331f9c-cabundle-cert\") pod \"isvc-canary-rollback-predictor-76998db6fd-mcm7j\" (UID: \"8ce5162d-f1da-4b72-9cd0-dbdf6e331f9c\") " pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-76998db6fd-mcm7j" Sep 05 02:28:17.568228 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:28:17.568191 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bgsqz\" (UniqueName: \"kubernetes.io/projected/8ce5162d-f1da-4b72-9cd0-dbdf6e331f9c-kube-api-access-bgsqz\") pod \"isvc-canary-rollback-predictor-76998db6fd-mcm7j\" (UID: \"8ce5162d-f1da-4b72-9cd0-dbdf6e331f9c\") " pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-76998db6fd-mcm7j" Sep 05 02:28:17.669297 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:28:17.669258 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bgsqz\" (UniqueName: \"kubernetes.io/projected/8ce5162d-f1da-4b72-9cd0-dbdf6e331f9c-kube-api-access-bgsqz\") pod \"isvc-canary-rollback-predictor-76998db6fd-mcm7j\" (UID: \"8ce5162d-f1da-4b72-9cd0-dbdf6e331f9c\") " pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-76998db6fd-mcm7j" Sep 05 02:28:17.669471 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:28:17.669343 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/8ce5162d-f1da-4b72-9cd0-dbdf6e331f9c-kserve-provision-location\") pod \"isvc-canary-rollback-predictor-76998db6fd-mcm7j\" (UID: \"8ce5162d-f1da-4b72-9cd0-dbdf6e331f9c\") " pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-76998db6fd-mcm7j" Sep 05 02:28:17.669471 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:28:17.669402 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/8ce5162d-f1da-4b72-9cd0-dbdf6e331f9c-proxy-tls\") pod \"isvc-canary-rollback-predictor-76998db6fd-mcm7j\" (UID: \"8ce5162d-f1da-4b72-9cd0-dbdf6e331f9c\") " pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-76998db6fd-mcm7j" Sep 05 02:28:17.669471 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:28:17.669434 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/8ce5162d-f1da-4b72-9cd0-dbdf6e331f9c-kube-rbac-proxy-sar-config\") pod \"isvc-canary-rollback-predictor-76998db6fd-mcm7j\" (UID: \"8ce5162d-f1da-4b72-9cd0-dbdf6e331f9c\") " pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-76998db6fd-mcm7j" Sep 05 02:28:17.669627 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:28:17.669488 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/8ce5162d-f1da-4b72-9cd0-dbdf6e331f9c-cabundle-cert\") pod \"isvc-canary-rollback-predictor-76998db6fd-mcm7j\" (UID: \"8ce5162d-f1da-4b72-9cd0-dbdf6e331f9c\") " pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-76998db6fd-mcm7j" Sep 05 02:28:17.669817 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:28:17.669793 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/8ce5162d-f1da-4b72-9cd0-dbdf6e331f9c-kserve-provision-location\") pod \"isvc-canary-rollback-predictor-76998db6fd-mcm7j\" (UID: \"8ce5162d-f1da-4b72-9cd0-dbdf6e331f9c\") " pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-76998db6fd-mcm7j" Sep 05 02:28:17.670193 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:28:17.670176 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/8ce5162d-f1da-4b72-9cd0-dbdf6e331f9c-kube-rbac-proxy-sar-config\") pod \"isvc-canary-rollback-predictor-76998db6fd-mcm7j\" (UID: \"8ce5162d-f1da-4b72-9cd0-dbdf6e331f9c\") " pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-76998db6fd-mcm7j" Sep 05 02:28:17.670242 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:28:17.670225 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/8ce5162d-f1da-4b72-9cd0-dbdf6e331f9c-cabundle-cert\") pod \"isvc-canary-rollback-predictor-76998db6fd-mcm7j\" (UID: \"8ce5162d-f1da-4b72-9cd0-dbdf6e331f9c\") " pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-76998db6fd-mcm7j" Sep 05 02:28:17.671792 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:28:17.671776 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/8ce5162d-f1da-4b72-9cd0-dbdf6e331f9c-proxy-tls\") pod \"isvc-canary-rollback-predictor-76998db6fd-mcm7j\" (UID: \"8ce5162d-f1da-4b72-9cd0-dbdf6e331f9c\") " pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-76998db6fd-mcm7j" Sep 05 02:28:17.679310 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:28:17.679281 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bgsqz\" (UniqueName: \"kubernetes.io/projected/8ce5162d-f1da-4b72-9cd0-dbdf6e331f9c-kube-api-access-bgsqz\") pod \"isvc-canary-rollback-predictor-76998db6fd-mcm7j\" (UID: \"8ce5162d-f1da-4b72-9cd0-dbdf6e331f9c\") " pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-76998db6fd-mcm7j" Sep 05 02:28:17.800035 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:28:17.799918 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-76998db6fd-mcm7j" Sep 05 02:28:18.101783 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:28:18.101709 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-canary-rollback-predictor-76998db6fd-mcm7j"] Sep 05 02:28:18.105085 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:28:18.105059 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8ce5162d_f1da_4b72_9cd0_dbdf6e331f9c.slice/crio-4a8ba164eb342ef79db0ac350dc4bc711a6c119c7a4e62ad9b0f4377bb49033c WatchSource:0}: Error finding container 4a8ba164eb342ef79db0ac350dc4bc711a6c119c7a4e62ad9b0f4377bb49033c: Status 404 returned error can't find the container with id 4a8ba164eb342ef79db0ac350dc4bc711a6c119c7a4e62ad9b0f4377bb49033c Sep 05 02:28:18.825810 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:28:18.825775 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-76998db6fd-mcm7j" event={"ID":"8ce5162d-f1da-4b72-9cd0-dbdf6e331f9c","Type":"ContainerStarted","Data":"6231116d94a54adc3295d4cc4bbf32e6da145689f8755db879a62647e4939487"} Sep 05 02:28:18.826197 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:28:18.825833 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-76998db6fd-mcm7j" event={"ID":"8ce5162d-f1da-4b72-9cd0-dbdf6e331f9c","Type":"ContainerStarted","Data":"4a8ba164eb342ef79db0ac350dc4bc711a6c119c7a4e62ad9b0f4377bb49033c"} Sep 05 02:28:22.843196 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:28:22.843163 2555 generic.go:356] "Generic (PLEG): container finished" podID="8ce5162d-f1da-4b72-9cd0-dbdf6e331f9c" containerID="6231116d94a54adc3295d4cc4bbf32e6da145689f8755db879a62647e4939487" exitCode=0 Sep 05 02:28:22.843570 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:28:22.843225 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-76998db6fd-mcm7j" event={"ID":"8ce5162d-f1da-4b72-9cd0-dbdf6e331f9c","Type":"ContainerDied","Data":"6231116d94a54adc3295d4cc4bbf32e6da145689f8755db879a62647e4939487"} Sep 05 02:28:36.921552 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:28:36.921513 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-76998db6fd-mcm7j" event={"ID":"8ce5162d-f1da-4b72-9cd0-dbdf6e331f9c","Type":"ContainerStarted","Data":"a21194a7987b5298f6756fe99e1077497b7592d8383d9a40778813c1fccc80db"} Sep 05 02:28:38.932445 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:28:38.932406 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-76998db6fd-mcm7j" event={"ID":"8ce5162d-f1da-4b72-9cd0-dbdf6e331f9c","Type":"ContainerStarted","Data":"06d7a00e32e0ed5cf1a7dc05e9ad7f4df2f88f01ad2361c66ab08859364c855c"} Sep 05 02:28:38.932822 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:28:38.932558 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-76998db6fd-mcm7j" Sep 05 02:28:38.953847 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:28:38.953799 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-76998db6fd-mcm7j" podStartSLOduration=2.7896160009999997 podStartE2EDuration="21.953783568s" totalImagesPullingTime="15.416736687s" totalInitContainerRuntime="3.74743088s" isStatefulPod=false podCreationTimestamp="2026-09-05 02:28:17 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-05 02:28:38.951992255 +0000 UTC m=+645.454129877" watchObservedRunningTime="2026-09-05 02:28:38.953783568 +0000 UTC m=+645.455921164" Sep 05 02:28:39.936926 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:28:39.936892 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-76998db6fd-mcm7j" Sep 05 02:28:39.937989 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:28:39.937958 2555 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-76998db6fd-mcm7j" podUID="8ce5162d-f1da-4b72-9cd0-dbdf6e331f9c" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.23:8080: connect: connection refused" Sep 05 02:28:40.941131 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:28:40.941094 2555 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-76998db6fd-mcm7j" podUID="8ce5162d-f1da-4b72-9cd0-dbdf6e331f9c" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.23:8080: connect: connection refused" Sep 05 02:28:45.945454 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:28:45.945419 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-76998db6fd-mcm7j" Sep 05 02:28:45.945948 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:28:45.945919 2555 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-76998db6fd-mcm7j" podUID="8ce5162d-f1da-4b72-9cd0-dbdf6e331f9c" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.23:8080: connect: connection refused" Sep 05 02:28:55.946805 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:28:55.946761 2555 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-76998db6fd-mcm7j" podUID="8ce5162d-f1da-4b72-9cd0-dbdf6e331f9c" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.23:8080: connect: connection refused" Sep 05 02:29:05.946012 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:29:05.945973 2555 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-76998db6fd-mcm7j" podUID="8ce5162d-f1da-4b72-9cd0-dbdf6e331f9c" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.23:8080: connect: connection refused" Sep 05 02:29:15.945847 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:29:15.945796 2555 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-76998db6fd-mcm7j" podUID="8ce5162d-f1da-4b72-9cd0-dbdf6e331f9c" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.23:8080: connect: connection refused" Sep 05 02:29:25.946513 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:29:25.946472 2555 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-76998db6fd-mcm7j" podUID="8ce5162d-f1da-4b72-9cd0-dbdf6e331f9c" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.23:8080: connect: connection refused" Sep 05 02:29:35.946222 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:29:35.946178 2555 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-76998db6fd-mcm7j" podUID="8ce5162d-f1da-4b72-9cd0-dbdf6e331f9c" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.23:8080: connect: connection refused" Sep 05 02:29:45.946571 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:29:45.946486 2555 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-76998db6fd-mcm7j" podUID="8ce5162d-f1da-4b72-9cd0-dbdf6e331f9c" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.23:8080: connect: connection refused" Sep 05 02:29:46.077989 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:29:46.077944 2555 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-76998db6fd-mcm7j" podUID="8ce5162d-f1da-4b72-9cd0-dbdf6e331f9c" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.23:8080: connect: connection refused" Sep 05 02:29:56.082765 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:29:56.082739 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-76998db6fd-mcm7j" Sep 05 02:31:36.901612 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:31:36.901531 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-canary-rollback-predictor-76998db6fd-mcm7j"] Sep 05 02:31:36.902106 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:31:36.901790 2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-76998db6fd-mcm7j" podUID="8ce5162d-f1da-4b72-9cd0-dbdf6e331f9c" containerName="kserve-container" containerID="cri-o://a21194a7987b5298f6756fe99e1077497b7592d8383d9a40778813c1fccc80db" gracePeriod=30 Sep 05 02:31:36.902106 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:31:36.901853 2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-76998db6fd-mcm7j" podUID="8ce5162d-f1da-4b72-9cd0-dbdf6e331f9c" containerName="kube-rbac-proxy" containerID="cri-o://06d7a00e32e0ed5cf1a7dc05e9ad7f4df2f88f01ad2361c66ab08859364c855c" gracePeriod=30 Sep 05 02:31:37.672953 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:31:37.672918 2555 generic.go:356] "Generic (PLEG): container finished" podID="8ce5162d-f1da-4b72-9cd0-dbdf6e331f9c" containerID="06d7a00e32e0ed5cf1a7dc05e9ad7f4df2f88f01ad2361c66ab08859364c855c" exitCode=2 Sep 05 02:31:37.673135 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:31:37.672987 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-76998db6fd-mcm7j" event={"ID":"8ce5162d-f1da-4b72-9cd0-dbdf6e331f9c","Type":"ContainerDied","Data":"06d7a00e32e0ed5cf1a7dc05e9ad7f4df2f88f01ad2361c66ab08859364c855c"} Sep 05 02:31:40.941544 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:31:40.941508 2555 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-76998db6fd-mcm7j" podUID="8ce5162d-f1da-4b72-9cd0-dbdf6e331f9c" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.134.0.23:8643/healthz\": dial tcp 10.134.0.23:8643: connect: connection refused" Sep 05 02:31:41.541270 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:31:41.541241 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-76998db6fd-mcm7j" Sep 05 02:31:41.690427 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:31:41.690337 2555 generic.go:356] "Generic (PLEG): container finished" podID="8ce5162d-f1da-4b72-9cd0-dbdf6e331f9c" containerID="a21194a7987b5298f6756fe99e1077497b7592d8383d9a40778813c1fccc80db" exitCode=0 Sep 05 02:31:41.690427 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:31:41.690377 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-76998db6fd-mcm7j" event={"ID":"8ce5162d-f1da-4b72-9cd0-dbdf6e331f9c","Type":"ContainerDied","Data":"a21194a7987b5298f6756fe99e1077497b7592d8383d9a40778813c1fccc80db"} Sep 05 02:31:41.690427 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:31:41.690404 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-76998db6fd-mcm7j" Sep 05 02:31:41.690680 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:31:41.690438 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-canary-rollback-predictor-76998db6fd-mcm7j" event={"ID":"8ce5162d-f1da-4b72-9cd0-dbdf6e331f9c","Type":"ContainerDied","Data":"4a8ba164eb342ef79db0ac350dc4bc711a6c119c7a4e62ad9b0f4377bb49033c"} Sep 05 02:31:41.690680 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:31:41.690473 2555 scope.go:117] "RemoveContainer" containerID="06d7a00e32e0ed5cf1a7dc05e9ad7f4df2f88f01ad2361c66ab08859364c855c" Sep 05 02:31:41.698361 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:31:41.698344 2555 scope.go:117] "RemoveContainer" containerID="a21194a7987b5298f6756fe99e1077497b7592d8383d9a40778813c1fccc80db" Sep 05 02:31:41.705407 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:31:41.705390 2555 scope.go:117] "RemoveContainer" containerID="6231116d94a54adc3295d4cc4bbf32e6da145689f8755db879a62647e4939487" Sep 05 02:31:41.705569 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:31:41.705548 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/8ce5162d-f1da-4b72-9cd0-dbdf6e331f9c-proxy-tls\") pod \"8ce5162d-f1da-4b72-9cd0-dbdf6e331f9c\" (UID: \"8ce5162d-f1da-4b72-9cd0-dbdf6e331f9c\") " Sep 05 02:31:41.705640 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:31:41.705621 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/8ce5162d-f1da-4b72-9cd0-dbdf6e331f9c-kserve-provision-location\") pod \"8ce5162d-f1da-4b72-9cd0-dbdf6e331f9c\" (UID: \"8ce5162d-f1da-4b72-9cd0-dbdf6e331f9c\") " Sep 05 02:31:41.705696 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:31:41.705667 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/8ce5162d-f1da-4b72-9cd0-dbdf6e331f9c-cabundle-cert\") pod \"8ce5162d-f1da-4b72-9cd0-dbdf6e331f9c\" (UID: \"8ce5162d-f1da-4b72-9cd0-dbdf6e331f9c\") " Sep 05 02:31:41.705696 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:31:41.705684 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/8ce5162d-f1da-4b72-9cd0-dbdf6e331f9c-kube-rbac-proxy-sar-config\") pod \"8ce5162d-f1da-4b72-9cd0-dbdf6e331f9c\" (UID: \"8ce5162d-f1da-4b72-9cd0-dbdf6e331f9c\") " Sep 05 02:31:41.705793 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:31:41.705748 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bgsqz\" (UniqueName: \"kubernetes.io/projected/8ce5162d-f1da-4b72-9cd0-dbdf6e331f9c-kube-api-access-bgsqz\") pod \"8ce5162d-f1da-4b72-9cd0-dbdf6e331f9c\" (UID: \"8ce5162d-f1da-4b72-9cd0-dbdf6e331f9c\") " Sep 05 02:31:41.706001 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:31:41.705969 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8ce5162d-f1da-4b72-9cd0-dbdf6e331f9c-kserve-provision-location" (OuterVolumeSpecName: "kserve-provision-location") pod "8ce5162d-f1da-4b72-9cd0-dbdf6e331f9c" (UID: "8ce5162d-f1da-4b72-9cd0-dbdf6e331f9c"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 05 02:31:41.706212 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:31:41.706181 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8ce5162d-f1da-4b72-9cd0-dbdf6e331f9c-cabundle-cert" (OuterVolumeSpecName: "cabundle-cert") pod "8ce5162d-f1da-4b72-9cd0-dbdf6e331f9c" (UID: "8ce5162d-f1da-4b72-9cd0-dbdf6e331f9c"). InnerVolumeSpecName "cabundle-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 05 02:31:41.706311 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:31:41.706224 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8ce5162d-f1da-4b72-9cd0-dbdf6e331f9c-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "8ce5162d-f1da-4b72-9cd0-dbdf6e331f9c" (UID: "8ce5162d-f1da-4b72-9cd0-dbdf6e331f9c"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 05 02:31:41.707830 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:31:41.707804 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8ce5162d-f1da-4b72-9cd0-dbdf6e331f9c-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "8ce5162d-f1da-4b72-9cd0-dbdf6e331f9c" (UID: "8ce5162d-f1da-4b72-9cd0-dbdf6e331f9c"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 05 02:31:41.707910 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:31:41.707830 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8ce5162d-f1da-4b72-9cd0-dbdf6e331f9c-kube-api-access-bgsqz" (OuterVolumeSpecName: "kube-api-access-bgsqz") pod "8ce5162d-f1da-4b72-9cd0-dbdf6e331f9c" (UID: "8ce5162d-f1da-4b72-9cd0-dbdf6e331f9c"). InnerVolumeSpecName "kube-api-access-bgsqz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 05 02:31:41.721997 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:31:41.721979 2555 scope.go:117] "RemoveContainer" containerID="06d7a00e32e0ed5cf1a7dc05e9ad7f4df2f88f01ad2361c66ab08859364c855c" Sep 05 02:31:41.722279 ip-10-0-133-250 kubenswrapper[2555]: E0905 02:31:41.722256 2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"06d7a00e32e0ed5cf1a7dc05e9ad7f4df2f88f01ad2361c66ab08859364c855c\": container with ID starting with 06d7a00e32e0ed5cf1a7dc05e9ad7f4df2f88f01ad2361c66ab08859364c855c not found: ID does not exist" containerID="06d7a00e32e0ed5cf1a7dc05e9ad7f4df2f88f01ad2361c66ab08859364c855c" Sep 05 02:31:41.722328 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:31:41.722282 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"06d7a00e32e0ed5cf1a7dc05e9ad7f4df2f88f01ad2361c66ab08859364c855c"} err="failed to get container status \"06d7a00e32e0ed5cf1a7dc05e9ad7f4df2f88f01ad2361c66ab08859364c855c\": rpc error: code = NotFound desc = could not find container \"06d7a00e32e0ed5cf1a7dc05e9ad7f4df2f88f01ad2361c66ab08859364c855c\": container with ID starting with 06d7a00e32e0ed5cf1a7dc05e9ad7f4df2f88f01ad2361c66ab08859364c855c not found: ID does not exist" Sep 05 02:31:41.722328 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:31:41.722299 2555 scope.go:117] "RemoveContainer" containerID="a21194a7987b5298f6756fe99e1077497b7592d8383d9a40778813c1fccc80db" Sep 05 02:31:41.722531 ip-10-0-133-250 kubenswrapper[2555]: E0905 02:31:41.722514 2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a21194a7987b5298f6756fe99e1077497b7592d8383d9a40778813c1fccc80db\": container with ID starting with a21194a7987b5298f6756fe99e1077497b7592d8383d9a40778813c1fccc80db not found: ID does not exist" containerID="a21194a7987b5298f6756fe99e1077497b7592d8383d9a40778813c1fccc80db" Sep 05 02:31:41.722570 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:31:41.722537 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a21194a7987b5298f6756fe99e1077497b7592d8383d9a40778813c1fccc80db"} err="failed to get container status \"a21194a7987b5298f6756fe99e1077497b7592d8383d9a40778813c1fccc80db\": rpc error: code = NotFound desc = could not find container \"a21194a7987b5298f6756fe99e1077497b7592d8383d9a40778813c1fccc80db\": container with ID starting with a21194a7987b5298f6756fe99e1077497b7592d8383d9a40778813c1fccc80db not found: ID does not exist" Sep 05 02:31:41.722570 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:31:41.722553 2555 scope.go:117] "RemoveContainer" containerID="6231116d94a54adc3295d4cc4bbf32e6da145689f8755db879a62647e4939487" Sep 05 02:31:41.722751 ip-10-0-133-250 kubenswrapper[2555]: E0905 02:31:41.722739 2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6231116d94a54adc3295d4cc4bbf32e6da145689f8755db879a62647e4939487\": container with ID starting with 6231116d94a54adc3295d4cc4bbf32e6da145689f8755db879a62647e4939487 not found: ID does not exist" containerID="6231116d94a54adc3295d4cc4bbf32e6da145689f8755db879a62647e4939487" Sep 05 02:31:41.722789 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:31:41.722754 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6231116d94a54adc3295d4cc4bbf32e6da145689f8755db879a62647e4939487"} err="failed to get container status \"6231116d94a54adc3295d4cc4bbf32e6da145689f8755db879a62647e4939487\": rpc error: code = NotFound desc = could not find container \"6231116d94a54adc3295d4cc4bbf32e6da145689f8755db879a62647e4939487\": container with ID starting with 6231116d94a54adc3295d4cc4bbf32e6da145689f8755db879a62647e4939487 not found: ID does not exist" Sep 05 02:31:41.807167 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:31:41.807132 2555 reconciler_common.go:299] "Volume detached for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/8ce5162d-f1da-4b72-9cd0-dbdf6e331f9c-cabundle-cert\") on node \"ip-10-0-133-250.ec2.internal\" DevicePath \"\"" Sep 05 02:31:41.807167 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:31:41.807159 2555 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/8ce5162d-f1da-4b72-9cd0-dbdf6e331f9c-kube-rbac-proxy-sar-config\") on node \"ip-10-0-133-250.ec2.internal\" DevicePath \"\"" Sep 05 02:31:41.807167 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:31:41.807170 2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bgsqz\" (UniqueName: \"kubernetes.io/projected/8ce5162d-f1da-4b72-9cd0-dbdf6e331f9c-kube-api-access-bgsqz\") on node \"ip-10-0-133-250.ec2.internal\" DevicePath \"\"" Sep 05 02:31:41.807383 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:31:41.807179 2555 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/8ce5162d-f1da-4b72-9cd0-dbdf6e331f9c-proxy-tls\") on node \"ip-10-0-133-250.ec2.internal\" DevicePath \"\"" Sep 05 02:31:41.807383 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:31:41.807189 2555 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/8ce5162d-f1da-4b72-9cd0-dbdf6e331f9c-kserve-provision-location\") on node \"ip-10-0-133-250.ec2.internal\" DevicePath \"\"" Sep 05 02:31:42.027317 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:31:42.027285 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-canary-rollback-predictor-76998db6fd-mcm7j"] Sep 05 02:31:42.032389 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:31:42.032361 2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/isvc-canary-rollback-predictor-76998db6fd-mcm7j"] Sep 05 02:31:42.084130 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:31:42.084102 2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8ce5162d-f1da-4b72-9cd0-dbdf6e331f9c" path="/var/lib/kubelet/pods/8ce5162d-f1da-4b72-9cd0-dbdf6e331f9c/volumes" Sep 05 02:31:51.907824 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:31:51.907788 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/model-chainer-raw-e3535-66db6d66bd-2f6xn"] Sep 05 02:31:51.908290 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:31:51.908126 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8ce5162d-f1da-4b72-9cd0-dbdf6e331f9c" containerName="kube-rbac-proxy" Sep 05 02:31:51.908290 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:31:51.908139 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="8ce5162d-f1da-4b72-9cd0-dbdf6e331f9c" containerName="kube-rbac-proxy" Sep 05 02:31:51.908290 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:31:51.908151 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8ce5162d-f1da-4b72-9cd0-dbdf6e331f9c" containerName="kserve-container" Sep 05 02:31:51.908290 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:31:51.908156 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="8ce5162d-f1da-4b72-9cd0-dbdf6e331f9c" containerName="kserve-container" Sep 05 02:31:51.908290 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:31:51.908164 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8ce5162d-f1da-4b72-9cd0-dbdf6e331f9c" containerName="storage-initializer" Sep 05 02:31:51.908290 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:31:51.908171 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="8ce5162d-f1da-4b72-9cd0-dbdf6e331f9c" containerName="storage-initializer" Sep 05 02:31:51.908290 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:31:51.908234 2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="8ce5162d-f1da-4b72-9cd0-dbdf6e331f9c" containerName="kube-rbac-proxy" Sep 05 02:31:51.908290 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:31:51.908244 2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="8ce5162d-f1da-4b72-9cd0-dbdf6e331f9c" containerName="kserve-container" Sep 05 02:31:51.910940 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:31:51.910923 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/model-chainer-raw-e3535-66db6d66bd-2f6xn" Sep 05 02:31:51.913786 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:31:51.913749 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"model-chainer-raw-e3535-kube-rbac-proxy-sar-config\"" Sep 05 02:31:51.913786 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:31:51.913767 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"openshift-service-ca.crt\"" Sep 05 02:31:51.914002 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:31:51.913755 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"model-chainer-raw-e3535-serving-cert\"" Sep 05 02:31:51.914002 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:31:51.913883 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"default-dockercfg-85bmm\"" Sep 05 02:31:51.922898 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:31:51.922867 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/model-chainer-raw-e3535-66db6d66bd-2f6xn"] Sep 05 02:31:51.988533 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:31:51.988502 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/80508e76-3303-4eb5-8828-1dfc98a40353-proxy-tls\") pod \"model-chainer-raw-e3535-66db6d66bd-2f6xn\" (UID: \"80508e76-3303-4eb5-8828-1dfc98a40353\") " pod="kserve-ci-e2e-test/model-chainer-raw-e3535-66db6d66bd-2f6xn" Sep 05 02:31:51.988678 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:31:51.988556 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/80508e76-3303-4eb5-8828-1dfc98a40353-openshift-service-ca-bundle\") pod \"model-chainer-raw-e3535-66db6d66bd-2f6xn\" (UID: \"80508e76-3303-4eb5-8828-1dfc98a40353\") " pod="kserve-ci-e2e-test/model-chainer-raw-e3535-66db6d66bd-2f6xn" Sep 05 02:31:52.089377 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:31:52.089346 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/80508e76-3303-4eb5-8828-1dfc98a40353-proxy-tls\") pod \"model-chainer-raw-e3535-66db6d66bd-2f6xn\" (UID: \"80508e76-3303-4eb5-8828-1dfc98a40353\") " pod="kserve-ci-e2e-test/model-chainer-raw-e3535-66db6d66bd-2f6xn" Sep 05 02:31:52.089563 ip-10-0-133-250 kubenswrapper[2555]: E0905 02:31:52.089490 2555 secret.go:189] Couldn't get secret kserve-ci-e2e-test/model-chainer-raw-e3535-serving-cert: secret "model-chainer-raw-e3535-serving-cert" not found Sep 05 02:31:52.089563 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:31:52.089527 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/80508e76-3303-4eb5-8828-1dfc98a40353-openshift-service-ca-bundle\") pod \"model-chainer-raw-e3535-66db6d66bd-2f6xn\" (UID: \"80508e76-3303-4eb5-8828-1dfc98a40353\") " pod="kserve-ci-e2e-test/model-chainer-raw-e3535-66db6d66bd-2f6xn" Sep 05 02:31:52.089563 ip-10-0-133-250 kubenswrapper[2555]: E0905 02:31:52.089561 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/80508e76-3303-4eb5-8828-1dfc98a40353-proxy-tls podName:80508e76-3303-4eb5-8828-1dfc98a40353 nodeName:}" failed. No retries permitted until 2026-09-05 02:31:52.589544961 +0000 UTC m=+839.091682541 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "proxy-tls" (UniqueName: "kubernetes.io/secret/80508e76-3303-4eb5-8828-1dfc98a40353-proxy-tls") pod "model-chainer-raw-e3535-66db6d66bd-2f6xn" (UID: "80508e76-3303-4eb5-8828-1dfc98a40353") : secret "model-chainer-raw-e3535-serving-cert" not found Sep 05 02:31:52.090222 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:31:52.090202 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/80508e76-3303-4eb5-8828-1dfc98a40353-openshift-service-ca-bundle\") pod \"model-chainer-raw-e3535-66db6d66bd-2f6xn\" (UID: \"80508e76-3303-4eb5-8828-1dfc98a40353\") " pod="kserve-ci-e2e-test/model-chainer-raw-e3535-66db6d66bd-2f6xn" Sep 05 02:31:52.593705 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:31:52.593665 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/80508e76-3303-4eb5-8828-1dfc98a40353-proxy-tls\") pod \"model-chainer-raw-e3535-66db6d66bd-2f6xn\" (UID: \"80508e76-3303-4eb5-8828-1dfc98a40353\") " pod="kserve-ci-e2e-test/model-chainer-raw-e3535-66db6d66bd-2f6xn" Sep 05 02:31:52.596038 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:31:52.596003 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/80508e76-3303-4eb5-8828-1dfc98a40353-proxy-tls\") pod \"model-chainer-raw-e3535-66db6d66bd-2f6xn\" (UID: \"80508e76-3303-4eb5-8828-1dfc98a40353\") " pod="kserve-ci-e2e-test/model-chainer-raw-e3535-66db6d66bd-2f6xn" Sep 05 02:31:52.822764 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:31:52.822735 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/model-chainer-raw-e3535-66db6d66bd-2f6xn" Sep 05 02:31:53.091071 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:31:53.091046 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/model-chainer-raw-e3535-66db6d66bd-2f6xn"] Sep 05 02:31:53.093176 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:31:53.093150 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod80508e76_3303_4eb5_8828_1dfc98a40353.slice/crio-7307e7d7f219c770abfbc0425a41f66a433956ca6f3d79e910f7769a976a44c3 WatchSource:0}: Error finding container 7307e7d7f219c770abfbc0425a41f66a433956ca6f3d79e910f7769a976a44c3: Status 404 returned error can't find the container with id 7307e7d7f219c770abfbc0425a41f66a433956ca6f3d79e910f7769a976a44c3 Sep 05 02:31:53.095468 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:31:53.095451 2555 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 05 02:31:53.753294 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:31:53.753255 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/model-chainer-raw-e3535-66db6d66bd-2f6xn" event={"ID":"80508e76-3303-4eb5-8828-1dfc98a40353","Type":"ContainerStarted","Data":"7307e7d7f219c770abfbc0425a41f66a433956ca6f3d79e910f7769a976a44c3"} Sep 05 02:31:55.763130 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:31:55.763091 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/model-chainer-raw-e3535-66db6d66bd-2f6xn" event={"ID":"80508e76-3303-4eb5-8828-1dfc98a40353","Type":"ContainerStarted","Data":"3384a6b498d46c8ade6b2ca11549ae71c4e92194ac339eec64d4b779e86dbef4"} Sep 05 02:31:55.763563 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:31:55.763194 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/model-chainer-raw-e3535-66db6d66bd-2f6xn" Sep 05 02:31:55.779956 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:31:55.779917 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/model-chainer-raw-e3535-66db6d66bd-2f6xn" podStartSLOduration=3.139141693 podStartE2EDuration="4.779903053s" totalImagesPullingTime="1.64076136s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-05 02:31:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-05 02:31:55.779115606 +0000 UTC m=+842.281253204" watchObservedRunningTime="2026-09-05 02:31:55.779903053 +0000 UTC m=+842.282040632" Sep 05 02:32:01.772693 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:32:01.772658 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/model-chainer-raw-e3535-66db6d66bd-2f6xn" Sep 05 02:32:01.949981 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:32:01.949946 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/model-chainer-raw-e3535-66db6d66bd-2f6xn"] Sep 05 02:32:01.950165 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:32:01.950144 2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/model-chainer-raw-e3535-66db6d66bd-2f6xn" podUID="80508e76-3303-4eb5-8828-1dfc98a40353" containerName="model-chainer-raw-e3535" containerID="cri-o://3384a6b498d46c8ade6b2ca11549ae71c4e92194ac339eec64d4b779e86dbef4" gracePeriod=30 Sep 05 02:32:02.287129 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:32:02.287090 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-bd0a0-predictor-94467dbb5-ks9c6"] Sep 05 02:32:02.291148 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:32:02.291130 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-bd0a0-predictor-94467dbb5-ks9c6" Sep 05 02:32:02.293710 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:32:02.293685 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-xgboost-graph-raw-hpa-bd0a0-predictor-serving-cert\"" Sep 05 02:32:02.293834 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:32:02.293709 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-xgboost-graph-raw-hpa-bd0a0-kube-rbac-proxy-sar-config\"" Sep 05 02:32:02.293834 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:32:02.293688 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"seaweedfs-s3-creds\"" Sep 05 02:32:02.293834 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:32:02.293782 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"odh-kserve-custom-ca-bundle\"" Sep 05 02:32:02.293834 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:32:02.293803 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"kube-root-ca.crt\"" Sep 05 02:32:02.298980 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:32:02.298959 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-bd0a0-predictor-94467dbb5-ks9c6"] Sep 05 02:32:02.372899 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:32:02.372864 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/c64fe915-a5c8-4c33-8563-427e62ff8aa7-proxy-tls\") pod \"isvc-xgboost-graph-raw-hpa-bd0a0-predictor-94467dbb5-ks9c6\" (UID: \"c64fe915-a5c8-4c33-8563-427e62ff8aa7\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-bd0a0-predictor-94467dbb5-ks9c6" Sep 05 02:32:02.373059 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:32:02.372910 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/c64fe915-a5c8-4c33-8563-427e62ff8aa7-kserve-provision-location\") pod \"isvc-xgboost-graph-raw-hpa-bd0a0-predictor-94467dbb5-ks9c6\" (UID: \"c64fe915-a5c8-4c33-8563-427e62ff8aa7\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-bd0a0-predictor-94467dbb5-ks9c6" Sep 05 02:32:02.373059 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:32:02.372949 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zbns7\" (UniqueName: \"kubernetes.io/projected/c64fe915-a5c8-4c33-8563-427e62ff8aa7-kube-api-access-zbns7\") pod \"isvc-xgboost-graph-raw-hpa-bd0a0-predictor-94467dbb5-ks9c6\" (UID: \"c64fe915-a5c8-4c33-8563-427e62ff8aa7\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-bd0a0-predictor-94467dbb5-ks9c6" Sep 05 02:32:02.373059 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:32:02.372991 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/c64fe915-a5c8-4c33-8563-427e62ff8aa7-kube-rbac-proxy-sar-config\") pod \"isvc-xgboost-graph-raw-hpa-bd0a0-predictor-94467dbb5-ks9c6\" (UID: \"c64fe915-a5c8-4c33-8563-427e62ff8aa7\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-bd0a0-predictor-94467dbb5-ks9c6" Sep 05 02:32:02.373168 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:32:02.373097 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/c64fe915-a5c8-4c33-8563-427e62ff8aa7-cabundle-cert\") pod \"isvc-xgboost-graph-raw-hpa-bd0a0-predictor-94467dbb5-ks9c6\" (UID: \"c64fe915-a5c8-4c33-8563-427e62ff8aa7\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-bd0a0-predictor-94467dbb5-ks9c6" Sep 05 02:32:02.474481 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:32:02.474446 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/c64fe915-a5c8-4c33-8563-427e62ff8aa7-proxy-tls\") pod \"isvc-xgboost-graph-raw-hpa-bd0a0-predictor-94467dbb5-ks9c6\" (UID: \"c64fe915-a5c8-4c33-8563-427e62ff8aa7\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-bd0a0-predictor-94467dbb5-ks9c6" Sep 05 02:32:02.474481 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:32:02.474481 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/c64fe915-a5c8-4c33-8563-427e62ff8aa7-kserve-provision-location\") pod \"isvc-xgboost-graph-raw-hpa-bd0a0-predictor-94467dbb5-ks9c6\" (UID: \"c64fe915-a5c8-4c33-8563-427e62ff8aa7\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-bd0a0-predictor-94467dbb5-ks9c6" Sep 05 02:32:02.474727 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:32:02.474498 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zbns7\" (UniqueName: \"kubernetes.io/projected/c64fe915-a5c8-4c33-8563-427e62ff8aa7-kube-api-access-zbns7\") pod \"isvc-xgboost-graph-raw-hpa-bd0a0-predictor-94467dbb5-ks9c6\" (UID: \"c64fe915-a5c8-4c33-8563-427e62ff8aa7\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-bd0a0-predictor-94467dbb5-ks9c6" Sep 05 02:32:02.474727 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:32:02.474559 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/c64fe915-a5c8-4c33-8563-427e62ff8aa7-kube-rbac-proxy-sar-config\") pod \"isvc-xgboost-graph-raw-hpa-bd0a0-predictor-94467dbb5-ks9c6\" (UID: \"c64fe915-a5c8-4c33-8563-427e62ff8aa7\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-bd0a0-predictor-94467dbb5-ks9c6" Sep 05 02:32:02.474727 ip-10-0-133-250 kubenswrapper[2555]: E0905 02:32:02.474587 2555 secret.go:189] Couldn't get secret kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-bd0a0-predictor-serving-cert: secret "isvc-xgboost-graph-raw-hpa-bd0a0-predictor-serving-cert" not found Sep 05 02:32:02.474727 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:32:02.474648 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/c64fe915-a5c8-4c33-8563-427e62ff8aa7-cabundle-cert\") pod \"isvc-xgboost-graph-raw-hpa-bd0a0-predictor-94467dbb5-ks9c6\" (UID: \"c64fe915-a5c8-4c33-8563-427e62ff8aa7\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-bd0a0-predictor-94467dbb5-ks9c6" Sep 05 02:32:02.474727 ip-10-0-133-250 kubenswrapper[2555]: E0905 02:32:02.474678 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c64fe915-a5c8-4c33-8563-427e62ff8aa7-proxy-tls podName:c64fe915-a5c8-4c33-8563-427e62ff8aa7 nodeName:}" failed. No retries permitted until 2026-09-05 02:32:02.974658088 +0000 UTC m=+849.476795678 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "proxy-tls" (UniqueName: "kubernetes.io/secret/c64fe915-a5c8-4c33-8563-427e62ff8aa7-proxy-tls") pod "isvc-xgboost-graph-raw-hpa-bd0a0-predictor-94467dbb5-ks9c6" (UID: "c64fe915-a5c8-4c33-8563-427e62ff8aa7") : secret "isvc-xgboost-graph-raw-hpa-bd0a0-predictor-serving-cert" not found Sep 05 02:32:02.475120 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:32:02.474982 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/c64fe915-a5c8-4c33-8563-427e62ff8aa7-kserve-provision-location\") pod \"isvc-xgboost-graph-raw-hpa-bd0a0-predictor-94467dbb5-ks9c6\" (UID: \"c64fe915-a5c8-4c33-8563-427e62ff8aa7\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-bd0a0-predictor-94467dbb5-ks9c6" Sep 05 02:32:02.475356 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:32:02.475335 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/c64fe915-a5c8-4c33-8563-427e62ff8aa7-cabundle-cert\") pod \"isvc-xgboost-graph-raw-hpa-bd0a0-predictor-94467dbb5-ks9c6\" (UID: \"c64fe915-a5c8-4c33-8563-427e62ff8aa7\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-bd0a0-predictor-94467dbb5-ks9c6" Sep 05 02:32:02.475426 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:32:02.475402 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/c64fe915-a5c8-4c33-8563-427e62ff8aa7-kube-rbac-proxy-sar-config\") pod \"isvc-xgboost-graph-raw-hpa-bd0a0-predictor-94467dbb5-ks9c6\" (UID: \"c64fe915-a5c8-4c33-8563-427e62ff8aa7\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-bd0a0-predictor-94467dbb5-ks9c6" Sep 05 02:32:02.483181 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:32:02.483156 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zbns7\" (UniqueName: \"kubernetes.io/projected/c64fe915-a5c8-4c33-8563-427e62ff8aa7-kube-api-access-zbns7\") pod \"isvc-xgboost-graph-raw-hpa-bd0a0-predictor-94467dbb5-ks9c6\" (UID: \"c64fe915-a5c8-4c33-8563-427e62ff8aa7\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-bd0a0-predictor-94467dbb5-ks9c6" Sep 05 02:32:02.980128 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:32:02.980092 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/c64fe915-a5c8-4c33-8563-427e62ff8aa7-proxy-tls\") pod \"isvc-xgboost-graph-raw-hpa-bd0a0-predictor-94467dbb5-ks9c6\" (UID: \"c64fe915-a5c8-4c33-8563-427e62ff8aa7\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-bd0a0-predictor-94467dbb5-ks9c6" Sep 05 02:32:02.982500 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:32:02.982480 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/c64fe915-a5c8-4c33-8563-427e62ff8aa7-proxy-tls\") pod \"isvc-xgboost-graph-raw-hpa-bd0a0-predictor-94467dbb5-ks9c6\" (UID: \"c64fe915-a5c8-4c33-8563-427e62ff8aa7\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-bd0a0-predictor-94467dbb5-ks9c6" Sep 05 02:32:03.202131 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:32:03.202095 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-bd0a0-predictor-94467dbb5-ks9c6" Sep 05 02:32:03.474716 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:32:03.474690 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-bd0a0-predictor-94467dbb5-ks9c6"] Sep 05 02:32:03.477646 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:32:03.477615 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc64fe915_a5c8_4c33_8563_427e62ff8aa7.slice/crio-9760ad08bc244bfa31858f7a180c127cf1eee020f525d3c7d9e2d53a719b5e19 WatchSource:0}: Error finding container 9760ad08bc244bfa31858f7a180c127cf1eee020f525d3c7d9e2d53a719b5e19: Status 404 returned error can't find the container with id 9760ad08bc244bfa31858f7a180c127cf1eee020f525d3c7d9e2d53a719b5e19 Sep 05 02:32:03.799443 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:32:03.799360 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-bd0a0-predictor-94467dbb5-ks9c6" event={"ID":"c64fe915-a5c8-4c33-8563-427e62ff8aa7","Type":"ContainerStarted","Data":"94f11a8375e29ab59de5cd4c454c7382adc3b9f11236848772be90c98af91b34"} Sep 05 02:32:03.799443 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:32:03.799416 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-bd0a0-predictor-94467dbb5-ks9c6" event={"ID":"c64fe915-a5c8-4c33-8563-427e62ff8aa7","Type":"ContainerStarted","Data":"9760ad08bc244bfa31858f7a180c127cf1eee020f525d3c7d9e2d53a719b5e19"} Sep 05 02:32:06.770961 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:32:06.770921 2555 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-raw-e3535-66db6d66bd-2f6xn" podUID="80508e76-3303-4eb5-8828-1dfc98a40353" containerName="model-chainer-raw-e3535" probeResult="failure" output="HTTP probe failed with statuscode: 503" Sep 05 02:32:07.817543 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:32:07.817509 2555 generic.go:356] "Generic (PLEG): container finished" podID="c64fe915-a5c8-4c33-8563-427e62ff8aa7" containerID="94f11a8375e29ab59de5cd4c454c7382adc3b9f11236848772be90c98af91b34" exitCode=0 Sep 05 02:32:07.817900 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:32:07.817564 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-bd0a0-predictor-94467dbb5-ks9c6" event={"ID":"c64fe915-a5c8-4c33-8563-427e62ff8aa7","Type":"ContainerDied","Data":"94f11a8375e29ab59de5cd4c454c7382adc3b9f11236848772be90c98af91b34"} Sep 05 02:32:11.771599 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:32:11.771556 2555 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-raw-e3535-66db6d66bd-2f6xn" podUID="80508e76-3303-4eb5-8828-1dfc98a40353" containerName="model-chainer-raw-e3535" probeResult="failure" output="HTTP probe failed with statuscode: 503" Sep 05 02:32:16.772208 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:32:16.772165 2555 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-raw-e3535-66db6d66bd-2f6xn" podUID="80508e76-3303-4eb5-8828-1dfc98a40353" containerName="model-chainer-raw-e3535" probeResult="failure" output="HTTP probe failed with statuscode: 503" Sep 05 02:32:16.772652 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:32:16.772379 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/model-chainer-raw-e3535-66db6d66bd-2f6xn" Sep 05 02:32:21.772005 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:32:21.771963 2555 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-raw-e3535-66db6d66bd-2f6xn" podUID="80508e76-3303-4eb5-8828-1dfc98a40353" containerName="model-chainer-raw-e3535" probeResult="failure" output="HTTP probe failed with statuscode: 503" Sep 05 02:32:26.771450 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:32:26.771362 2555 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-raw-e3535-66db6d66bd-2f6xn" podUID="80508e76-3303-4eb5-8828-1dfc98a40353" containerName="model-chainer-raw-e3535" probeResult="failure" output="HTTP probe failed with statuscode: 503" Sep 05 02:32:26.913295 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:32:26.913257 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-bd0a0-predictor-94467dbb5-ks9c6" event={"ID":"c64fe915-a5c8-4c33-8563-427e62ff8aa7","Type":"ContainerStarted","Data":"261e752700e7dd294e5f46364707ec7e6bffc229f49a0e539df47e4b2da7bcf1"} Sep 05 02:32:26.913441 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:32:26.913354 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-bd0a0-predictor-94467dbb5-ks9c6" event={"ID":"c64fe915-a5c8-4c33-8563-427e62ff8aa7","Type":"ContainerStarted","Data":"bf2bdaf15b35dae9f350d1bc6dc1e7d138c56a2dcfd0ed6ac5b53a2af7b65670"} Sep 05 02:32:26.913589 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:32:26.913560 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-bd0a0-predictor-94467dbb5-ks9c6" Sep 05 02:32:26.934382 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:32:26.934339 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-bd0a0-predictor-94467dbb5-ks9c6" podStartSLOduration=2.1365818340000002 podStartE2EDuration="24.934323519s" totalImagesPullingTime="18.680809192s" totalInitContainerRuntime="4.116932493s" isStatefulPod=false podCreationTimestamp="2026-09-05 02:32:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-05 02:32:26.932188567 +0000 UTC m=+873.434326164" watchObservedRunningTime="2026-09-05 02:32:26.934323519 +0000 UTC m=+873.436461182" Sep 05 02:32:27.917599 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:32:27.917568 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-bd0a0-predictor-94467dbb5-ks9c6" Sep 05 02:32:27.918882 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:32:27.918854 2555 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-bd0a0-predictor-94467dbb5-ks9c6" podUID="c64fe915-a5c8-4c33-8563-427e62ff8aa7" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.25:8080: connect: connection refused" Sep 05 02:32:28.922457 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:32:28.922413 2555 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-bd0a0-predictor-94467dbb5-ks9c6" podUID="c64fe915-a5c8-4c33-8563-427e62ff8aa7" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.25:8080: connect: connection refused" Sep 05 02:32:31.771939 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:32:31.771896 2555 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-raw-e3535-66db6d66bd-2f6xn" podUID="80508e76-3303-4eb5-8828-1dfc98a40353" containerName="model-chainer-raw-e3535" probeResult="failure" output="HTTP probe failed with statuscode: 503" Sep 05 02:32:32.615876 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:32:32.615848 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/model-chainer-raw-e3535-66db6d66bd-2f6xn" Sep 05 02:32:32.760349 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:32:32.760315 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/80508e76-3303-4eb5-8828-1dfc98a40353-proxy-tls\") pod \"80508e76-3303-4eb5-8828-1dfc98a40353\" (UID: \"80508e76-3303-4eb5-8828-1dfc98a40353\") " Sep 05 02:32:32.760518 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:32:32.760414 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/80508e76-3303-4eb5-8828-1dfc98a40353-openshift-service-ca-bundle\") pod \"80508e76-3303-4eb5-8828-1dfc98a40353\" (UID: \"80508e76-3303-4eb5-8828-1dfc98a40353\") " Sep 05 02:32:32.760772 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:32:32.760747 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/80508e76-3303-4eb5-8828-1dfc98a40353-openshift-service-ca-bundle" (OuterVolumeSpecName: "openshift-service-ca-bundle") pod "80508e76-3303-4eb5-8828-1dfc98a40353" (UID: "80508e76-3303-4eb5-8828-1dfc98a40353"). InnerVolumeSpecName "openshift-service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 05 02:32:32.762308 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:32:32.762283 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/80508e76-3303-4eb5-8828-1dfc98a40353-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "80508e76-3303-4eb5-8828-1dfc98a40353" (UID: "80508e76-3303-4eb5-8828-1dfc98a40353"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 05 02:32:32.861326 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:32:32.861261 2555 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/80508e76-3303-4eb5-8828-1dfc98a40353-openshift-service-ca-bundle\") on node \"ip-10-0-133-250.ec2.internal\" DevicePath \"\"" Sep 05 02:32:32.861326 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:32:32.861286 2555 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/80508e76-3303-4eb5-8828-1dfc98a40353-proxy-tls\") on node \"ip-10-0-133-250.ec2.internal\" DevicePath \"\"" Sep 05 02:32:32.940504 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:32:32.940473 2555 generic.go:356] "Generic (PLEG): container finished" podID="80508e76-3303-4eb5-8828-1dfc98a40353" containerID="3384a6b498d46c8ade6b2ca11549ae71c4e92194ac339eec64d4b779e86dbef4" exitCode=0 Sep 05 02:32:32.940681 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:32:32.940526 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/model-chainer-raw-e3535-66db6d66bd-2f6xn" Sep 05 02:32:32.940681 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:32:32.940564 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/model-chainer-raw-e3535-66db6d66bd-2f6xn" event={"ID":"80508e76-3303-4eb5-8828-1dfc98a40353","Type":"ContainerDied","Data":"3384a6b498d46c8ade6b2ca11549ae71c4e92194ac339eec64d4b779e86dbef4"} Sep 05 02:32:32.940681 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:32:32.940620 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/model-chainer-raw-e3535-66db6d66bd-2f6xn" event={"ID":"80508e76-3303-4eb5-8828-1dfc98a40353","Type":"ContainerDied","Data":"7307e7d7f219c770abfbc0425a41f66a433956ca6f3d79e910f7769a976a44c3"} Sep 05 02:32:32.940681 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:32:32.940643 2555 scope.go:117] "RemoveContainer" containerID="3384a6b498d46c8ade6b2ca11549ae71c4e92194ac339eec64d4b779e86dbef4" Sep 05 02:32:32.954811 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:32:32.954611 2555 scope.go:117] "RemoveContainer" containerID="3384a6b498d46c8ade6b2ca11549ae71c4e92194ac339eec64d4b779e86dbef4" Sep 05 02:32:32.955054 ip-10-0-133-250 kubenswrapper[2555]: E0905 02:32:32.954953 2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3384a6b498d46c8ade6b2ca11549ae71c4e92194ac339eec64d4b779e86dbef4\": container with ID starting with 3384a6b498d46c8ade6b2ca11549ae71c4e92194ac339eec64d4b779e86dbef4 not found: ID does not exist" containerID="3384a6b498d46c8ade6b2ca11549ae71c4e92194ac339eec64d4b779e86dbef4" Sep 05 02:32:32.955054 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:32:32.954985 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3384a6b498d46c8ade6b2ca11549ae71c4e92194ac339eec64d4b779e86dbef4"} err="failed to get container status \"3384a6b498d46c8ade6b2ca11549ae71c4e92194ac339eec64d4b779e86dbef4\": rpc error: code = NotFound desc = could not find container \"3384a6b498d46c8ade6b2ca11549ae71c4e92194ac339eec64d4b779e86dbef4\": container with ID starting with 3384a6b498d46c8ade6b2ca11549ae71c4e92194ac339eec64d4b779e86dbef4 not found: ID does not exist" Sep 05 02:32:32.968298 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:32:32.968273 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/model-chainer-raw-e3535-66db6d66bd-2f6xn"] Sep 05 02:32:32.972497 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:32:32.972474 2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/model-chainer-raw-e3535-66db6d66bd-2f6xn"] Sep 05 02:32:33.926504 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:32:33.926477 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-bd0a0-predictor-94467dbb5-ks9c6" Sep 05 02:32:33.927181 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:32:33.927152 2555 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-bd0a0-predictor-94467dbb5-ks9c6" podUID="c64fe915-a5c8-4c33-8563-427e62ff8aa7" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.25:8080: connect: connection refused" Sep 05 02:32:34.082718 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:32:34.082687 2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="80508e76-3303-4eb5-8828-1dfc98a40353" path="/var/lib/kubelet/pods/80508e76-3303-4eb5-8828-1dfc98a40353/volumes" Sep 05 02:32:43.927406 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:32:43.927362 2555 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-bd0a0-predictor-94467dbb5-ks9c6" podUID="c64fe915-a5c8-4c33-8563-427e62ff8aa7" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.25:8080: connect: connection refused" Sep 05 02:32:53.927715 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:32:53.927632 2555 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-bd0a0-predictor-94467dbb5-ks9c6" podUID="c64fe915-a5c8-4c33-8563-427e62ff8aa7" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.25:8080: connect: connection refused" Sep 05 02:32:54.023995 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:32:54.023964 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-k2cdf_2ab9a760-ef7b-48dc-acbe-2694be7274e0/console-operator/1.log" Sep 05 02:32:54.025223 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:32:54.025197 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-k2cdf_2ab9a760-ef7b-48dc-acbe-2694be7274e0/console-operator/1.log" Sep 05 02:33:03.927177 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:33:03.927139 2555 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-bd0a0-predictor-94467dbb5-ks9c6" podUID="c64fe915-a5c8-4c33-8563-427e62ff8aa7" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.25:8080: connect: connection refused" Sep 05 02:33:13.927448 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:33:13.927406 2555 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-bd0a0-predictor-94467dbb5-ks9c6" podUID="c64fe915-a5c8-4c33-8563-427e62ff8aa7" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.25:8080: connect: connection refused" Sep 05 02:33:23.927316 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:33:23.927273 2555 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-bd0a0-predictor-94467dbb5-ks9c6" podUID="c64fe915-a5c8-4c33-8563-427e62ff8aa7" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.25:8080: connect: connection refused" Sep 05 02:33:33.928335 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:33:33.928304 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-bd0a0-predictor-94467dbb5-ks9c6" Sep 05 02:33:42.177444 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:33:42.177411 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/model-chainer-raw-hpa-bd0a0-57bc6b4ffd-sqwsx"] Sep 05 02:33:42.177832 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:33:42.177745 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="80508e76-3303-4eb5-8828-1dfc98a40353" containerName="model-chainer-raw-e3535" Sep 05 02:33:42.177832 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:33:42.177756 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="80508e76-3303-4eb5-8828-1dfc98a40353" containerName="model-chainer-raw-e3535" Sep 05 02:33:42.177832 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:33:42.177814 2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="80508e76-3303-4eb5-8828-1dfc98a40353" containerName="model-chainer-raw-e3535" Sep 05 02:33:42.180460 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:33:42.180443 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-bd0a0-57bc6b4ffd-sqwsx" Sep 05 02:33:42.182740 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:33:42.182714 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"model-chainer-raw-hpa-bd0a0-kube-rbac-proxy-sar-config\"" Sep 05 02:33:42.182854 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:33:42.182720 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"model-chainer-raw-hpa-bd0a0-serving-cert\"" Sep 05 02:33:42.191225 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:33:42.191204 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/model-chainer-raw-hpa-bd0a0-57bc6b4ffd-sqwsx"] Sep 05 02:33:42.255483 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:33:42.255455 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/03e0804f-c1c6-46d6-a72c-d0a12d681ff0-openshift-service-ca-bundle\") pod \"model-chainer-raw-hpa-bd0a0-57bc6b4ffd-sqwsx\" (UID: \"03e0804f-c1c6-46d6-a72c-d0a12d681ff0\") " pod="kserve-ci-e2e-test/model-chainer-raw-hpa-bd0a0-57bc6b4ffd-sqwsx" Sep 05 02:33:42.255655 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:33:42.255523 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/03e0804f-c1c6-46d6-a72c-d0a12d681ff0-proxy-tls\") pod \"model-chainer-raw-hpa-bd0a0-57bc6b4ffd-sqwsx\" (UID: \"03e0804f-c1c6-46d6-a72c-d0a12d681ff0\") " pod="kserve-ci-e2e-test/model-chainer-raw-hpa-bd0a0-57bc6b4ffd-sqwsx" Sep 05 02:33:42.356895 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:33:42.356859 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/03e0804f-c1c6-46d6-a72c-d0a12d681ff0-openshift-service-ca-bundle\") pod \"model-chainer-raw-hpa-bd0a0-57bc6b4ffd-sqwsx\" (UID: \"03e0804f-c1c6-46d6-a72c-d0a12d681ff0\") " pod="kserve-ci-e2e-test/model-chainer-raw-hpa-bd0a0-57bc6b4ffd-sqwsx" Sep 05 02:33:42.357096 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:33:42.356915 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/03e0804f-c1c6-46d6-a72c-d0a12d681ff0-proxy-tls\") pod \"model-chainer-raw-hpa-bd0a0-57bc6b4ffd-sqwsx\" (UID: \"03e0804f-c1c6-46d6-a72c-d0a12d681ff0\") " pod="kserve-ci-e2e-test/model-chainer-raw-hpa-bd0a0-57bc6b4ffd-sqwsx" Sep 05 02:33:42.357096 ip-10-0-133-250 kubenswrapper[2555]: E0905 02:33:42.357039 2555 secret.go:189] Couldn't get secret kserve-ci-e2e-test/model-chainer-raw-hpa-bd0a0-serving-cert: secret "model-chainer-raw-hpa-bd0a0-serving-cert" not found Sep 05 02:33:42.357096 ip-10-0-133-250 kubenswrapper[2555]: E0905 02:33:42.357097 2555 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/03e0804f-c1c6-46d6-a72c-d0a12d681ff0-proxy-tls podName:03e0804f-c1c6-46d6-a72c-d0a12d681ff0 nodeName:}" failed. No retries permitted until 2026-09-05 02:33:42.857078351 +0000 UTC m=+949.359215943 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "proxy-tls" (UniqueName: "kubernetes.io/secret/03e0804f-c1c6-46d6-a72c-d0a12d681ff0-proxy-tls") pod "model-chainer-raw-hpa-bd0a0-57bc6b4ffd-sqwsx" (UID: "03e0804f-c1c6-46d6-a72c-d0a12d681ff0") : secret "model-chainer-raw-hpa-bd0a0-serving-cert" not found Sep 05 02:33:42.357497 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:33:42.357476 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/03e0804f-c1c6-46d6-a72c-d0a12d681ff0-openshift-service-ca-bundle\") pod \"model-chainer-raw-hpa-bd0a0-57bc6b4ffd-sqwsx\" (UID: \"03e0804f-c1c6-46d6-a72c-d0a12d681ff0\") " pod="kserve-ci-e2e-test/model-chainer-raw-hpa-bd0a0-57bc6b4ffd-sqwsx" Sep 05 02:33:42.860724 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:33:42.860686 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/03e0804f-c1c6-46d6-a72c-d0a12d681ff0-proxy-tls\") pod \"model-chainer-raw-hpa-bd0a0-57bc6b4ffd-sqwsx\" (UID: \"03e0804f-c1c6-46d6-a72c-d0a12d681ff0\") " pod="kserve-ci-e2e-test/model-chainer-raw-hpa-bd0a0-57bc6b4ffd-sqwsx" Sep 05 02:33:42.863092 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:33:42.863071 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/03e0804f-c1c6-46d6-a72c-d0a12d681ff0-proxy-tls\") pod \"model-chainer-raw-hpa-bd0a0-57bc6b4ffd-sqwsx\" (UID: \"03e0804f-c1c6-46d6-a72c-d0a12d681ff0\") " pod="kserve-ci-e2e-test/model-chainer-raw-hpa-bd0a0-57bc6b4ffd-sqwsx" Sep 05 02:33:43.091521 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:33:43.091474 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-bd0a0-57bc6b4ffd-sqwsx" Sep 05 02:33:43.360448 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:33:43.360406 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/model-chainer-raw-hpa-bd0a0-57bc6b4ffd-sqwsx"] Sep 05 02:33:43.362604 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:33:43.362579 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod03e0804f_c1c6_46d6_a72c_d0a12d681ff0.slice/crio-0d23f356b872e91f088cb765685b4d40f4fd182d9dc6e854552551feb6466c0e WatchSource:0}: Error finding container 0d23f356b872e91f088cb765685b4d40f4fd182d9dc6e854552551feb6466c0e: Status 404 returned error can't find the container with id 0d23f356b872e91f088cb765685b4d40f4fd182d9dc6e854552551feb6466c0e Sep 05 02:33:44.227620 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:33:44.227587 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-bd0a0-57bc6b4ffd-sqwsx" event={"ID":"03e0804f-c1c6-46d6-a72c-d0a12d681ff0","Type":"ContainerStarted","Data":"b2f9b5b81bf2da6d71884e8323387966908a56cd38428a1fd658947d8c7c0cb1"} Sep 05 02:33:44.227965 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:33:44.227639 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-bd0a0-57bc6b4ffd-sqwsx" event={"ID":"03e0804f-c1c6-46d6-a72c-d0a12d681ff0","Type":"ContainerStarted","Data":"0d23f356b872e91f088cb765685b4d40f4fd182d9dc6e854552551feb6466c0e"} Sep 05 02:33:44.227965 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:33:44.227689 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-bd0a0-57bc6b4ffd-sqwsx" Sep 05 02:33:44.243586 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:33:44.243535 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-bd0a0-57bc6b4ffd-sqwsx" podStartSLOduration=2.243522128 podStartE2EDuration="2.243522128s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-05 02:33:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-05 02:33:44.243134963 +0000 UTC m=+950.745272561" watchObservedRunningTime="2026-09-05 02:33:44.243522128 +0000 UTC m=+950.745659757" Sep 05 02:33:50.237824 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:33:50.237798 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-bd0a0-57bc6b4ffd-sqwsx" Sep 05 02:33:52.235014 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:33:52.234981 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/model-chainer-raw-hpa-bd0a0-57bc6b4ffd-sqwsx"] Sep 05 02:33:52.235445 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:33:52.235177 2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-bd0a0-57bc6b4ffd-sqwsx" podUID="03e0804f-c1c6-46d6-a72c-d0a12d681ff0" containerName="model-chainer-raw-hpa-bd0a0" containerID="cri-o://b2f9b5b81bf2da6d71884e8323387966908a56cd38428a1fd658947d8c7c0cb1" gracePeriod=30 Sep 05 02:33:52.413933 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:33:52.413899 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-bd0a0-predictor-94467dbb5-ks9c6"] Sep 05 02:33:52.414226 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:33:52.414201 2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-bd0a0-predictor-94467dbb5-ks9c6" podUID="c64fe915-a5c8-4c33-8563-427e62ff8aa7" containerName="kserve-container" containerID="cri-o://bf2bdaf15b35dae9f350d1bc6dc1e7d138c56a2dcfd0ed6ac5b53a2af7b65670" gracePeriod=30 Sep 05 02:33:52.414311 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:33:52.414236 2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-bd0a0-predictor-94467dbb5-ks9c6" podUID="c64fe915-a5c8-4c33-8563-427e62ff8aa7" containerName="kube-rbac-proxy" containerID="cri-o://261e752700e7dd294e5f46364707ec7e6bffc229f49a0e539df47e4b2da7bcf1" gracePeriod=30 Sep 05 02:33:53.266298 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:33:53.266269 2555 generic.go:356] "Generic (PLEG): container finished" podID="c64fe915-a5c8-4c33-8563-427e62ff8aa7" containerID="261e752700e7dd294e5f46364707ec7e6bffc229f49a0e539df47e4b2da7bcf1" exitCode=2 Sep 05 02:33:53.266669 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:33:53.266338 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-bd0a0-predictor-94467dbb5-ks9c6" event={"ID":"c64fe915-a5c8-4c33-8563-427e62ff8aa7","Type":"ContainerDied","Data":"261e752700e7dd294e5f46364707ec7e6bffc229f49a0e539df47e4b2da7bcf1"} Sep 05 02:33:53.922758 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:33:53.922721 2555 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-bd0a0-predictor-94467dbb5-ks9c6" podUID="c64fe915-a5c8-4c33-8563-427e62ff8aa7" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.134.0.25:8643/healthz\": dial tcp 10.134.0.25:8643: connect: connection refused" Sep 05 02:33:53.927071 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:33:53.927042 2555 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-bd0a0-predictor-94467dbb5-ks9c6" podUID="c64fe915-a5c8-4c33-8563-427e62ff8aa7" containerName="kserve-container" probeResult="failure" output="dial tcp 10.134.0.25:8080: connect: connection refused" Sep 05 02:33:55.235860 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:33:55.235824 2555 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-bd0a0-57bc6b4ffd-sqwsx" podUID="03e0804f-c1c6-46d6-a72c-d0a12d681ff0" containerName="model-chainer-raw-hpa-bd0a0" probeResult="failure" output="HTTP probe failed with statuscode: 503" Sep 05 02:33:55.964614 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:33:55.964592 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-bd0a0-predictor-94467dbb5-ks9c6" Sep 05 02:33:56.073350 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:33:56.073268 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/c64fe915-a5c8-4c33-8563-427e62ff8aa7-kube-rbac-proxy-sar-config\") pod \"c64fe915-a5c8-4c33-8563-427e62ff8aa7\" (UID: \"c64fe915-a5c8-4c33-8563-427e62ff8aa7\") " Sep 05 02:33:56.073350 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:33:56.073314 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/c64fe915-a5c8-4c33-8563-427e62ff8aa7-kserve-provision-location\") pod \"c64fe915-a5c8-4c33-8563-427e62ff8aa7\" (UID: \"c64fe915-a5c8-4c33-8563-427e62ff8aa7\") " Sep 05 02:33:56.073521 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:33:56.073358 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/c64fe915-a5c8-4c33-8563-427e62ff8aa7-proxy-tls\") pod \"c64fe915-a5c8-4c33-8563-427e62ff8aa7\" (UID: \"c64fe915-a5c8-4c33-8563-427e62ff8aa7\") " Sep 05 02:33:56.073521 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:33:56.073453 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/c64fe915-a5c8-4c33-8563-427e62ff8aa7-cabundle-cert\") pod \"c64fe915-a5c8-4c33-8563-427e62ff8aa7\" (UID: \"c64fe915-a5c8-4c33-8563-427e62ff8aa7\") " Sep 05 02:33:56.073607 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:33:56.073587 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zbns7\" (UniqueName: \"kubernetes.io/projected/c64fe915-a5c8-4c33-8563-427e62ff8aa7-kube-api-access-zbns7\") pod \"c64fe915-a5c8-4c33-8563-427e62ff8aa7\" (UID: \"c64fe915-a5c8-4c33-8563-427e62ff8aa7\") " Sep 05 02:33:56.073730 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:33:56.073708 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c64fe915-a5c8-4c33-8563-427e62ff8aa7-kserve-provision-location" (OuterVolumeSpecName: "kserve-provision-location") pod "c64fe915-a5c8-4c33-8563-427e62ff8aa7" (UID: "c64fe915-a5c8-4c33-8563-427e62ff8aa7"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 05 02:33:56.073805 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:33:56.073742 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c64fe915-a5c8-4c33-8563-427e62ff8aa7-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "c64fe915-a5c8-4c33-8563-427e62ff8aa7" (UID: "c64fe915-a5c8-4c33-8563-427e62ff8aa7"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 05 02:33:56.073805 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:33:56.073792 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c64fe915-a5c8-4c33-8563-427e62ff8aa7-cabundle-cert" (OuterVolumeSpecName: "cabundle-cert") pod "c64fe915-a5c8-4c33-8563-427e62ff8aa7" (UID: "c64fe915-a5c8-4c33-8563-427e62ff8aa7"). InnerVolumeSpecName "cabundle-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 05 02:33:56.073918 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:33:56.073860 2555 reconciler_common.go:299] "Volume detached for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/c64fe915-a5c8-4c33-8563-427e62ff8aa7-cabundle-cert\") on node \"ip-10-0-133-250.ec2.internal\" DevicePath \"\"" Sep 05 02:33:56.073918 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:33:56.073878 2555 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/c64fe915-a5c8-4c33-8563-427e62ff8aa7-kube-rbac-proxy-sar-config\") on node \"ip-10-0-133-250.ec2.internal\" DevicePath \"\"" Sep 05 02:33:56.073918 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:33:56.073888 2555 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/c64fe915-a5c8-4c33-8563-427e62ff8aa7-kserve-provision-location\") on node \"ip-10-0-133-250.ec2.internal\" DevicePath \"\"" Sep 05 02:33:56.075420 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:33:56.075399 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c64fe915-a5c8-4c33-8563-427e62ff8aa7-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "c64fe915-a5c8-4c33-8563-427e62ff8aa7" (UID: "c64fe915-a5c8-4c33-8563-427e62ff8aa7"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 05 02:33:56.075515 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:33:56.075496 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c64fe915-a5c8-4c33-8563-427e62ff8aa7-kube-api-access-zbns7" (OuterVolumeSpecName: "kube-api-access-zbns7") pod "c64fe915-a5c8-4c33-8563-427e62ff8aa7" (UID: "c64fe915-a5c8-4c33-8563-427e62ff8aa7"). InnerVolumeSpecName "kube-api-access-zbns7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 05 02:33:56.174844 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:33:56.174816 2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zbns7\" (UniqueName: \"kubernetes.io/projected/c64fe915-a5c8-4c33-8563-427e62ff8aa7-kube-api-access-zbns7\") on node \"ip-10-0-133-250.ec2.internal\" DevicePath \"\"" Sep 05 02:33:56.174844 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:33:56.174843 2555 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/c64fe915-a5c8-4c33-8563-427e62ff8aa7-proxy-tls\") on node \"ip-10-0-133-250.ec2.internal\" DevicePath \"\"" Sep 05 02:33:56.280791 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:33:56.280759 2555 generic.go:356] "Generic (PLEG): container finished" podID="c64fe915-a5c8-4c33-8563-427e62ff8aa7" containerID="bf2bdaf15b35dae9f350d1bc6dc1e7d138c56a2dcfd0ed6ac5b53a2af7b65670" exitCode=0 Sep 05 02:33:56.281185 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:33:56.280825 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-bd0a0-predictor-94467dbb5-ks9c6" Sep 05 02:33:56.281185 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:33:56.280836 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-bd0a0-predictor-94467dbb5-ks9c6" event={"ID":"c64fe915-a5c8-4c33-8563-427e62ff8aa7","Type":"ContainerDied","Data":"bf2bdaf15b35dae9f350d1bc6dc1e7d138c56a2dcfd0ed6ac5b53a2af7b65670"} Sep 05 02:33:56.281185 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:33:56.280902 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-bd0a0-predictor-94467dbb5-ks9c6" event={"ID":"c64fe915-a5c8-4c33-8563-427e62ff8aa7","Type":"ContainerDied","Data":"9760ad08bc244bfa31858f7a180c127cf1eee020f525d3c7d9e2d53a719b5e19"} Sep 05 02:33:56.281185 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:33:56.280933 2555 scope.go:117] "RemoveContainer" containerID="261e752700e7dd294e5f46364707ec7e6bffc229f49a0e539df47e4b2da7bcf1" Sep 05 02:33:56.289296 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:33:56.289278 2555 scope.go:117] "RemoveContainer" containerID="bf2bdaf15b35dae9f350d1bc6dc1e7d138c56a2dcfd0ed6ac5b53a2af7b65670" Sep 05 02:33:56.296727 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:33:56.296706 2555 scope.go:117] "RemoveContainer" containerID="94f11a8375e29ab59de5cd4c454c7382adc3b9f11236848772be90c98af91b34" Sep 05 02:33:56.297614 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:33:56.297591 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-bd0a0-predictor-94467dbb5-ks9c6"] Sep 05 02:33:56.301448 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:33:56.301428 2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/isvc-xgboost-graph-raw-hpa-bd0a0-predictor-94467dbb5-ks9c6"] Sep 05 02:33:56.304216 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:33:56.304203 2555 scope.go:117] "RemoveContainer" containerID="261e752700e7dd294e5f46364707ec7e6bffc229f49a0e539df47e4b2da7bcf1" Sep 05 02:33:56.304497 ip-10-0-133-250 kubenswrapper[2555]: E0905 02:33:56.304476 2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"261e752700e7dd294e5f46364707ec7e6bffc229f49a0e539df47e4b2da7bcf1\": container with ID starting with 261e752700e7dd294e5f46364707ec7e6bffc229f49a0e539df47e4b2da7bcf1 not found: ID does not exist" containerID="261e752700e7dd294e5f46364707ec7e6bffc229f49a0e539df47e4b2da7bcf1" Sep 05 02:33:56.304578 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:33:56.304502 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"261e752700e7dd294e5f46364707ec7e6bffc229f49a0e539df47e4b2da7bcf1"} err="failed to get container status \"261e752700e7dd294e5f46364707ec7e6bffc229f49a0e539df47e4b2da7bcf1\": rpc error: code = NotFound desc = could not find container \"261e752700e7dd294e5f46364707ec7e6bffc229f49a0e539df47e4b2da7bcf1\": container with ID starting with 261e752700e7dd294e5f46364707ec7e6bffc229f49a0e539df47e4b2da7bcf1 not found: ID does not exist" Sep 05 02:33:56.304578 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:33:56.304518 2555 scope.go:117] "RemoveContainer" containerID="bf2bdaf15b35dae9f350d1bc6dc1e7d138c56a2dcfd0ed6ac5b53a2af7b65670" Sep 05 02:33:56.304811 ip-10-0-133-250 kubenswrapper[2555]: E0905 02:33:56.304793 2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bf2bdaf15b35dae9f350d1bc6dc1e7d138c56a2dcfd0ed6ac5b53a2af7b65670\": container with ID starting with bf2bdaf15b35dae9f350d1bc6dc1e7d138c56a2dcfd0ed6ac5b53a2af7b65670 not found: ID does not exist" containerID="bf2bdaf15b35dae9f350d1bc6dc1e7d138c56a2dcfd0ed6ac5b53a2af7b65670" Sep 05 02:33:56.304872 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:33:56.304816 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bf2bdaf15b35dae9f350d1bc6dc1e7d138c56a2dcfd0ed6ac5b53a2af7b65670"} err="failed to get container status \"bf2bdaf15b35dae9f350d1bc6dc1e7d138c56a2dcfd0ed6ac5b53a2af7b65670\": rpc error: code = NotFound desc = could not find container \"bf2bdaf15b35dae9f350d1bc6dc1e7d138c56a2dcfd0ed6ac5b53a2af7b65670\": container with ID starting with bf2bdaf15b35dae9f350d1bc6dc1e7d138c56a2dcfd0ed6ac5b53a2af7b65670 not found: ID does not exist" Sep 05 02:33:56.304872 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:33:56.304831 2555 scope.go:117] "RemoveContainer" containerID="94f11a8375e29ab59de5cd4c454c7382adc3b9f11236848772be90c98af91b34" Sep 05 02:33:56.305087 ip-10-0-133-250 kubenswrapper[2555]: E0905 02:33:56.305069 2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"94f11a8375e29ab59de5cd4c454c7382adc3b9f11236848772be90c98af91b34\": container with ID starting with 94f11a8375e29ab59de5cd4c454c7382adc3b9f11236848772be90c98af91b34 not found: ID does not exist" containerID="94f11a8375e29ab59de5cd4c454c7382adc3b9f11236848772be90c98af91b34" Sep 05 02:33:56.305173 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:33:56.305087 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"94f11a8375e29ab59de5cd4c454c7382adc3b9f11236848772be90c98af91b34"} err="failed to get container status \"94f11a8375e29ab59de5cd4c454c7382adc3b9f11236848772be90c98af91b34\": rpc error: code = NotFound desc = could not find container \"94f11a8375e29ab59de5cd4c454c7382adc3b9f11236848772be90c98af91b34\": container with ID starting with 94f11a8375e29ab59de5cd4c454c7382adc3b9f11236848772be90c98af91b34 not found: ID does not exist" Sep 05 02:33:58.085254 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:33:58.083638 2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c64fe915-a5c8-4c33-8563-427e62ff8aa7" path="/var/lib/kubelet/pods/c64fe915-a5c8-4c33-8563-427e62ff8aa7/volumes" Sep 05 02:34:00.236567 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:34:00.236524 2555 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-bd0a0-57bc6b4ffd-sqwsx" podUID="03e0804f-c1c6-46d6-a72c-d0a12d681ff0" containerName="model-chainer-raw-hpa-bd0a0" probeResult="failure" output="HTTP probe failed with statuscode: 503" Sep 05 02:34:05.236323 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:34:05.236281 2555 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-bd0a0-57bc6b4ffd-sqwsx" podUID="03e0804f-c1c6-46d6-a72c-d0a12d681ff0" containerName="model-chainer-raw-hpa-bd0a0" probeResult="failure" output="HTTP probe failed with statuscode: 503" Sep 05 02:34:05.236765 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:34:05.236395 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-bd0a0-57bc6b4ffd-sqwsx" Sep 05 02:34:10.236700 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:34:10.236655 2555 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-bd0a0-57bc6b4ffd-sqwsx" podUID="03e0804f-c1c6-46d6-a72c-d0a12d681ff0" containerName="model-chainer-raw-hpa-bd0a0" probeResult="failure" output="HTTP probe failed with statuscode: 503" Sep 05 02:34:15.236283 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:34:15.236240 2555 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-bd0a0-57bc6b4ffd-sqwsx" podUID="03e0804f-c1c6-46d6-a72c-d0a12d681ff0" containerName="model-chainer-raw-hpa-bd0a0" probeResult="failure" output="HTTP probe failed with statuscode: 503" Sep 05 02:34:20.235516 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:34:20.235421 2555 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-bd0a0-57bc6b4ffd-sqwsx" podUID="03e0804f-c1c6-46d6-a72c-d0a12d681ff0" containerName="model-chainer-raw-hpa-bd0a0" probeResult="failure" output="HTTP probe failed with statuscode: 503" Sep 05 02:34:22.376288 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:34:22.376264 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-bd0a0-57bc6b4ffd-sqwsx" Sep 05 02:34:22.390166 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:34:22.390138 2555 generic.go:356] "Generic (PLEG): container finished" podID="03e0804f-c1c6-46d6-a72c-d0a12d681ff0" containerID="b2f9b5b81bf2da6d71884e8323387966908a56cd38428a1fd658947d8c7c0cb1" exitCode=0 Sep 05 02:34:22.390285 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:34:22.390188 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-bd0a0-57bc6b4ffd-sqwsx" event={"ID":"03e0804f-c1c6-46d6-a72c-d0a12d681ff0","Type":"ContainerDied","Data":"b2f9b5b81bf2da6d71884e8323387966908a56cd38428a1fd658947d8c7c0cb1"} Sep 05 02:34:22.390285 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:34:22.390239 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-bd0a0-57bc6b4ffd-sqwsx" event={"ID":"03e0804f-c1c6-46d6-a72c-d0a12d681ff0","Type":"ContainerDied","Data":"0d23f356b872e91f088cb765685b4d40f4fd182d9dc6e854552551feb6466c0e"} Sep 05 02:34:22.390285 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:34:22.390247 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/model-chainer-raw-hpa-bd0a0-57bc6b4ffd-sqwsx" Sep 05 02:34:22.390285 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:34:22.390267 2555 scope.go:117] "RemoveContainer" containerID="b2f9b5b81bf2da6d71884e8323387966908a56cd38428a1fd658947d8c7c0cb1" Sep 05 02:34:22.398948 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:34:22.398928 2555 scope.go:117] "RemoveContainer" containerID="b2f9b5b81bf2da6d71884e8323387966908a56cd38428a1fd658947d8c7c0cb1" Sep 05 02:34:22.399323 ip-10-0-133-250 kubenswrapper[2555]: E0905 02:34:22.399299 2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b2f9b5b81bf2da6d71884e8323387966908a56cd38428a1fd658947d8c7c0cb1\": container with ID starting with b2f9b5b81bf2da6d71884e8323387966908a56cd38428a1fd658947d8c7c0cb1 not found: ID does not exist" containerID="b2f9b5b81bf2da6d71884e8323387966908a56cd38428a1fd658947d8c7c0cb1" Sep 05 02:34:22.399418 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:34:22.399331 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b2f9b5b81bf2da6d71884e8323387966908a56cd38428a1fd658947d8c7c0cb1"} err="failed to get container status \"b2f9b5b81bf2da6d71884e8323387966908a56cd38428a1fd658947d8c7c0cb1\": rpc error: code = NotFound desc = could not find container \"b2f9b5b81bf2da6d71884e8323387966908a56cd38428a1fd658947d8c7c0cb1\": container with ID starting with b2f9b5b81bf2da6d71884e8323387966908a56cd38428a1fd658947d8c7c0cb1 not found: ID does not exist" Sep 05 02:34:22.485003 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:34:22.484961 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/03e0804f-c1c6-46d6-a72c-d0a12d681ff0-openshift-service-ca-bundle\") pod \"03e0804f-c1c6-46d6-a72c-d0a12d681ff0\" (UID: \"03e0804f-c1c6-46d6-a72c-d0a12d681ff0\") " Sep 05 02:34:22.485170 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:34:22.485068 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/03e0804f-c1c6-46d6-a72c-d0a12d681ff0-proxy-tls\") pod \"03e0804f-c1c6-46d6-a72c-d0a12d681ff0\" (UID: \"03e0804f-c1c6-46d6-a72c-d0a12d681ff0\") " Sep 05 02:34:22.485387 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:34:22.485366 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/03e0804f-c1c6-46d6-a72c-d0a12d681ff0-openshift-service-ca-bundle" (OuterVolumeSpecName: "openshift-service-ca-bundle") pod "03e0804f-c1c6-46d6-a72c-d0a12d681ff0" (UID: "03e0804f-c1c6-46d6-a72c-d0a12d681ff0"). InnerVolumeSpecName "openshift-service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 05 02:34:22.487048 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:34:22.487011 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/03e0804f-c1c6-46d6-a72c-d0a12d681ff0-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "03e0804f-c1c6-46d6-a72c-d0a12d681ff0" (UID: "03e0804f-c1c6-46d6-a72c-d0a12d681ff0"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 05 02:34:22.586338 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:34:22.586309 2555 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/03e0804f-c1c6-46d6-a72c-d0a12d681ff0-proxy-tls\") on node \"ip-10-0-133-250.ec2.internal\" DevicePath \"\"" Sep 05 02:34:22.586338 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:34:22.586336 2555 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/03e0804f-c1c6-46d6-a72c-d0a12d681ff0-openshift-service-ca-bundle\") on node \"ip-10-0-133-250.ec2.internal\" DevicePath \"\"" Sep 05 02:34:22.711149 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:34:22.711115 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/model-chainer-raw-hpa-bd0a0-57bc6b4ffd-sqwsx"] Sep 05 02:34:22.714832 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:34:22.714810 2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/model-chainer-raw-hpa-bd0a0-57bc6b4ffd-sqwsx"] Sep 05 02:34:24.082925 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:34:24.082885 2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="03e0804f-c1c6-46d6-a72c-d0a12d681ff0" path="/var/lib/kubelet/pods/03e0804f-c1c6-46d6-a72c-d0a12d681ff0/volumes" Sep 05 02:37:54.059793 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:37:54.059764 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-k2cdf_2ab9a760-ef7b-48dc-acbe-2694be7274e0/console-operator/1.log" Sep 05 02:37:54.060260 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:37:54.059870 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-k2cdf_2ab9a760-ef7b-48dc-acbe-2694be7274e0/console-operator/1.log" Sep 05 02:42:54.087823 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:42:54.087792 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-k2cdf_2ab9a760-ef7b-48dc-acbe-2694be7274e0/console-operator/1.log" Sep 05 02:42:54.088662 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:42:54.088643 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-k2cdf_2ab9a760-ef7b-48dc-acbe-2694be7274e0/console-operator/1.log" Sep 05 02:45:19.113536 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:45:19.113458 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-hw6hz/must-gather-cgmfn"] Sep 05 02:45:19.113966 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:45:19.113767 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c64fe915-a5c8-4c33-8563-427e62ff8aa7" containerName="kserve-container" Sep 05 02:45:19.113966 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:45:19.113777 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="c64fe915-a5c8-4c33-8563-427e62ff8aa7" containerName="kserve-container" Sep 05 02:45:19.113966 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:45:19.113793 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="03e0804f-c1c6-46d6-a72c-d0a12d681ff0" containerName="model-chainer-raw-hpa-bd0a0" Sep 05 02:45:19.113966 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:45:19.113799 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="03e0804f-c1c6-46d6-a72c-d0a12d681ff0" containerName="model-chainer-raw-hpa-bd0a0" Sep 05 02:45:19.113966 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:45:19.113812 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c64fe915-a5c8-4c33-8563-427e62ff8aa7" containerName="storage-initializer" Sep 05 02:45:19.113966 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:45:19.113818 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="c64fe915-a5c8-4c33-8563-427e62ff8aa7" containerName="storage-initializer" Sep 05 02:45:19.113966 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:45:19.113825 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c64fe915-a5c8-4c33-8563-427e62ff8aa7" containerName="kube-rbac-proxy" Sep 05 02:45:19.113966 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:45:19.113830 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="c64fe915-a5c8-4c33-8563-427e62ff8aa7" containerName="kube-rbac-proxy" Sep 05 02:45:19.113966 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:45:19.113873 2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="c64fe915-a5c8-4c33-8563-427e62ff8aa7" containerName="kserve-container" Sep 05 02:45:19.113966 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:45:19.113884 2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="c64fe915-a5c8-4c33-8563-427e62ff8aa7" containerName="kube-rbac-proxy" Sep 05 02:45:19.113966 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:45:19.113891 2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="03e0804f-c1c6-46d6-a72c-d0a12d681ff0" containerName="model-chainer-raw-hpa-bd0a0" Sep 05 02:45:19.117028 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:45:19.117001 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-hw6hz/must-gather-cgmfn" Sep 05 02:45:19.119586 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:45:19.119562 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-hw6hz\"/\"openshift-service-ca.crt\"" Sep 05 02:45:19.119698 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:45:19.119680 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-hw6hz\"/\"default-dockercfg-lnbj2\"" Sep 05 02:45:19.120559 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:45:19.120542 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-hw6hz\"/\"kube-root-ca.crt\"" Sep 05 02:45:19.131302 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:45:19.131277 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-hw6hz/must-gather-cgmfn"] Sep 05 02:45:19.247823 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:45:19.247786 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/02000257-f431-41e9-b2fe-a13c09b7dfdc-must-gather-output\") pod \"must-gather-cgmfn\" (UID: \"02000257-f431-41e9-b2fe-a13c09b7dfdc\") " pod="openshift-must-gather-hw6hz/must-gather-cgmfn" Sep 05 02:45:19.247823 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:45:19.247820 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cgfdq\" (UniqueName: \"kubernetes.io/projected/02000257-f431-41e9-b2fe-a13c09b7dfdc-kube-api-access-cgfdq\") pod \"must-gather-cgmfn\" (UID: \"02000257-f431-41e9-b2fe-a13c09b7dfdc\") " pod="openshift-must-gather-hw6hz/must-gather-cgmfn" Sep 05 02:45:19.348872 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:45:19.348833 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/02000257-f431-41e9-b2fe-a13c09b7dfdc-must-gather-output\") pod \"must-gather-cgmfn\" (UID: \"02000257-f431-41e9-b2fe-a13c09b7dfdc\") " pod="openshift-must-gather-hw6hz/must-gather-cgmfn" Sep 05 02:45:19.348872 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:45:19.348873 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cgfdq\" (UniqueName: \"kubernetes.io/projected/02000257-f431-41e9-b2fe-a13c09b7dfdc-kube-api-access-cgfdq\") pod \"must-gather-cgmfn\" (UID: \"02000257-f431-41e9-b2fe-a13c09b7dfdc\") " pod="openshift-must-gather-hw6hz/must-gather-cgmfn" Sep 05 02:45:19.349276 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:45:19.349254 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/02000257-f431-41e9-b2fe-a13c09b7dfdc-must-gather-output\") pod \"must-gather-cgmfn\" (UID: \"02000257-f431-41e9-b2fe-a13c09b7dfdc\") " pod="openshift-must-gather-hw6hz/must-gather-cgmfn" Sep 05 02:45:19.356998 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:45:19.356980 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cgfdq\" (UniqueName: \"kubernetes.io/projected/02000257-f431-41e9-b2fe-a13c09b7dfdc-kube-api-access-cgfdq\") pod \"must-gather-cgmfn\" (UID: \"02000257-f431-41e9-b2fe-a13c09b7dfdc\") " pod="openshift-must-gather-hw6hz/must-gather-cgmfn" Sep 05 02:45:19.436571 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:45:19.436502 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-hw6hz/must-gather-cgmfn" Sep 05 02:45:19.705856 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:45:19.705830 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-hw6hz/must-gather-cgmfn"] Sep 05 02:45:19.708110 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:45:19.708084 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod02000257_f431_41e9_b2fe_a13c09b7dfdc.slice/crio-5c51b34f6a3d02b818e8c47b8181118bcec1c2a70d4922729beb914dc27ada21 WatchSource:0}: Error finding container 5c51b34f6a3d02b818e8c47b8181118bcec1c2a70d4922729beb914dc27ada21: Status 404 returned error can't find the container with id 5c51b34f6a3d02b818e8c47b8181118bcec1c2a70d4922729beb914dc27ada21 Sep 05 02:45:19.709892 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:45:19.709875 2555 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 05 02:45:20.011943 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:45:20.011868 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-hw6hz/must-gather-cgmfn" event={"ID":"02000257-f431-41e9-b2fe-a13c09b7dfdc","Type":"ContainerStarted","Data":"5c51b34f6a3d02b818e8c47b8181118bcec1c2a70d4922729beb914dc27ada21"} Sep 05 02:45:27.051048 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:45:27.050997 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-hw6hz/must-gather-cgmfn" event={"ID":"02000257-f431-41e9-b2fe-a13c09b7dfdc","Type":"ContainerStarted","Data":"8cabb5764f689656d2c6d2923d617a57d7d2881ab0487901b2183c22926fb287"} Sep 05 02:45:27.051433 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:45:27.051059 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-hw6hz/must-gather-cgmfn" event={"ID":"02000257-f431-41e9-b2fe-a13c09b7dfdc","Type":"ContainerStarted","Data":"406a6719cfd38ece32b71471b79fc2c59da25e743a56b3d61f7b269d0d78c2ab"} Sep 05 02:45:27.068270 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:45:27.067566 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-hw6hz/must-gather-cgmfn" podStartSLOduration=1.581136553 podStartE2EDuration="8.067544196s" totalImagesPullingTime="6.486407643s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-05 02:45:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-05 02:45:27.067227857 +0000 UTC m=+1653.569365455" watchObservedRunningTime="2026-09-05 02:45:27.067544196 +0000 UTC m=+1653.569681794" Sep 05 02:45:49.156469 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:45:49.156387 2555 generic.go:356] "Generic (PLEG): container finished" podID="02000257-f431-41e9-b2fe-a13c09b7dfdc" containerID="406a6719cfd38ece32b71471b79fc2c59da25e743a56b3d61f7b269d0d78c2ab" exitCode=0 Sep 05 02:45:49.156860 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:45:49.156460 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-hw6hz/must-gather-cgmfn" event={"ID":"02000257-f431-41e9-b2fe-a13c09b7dfdc","Type":"ContainerDied","Data":"406a6719cfd38ece32b71471b79fc2c59da25e743a56b3d61f7b269d0d78c2ab"} Sep 05 02:45:49.156860 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:45:49.156778 2555 scope.go:117] "RemoveContainer" containerID="406a6719cfd38ece32b71471b79fc2c59da25e743a56b3d61f7b269d0d78c2ab" Sep 05 02:45:49.752962 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:45:49.752936 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-hw6hz_must-gather-cgmfn_02000257-f431-41e9-b2fe-a13c09b7dfdc/gather/0.log" Sep 05 02:45:53.134132 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:45:53.134098 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-ghjcr_bd4a3b61-19e3-4177-b012-e8ec8048aed1/global-pull-secret-syncer/0.log" Sep 05 02:45:53.246272 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:45:53.246243 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-nvjx5_3f060a3e-d7fc-4886-bca4-7564087e02ac/konnectivity-agent/0.log" Sep 05 02:45:53.323009 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:45:53.322978 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-133-250.ec2.internal_ccb165d55e894605f0ca2c828f2460a9/haproxy/0.log" Sep 05 02:45:55.166726 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:45:55.166689 2555 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-must-gather-hw6hz/must-gather-cgmfn"] Sep 05 02:45:55.167134 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:45:55.166883 2555 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-must-gather-hw6hz/must-gather-cgmfn" podUID="02000257-f431-41e9-b2fe-a13c09b7dfdc" containerName="copy" containerID="cri-o://8cabb5764f689656d2c6d2923d617a57d7d2881ab0487901b2183c22926fb287" gracePeriod=2 Sep 05 02:45:55.171915 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:45:55.171893 2555 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-must-gather-hw6hz/must-gather-cgmfn"] Sep 05 02:45:55.395469 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:45:55.395449 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-hw6hz_must-gather-cgmfn_02000257-f431-41e9-b2fe-a13c09b7dfdc/copy/0.log" Sep 05 02:45:55.398100 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:45:55.398082 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-hw6hz/must-gather-cgmfn" Sep 05 02:45:55.400130 ip-10-0-133-250 kubenswrapper[2555]: E0905 02:45:55.400107 2555 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-cgmfn\" is forbidden: User \"system:node:ip-10-0-133-250.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-hw6hz\": no relationship found between node 'ip-10-0-133-250.ec2.internal' and this object" podUID="02000257-f431-41e9-b2fe-a13c09b7dfdc" pod="openshift-must-gather-hw6hz/must-gather-cgmfn" Sep 05 02:45:55.480839 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:45:55.480818 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/02000257-f431-41e9-b2fe-a13c09b7dfdc-must-gather-output\") pod \"02000257-f431-41e9-b2fe-a13c09b7dfdc\" (UID: \"02000257-f431-41e9-b2fe-a13c09b7dfdc\") " Sep 05 02:45:55.480942 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:45:55.480891 2555 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cgfdq\" (UniqueName: \"kubernetes.io/projected/02000257-f431-41e9-b2fe-a13c09b7dfdc-kube-api-access-cgfdq\") pod \"02000257-f431-41e9-b2fe-a13c09b7dfdc\" (UID: \"02000257-f431-41e9-b2fe-a13c09b7dfdc\") " Sep 05 02:45:55.482883 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:45:55.482851 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/02000257-f431-41e9-b2fe-a13c09b7dfdc-must-gather-output" (OuterVolumeSpecName: "must-gather-output") pod "02000257-f431-41e9-b2fe-a13c09b7dfdc" (UID: "02000257-f431-41e9-b2fe-a13c09b7dfdc"). InnerVolumeSpecName "must-gather-output". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 05 02:45:55.482974 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:45:55.482907 2555 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/02000257-f431-41e9-b2fe-a13c09b7dfdc-kube-api-access-cgfdq" (OuterVolumeSpecName: "kube-api-access-cgfdq") pod "02000257-f431-41e9-b2fe-a13c09b7dfdc" (UID: "02000257-f431-41e9-b2fe-a13c09b7dfdc"). InnerVolumeSpecName "kube-api-access-cgfdq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 05 02:45:55.582531 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:45:55.582496 2555 reconciler_common.go:299] "Volume detached for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/02000257-f431-41e9-b2fe-a13c09b7dfdc-must-gather-output\") on node \"ip-10-0-133-250.ec2.internal\" DevicePath \"\"" Sep 05 02:45:55.582531 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:45:55.582523 2555 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cgfdq\" (UniqueName: \"kubernetes.io/projected/02000257-f431-41e9-b2fe-a13c09b7dfdc-kube-api-access-cgfdq\") on node \"ip-10-0-133-250.ec2.internal\" DevicePath \"\"" Sep 05 02:45:56.082368 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:45:56.082334 2555 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="02000257-f431-41e9-b2fe-a13c09b7dfdc" path="/var/lib/kubelet/pods/02000257-f431-41e9-b2fe-a13c09b7dfdc/volumes" Sep 05 02:45:56.185782 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:45:56.185751 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-hw6hz_must-gather-cgmfn_02000257-f431-41e9-b2fe-a13c09b7dfdc/copy/0.log" Sep 05 02:45:56.186162 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:45:56.186134 2555 generic.go:356] "Generic (PLEG): container finished" podID="02000257-f431-41e9-b2fe-a13c09b7dfdc" containerID="8cabb5764f689656d2c6d2923d617a57d7d2881ab0487901b2183c22926fb287" exitCode=143 Sep 05 02:45:56.186209 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:45:56.186176 2555 scope.go:117] "RemoveContainer" containerID="8cabb5764f689656d2c6d2923d617a57d7d2881ab0487901b2183c22926fb287" Sep 05 02:45:56.186209 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:45:56.186182 2555 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-hw6hz/must-gather-cgmfn" Sep 05 02:45:56.193974 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:45:56.193956 2555 scope.go:117] "RemoveContainer" containerID="406a6719cfd38ece32b71471b79fc2c59da25e743a56b3d61f7b269d0d78c2ab" Sep 05 02:45:56.206976 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:45:56.206959 2555 scope.go:117] "RemoveContainer" containerID="8cabb5764f689656d2c6d2923d617a57d7d2881ab0487901b2183c22926fb287" Sep 05 02:45:56.207273 ip-10-0-133-250 kubenswrapper[2555]: E0905 02:45:56.207255 2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8cabb5764f689656d2c6d2923d617a57d7d2881ab0487901b2183c22926fb287\": container with ID starting with 8cabb5764f689656d2c6d2923d617a57d7d2881ab0487901b2183c22926fb287 not found: ID does not exist" containerID="8cabb5764f689656d2c6d2923d617a57d7d2881ab0487901b2183c22926fb287" Sep 05 02:45:56.207366 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:45:56.207283 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8cabb5764f689656d2c6d2923d617a57d7d2881ab0487901b2183c22926fb287"} err="failed to get container status \"8cabb5764f689656d2c6d2923d617a57d7d2881ab0487901b2183c22926fb287\": rpc error: code = NotFound desc = could not find container \"8cabb5764f689656d2c6d2923d617a57d7d2881ab0487901b2183c22926fb287\": container with ID starting with 8cabb5764f689656d2c6d2923d617a57d7d2881ab0487901b2183c22926fb287 not found: ID does not exist" Sep 05 02:45:56.207366 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:45:56.207309 2555 scope.go:117] "RemoveContainer" containerID="406a6719cfd38ece32b71471b79fc2c59da25e743a56b3d61f7b269d0d78c2ab" Sep 05 02:45:56.207903 ip-10-0-133-250 kubenswrapper[2555]: E0905 02:45:56.207871 2555 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"406a6719cfd38ece32b71471b79fc2c59da25e743a56b3d61f7b269d0d78c2ab\": container with ID starting with 406a6719cfd38ece32b71471b79fc2c59da25e743a56b3d61f7b269d0d78c2ab not found: ID does not exist" containerID="406a6719cfd38ece32b71471b79fc2c59da25e743a56b3d61f7b269d0d78c2ab" Sep 05 02:45:56.208005 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:45:56.207904 2555 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"406a6719cfd38ece32b71471b79fc2c59da25e743a56b3d61f7b269d0d78c2ab"} err="failed to get container status \"406a6719cfd38ece32b71471b79fc2c59da25e743a56b3d61f7b269d0d78c2ab\": rpc error: code = NotFound desc = could not find container \"406a6719cfd38ece32b71471b79fc2c59da25e743a56b3d61f7b269d0d78c2ab\": container with ID starting with 406a6719cfd38ece32b71471b79fc2c59da25e743a56b3d61f7b269d0d78c2ab not found: ID does not exist" Sep 05 02:45:57.254344 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:45:57.254313 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_8ab5921f-af18-4481-9175-7cb222351eaa/alertmanager/0.log" Sep 05 02:45:57.279735 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:45:57.279699 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_8ab5921f-af18-4481-9175-7cb222351eaa/config-reloader/0.log" Sep 05 02:45:57.307821 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:45:57.307797 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_8ab5921f-af18-4481-9175-7cb222351eaa/kube-rbac-proxy-web/0.log" Sep 05 02:45:57.340336 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:45:57.340317 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_8ab5921f-af18-4481-9175-7cb222351eaa/kube-rbac-proxy/0.log" Sep 05 02:45:57.368770 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:45:57.368744 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_8ab5921f-af18-4481-9175-7cb222351eaa/kube-rbac-proxy-metric/0.log" Sep 05 02:45:57.391385 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:45:57.391360 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_8ab5921f-af18-4481-9175-7cb222351eaa/prom-label-proxy/0.log" Sep 05 02:45:57.416703 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:45:57.416684 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_8ab5921f-af18-4481-9175-7cb222351eaa/init-config-reloader/0.log" Sep 05 02:45:57.579218 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:45:57.579128 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-d589b4565-5jb8r_816a886c-8197-4b15-add7-901cf4a9c678/metrics-server/0.log" Sep 05 02:45:57.637883 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:45:57.637856 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-c7mrv_40a7d562-85f7-4a96-8dfc-a4dbb0d0b9a1/node-exporter/0.log" Sep 05 02:45:57.658913 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:45:57.658882 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-c7mrv_40a7d562-85f7-4a96-8dfc-a4dbb0d0b9a1/kube-rbac-proxy/0.log" Sep 05 02:45:57.694627 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:45:57.694597 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-c7mrv_40a7d562-85f7-4a96-8dfc-a4dbb0d0b9a1/init-textfile/0.log" Sep 05 02:45:58.036113 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:45:58.036081 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_24f506bf-603c-4bd1-886f-740069e5c1f4/prometheus/0.log" Sep 05 02:45:58.064595 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:45:58.064569 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_24f506bf-603c-4bd1-886f-740069e5c1f4/config-reloader/0.log" Sep 05 02:45:58.095812 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:45:58.095792 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_24f506bf-603c-4bd1-886f-740069e5c1f4/thanos-sidecar/0.log" Sep 05 02:45:58.145797 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:45:58.145774 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_24f506bf-603c-4bd1-886f-740069e5c1f4/kube-rbac-proxy-web/0.log" Sep 05 02:45:58.170765 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:45:58.170745 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_24f506bf-603c-4bd1-886f-740069e5c1f4/kube-rbac-proxy/0.log" Sep 05 02:45:58.194663 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:45:58.194640 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_24f506bf-603c-4bd1-886f-740069e5c1f4/kube-rbac-proxy-thanos/0.log" Sep 05 02:45:58.236754 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:45:58.236734 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_24f506bf-603c-4bd1-886f-740069e5c1f4/init-config-reloader/0.log" Sep 05 02:45:58.270543 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:45:58.270520 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-6f4946db56-m7bnk_84e1ef5e-21a2-4e76-a877-c8f387c42603/prometheus-operator/0.log" Sep 05 02:45:58.296135 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:45:58.296108 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-6f4946db56-m7bnk_84e1ef5e-21a2-4e76-a877-c8f387c42603/kube-rbac-proxy/0.log" Sep 05 02:45:58.472073 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:45:58.472047 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-884bfd544-9h585_7df84300-7490-4118-a2a4-1849523b5ef2/thanos-query/0.log" Sep 05 02:45:58.501855 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:45:58.501824 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-884bfd544-9h585_7df84300-7490-4118-a2a4-1849523b5ef2/kube-rbac-proxy-web/0.log" Sep 05 02:45:58.543986 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:45:58.543907 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-884bfd544-9h585_7df84300-7490-4118-a2a4-1849523b5ef2/kube-rbac-proxy/0.log" Sep 05 02:45:58.580058 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:45:58.580031 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-884bfd544-9h585_7df84300-7490-4118-a2a4-1849523b5ef2/prom-label-proxy/0.log" Sep 05 02:45:58.612676 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:45:58.612652 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-884bfd544-9h585_7df84300-7490-4118-a2a4-1849523b5ef2/kube-rbac-proxy-rules/0.log" Sep 05 02:45:58.657066 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:45:58.657033 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-884bfd544-9h585_7df84300-7490-4118-a2a4-1849523b5ef2/kube-rbac-proxy-metrics/0.log" Sep 05 02:45:59.912130 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:45:59.912102 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-79977f9844-xz7zr_e0bb0aec-dbbe-4026-abd6-ba57cb7f7c7d/networking-console-plugin/0.log" Sep 05 02:46:00.429002 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:46:00.428933 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-k2cdf_2ab9a760-ef7b-48dc-acbe-2694be7274e0/console-operator/1.log" Sep 05 02:46:00.433363 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:46:00.433342 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-k2cdf_2ab9a760-ef7b-48dc-acbe-2694be7274e0/console-operator/2.log" Sep 05 02:46:01.450620 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:46:01.450585 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-695c895bd6-qsp8m_5232a6e8-2284-4488-ba83-55a96de9935d/volume-data-source-validator/0.log" Sep 05 02:46:01.628761 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:46:01.628734 2555 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-s672k/perf-node-gather-daemonset-cdr4b"] Sep 05 02:46:01.629129 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:46:01.629114 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="02000257-f431-41e9-b2fe-a13c09b7dfdc" containerName="copy" Sep 05 02:46:01.629186 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:46:01.629131 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="02000257-f431-41e9-b2fe-a13c09b7dfdc" containerName="copy" Sep 05 02:46:01.629186 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:46:01.629140 2555 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="02000257-f431-41e9-b2fe-a13c09b7dfdc" containerName="gather" Sep 05 02:46:01.629186 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:46:01.629145 2555 state_mem.go:107] "Deleted CPUSet assignment" podUID="02000257-f431-41e9-b2fe-a13c09b7dfdc" containerName="gather" Sep 05 02:46:01.629276 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:46:01.629194 2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="02000257-f431-41e9-b2fe-a13c09b7dfdc" containerName="gather" Sep 05 02:46:01.629276 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:46:01.629205 2555 memory_manager.go:368] "RemoveStaleState removing state" podUID="02000257-f431-41e9-b2fe-a13c09b7dfdc" containerName="copy" Sep 05 02:46:01.634133 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:46:01.634106 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-s672k/perf-node-gather-daemonset-cdr4b" Sep 05 02:46:01.636815 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:46:01.636794 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-s672k\"/\"kube-root-ca.crt\"" Sep 05 02:46:01.637708 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:46:01.637694 2555 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-s672k\"/\"openshift-service-ca.crt\"" Sep 05 02:46:01.637779 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:46:01.637733 2555 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-s672k\"/\"default-dockercfg-d5z68\"" Sep 05 02:46:01.642779 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:46:01.642758 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-s672k/perf-node-gather-daemonset-cdr4b"] Sep 05 02:46:01.731900 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:46:01.731874 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/25e6012a-3137-46f2-aeb8-c4a421bb4f69-proc\") pod \"perf-node-gather-daemonset-cdr4b\" (UID: \"25e6012a-3137-46f2-aeb8-c4a421bb4f69\") " pod="openshift-must-gather-s672k/perf-node-gather-daemonset-cdr4b" Sep 05 02:46:01.732063 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:46:01.731909 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-567p7\" (UniqueName: \"kubernetes.io/projected/25e6012a-3137-46f2-aeb8-c4a421bb4f69-kube-api-access-567p7\") pod \"perf-node-gather-daemonset-cdr4b\" (UID: \"25e6012a-3137-46f2-aeb8-c4a421bb4f69\") " pod="openshift-must-gather-s672k/perf-node-gather-daemonset-cdr4b" Sep 05 02:46:01.732063 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:46:01.731936 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/25e6012a-3137-46f2-aeb8-c4a421bb4f69-lib-modules\") pod \"perf-node-gather-daemonset-cdr4b\" (UID: \"25e6012a-3137-46f2-aeb8-c4a421bb4f69\") " pod="openshift-must-gather-s672k/perf-node-gather-daemonset-cdr4b" Sep 05 02:46:01.732197 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:46:01.732106 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/25e6012a-3137-46f2-aeb8-c4a421bb4f69-sys\") pod \"perf-node-gather-daemonset-cdr4b\" (UID: \"25e6012a-3137-46f2-aeb8-c4a421bb4f69\") " pod="openshift-must-gather-s672k/perf-node-gather-daemonset-cdr4b" Sep 05 02:46:01.732197 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:46:01.732144 2555 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/25e6012a-3137-46f2-aeb8-c4a421bb4f69-podres\") pod \"perf-node-gather-daemonset-cdr4b\" (UID: \"25e6012a-3137-46f2-aeb8-c4a421bb4f69\") " pod="openshift-must-gather-s672k/perf-node-gather-daemonset-cdr4b" Sep 05 02:46:01.833226 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:46:01.833180 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/25e6012a-3137-46f2-aeb8-c4a421bb4f69-sys\") pod \"perf-node-gather-daemonset-cdr4b\" (UID: \"25e6012a-3137-46f2-aeb8-c4a421bb4f69\") " pod="openshift-must-gather-s672k/perf-node-gather-daemonset-cdr4b" Sep 05 02:46:01.833226 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:46:01.833223 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/25e6012a-3137-46f2-aeb8-c4a421bb4f69-podres\") pod \"perf-node-gather-daemonset-cdr4b\" (UID: \"25e6012a-3137-46f2-aeb8-c4a421bb4f69\") " pod="openshift-must-gather-s672k/perf-node-gather-daemonset-cdr4b" Sep 05 02:46:01.833456 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:46:01.833270 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/25e6012a-3137-46f2-aeb8-c4a421bb4f69-proc\") pod \"perf-node-gather-daemonset-cdr4b\" (UID: \"25e6012a-3137-46f2-aeb8-c4a421bb4f69\") " pod="openshift-must-gather-s672k/perf-node-gather-daemonset-cdr4b" Sep 05 02:46:01.833456 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:46:01.833299 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-567p7\" (UniqueName: \"kubernetes.io/projected/25e6012a-3137-46f2-aeb8-c4a421bb4f69-kube-api-access-567p7\") pod \"perf-node-gather-daemonset-cdr4b\" (UID: \"25e6012a-3137-46f2-aeb8-c4a421bb4f69\") " pod="openshift-must-gather-s672k/perf-node-gather-daemonset-cdr4b" Sep 05 02:46:01.833456 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:46:01.833311 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/25e6012a-3137-46f2-aeb8-c4a421bb4f69-sys\") pod \"perf-node-gather-daemonset-cdr4b\" (UID: \"25e6012a-3137-46f2-aeb8-c4a421bb4f69\") " pod="openshift-must-gather-s672k/perf-node-gather-daemonset-cdr4b" Sep 05 02:46:01.833456 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:46:01.833343 2555 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/25e6012a-3137-46f2-aeb8-c4a421bb4f69-lib-modules\") pod \"perf-node-gather-daemonset-cdr4b\" (UID: \"25e6012a-3137-46f2-aeb8-c4a421bb4f69\") " pod="openshift-must-gather-s672k/perf-node-gather-daemonset-cdr4b" Sep 05 02:46:01.833456 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:46:01.833359 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/25e6012a-3137-46f2-aeb8-c4a421bb4f69-proc\") pod \"perf-node-gather-daemonset-cdr4b\" (UID: \"25e6012a-3137-46f2-aeb8-c4a421bb4f69\") " pod="openshift-must-gather-s672k/perf-node-gather-daemonset-cdr4b" Sep 05 02:46:01.833456 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:46:01.833431 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/25e6012a-3137-46f2-aeb8-c4a421bb4f69-podres\") pod \"perf-node-gather-daemonset-cdr4b\" (UID: \"25e6012a-3137-46f2-aeb8-c4a421bb4f69\") " pod="openshift-must-gather-s672k/perf-node-gather-daemonset-cdr4b" Sep 05 02:46:01.833667 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:46:01.833511 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/25e6012a-3137-46f2-aeb8-c4a421bb4f69-lib-modules\") pod \"perf-node-gather-daemonset-cdr4b\" (UID: \"25e6012a-3137-46f2-aeb8-c4a421bb4f69\") " pod="openshift-must-gather-s672k/perf-node-gather-daemonset-cdr4b" Sep 05 02:46:01.841244 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:46:01.841223 2555 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-567p7\" (UniqueName: \"kubernetes.io/projected/25e6012a-3137-46f2-aeb8-c4a421bb4f69-kube-api-access-567p7\") pod \"perf-node-gather-daemonset-cdr4b\" (UID: \"25e6012a-3137-46f2-aeb8-c4a421bb4f69\") " pod="openshift-must-gather-s672k/perf-node-gather-daemonset-cdr4b" Sep 05 02:46:01.944605 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:46:01.944572 2555 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-s672k/perf-node-gather-daemonset-cdr4b" Sep 05 02:46:02.216676 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:46:02.216652 2555 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-s672k/perf-node-gather-daemonset-cdr4b"] Sep 05 02:46:02.219140 ip-10-0-133-250 kubenswrapper[2555]: W0905 02:46:02.219112 2555 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod25e6012a_3137_46f2_aeb8_c4a421bb4f69.slice/crio-470cb296986f94929353df481126ebef975389fb06a2e850c7df1f1240209c59 WatchSource:0}: Error finding container 470cb296986f94929353df481126ebef975389fb06a2e850c7df1f1240209c59: Status 404 returned error can't find the container with id 470cb296986f94929353df481126ebef975389fb06a2e850c7df1f1240209c59 Sep 05 02:46:02.480526 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:46:02.480500 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-mckdq_fd1b28f1-f463-4135-8776-fd0ceff545ca/dns/0.log" Sep 05 02:46:02.498880 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:46:02.498851 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-mckdq_fd1b28f1-f463-4135-8776-fd0ceff545ca/kube-rbac-proxy/0.log" Sep 05 02:46:02.564673 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:46:02.564604 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-lq8k6_c3aed02f-b69d-4743-8089-e6b5f142dbc1/dns-node-resolver/0.log" Sep 05 02:46:03.030180 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:46:03.030148 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-77d8dbf4d7-2mzx5_92bd0895-9344-48de-8982-c828ce76b108/registry/0.log" Sep 05 02:46:03.071597 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:46:03.071567 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-4gpmf_c2dc61db-cd5c-4972-b21e-633ad3b71ef5/node-ca/0.log" Sep 05 02:46:03.216639 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:46:03.216604 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-s672k/perf-node-gather-daemonset-cdr4b" event={"ID":"25e6012a-3137-46f2-aeb8-c4a421bb4f69","Type":"ContainerStarted","Data":"2544709c8cd9c5c78e3d17a18ed442dc2336bf138c26c7de0dd625963b65f64b"} Sep 05 02:46:03.216812 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:46:03.216660 2555 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-s672k/perf-node-gather-daemonset-cdr4b" event={"ID":"25e6012a-3137-46f2-aeb8-c4a421bb4f69","Type":"ContainerStarted","Data":"470cb296986f94929353df481126ebef975389fb06a2e850c7df1f1240209c59"} Sep 05 02:46:03.216812 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:46:03.216699 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-s672k/perf-node-gather-daemonset-cdr4b" Sep 05 02:46:03.238491 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:46:03.238450 2555 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-s672k/perf-node-gather-daemonset-cdr4b" podStartSLOduration=2.23843501 podStartE2EDuration="2.23843501s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-05 02:46:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-05 02:46:03.237986608 +0000 UTC m=+1689.740124208" watchObservedRunningTime="2026-09-05 02:46:03.23843501 +0000 UTC m=+1689.740572606" Sep 05 02:46:04.177639 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:46:04.177609 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-5pbzk_0f87c1ae-2aab-484b-9483-aa5aa41bbf2a/serve-healthcheck-canary/0.log" Sep 05 02:46:04.732486 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:46:04.732458 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-nxqlq_ba8f84f4-5dce-49da-81c1-705a209d5f31/kube-rbac-proxy/0.log" Sep 05 02:46:04.751859 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:46:04.751830 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-nxqlq_ba8f84f4-5dce-49da-81c1-705a209d5f31/exporter/0.log" Sep 05 02:46:04.773861 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:46:04.773822 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-nxqlq_ba8f84f4-5dce-49da-81c1-705a209d5f31/extractor/0.log" Sep 05 02:46:07.215856 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:46:07.215826 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_s3-init-sn7z7_6f08dae8-a141-40a3-99e2-6c8b727f9dcb/s3-init/0.log" Sep 05 02:46:07.231903 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:46:07.231880 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_s3-init-sn7z7_6f08dae8-a141-40a3-99e2-6c8b727f9dcb/download-hf-model/0.log" Sep 05 02:46:09.230661 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:46:09.230629 2555 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-s672k/perf-node-gather-daemonset-cdr4b" Sep 05 02:46:12.203635 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:46:12.203549 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-8d7dd4675-8g9pd_9ac0ce1c-17b0-4dd0-955d-9881b8ee8f22/kube-storage-version-migrator-operator/1.log" Sep 05 02:46:12.204446 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:46:12.204431 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-8d7dd4675-8g9pd_9ac0ce1c-17b0-4dd0-955d-9881b8ee8f22/kube-storage-version-migrator-operator/0.log" Sep 05 02:46:13.535819 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:46:13.535791 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-v4hcb_9fccb273-b727-42f4-8e22-50f62446778f/kube-multus-additional-cni-plugins/0.log" Sep 05 02:46:13.560958 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:46:13.560928 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-v4hcb_9fccb273-b727-42f4-8e22-50f62446778f/egress-router-binary-copy/0.log" Sep 05 02:46:13.586277 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:46:13.586258 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-v4hcb_9fccb273-b727-42f4-8e22-50f62446778f/cni-plugins/0.log" Sep 05 02:46:13.612999 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:46:13.612978 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-v4hcb_9fccb273-b727-42f4-8e22-50f62446778f/bond-cni-plugin/0.log" Sep 05 02:46:13.635087 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:46:13.635058 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-v4hcb_9fccb273-b727-42f4-8e22-50f62446778f/routeoverride-cni/0.log" Sep 05 02:46:13.657496 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:46:13.657476 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-v4hcb_9fccb273-b727-42f4-8e22-50f62446778f/whereabouts-cni-bincopy/0.log" Sep 05 02:46:13.678947 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:46:13.678919 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-v4hcb_9fccb273-b727-42f4-8e22-50f62446778f/whereabouts-cni/0.log" Sep 05 02:46:13.771301 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:46:13.771275 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-n5fs5_8de62bad-6e7c-4c9e-bb4a-49914420c1de/kube-multus/0.log" Sep 05 02:46:13.834038 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:46:13.833952 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-2x2gr_2fc3d6af-c656-4be0-8188-317d2dde7a6b/network-metrics-daemon/0.log" Sep 05 02:46:13.855056 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:46:13.855011 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-2x2gr_2fc3d6af-c656-4be0-8188-317d2dde7a6b/kube-rbac-proxy/0.log" Sep 05 02:46:15.056438 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:46:15.056409 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mz2wx_45944019-aa1a-49fd-a178-a6a38ad9a139/ovn-controller/0.log" Sep 05 02:46:15.076111 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:46:15.076092 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mz2wx_45944019-aa1a-49fd-a178-a6a38ad9a139/ovn-acl-logging/0.log" Sep 05 02:46:15.100720 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:46:15.100701 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mz2wx_45944019-aa1a-49fd-a178-a6a38ad9a139/kube-rbac-proxy-node/0.log" Sep 05 02:46:15.124866 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:46:15.124844 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mz2wx_45944019-aa1a-49fd-a178-a6a38ad9a139/kube-rbac-proxy-ovn-metrics/0.log" Sep 05 02:46:15.145186 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:46:15.145167 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mz2wx_45944019-aa1a-49fd-a178-a6a38ad9a139/northd/0.log" Sep 05 02:46:15.171201 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:46:15.171181 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mz2wx_45944019-aa1a-49fd-a178-a6a38ad9a139/nbdb/0.log" Sep 05 02:46:15.196439 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:46:15.196398 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mz2wx_45944019-aa1a-49fd-a178-a6a38ad9a139/sbdb/0.log" Sep 05 02:46:15.235140 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:46:15.235123 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mz2wx_45944019-aa1a-49fd-a178-a6a38ad9a139/ovnkube-controller/0.log" Sep 05 02:46:16.273769 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:46:16.273694 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-zt7r6_ba04f298-aebd-463b-940e-8a446b160645/network-check-target-container/0.log" Sep 05 02:46:17.180476 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:46:17.180452 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-bz7s2_86874f7b-fd54-4c79-9346-2c3f6d1e8508/iptables-alerter/0.log" Sep 05 02:46:17.959135 ip-10-0-133-250 kubenswrapper[2555]: I0905 02:46:17.959102 2555 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_tuned-qf6xm_4ddfb9fd-38a7-4b2d-bb70-5e5c4494a02d/tuned/0.log"