Sep 08 03:55:05.318598 ip-10-0-128-67 systemd[1]: Starting Kubernetes Kubelet... Sep 08 03:55:05.743152 ip-10-0-128-67 kubenswrapper[2571]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 08 03:55:05.743152 ip-10-0-128-67 kubenswrapper[2571]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Sep 08 03:55:05.743152 ip-10-0-128-67 kubenswrapper[2571]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 08 03:55:05.743152 ip-10-0-128-67 kubenswrapper[2571]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Sep 08 03:55:05.743152 ip-10-0-128-67 kubenswrapper[2571]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 08 03:55:05.745061 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:05.744980 2571 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Sep 08 03:55:05.750817 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.750796 2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 08 03:55:05.750817 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.750812 2571 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 08 03:55:05.750817 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.750816 2571 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 08 03:55:05.750817 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.750819 2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 08 03:55:05.750817 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.750822 2571 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 08 03:55:05.751012 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.750826 2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 08 03:55:05.751012 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.750829 2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 08 03:55:05.751012 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.750832 2571 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 08 03:55:05.751012 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.750834 2571 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 08 03:55:05.751012 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.750838 2571 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 08 03:55:05.751012 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.750841 2571 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 08 03:55:05.751012 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.750843 2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 08 03:55:05.751012 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.750846 2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 08 03:55:05.751012 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.750853 2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 08 03:55:05.751012 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.750856 2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 08 03:55:05.751012 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.750859 2571 feature_gate.go:328] unrecognized feature gate: Example2 Sep 08 03:55:05.751012 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.750862 2571 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 08 03:55:05.751012 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.750864 2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 08 03:55:05.751012 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.750867 2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 08 03:55:05.751012 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.750870 2571 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 08 03:55:05.751012 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.750872 2571 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 08 03:55:05.751012 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.750875 2571 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 08 03:55:05.751012 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.750878 2571 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 08 03:55:05.751012 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.750881 2571 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 08 03:55:05.751012 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.750883 2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 08 03:55:05.751517 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.750886 2571 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 08 03:55:05.751517 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.750888 2571 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 08 03:55:05.751517 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.750895 2571 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 08 03:55:05.751517 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.750898 2571 feature_gate.go:328] unrecognized feature gate: Example Sep 08 03:55:05.751517 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.750900 2571 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 08 03:55:05.751517 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.750903 2571 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 08 03:55:05.751517 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.750906 2571 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 08 03:55:05.751517 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.750908 2571 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 08 03:55:05.751517 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.750911 2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 08 03:55:05.751517 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.750914 2571 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 08 03:55:05.751517 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.750916 2571 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 08 03:55:05.751517 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.750919 2571 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 08 03:55:05.751517 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.750922 2571 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 08 03:55:05.751517 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.750926 2571 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 08 03:55:05.751517 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.750929 2571 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 08 03:55:05.751517 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.750931 2571 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 08 03:55:05.751517 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.750934 2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 08 03:55:05.751517 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.750937 2571 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 08 03:55:05.751517 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.750940 2571 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 08 03:55:05.751517 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.750943 2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 08 03:55:05.751998 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.750946 2571 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 08 03:55:05.751998 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.750949 2571 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 08 03:55:05.751998 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.750951 2571 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 08 03:55:05.751998 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.750954 2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 08 03:55:05.751998 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.750956 2571 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 08 03:55:05.751998 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.750959 2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 08 03:55:05.751998 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.750962 2571 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 08 03:55:05.751998 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.750965 2571 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 08 03:55:05.751998 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.750967 2571 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 08 03:55:05.751998 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.750970 2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 08 03:55:05.751998 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.750973 2571 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 08 03:55:05.751998 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.750976 2571 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 08 03:55:05.751998 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.750978 2571 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 08 03:55:05.751998 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.750982 2571 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 08 03:55:05.751998 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.750987 2571 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 08 03:55:05.751998 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.750990 2571 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 08 03:55:05.751998 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.750993 2571 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 08 03:55:05.751998 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.750997 2571 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 08 03:55:05.751998 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.750999 2571 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 08 03:55:05.752462 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.751002 2571 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 08 03:55:05.752462 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.751005 2571 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 08 03:55:05.752462 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.751007 2571 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 08 03:55:05.752462 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.751010 2571 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 08 03:55:05.752462 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.751013 2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 08 03:55:05.752462 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.751017 2571 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 08 03:55:05.752462 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.751022 2571 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 08 03:55:05.752462 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.751025 2571 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 08 03:55:05.752462 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.751030 2571 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 08 03:55:05.752462 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.751035 2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 08 03:55:05.752462 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.751038 2571 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 08 03:55:05.752462 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.751041 2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 08 03:55:05.752462 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.751044 2571 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 08 03:55:05.752462 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.751046 2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 08 03:55:05.752462 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.751049 2571 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 08 03:55:05.752462 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.751052 2571 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 08 03:55:05.752462 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.751054 2571 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 08 03:55:05.752462 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.751057 2571 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 08 03:55:05.752462 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.751059 2571 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 08 03:55:05.752933 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.751063 2571 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 08 03:55:05.752933 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.751065 2571 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 08 03:55:05.752933 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.751068 2571 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 08 03:55:05.752933 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.751070 2571 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 08 03:55:05.752933 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.751073 2571 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 08 03:55:05.752933 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.751076 2571 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 08 03:55:05.752933 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.751078 2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 08 03:55:05.752933 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.751080 2571 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 08 03:55:05.752933 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.751083 2571 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 08 03:55:05.752933 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.751085 2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 08 03:55:05.752933 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.751088 2571 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 08 03:55:05.752933 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.751090 2571 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 08 03:55:05.752933 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.751093 2571 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 08 03:55:05.752933 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.751095 2571 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 08 03:55:05.752933 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.751098 2571 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 08 03:55:05.752933 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.751100 2571 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 08 03:55:05.752933 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.751810 2571 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 08 03:55:05.752933 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.751816 2571 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 08 03:55:05.752933 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.751819 2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 08 03:55:05.752933 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.751823 2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 08 03:55:05.753434 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.751826 2571 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 08 03:55:05.753434 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.751829 2571 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 08 03:55:05.753434 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.751831 2571 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 08 03:55:05.753434 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.751834 2571 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 08 03:55:05.753434 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.751837 2571 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 08 03:55:05.753434 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.751840 2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 08 03:55:05.753434 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.751842 2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 08 03:55:05.753434 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.751845 2571 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 08 03:55:05.753434 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.751847 2571 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 08 03:55:05.753434 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.751850 2571 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 08 03:55:05.753434 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.751853 2571 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 08 03:55:05.753434 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.751855 2571 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 08 03:55:05.753434 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.751858 2571 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 08 03:55:05.753434 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.751861 2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 08 03:55:05.753434 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.751864 2571 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 08 03:55:05.753434 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.751866 2571 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 08 03:55:05.753434 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.751869 2571 feature_gate.go:328] unrecognized feature gate: Example Sep 08 03:55:05.753434 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.751872 2571 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 08 03:55:05.753434 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.751874 2571 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 08 03:55:05.753434 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.751877 2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 08 03:55:05.753923 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.751879 2571 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 08 03:55:05.753923 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.751882 2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 08 03:55:05.753923 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.751886 2571 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 08 03:55:05.753923 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.751890 2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 08 03:55:05.753923 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.751893 2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 08 03:55:05.753923 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.751896 2571 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 08 03:55:05.753923 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.751899 2571 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 08 03:55:05.753923 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.751902 2571 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 08 03:55:05.753923 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.751905 2571 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 08 03:55:05.753923 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.751907 2571 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 08 03:55:05.753923 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.751910 2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 08 03:55:05.753923 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.751915 2571 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 08 03:55:05.753923 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.751918 2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 08 03:55:05.753923 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.751920 2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 08 03:55:05.753923 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.751923 2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 08 03:55:05.753923 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.751926 2571 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 08 03:55:05.753923 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.751928 2571 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 08 03:55:05.753923 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.751931 2571 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 08 03:55:05.753923 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.751934 2571 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 08 03:55:05.754412 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.751936 2571 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 08 03:55:05.754412 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.751939 2571 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 08 03:55:05.754412 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.751942 2571 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 08 03:55:05.754412 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.751944 2571 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 08 03:55:05.754412 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.751947 2571 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 08 03:55:05.754412 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.751950 2571 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 08 03:55:05.754412 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.751953 2571 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 08 03:55:05.754412 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.751956 2571 feature_gate.go:328] unrecognized feature gate: Example2 Sep 08 03:55:05.754412 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.751959 2571 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 08 03:55:05.754412 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.751962 2571 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 08 03:55:05.754412 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.751965 2571 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 08 03:55:05.754412 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.751970 2571 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 08 03:55:05.754412 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.751973 2571 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 08 03:55:05.754412 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.751976 2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 08 03:55:05.754412 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.751978 2571 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 08 03:55:05.754412 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.751981 2571 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 08 03:55:05.754412 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.751984 2571 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 08 03:55:05.754412 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.751987 2571 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 08 03:55:05.754412 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.751990 2571 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 08 03:55:05.754872 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.751992 2571 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 08 03:55:05.754872 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.751995 2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 08 03:55:05.754872 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.751997 2571 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 08 03:55:05.754872 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.752000 2571 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 08 03:55:05.754872 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.752003 2571 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 08 03:55:05.754872 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.752008 2571 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 08 03:55:05.754872 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.752012 2571 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 08 03:55:05.754872 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.752015 2571 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 08 03:55:05.754872 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.752017 2571 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 08 03:55:05.754872 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.752021 2571 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 08 03:55:05.754872 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.752024 2571 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 08 03:55:05.754872 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.752028 2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 08 03:55:05.754872 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.752031 2571 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 08 03:55:05.754872 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.752033 2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 08 03:55:05.754872 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.752036 2571 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 08 03:55:05.754872 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.752039 2571 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 08 03:55:05.754872 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.752041 2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 08 03:55:05.754872 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.752044 2571 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 08 03:55:05.754872 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.752046 2571 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 08 03:55:05.755355 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.752049 2571 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 08 03:55:05.755355 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.752051 2571 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 08 03:55:05.755355 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.752055 2571 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 08 03:55:05.755355 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.752057 2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 08 03:55:05.755355 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.752060 2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 08 03:55:05.755355 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.752062 2571 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 08 03:55:05.755355 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.752065 2571 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 08 03:55:05.755355 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.752067 2571 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 08 03:55:05.755355 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.752070 2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 08 03:55:05.755355 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.752072 2571 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 08 03:55:05.755355 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.752075 2571 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 08 03:55:05.755355 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.752077 2571 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 08 03:55:05.755355 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.752080 2571 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 08 03:55:05.755355 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.752083 2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 08 03:55:05.755355 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.752086 2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 08 03:55:05.755355 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.752088 2571 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 08 03:55:05.755355 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.752091 2571 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 08 03:55:05.755355 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.752093 2571 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 08 03:55:05.755355 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.752485 2571 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 08 03:55:05.755811 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.752490 2571 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 08 03:55:05.755811 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.752493 2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 08 03:55:05.755811 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.752496 2571 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 08 03:55:05.755811 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.752499 2571 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 08 03:55:05.755811 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.752502 2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 08 03:55:05.755811 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.752504 2571 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 08 03:55:05.755811 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.752508 2571 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 08 03:55:05.755811 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.752512 2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 08 03:55:05.755811 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.752516 2571 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 08 03:55:05.755811 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.752519 2571 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 08 03:55:05.755811 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.752522 2571 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 08 03:55:05.755811 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.752525 2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 08 03:55:05.755811 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.752527 2571 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 08 03:55:05.755811 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.752530 2571 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 08 03:55:05.755811 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.752532 2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 08 03:55:05.755811 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.752535 2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 08 03:55:05.755811 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.752538 2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 08 03:55:05.755811 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.752540 2571 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 08 03:55:05.755811 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.752543 2571 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 08 03:55:05.756302 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.752545 2571 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 08 03:55:05.756302 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.752548 2571 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 08 03:55:05.756302 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.752551 2571 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 08 03:55:05.756302 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.752553 2571 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 08 03:55:05.756302 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.752555 2571 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 08 03:55:05.756302 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.752558 2571 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 08 03:55:05.756302 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.752561 2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 08 03:55:05.756302 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.752564 2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 08 03:55:05.756302 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.752566 2571 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 08 03:55:05.756302 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.752569 2571 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 08 03:55:05.756302 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.752571 2571 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 08 03:55:05.756302 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.752574 2571 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 08 03:55:05.756302 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.752579 2571 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 08 03:55:05.756302 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.752582 2571 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 08 03:55:05.756302 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.752586 2571 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 08 03:55:05.756302 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.752590 2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 08 03:55:05.756302 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.752593 2571 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 08 03:55:05.756302 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.752596 2571 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 08 03:55:05.756302 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.752599 2571 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 08 03:55:05.756302 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.752601 2571 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 08 03:55:05.756786 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.752604 2571 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 08 03:55:05.756786 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.752607 2571 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 08 03:55:05.756786 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.752610 2571 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 08 03:55:05.756786 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.752612 2571 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 08 03:55:05.756786 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.752620 2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 08 03:55:05.756786 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.752623 2571 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 08 03:55:05.756786 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.752626 2571 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 08 03:55:05.756786 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.752628 2571 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 08 03:55:05.756786 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.752631 2571 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 08 03:55:05.756786 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.752633 2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 08 03:55:05.756786 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.752636 2571 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 08 03:55:05.756786 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.752638 2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 08 03:55:05.756786 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.752641 2571 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 08 03:55:05.756786 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.752643 2571 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 08 03:55:05.756786 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.752646 2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 08 03:55:05.756786 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.752648 2571 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 08 03:55:05.756786 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.752651 2571 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 08 03:55:05.756786 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.752653 2571 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 08 03:55:05.756786 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.752656 2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 08 03:55:05.757236 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.752658 2571 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 08 03:55:05.757236 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.752661 2571 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 08 03:55:05.757236 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.752663 2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 08 03:55:05.757236 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.752666 2571 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 08 03:55:05.757236 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.752668 2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 08 03:55:05.757236 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.752673 2571 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 08 03:55:05.757236 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.752676 2571 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 08 03:55:05.757236 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.752680 2571 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 08 03:55:05.757236 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.752683 2571 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 08 03:55:05.757236 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.752685 2571 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 08 03:55:05.757236 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.752688 2571 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 08 03:55:05.757236 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.752691 2571 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 08 03:55:05.757236 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.752694 2571 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 08 03:55:05.757236 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.752696 2571 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 08 03:55:05.757236 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.752699 2571 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 08 03:55:05.757236 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.752701 2571 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 08 03:55:05.757236 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.752704 2571 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 08 03:55:05.757236 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.752706 2571 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 08 03:55:05.757236 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.752709 2571 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 08 03:55:05.757236 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.752712 2571 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 08 03:55:05.757890 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.752714 2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 08 03:55:05.757890 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.752716 2571 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 08 03:55:05.757890 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.752719 2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 08 03:55:05.757890 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.752722 2571 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 08 03:55:05.757890 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.752724 2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 08 03:55:05.757890 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.752727 2571 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 08 03:55:05.757890 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.752729 2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 08 03:55:05.757890 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.752732 2571 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 08 03:55:05.757890 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.752734 2571 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 08 03:55:05.757890 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.752736 2571 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 08 03:55:05.757890 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.752739 2571 feature_gate.go:328] unrecognized feature gate: Example Sep 08 03:55:05.757890 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.752742 2571 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 08 03:55:05.757890 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.752744 2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 08 03:55:05.757890 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.752746 2571 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 08 03:55:05.757890 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.752749 2571 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 08 03:55:05.757890 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.752751 2571 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 08 03:55:05.757890 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.752754 2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 08 03:55:05.757890 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.752758 2571 feature_gate.go:328] unrecognized feature gate: Example2 Sep 08 03:55:05.757890 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.752761 2571 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 08 03:55:05.757890 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.752763 2571 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 08 03:55:05.758405 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:05.752840 2571 flags.go:64] FLAG: --address="0.0.0.0" Sep 08 03:55:05.758405 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:05.752874 2571 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Sep 08 03:55:05.758405 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:05.752880 2571 flags.go:64] FLAG: --anonymous-auth="true" Sep 08 03:55:05.758405 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:05.752885 2571 flags.go:64] FLAG: --application-metrics-count-limit="100" Sep 08 03:55:05.758405 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:05.752889 2571 flags.go:64] FLAG: --authentication-token-webhook="false" Sep 08 03:55:05.758405 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:05.752892 2571 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Sep 08 03:55:05.758405 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:05.752897 2571 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Sep 08 03:55:05.758405 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:05.752900 2571 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Sep 08 03:55:05.758405 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:05.752903 2571 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Sep 08 03:55:05.758405 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:05.752906 2571 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Sep 08 03:55:05.758405 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:05.752909 2571 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Sep 08 03:55:05.758405 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:05.752913 2571 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Sep 08 03:55:05.758405 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:05.752916 2571 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Sep 08 03:55:05.758405 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:05.752919 2571 flags.go:64] FLAG: --cgroup-root="" Sep 08 03:55:05.758405 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:05.752922 2571 flags.go:64] FLAG: --cgroups-per-qos="true" Sep 08 03:55:05.758405 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:05.752925 2571 flags.go:64] FLAG: --client-ca-file="" Sep 08 03:55:05.758405 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:05.752928 2571 flags.go:64] FLAG: --cloud-provider="external" Sep 08 03:55:05.758405 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:05.752931 2571 flags.go:64] FLAG: --cluster-dns="[]" Sep 08 03:55:05.758405 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:05.752935 2571 flags.go:64] FLAG: --cluster-domain="" Sep 08 03:55:05.758405 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:05.752938 2571 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Sep 08 03:55:05.758405 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:05.752941 2571 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Sep 08 03:55:05.758405 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:05.752945 2571 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Sep 08 03:55:05.758405 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:05.752948 2571 flags.go:64] FLAG: --container-log-max-files="5" Sep 08 03:55:05.758405 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:05.752952 2571 flags.go:64] FLAG: --container-log-max-size="10Mi" Sep 08 03:55:05.759018 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:05.752954 2571 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Sep 08 03:55:05.759018 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:05.752957 2571 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Sep 08 03:55:05.759018 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:05.752961 2571 flags.go:64] FLAG: --containerd-namespace="k8s.io" Sep 08 03:55:05.759018 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:05.752964 2571 flags.go:64] FLAG: --contention-profiling="false" Sep 08 03:55:05.759018 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:05.752966 2571 flags.go:64] FLAG: --cpu-cfs-quota="true" Sep 08 03:55:05.759018 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:05.752971 2571 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Sep 08 03:55:05.759018 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:05.752974 2571 flags.go:64] FLAG: --cpu-manager-policy="none" Sep 08 03:55:05.759018 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:05.752977 2571 flags.go:64] FLAG: --cpu-manager-policy-options="" Sep 08 03:55:05.759018 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:05.752981 2571 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Sep 08 03:55:05.759018 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:05.752984 2571 flags.go:64] FLAG: --enable-controller-attach-detach="true" Sep 08 03:55:05.759018 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:05.752987 2571 flags.go:64] FLAG: --enable-debugging-handlers="true" Sep 08 03:55:05.759018 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:05.752989 2571 flags.go:64] FLAG: --enable-load-reader="false" Sep 08 03:55:05.759018 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:05.752992 2571 flags.go:64] FLAG: --enable-server="true" Sep 08 03:55:05.759018 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:05.752995 2571 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Sep 08 03:55:05.759018 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:05.752999 2571 flags.go:64] FLAG: --event-burst="100" Sep 08 03:55:05.759018 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:05.753002 2571 flags.go:64] FLAG: --event-qps="50" Sep 08 03:55:05.759018 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:05.753005 2571 flags.go:64] FLAG: --event-storage-age-limit="default=0" Sep 08 03:55:05.759018 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:05.753008 2571 flags.go:64] FLAG: --event-storage-event-limit="default=0" Sep 08 03:55:05.759018 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:05.753011 2571 flags.go:64] FLAG: --eviction-hard="" Sep 08 03:55:05.759018 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:05.753014 2571 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Sep 08 03:55:05.759018 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:05.753017 2571 flags.go:64] FLAG: --eviction-minimum-reclaim="" Sep 08 03:55:05.759018 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:05.753020 2571 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Sep 08 03:55:05.759018 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:05.753023 2571 flags.go:64] FLAG: --eviction-soft="" Sep 08 03:55:05.759018 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:05.753025 2571 flags.go:64] FLAG: --eviction-soft-grace-period="" Sep 08 03:55:05.759018 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:05.753028 2571 flags.go:64] FLAG: --exit-on-lock-contention="false" Sep 08 03:55:05.759658 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:05.753031 2571 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Sep 08 03:55:05.759658 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:05.753034 2571 flags.go:64] FLAG: --experimental-mounter-path="" Sep 08 03:55:05.759658 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:05.753037 2571 flags.go:64] FLAG: --fail-cgroupv1="false" Sep 08 03:55:05.759658 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:05.753040 2571 flags.go:64] FLAG: --fail-swap-on="true" Sep 08 03:55:05.759658 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:05.753044 2571 flags.go:64] FLAG: --feature-gates="" Sep 08 03:55:05.759658 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:05.753048 2571 flags.go:64] FLAG: --file-check-frequency="20s" Sep 08 03:55:05.759658 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:05.753051 2571 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Sep 08 03:55:05.759658 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:05.753054 2571 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Sep 08 03:55:05.759658 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:05.753057 2571 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Sep 08 03:55:05.759658 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:05.753060 2571 flags.go:64] FLAG: --healthz-port="10248" Sep 08 03:55:05.759658 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:05.753063 2571 flags.go:64] FLAG: --help="false" Sep 08 03:55:05.759658 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:05.753066 2571 flags.go:64] FLAG: --hostname-override="ip-10-0-128-67.ec2.internal" Sep 08 03:55:05.759658 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:05.753071 2571 flags.go:64] FLAG: --housekeeping-interval="10s" Sep 08 03:55:05.759658 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:05.753073 2571 flags.go:64] FLAG: --http-check-frequency="20s" Sep 08 03:55:05.759658 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:05.753077 2571 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Sep 08 03:55:05.759658 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:05.753080 2571 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Sep 08 03:55:05.759658 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:05.753083 2571 flags.go:64] FLAG: --image-gc-high-threshold="85" Sep 08 03:55:05.759658 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:05.753086 2571 flags.go:64] FLAG: --image-gc-low-threshold="80" Sep 08 03:55:05.759658 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:05.753089 2571 flags.go:64] FLAG: --image-service-endpoint="" Sep 08 03:55:05.759658 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:05.753091 2571 flags.go:64] FLAG: --kernel-memcg-notification="false" Sep 08 03:55:05.759658 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:05.753094 2571 flags.go:64] FLAG: --kube-api-burst="100" Sep 08 03:55:05.759658 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:05.753097 2571 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Sep 08 03:55:05.759658 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:05.753100 2571 flags.go:64] FLAG: --kube-api-qps="50" Sep 08 03:55:05.759658 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:05.753102 2571 flags.go:64] FLAG: --kube-reserved="" Sep 08 03:55:05.760270 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:05.753105 2571 flags.go:64] FLAG: --kube-reserved-cgroup="" Sep 08 03:55:05.760270 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:05.753108 2571 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Sep 08 03:55:05.760270 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:05.753111 2571 flags.go:64] FLAG: --kubelet-cgroups="" Sep 08 03:55:05.760270 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:05.753113 2571 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Sep 08 03:55:05.760270 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:05.753116 2571 flags.go:64] FLAG: --lock-file="" Sep 08 03:55:05.760270 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:05.753119 2571 flags.go:64] FLAG: --log-cadvisor-usage="false" Sep 08 03:55:05.760270 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:05.753122 2571 flags.go:64] FLAG: --log-flush-frequency="5s" Sep 08 03:55:05.760270 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:05.753124 2571 flags.go:64] FLAG: --log-json-info-buffer-size="0" Sep 08 03:55:05.760270 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:05.753129 2571 flags.go:64] FLAG: --log-json-split-stream="false" Sep 08 03:55:05.760270 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:05.753132 2571 flags.go:64] FLAG: --log-text-info-buffer-size="0" Sep 08 03:55:05.760270 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:05.753135 2571 flags.go:64] FLAG: --log-text-split-stream="false" Sep 08 03:55:05.760270 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:05.753138 2571 flags.go:64] FLAG: --logging-format="text" Sep 08 03:55:05.760270 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:05.753142 2571 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Sep 08 03:55:05.760270 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:05.753145 2571 flags.go:64] FLAG: --make-iptables-util-chains="true" Sep 08 03:55:05.760270 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:05.753147 2571 flags.go:64] FLAG: --manifest-url="" Sep 08 03:55:05.760270 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:05.753150 2571 flags.go:64] FLAG: --manifest-url-header="" Sep 08 03:55:05.760270 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:05.753154 2571 flags.go:64] FLAG: --max-housekeeping-interval="15s" Sep 08 03:55:05.760270 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:05.753157 2571 flags.go:64] FLAG: --max-open-files="1000000" Sep 08 03:55:05.760270 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:05.753165 2571 flags.go:64] FLAG: --max-pods="110" Sep 08 03:55:05.760270 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:05.753168 2571 flags.go:64] FLAG: --maximum-dead-containers="-1" Sep 08 03:55:05.760270 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:05.753172 2571 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Sep 08 03:55:05.760270 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:05.753175 2571 flags.go:64] FLAG: --memory-manager-policy="None" Sep 08 03:55:05.760270 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:05.753178 2571 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Sep 08 03:55:05.760270 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:05.753181 2571 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Sep 08 03:55:05.760270 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:05.753183 2571 flags.go:64] FLAG: --node-ip="0.0.0.0" Sep 08 03:55:05.760893 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:05.753186 2571 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Sep 08 03:55:05.760893 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:05.753193 2571 flags.go:64] FLAG: --node-status-max-images="50" Sep 08 03:55:05.760893 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:05.753196 2571 flags.go:64] FLAG: --node-status-update-frequency="10s" Sep 08 03:55:05.760893 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:05.753199 2571 flags.go:64] FLAG: --oom-score-adj="-999" Sep 08 03:55:05.760893 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:05.753202 2571 flags.go:64] FLAG: --pod-cidr="" Sep 08 03:55:05.760893 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:05.753205 2571 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8ccbacc999dbf9abad8f4009240188312b683f36ced4763eed166c1500c164b1" Sep 08 03:55:05.760893 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:05.753210 2571 flags.go:64] FLAG: --pod-manifest-path="" Sep 08 03:55:05.760893 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:05.753212 2571 flags.go:64] FLAG: --pod-max-pids="-1" Sep 08 03:55:05.760893 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:05.753215 2571 flags.go:64] FLAG: --pods-per-core="0" Sep 08 03:55:05.760893 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:05.753218 2571 flags.go:64] FLAG: --port="10250" Sep 08 03:55:05.760893 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:05.753221 2571 flags.go:64] FLAG: --protect-kernel-defaults="false" Sep 08 03:55:05.760893 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:05.753224 2571 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-09a3d353f772481bd" Sep 08 03:55:05.760893 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:05.753227 2571 flags.go:64] FLAG: --qos-reserved="" Sep 08 03:55:05.760893 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:05.753230 2571 flags.go:64] FLAG: --read-only-port="10255" Sep 08 03:55:05.760893 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:05.753232 2571 flags.go:64] FLAG: --register-node="true" Sep 08 03:55:05.760893 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:05.753235 2571 flags.go:64] FLAG: --register-with-taints="" Sep 08 03:55:05.760893 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:05.753239 2571 flags.go:64] FLAG: --registry-burst="10" Sep 08 03:55:05.760893 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:05.753242 2571 flags.go:64] FLAG: --registry-qps="5" Sep 08 03:55:05.760893 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:05.753245 2571 flags.go:64] FLAG: --reserved-cpus="" Sep 08 03:55:05.760893 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:05.753262 2571 flags.go:64] FLAG: --reserved-memory="" Sep 08 03:55:05.760893 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:05.753266 2571 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Sep 08 03:55:05.760893 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:05.753269 2571 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Sep 08 03:55:05.760893 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:05.753272 2571 flags.go:64] FLAG: --rotate-certificates="false" Sep 08 03:55:05.760893 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:05.753275 2571 flags.go:64] FLAG: --rotate-server-certificates="false" Sep 08 03:55:05.760893 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:05.753278 2571 flags.go:64] FLAG: --runonce="false" Sep 08 03:55:05.761517 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:05.753280 2571 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Sep 08 03:55:05.761517 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:05.753283 2571 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Sep 08 03:55:05.761517 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:05.753286 2571 flags.go:64] FLAG: --seccomp-default="false" Sep 08 03:55:05.761517 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:05.753290 2571 flags.go:64] FLAG: --serialize-image-pulls="true" Sep 08 03:55:05.761517 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:05.753293 2571 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Sep 08 03:55:05.761517 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:05.753296 2571 flags.go:64] FLAG: --storage-driver-db="cadvisor" Sep 08 03:55:05.761517 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:05.753299 2571 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Sep 08 03:55:05.761517 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:05.753302 2571 flags.go:64] FLAG: --storage-driver-password="root" Sep 08 03:55:05.761517 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:05.753304 2571 flags.go:64] FLAG: --storage-driver-secure="false" Sep 08 03:55:05.761517 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:05.753307 2571 flags.go:64] FLAG: --storage-driver-table="stats" Sep 08 03:55:05.761517 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:05.753310 2571 flags.go:64] FLAG: --storage-driver-user="root" Sep 08 03:55:05.761517 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:05.753313 2571 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Sep 08 03:55:05.761517 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:05.753316 2571 flags.go:64] FLAG: --sync-frequency="1m0s" Sep 08 03:55:05.761517 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:05.753319 2571 flags.go:64] FLAG: --system-cgroups="" Sep 08 03:55:05.761517 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:05.753321 2571 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Sep 08 03:55:05.761517 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:05.753326 2571 flags.go:64] FLAG: --system-reserved-cgroup="" Sep 08 03:55:05.761517 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:05.753329 2571 flags.go:64] FLAG: --tls-cert-file="" Sep 08 03:55:05.761517 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:05.753332 2571 flags.go:64] FLAG: --tls-cipher-suites="[]" Sep 08 03:55:05.761517 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:05.753336 2571 flags.go:64] FLAG: --tls-min-version="" Sep 08 03:55:05.761517 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:05.753338 2571 flags.go:64] FLAG: --tls-private-key-file="" Sep 08 03:55:05.761517 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:05.753341 2571 flags.go:64] FLAG: --topology-manager-policy="none" Sep 08 03:55:05.761517 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:05.753344 2571 flags.go:64] FLAG: --topology-manager-policy-options="" Sep 08 03:55:05.761517 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:05.753346 2571 flags.go:64] FLAG: --topology-manager-scope="container" Sep 08 03:55:05.761517 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:05.753349 2571 flags.go:64] FLAG: --v="2" Sep 08 03:55:05.761517 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:05.753353 2571 flags.go:64] FLAG: --version="false" Sep 08 03:55:05.762136 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:05.753357 2571 flags.go:64] FLAG: --vmodule="" Sep 08 03:55:05.762136 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:05.753362 2571 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Sep 08 03:55:05.762136 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:05.753365 2571 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Sep 08 03:55:05.762136 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.753469 2571 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 08 03:55:05.762136 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.753473 2571 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 08 03:55:05.762136 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.753476 2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 08 03:55:05.762136 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.753479 2571 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 08 03:55:05.762136 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.753481 2571 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 08 03:55:05.762136 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.753486 2571 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 08 03:55:05.762136 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.753489 2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 08 03:55:05.762136 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.753494 2571 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 08 03:55:05.762136 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.753497 2571 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 08 03:55:05.762136 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.753500 2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 08 03:55:05.762136 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.753503 2571 feature_gate.go:328] unrecognized feature gate: Example2 Sep 08 03:55:05.762136 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.753506 2571 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 08 03:55:05.762136 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.753508 2571 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 08 03:55:05.762136 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.753511 2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 08 03:55:05.762136 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.753513 2571 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 08 03:55:05.762136 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.753516 2571 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 08 03:55:05.762655 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.753518 2571 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 08 03:55:05.762655 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.753521 2571 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 08 03:55:05.762655 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.753523 2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 08 03:55:05.762655 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.753526 2571 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 08 03:55:05.762655 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.753528 2571 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 08 03:55:05.762655 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.753531 2571 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 08 03:55:05.762655 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.753533 2571 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 08 03:55:05.762655 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.753536 2571 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 08 03:55:05.762655 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.753538 2571 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 08 03:55:05.762655 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.753541 2571 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 08 03:55:05.762655 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.753543 2571 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 08 03:55:05.762655 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.753546 2571 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 08 03:55:05.762655 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.753549 2571 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 08 03:55:05.762655 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.753551 2571 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 08 03:55:05.762655 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.753556 2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 08 03:55:05.762655 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.753558 2571 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 08 03:55:05.762655 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.753561 2571 feature_gate.go:328] unrecognized feature gate: Example Sep 08 03:55:05.762655 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.753563 2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 08 03:55:05.762655 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.753566 2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 08 03:55:05.762655 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.753568 2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 08 03:55:05.763141 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.753571 2571 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 08 03:55:05.763141 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.753573 2571 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 08 03:55:05.763141 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.753576 2571 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 08 03:55:05.763141 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.753580 2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 08 03:55:05.763141 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.753582 2571 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 08 03:55:05.763141 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.753585 2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 08 03:55:05.763141 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.753587 2571 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 08 03:55:05.763141 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.753590 2571 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 08 03:55:05.763141 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.753592 2571 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 08 03:55:05.763141 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.753595 2571 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 08 03:55:05.763141 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.753598 2571 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 08 03:55:05.763141 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.753600 2571 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 08 03:55:05.763141 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.753603 2571 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 08 03:55:05.763141 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.753605 2571 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 08 03:55:05.763141 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.753607 2571 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 08 03:55:05.763141 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.753610 2571 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 08 03:55:05.763141 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.753612 2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 08 03:55:05.763141 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.753615 2571 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 08 03:55:05.763141 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.753617 2571 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 08 03:55:05.763141 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.753620 2571 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 08 03:55:05.763643 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.753622 2571 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 08 03:55:05.763643 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.753625 2571 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 08 03:55:05.763643 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.753627 2571 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 08 03:55:05.763643 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.753630 2571 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 08 03:55:05.763643 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.753633 2571 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 08 03:55:05.763643 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.753635 2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 08 03:55:05.763643 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.753639 2571 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 08 03:55:05.763643 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.753642 2571 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 08 03:55:05.763643 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.753644 2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 08 03:55:05.763643 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.753647 2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 08 03:55:05.763643 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.753649 2571 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 08 03:55:05.763643 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.753652 2571 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 08 03:55:05.763643 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.753655 2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 08 03:55:05.763643 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.753657 2571 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 08 03:55:05.763643 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.753660 2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 08 03:55:05.763643 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.753664 2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 08 03:55:05.763643 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.753666 2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 08 03:55:05.763643 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.753669 2571 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 08 03:55:05.763643 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.753672 2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 08 03:55:05.763643 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.753674 2571 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 08 03:55:05.764130 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.753677 2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 08 03:55:05.764130 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.753680 2571 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 08 03:55:05.764130 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.753682 2571 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 08 03:55:05.764130 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.753685 2571 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 08 03:55:05.764130 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.753687 2571 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 08 03:55:05.764130 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.753690 2571 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 08 03:55:05.764130 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.753692 2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 08 03:55:05.764130 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.753696 2571 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 08 03:55:05.764130 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.753699 2571 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 08 03:55:05.764130 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.753702 2571 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 08 03:55:05.764130 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.753706 2571 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 08 03:55:05.764130 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.753710 2571 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 08 03:55:05.764130 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.753713 2571 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 08 03:55:05.764130 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.753716 2571 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 08 03:55:05.764130 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.753719 2571 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 08 03:55:05.764130 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.753722 2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 08 03:55:05.764130 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.753724 2571 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 08 03:55:05.764130 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.753727 2571 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 08 03:55:05.764130 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.753731 2571 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 08 03:55:05.764608 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.753734 2571 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 08 03:55:05.764608 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.753737 2571 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 08 03:55:05.764608 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.753739 2571 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 08 03:55:05.764608 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.753741 2571 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 08 03:55:05.764608 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:05.754430 2571 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 08 03:55:05.764608 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:05.762158 2571 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Sep 08 03:55:05.764608 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:05.762308 2571 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Sep 08 03:55:05.764608 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:05.762324 2571 watchdog_linux.go:95] "Systemd watchdog is not enabled" Sep 08 03:55:05.764608 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:05.762330 2571 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Sep 08 03:55:05.764608 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.762390 2571 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 08 03:55:05.764608 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.762396 2571 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 08 03:55:05.764608 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.762399 2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 08 03:55:05.764608 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.762402 2571 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 08 03:55:05.764608 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.762406 2571 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 08 03:55:05.764608 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.762409 2571 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 08 03:55:05.764982 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.762412 2571 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 08 03:55:05.764982 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.762415 2571 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 08 03:55:05.764982 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.762417 2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 08 03:55:05.764982 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.762420 2571 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 08 03:55:05.764982 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.762423 2571 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 08 03:55:05.764982 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.762425 2571 feature_gate.go:328] unrecognized feature gate: Example Sep 08 03:55:05.764982 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.762430 2571 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 08 03:55:05.764982 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.762435 2571 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 08 03:55:05.764982 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.762438 2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 08 03:55:05.764982 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.762440 2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 08 03:55:05.764982 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.762444 2571 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 08 03:55:05.764982 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.762447 2571 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 08 03:55:05.764982 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.762449 2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 08 03:55:05.764982 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.762452 2571 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 08 03:55:05.764982 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.762454 2571 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 08 03:55:05.764982 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.762457 2571 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 08 03:55:05.764982 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.762460 2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 08 03:55:05.764982 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.762463 2571 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 08 03:55:05.764982 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.762465 2571 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 08 03:55:05.765466 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.762468 2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 08 03:55:05.765466 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.762471 2571 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 08 03:55:05.765466 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.762473 2571 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 08 03:55:05.765466 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.762476 2571 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 08 03:55:05.765466 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.762480 2571 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 08 03:55:05.765466 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.762483 2571 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 08 03:55:05.765466 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.762485 2571 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 08 03:55:05.765466 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.762489 2571 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 08 03:55:05.765466 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.762493 2571 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 08 03:55:05.765466 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.762495 2571 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 08 03:55:05.765466 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.762498 2571 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 08 03:55:05.765466 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.762500 2571 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 08 03:55:05.765466 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.762503 2571 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 08 03:55:05.765466 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.762506 2571 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 08 03:55:05.765466 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.762508 2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 08 03:55:05.765466 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.762511 2571 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 08 03:55:05.765466 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.762513 2571 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 08 03:55:05.765466 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.762516 2571 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 08 03:55:05.765466 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.762519 2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 08 03:55:05.765958 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.762521 2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 08 03:55:05.765958 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.762523 2571 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 08 03:55:05.765958 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.762527 2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 08 03:55:05.765958 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.762529 2571 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 08 03:55:05.765958 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.762532 2571 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 08 03:55:05.765958 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.762534 2571 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 08 03:55:05.765958 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.762537 2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 08 03:55:05.765958 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.762540 2571 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 08 03:55:05.765958 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.762542 2571 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 08 03:55:05.765958 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.762545 2571 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 08 03:55:05.765958 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.762548 2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 08 03:55:05.765958 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.762550 2571 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 08 03:55:05.765958 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.762553 2571 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 08 03:55:05.765958 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.762555 2571 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 08 03:55:05.765958 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.762558 2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 08 03:55:05.765958 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.762561 2571 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 08 03:55:05.765958 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.762563 2571 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 08 03:55:05.765958 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.762567 2571 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 08 03:55:05.765958 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.762570 2571 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 08 03:55:05.766497 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.762573 2571 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 08 03:55:05.766497 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.762576 2571 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 08 03:55:05.766497 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.762579 2571 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 08 03:55:05.766497 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.762581 2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 08 03:55:05.766497 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.762584 2571 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 08 03:55:05.766497 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.762586 2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 08 03:55:05.766497 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.762589 2571 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 08 03:55:05.766497 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.762592 2571 feature_gate.go:328] unrecognized feature gate: Example2 Sep 08 03:55:05.766497 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.762594 2571 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 08 03:55:05.766497 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.762597 2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 08 03:55:05.766497 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.762599 2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 08 03:55:05.766497 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.762602 2571 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 08 03:55:05.766497 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.762605 2571 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 08 03:55:05.766497 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.762608 2571 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 08 03:55:05.766497 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.762611 2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 08 03:55:05.766497 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.762613 2571 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 08 03:55:05.766497 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.762616 2571 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 08 03:55:05.766497 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.762619 2571 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 08 03:55:05.766497 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.762623 2571 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 08 03:55:05.766497 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.762626 2571 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 08 03:55:05.766969 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.762629 2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 08 03:55:05.766969 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.762632 2571 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 08 03:55:05.766969 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.762635 2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 08 03:55:05.766969 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.762637 2571 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 08 03:55:05.766969 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.762640 2571 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 08 03:55:05.766969 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.762643 2571 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 08 03:55:05.766969 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.762646 2571 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 08 03:55:05.766969 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.762649 2571 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 08 03:55:05.766969 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.762651 2571 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 08 03:55:05.766969 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.762655 2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 08 03:55:05.766969 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.762658 2571 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 08 03:55:05.766969 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.762661 2571 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 08 03:55:05.766969 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.762665 2571 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 08 03:55:05.766969 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.762668 2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 08 03:55:05.766969 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.762671 2571 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 08 03:55:05.766969 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.762674 2571 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 08 03:55:05.767370 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:05.762679 2571 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 08 03:55:05.767370 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.762787 2571 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 08 03:55:05.767370 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.762792 2571 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 08 03:55:05.767370 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.762795 2571 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 08 03:55:05.767370 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.762798 2571 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 08 03:55:05.767370 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.762801 2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 08 03:55:05.767370 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.762804 2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 08 03:55:05.767370 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.762806 2571 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 08 03:55:05.767370 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.762809 2571 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 08 03:55:05.767370 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.762811 2571 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 08 03:55:05.767370 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.762814 2571 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 08 03:55:05.767370 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.762817 2571 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 08 03:55:05.767370 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.762819 2571 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 08 03:55:05.767370 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.762822 2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 08 03:55:05.767370 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.762825 2571 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 08 03:55:05.767733 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.762827 2571 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 08 03:55:05.767733 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.762830 2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 08 03:55:05.767733 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.762832 2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 08 03:55:05.767733 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.762835 2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 08 03:55:05.767733 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.762837 2571 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 08 03:55:05.767733 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.762840 2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 08 03:55:05.767733 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.762843 2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 08 03:55:05.767733 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.762845 2571 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 08 03:55:05.767733 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.762848 2571 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 08 03:55:05.767733 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.762852 2571 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 08 03:55:05.767733 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.762854 2571 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 08 03:55:05.767733 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.762857 2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 08 03:55:05.767733 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.762860 2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 08 03:55:05.767733 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.762862 2571 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 08 03:55:05.767733 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.762866 2571 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 08 03:55:05.767733 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.762868 2571 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 08 03:55:05.767733 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.762871 2571 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 08 03:55:05.767733 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.762873 2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 08 03:55:05.767733 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.762876 2571 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 08 03:55:05.767733 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.762878 2571 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 08 03:55:05.768211 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.762881 2571 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 08 03:55:05.768211 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.762885 2571 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 08 03:55:05.768211 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.762889 2571 feature_gate.go:328] unrecognized feature gate: Example2 Sep 08 03:55:05.768211 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.762892 2571 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 08 03:55:05.768211 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.762895 2571 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 08 03:55:05.768211 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.762908 2571 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 08 03:55:05.768211 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.762912 2571 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 08 03:55:05.768211 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.762914 2571 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 08 03:55:05.768211 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.762917 2571 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 08 03:55:05.768211 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.762920 2571 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 08 03:55:05.768211 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.762922 2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 08 03:55:05.768211 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.762925 2571 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 08 03:55:05.768211 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.762928 2571 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 08 03:55:05.768211 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.762931 2571 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 08 03:55:05.768211 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.762934 2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 08 03:55:05.768211 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.762936 2571 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 08 03:55:05.768211 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.762939 2571 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 08 03:55:05.768211 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.762941 2571 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 08 03:55:05.768211 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.762945 2571 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 08 03:55:05.768673 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.762948 2571 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 08 03:55:05.768673 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.762951 2571 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 08 03:55:05.768673 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.762955 2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 08 03:55:05.768673 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.762958 2571 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 08 03:55:05.768673 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.762961 2571 feature_gate.go:328] unrecognized feature gate: Example Sep 08 03:55:05.768673 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.762964 2571 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 08 03:55:05.768673 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.762966 2571 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 08 03:55:05.768673 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.762969 2571 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 08 03:55:05.768673 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.762972 2571 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 08 03:55:05.768673 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.762975 2571 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 08 03:55:05.768673 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.762977 2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 08 03:55:05.768673 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.762996 2571 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 08 03:55:05.768673 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.763000 2571 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 08 03:55:05.768673 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.763003 2571 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 08 03:55:05.768673 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.763006 2571 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 08 03:55:05.768673 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.763009 2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 08 03:55:05.768673 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.763012 2571 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 08 03:55:05.768673 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.763014 2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 08 03:55:05.768673 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.763017 2571 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 08 03:55:05.768673 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.763020 2571 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 08 03:55:05.769153 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.763022 2571 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 08 03:55:05.769153 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.763025 2571 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 08 03:55:05.769153 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.763028 2571 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 08 03:55:05.769153 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.763031 2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 08 03:55:05.769153 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.763034 2571 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 08 03:55:05.769153 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.763037 2571 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 08 03:55:05.769153 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.763039 2571 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 08 03:55:05.769153 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.763042 2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 08 03:55:05.769153 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.763045 2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 08 03:55:05.769153 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.763047 2571 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 08 03:55:05.769153 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.763050 2571 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 08 03:55:05.769153 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.763052 2571 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 08 03:55:05.769153 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.763055 2571 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 08 03:55:05.769153 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.763058 2571 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 08 03:55:05.769153 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.763060 2571 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 08 03:55:05.769153 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.763063 2571 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 08 03:55:05.769153 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.763066 2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 08 03:55:05.769153 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.763068 2571 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 08 03:55:05.769153 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.763071 2571 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 08 03:55:05.769153 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.763073 2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 08 03:55:05.769754 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.763076 2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 08 03:55:05.769754 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.763085 2571 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 08 03:55:05.769754 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.763087 2571 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 08 03:55:05.769754 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.763090 2571 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 08 03:55:05.769754 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.763093 2571 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 08 03:55:05.769754 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:05.763095 2571 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 08 03:55:05.769754 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:05.763100 2571 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 08 03:55:05.769754 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:05.763199 2571 server.go:962] "Client rotation is on, will bootstrap in background" Sep 08 03:55:05.769754 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:05.765579 2571 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Sep 08 03:55:05.769754 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:05.766732 2571 server.go:1019] "Starting client certificate rotation" Sep 08 03:55:05.769754 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:05.766827 2571 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Sep 08 03:55:05.769754 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:05.767684 2571 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Sep 08 03:55:05.769754 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:05.769520 2571 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Sep 08 03:55:05.770612 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:05.770595 2571 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Sep 08 03:55:05.782467 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:05.782449 2571 log.go:25] "Validated CRI v1 runtime API" Sep 08 03:55:05.786379 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:05.786362 2571 log.go:25] "Validated CRI v1 image API" Sep 08 03:55:05.789442 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:05.789397 2571 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Sep 08 03:55:05.793051 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:05.793029 2571 fs.go:135] Filesystem UUIDs: map[1f42e7d1-602b-4912-a97a-1dee485fa37f:/dev/nvme0n1p3 2a217db1-36f2-4d8e-abef-aec9a714ae65:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2] Sep 08 03:55:05.793119 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:05.793048 2571 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Sep 08 03:55:05.798150 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:05.798034 2571 manager.go:216] Machine: {Timestamp:2026-09-08 03:55:05.796642515 +0000 UTC m=+0.371877245 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099361 MemoryCapacity:33164484608 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2c64c9a25159b556988afabf9ab3cf SystemUUID:ec2c64c9-a251-59b5-5698-8afabf9ab3cf BootID:f60f5c4a-ce48-430a-a36f-94df33a57823 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582242304 Type:vfs Inodes:4048399 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582242304 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:c2:cf:40:63:d7 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:c2:cf:40:63:d7 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:26:71:6a:05:4e:67 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164484608 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Sep 08 03:55:05.798150 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:05.798146 2571 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Sep 08 03:55:05.798286 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:05.798273 2571 manager.go:232] Version: {KernelVersion:5.14.0-570.138.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260901-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Sep 08 03:55:05.802037 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:05.802013 2571 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Sep 08 03:55:05.802194 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:05.802040 2571 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-128-67.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Sep 08 03:55:05.802908 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:05.802898 2571 topology_manager.go:138] "Creating topology manager with none policy" Sep 08 03:55:05.802943 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:05.802910 2571 container_manager_linux.go:309] "Creating device plugin manager" Sep 08 03:55:05.802943 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:05.802918 2571 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Sep 08 03:55:05.802943 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:05.802932 2571 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Sep 08 03:55:05.803533 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:05.803514 2571 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Sep 08 03:55:05.804953 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:05.804940 2571 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Sep 08 03:55:05.809696 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:05.809684 2571 state_mem.go:36] "Initialized new in-memory state store" Sep 08 03:55:05.809813 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:05.809804 2571 server.go:1240] "Using root directory" path="/var/lib/kubelet" Sep 08 03:55:05.809847 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:05.809835 2571 kubelet.go:486] "Attempting to sync node with API server" Sep 08 03:55:05.809883 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:05.809848 2571 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Sep 08 03:55:05.809883 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:05.809870 2571 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Sep 08 03:55:05.809935 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:05.809884 2571 kubelet.go:398] "Adding apiserver pod source" Sep 08 03:55:05.809935 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:05.809896 2571 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Sep 08 03:55:05.810321 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:05.810310 2571 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Sep 08 03:55:05.810382 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:05.810337 2571 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Sep 08 03:55:05.812573 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:05.812553 2571 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.12-5.rhaos4.21.gitd1ec63c.el9" apiVersion="v1" Sep 08 03:55:05.815685 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:05.815670 2571 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Sep 08 03:55:05.815764 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:05.815708 2571 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Sep 08 03:55:05.815904 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:05.815892 2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Sep 08 03:55:05.815983 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:05.815913 2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Sep 08 03:55:05.815983 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:05.815922 2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Sep 08 03:55:05.815983 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:05.815930 2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Sep 08 03:55:05.815983 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:05.815943 2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Sep 08 03:55:05.815983 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:05.815952 2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Sep 08 03:55:05.816538 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:05.816526 2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Sep 08 03:55:05.816589 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:05.816540 2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Sep 08 03:55:05.816589 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:05.816550 2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Sep 08 03:55:05.816589 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:05.816561 2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Sep 08 03:55:05.816589 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:05.816575 2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Sep 08 03:55:05.816589 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:05.816586 2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Sep 08 03:55:05.818312 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:05.818297 2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Sep 08 03:55:05.818372 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:05.818315 2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Sep 08 03:55:05.820355 ip-10-0-128-67 kubenswrapper[2571]: E0908 03:55:05.820324 2571 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-128-67.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Sep 08 03:55:05.820355 ip-10-0-128-67 kubenswrapper[2571]: E0908 03:55:05.820325 2571 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Sep 08 03:55:05.822343 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:05.822329 2571 server.go:1268] "Started kubelet" Sep 08 03:55:05.822425 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:05.822384 2571 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Sep 08 03:55:05.822499 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:05.822442 2571 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Sep 08 03:55:05.822546 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:05.822535 2571 server_v1.go:49] "podresources" method="list" useActivePods=true Sep 08 03:55:05.823166 ip-10-0-128-67 systemd[1]: Started Kubernetes Kubelet. Sep 08 03:55:05.824009 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:05.823989 2571 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Sep 08 03:55:05.828940 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:05.828921 2571 server.go:310] "Adding debug handlers to kubelet server" Sep 08 03:55:05.829335 ip-10-0-128-67 kubenswrapper[2571]: E0908 03:55:05.829308 2571 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Sep 08 03:55:05.833630 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:05.833554 2571 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Sep 08 03:55:05.834264 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:05.834222 2571 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Sep 08 03:55:05.834362 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:05.834281 2571 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-128-67.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Sep 08 03:55:05.834655 ip-10-0-128-67 kubenswrapper[2571]: E0908 03:55:05.834638 2571 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-67.ec2.internal\" not found" Sep 08 03:55:05.835042 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:05.835024 2571 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Sep 08 03:55:05.835118 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:05.835028 2571 volume_manager.go:311] "The desired_state_of_world populator starts" Sep 08 03:55:05.835118 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:05.835067 2571 volume_manager.go:313] "Starting Kubelet Volume Manager" Sep 08 03:55:05.835224 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:05.835158 2571 reconstruct.go:97] "Volume reconstruction finished" Sep 08 03:55:05.835224 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:05.835165 2571 reconciler.go:29] "Reconciler: start to sync state" Sep 08 03:55:05.835482 ip-10-0-128-67 kubenswrapper[2571]: E0908 03:55:05.834073 2571 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-67.ec2.internal.18d33c3c19a6eb57 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-67.ec2.internal,UID:ip-10-0-128-67.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-128-67.ec2.internal,},FirstTimestamp:2026-09-08 03:55:05.822292823 +0000 UTC m=+0.397527552,LastTimestamp:2026-09-08 03:55:05.822292823 +0000 UTC m=+0.397527552,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-67.ec2.internal,}" Sep 08 03:55:05.835571 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:05.835517 2571 factory.go:55] Registering systemd factory Sep 08 03:55:05.835571 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:05.835549 2571 factory.go:223] Registration of the systemd container factory successfully Sep 08 03:55:05.835890 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:05.835877 2571 factory.go:153] Registering CRI-O factory Sep 08 03:55:05.835967 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:05.835892 2571 factory.go:223] Registration of the crio container factory successfully Sep 08 03:55:05.835967 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:05.835939 2571 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Sep 08 03:55:05.835967 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:05.835956 2571 factory.go:103] Registering Raw factory Sep 08 03:55:05.836100 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:05.835969 2571 manager.go:1196] Started watching for new ooms in manager Sep 08 03:55:05.836424 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:05.836397 2571 manager.go:349] Starting recovery of all containers Sep 08 03:55:05.837047 ip-10-0-128-67 kubenswrapper[2571]: E0908 03:55:05.837019 2571 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Sep 08 03:55:05.837304 ip-10-0-128-67 kubenswrapper[2571]: E0908 03:55:05.837280 2571 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-128-67.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Sep 08 03:55:05.847508 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:05.847489 2571 manager.go:354] Recovery completed Sep 08 03:55:05.851945 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:05.851931 2571 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 08 03:55:05.852848 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:05.852833 2571 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-pctxd" Sep 08 03:55:05.853319 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:05.853305 2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-67.ec2.internal" event="NodeHasSufficientMemory" Sep 08 03:55:05.853386 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:05.853331 2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-67.ec2.internal" event="NodeHasNoDiskPressure" Sep 08 03:55:05.853386 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:05.853341 2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-67.ec2.internal" event="NodeHasSufficientPID" Sep 08 03:55:05.853868 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:05.853850 2571 cpu_manager.go:222] "Starting CPU manager" policy="none" Sep 08 03:55:05.853868 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:05.853859 2571 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 08 03:55:05.853868 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:05.853866 2571 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Sep 08 03:55:05.854022 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:05.853881 2571 state_mem.go:36] "Initialized new in-memory state store" Sep 08 03:55:05.854585 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:05.854570 2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-67.ec2.internal" event="NodeHasSufficientMemory" Sep 08 03:55:05.854638 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:05.854594 2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-67.ec2.internal" event="NodeHasNoDiskPressure" Sep 08 03:55:05.854638 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:05.854604 2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-67.ec2.internal" event="NodeHasSufficientPID" Sep 08 03:55:05.855607 ip-10-0-128-67 kubenswrapper[2571]: E0908 03:55:05.855535 2571 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-67.ec2.internal.18d33c3c1b805696 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-67.ec2.internal,UID:ip-10-0-128-67.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-128-67.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-128-67.ec2.internal,},FirstTimestamp:2026-09-08 03:55:05.853318806 +0000 UTC m=+0.428553536,LastTimestamp:2026-09-08 03:55:05.853318806 +0000 UTC m=+0.428553536,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-67.ec2.internal,}" Sep 08 03:55:05.855953 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:05.855938 2571 policy_none.go:49] "None policy: Start" Sep 08 03:55:05.855953 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:05.855956 2571 memory_manager.go:187] "Starting memorymanager" policy="None" Sep 08 03:55:05.856045 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:05.855966 2571 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Sep 08 03:55:05.857806 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:05.857790 2571 policy_none.go:47] "Start" Sep 08 03:55:05.861894 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:05.861875 2571 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-pctxd" Sep 08 03:55:05.866076 ip-10-0-128-67 kubenswrapper[2571]: E0908 03:55:05.865721 2571 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-67.ec2.internal.18d33c3c1b809a2d default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-67.ec2.internal,UID:ip-10-0-128-67.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-128-67.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-128-67.ec2.internal,},FirstTimestamp:2026-09-08 03:55:05.853336109 +0000 UTC m=+0.428570838,LastTimestamp:2026-09-08 03:55:05.853336109 +0000 UTC m=+0.428570838,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-67.ec2.internal,}" Sep 08 03:55:05.895864 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:05.895846 2571 manager.go:337] "Starting Device Plugin manager" Sep 08 03:55:05.914371 ip-10-0-128-67 kubenswrapper[2571]: E0908 03:55:05.895890 2571 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Sep 08 03:55:05.914371 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:05.895903 2571 server.go:87] "Starting device plugin registration server" Sep 08 03:55:05.914371 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:05.896204 2571 eviction_manager.go:189] "Eviction manager: starting control loop" Sep 08 03:55:05.914371 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:05.896215 2571 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Sep 08 03:55:05.914371 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:05.896339 2571 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Sep 08 03:55:05.914371 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:05.896418 2571 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Sep 08 03:55:05.914371 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:05.896428 2571 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Sep 08 03:55:05.914371 ip-10-0-128-67 kubenswrapper[2571]: E0908 03:55:05.897001 2571 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Sep 08 03:55:05.914371 ip-10-0-128-67 kubenswrapper[2571]: E0908 03:55:05.897036 2571 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-128-67.ec2.internal\" not found" Sep 08 03:55:05.955239 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:05.955204 2571 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Sep 08 03:55:05.956457 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:05.956434 2571 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Sep 08 03:55:05.956557 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:05.956489 2571 status_manager.go:244] "Starting to sync pod status with apiserver" Sep 08 03:55:05.956557 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:05.956519 2571 kubelet.go:2448] "Starting kubelet main sync loop" Sep 08 03:55:05.956652 ip-10-0-128-67 kubenswrapper[2571]: E0908 03:55:05.956564 2571 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Sep 08 03:55:05.958815 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:05.958798 2571 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Sep 08 03:55:05.996535 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:05.996470 2571 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 08 03:55:05.998142 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:05.998126 2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-67.ec2.internal" event="NodeHasSufficientMemory" Sep 08 03:55:05.998213 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:05.998155 2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-67.ec2.internal" event="NodeHasNoDiskPressure" Sep 08 03:55:05.998213 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:05.998165 2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-67.ec2.internal" event="NodeHasSufficientPID" Sep 08 03:55:05.998213 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:05.998188 2571 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-128-67.ec2.internal" Sep 08 03:55:06.007193 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:06.007177 2571 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-128-67.ec2.internal" Sep 08 03:55:06.007237 ip-10-0-128-67 kubenswrapper[2571]: E0908 03:55:06.007196 2571 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-128-67.ec2.internal\": node \"ip-10-0-128-67.ec2.internal\" not found" Sep 08 03:55:06.050949 ip-10-0-128-67 kubenswrapper[2571]: E0908 03:55:06.050917 2571 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-67.ec2.internal\" not found" Sep 08 03:55:06.057095 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:06.057073 2571 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-67.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-128-67.ec2.internal"] Sep 08 03:55:06.057158 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:06.057139 2571 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 08 03:55:06.058587 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:06.058563 2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-67.ec2.internal" event="NodeHasSufficientMemory" Sep 08 03:55:06.058672 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:06.058600 2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-67.ec2.internal" event="NodeHasNoDiskPressure" Sep 08 03:55:06.058672 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:06.058613 2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-67.ec2.internal" event="NodeHasSufficientPID" Sep 08 03:55:06.061027 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:06.061011 2571 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 08 03:55:06.061130 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:06.061117 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-67.ec2.internal" Sep 08 03:55:06.061171 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:06.061147 2571 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 08 03:55:06.061767 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:06.061745 2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-67.ec2.internal" event="NodeHasSufficientMemory" Sep 08 03:55:06.061767 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:06.061767 2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-67.ec2.internal" event="NodeHasNoDiskPressure" Sep 08 03:55:06.061914 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:06.061747 2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-67.ec2.internal" event="NodeHasSufficientMemory" Sep 08 03:55:06.061914 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:06.061798 2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-67.ec2.internal" event="NodeHasNoDiskPressure" Sep 08 03:55:06.061914 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:06.061815 2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-67.ec2.internal" event="NodeHasSufficientPID" Sep 08 03:55:06.061914 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:06.061780 2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-67.ec2.internal" event="NodeHasSufficientPID" Sep 08 03:55:06.064132 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:06.064115 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-67.ec2.internal" Sep 08 03:55:06.064215 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:06.064144 2571 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 08 03:55:06.064858 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:06.064838 2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-67.ec2.internal" event="NodeHasSufficientMemory" Sep 08 03:55:06.064953 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:06.064862 2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-67.ec2.internal" event="NodeHasNoDiskPressure" Sep 08 03:55:06.064953 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:06.064874 2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-67.ec2.internal" event="NodeHasSufficientPID" Sep 08 03:55:06.086884 ip-10-0-128-67 kubenswrapper[2571]: E0908 03:55:06.086862 2571 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-128-67.ec2.internal\" not found" node="ip-10-0-128-67.ec2.internal" Sep 08 03:55:06.091158 ip-10-0-128-67 kubenswrapper[2571]: E0908 03:55:06.091141 2571 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-128-67.ec2.internal\" not found" node="ip-10-0-128-67.ec2.internal" Sep 08 03:55:06.137165 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:06.137141 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/79ed4e7f3bb3545fed2a22b103b1acef-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-67.ec2.internal\" (UID: \"79ed4e7f3bb3545fed2a22b103b1acef\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-67.ec2.internal" Sep 08 03:55:06.137283 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:06.137165 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/79ed4e7f3bb3545fed2a22b103b1acef-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-67.ec2.internal\" (UID: \"79ed4e7f3bb3545fed2a22b103b1acef\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-67.ec2.internal" Sep 08 03:55:06.137283 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:06.137183 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/c9e8db20add26e2681670793a6ac21cf-config\") pod \"kube-apiserver-proxy-ip-10-0-128-67.ec2.internal\" (UID: \"c9e8db20add26e2681670793a6ac21cf\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-67.ec2.internal" Sep 08 03:55:06.151308 ip-10-0-128-67 kubenswrapper[2571]: E0908 03:55:06.151287 2571 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-67.ec2.internal\" not found" Sep 08 03:55:06.238243 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:06.238214 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/79ed4e7f3bb3545fed2a22b103b1acef-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-67.ec2.internal\" (UID: \"79ed4e7f3bb3545fed2a22b103b1acef\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-67.ec2.internal" Sep 08 03:55:06.238391 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:06.238247 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/79ed4e7f3bb3545fed2a22b103b1acef-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-67.ec2.internal\" (UID: \"79ed4e7f3bb3545fed2a22b103b1acef\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-67.ec2.internal" Sep 08 03:55:06.238391 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:06.238305 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/c9e8db20add26e2681670793a6ac21cf-config\") pod \"kube-apiserver-proxy-ip-10-0-128-67.ec2.internal\" (UID: \"c9e8db20add26e2681670793a6ac21cf\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-67.ec2.internal" Sep 08 03:55:06.238391 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:06.238334 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/79ed4e7f3bb3545fed2a22b103b1acef-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-67.ec2.internal\" (UID: \"79ed4e7f3bb3545fed2a22b103b1acef\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-67.ec2.internal" Sep 08 03:55:06.238391 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:06.238344 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/c9e8db20add26e2681670793a6ac21cf-config\") pod \"kube-apiserver-proxy-ip-10-0-128-67.ec2.internal\" (UID: \"c9e8db20add26e2681670793a6ac21cf\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-67.ec2.internal" Sep 08 03:55:06.238553 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:06.238396 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/79ed4e7f3bb3545fed2a22b103b1acef-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-67.ec2.internal\" (UID: \"79ed4e7f3bb3545fed2a22b103b1acef\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-67.ec2.internal" Sep 08 03:55:06.252372 ip-10-0-128-67 kubenswrapper[2571]: E0908 03:55:06.252314 2571 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-67.ec2.internal\" not found" Sep 08 03:55:06.353062 ip-10-0-128-67 kubenswrapper[2571]: E0908 03:55:06.353037 2571 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-67.ec2.internal\" not found" Sep 08 03:55:06.389235 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:06.389198 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-67.ec2.internal" Sep 08 03:55:06.394212 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:06.394025 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-67.ec2.internal" Sep 08 03:55:07.558691 ip-10-0-128-67 kubenswrapper[2571]: E0908 03:55:07.558666 2571 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-67.ec2.internal\" not found" Sep 08 03:55:07.659189 ip-10-0-128-67 kubenswrapper[2571]: E0908 03:55:07.659125 2571 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-67.ec2.internal\" not found" Sep 08 03:55:07.759689 ip-10-0-128-67 kubenswrapper[2571]: E0908 03:55:07.759662 2571 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-67.ec2.internal\" not found" Sep 08 03:55:07.860285 ip-10-0-128-67 kubenswrapper[2571]: E0908 03:55:07.860256 2571 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-67.ec2.internal\" not found" Sep 08 03:55:07.871621 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:07.871604 2571 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Sep 08 03:55:07.871765 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:07.871749 2571 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Sep 08 03:55:07.960568 ip-10-0-128-67 kubenswrapper[2571]: E0908 03:55:07.960511 2571 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-67.ec2.internal\" not found" Sep 08 03:55:07.969619 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:07.969472 2571 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-07 03:50:06 +0000 UTC" deadline="2028-02-24 18:10:10.067913639 +0000 UTC" Sep 08 03:55:07.969619 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:07.969615 2571 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12830h15m2.098301474s" Sep 08 03:55:08.016818 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:08.016793 2571 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 08 03:55:08.018719 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:08.018696 2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-67.ec2.internal" event="NodeHasSufficientMemory" Sep 08 03:55:08.018843 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:08.018737 2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-67.ec2.internal" event="NodeHasNoDiskPressure" Sep 08 03:55:08.018843 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:08.018752 2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-67.ec2.internal" event="NodeHasSufficientPID" Sep 08 03:55:08.061122 ip-10-0-128-67 kubenswrapper[2571]: E0908 03:55:08.061096 2571 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-67.ec2.internal\" not found" Sep 08 03:55:08.098642 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:08.098619 2571 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Sep 08 03:55:08.161173 ip-10-0-128-67 kubenswrapper[2571]: E0908 03:55:08.161150 2571 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-67.ec2.internal\" not found" Sep 08 03:55:08.161173 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:08.161136 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc9e8db20add26e2681670793a6ac21cf.slice/crio-0f36fe3c234a1a00b33a1cbad1cfc119df59714c27d4a79f5cd50a6ffd37b525 WatchSource:0}: Error finding container 0f36fe3c234a1a00b33a1cbad1cfc119df59714c27d4a79f5cd50a6ffd37b525: Status 404 returned error can't find the container with id 0f36fe3c234a1a00b33a1cbad1cfc119df59714c27d4a79f5cd50a6ffd37b525 Sep 08 03:55:08.161497 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:08.161480 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod79ed4e7f3bb3545fed2a22b103b1acef.slice/crio-a3218466800f10955b055dd821f1653f15eb632ed6c51fa99c2fc670048a0d0f WatchSource:0}: Error finding container a3218466800f10955b055dd821f1653f15eb632ed6c51fa99c2fc670048a0d0f: Status 404 returned error can't find the container with id a3218466800f10955b055dd821f1653f15eb632ed6c51fa99c2fc670048a0d0f Sep 08 03:55:08.166331 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:08.166307 2571 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 08 03:55:08.262299 ip-10-0-128-67 kubenswrapper[2571]: E0908 03:55:08.262222 2571 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-67.ec2.internal\" not found" Sep 08 03:55:08.301145 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:08.301128 2571 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Sep 08 03:55:08.362650 ip-10-0-128-67 kubenswrapper[2571]: E0908 03:55:08.362622 2571 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-67.ec2.internal\" not found" Sep 08 03:55:08.461468 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:08.461445 2571 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Sep 08 03:55:08.540173 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:08.540102 2571 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-67.ec2.internal" Sep 08 03:55:08.553787 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:08.553763 2571 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Sep 08 03:55:08.555108 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:08.555095 2571 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-67.ec2.internal" Sep 08 03:55:08.565378 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:08.565359 2571 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Sep 08 03:55:08.916221 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:08.916142 2571 apiserver.go:52] "Watching apiserver" Sep 08 03:55:08.926948 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:08.925520 2571 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Sep 08 03:55:08.926948 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:08.926335 2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/node-resolver-t2qd4","openshift-multus/multus-tbtxs","openshift-multus/network-metrics-daemon-s2679","openshift-network-operator/iptables-alerter-cbzhc","kube-system/kube-apiserver-proxy-ip-10-0-128-67.ec2.internal","openshift-image-registry/node-ca-6gf2k","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-67.ec2.internal","openshift-multus/multus-additional-cni-plugins-wc8bl","openshift-network-diagnostics/network-check-target-4wk4q","openshift-ovn-kubernetes/ovnkube-node-7mnct","kube-system/global-pull-secret-syncer-6ffgk","kube-system/konnectivity-agent-xgq5w","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nxtjg","openshift-cluster-node-tuning-operator/tuned-xjf8j"] Sep 08 03:55:08.929828 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:08.929119 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-7mnct" Sep 08 03:55:08.932865 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:08.932813 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Sep 08 03:55:08.932865 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:08.932858 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Sep 08 03:55:08.933084 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:08.933062 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Sep 08 03:55:08.933198 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:08.933154 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Sep 08 03:55:08.933273 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:08.933257 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-h9wdd\"" Sep 08 03:55:08.933326 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:08.933303 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Sep 08 03:55:08.933642 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:08.933451 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Sep 08 03:55:08.936666 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:08.936649 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6ffgk" Sep 08 03:55:08.936762 ip-10-0-128-67 kubenswrapper[2571]: E0908 03:55:08.936714 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6ffgk" podUID="4c94cf72-6e9d-4f8b-ae71-105e52f051a1" Sep 08 03:55:08.939371 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:08.939352 2571 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Sep 08 03:55:08.940309 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:08.940012 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s2679" Sep 08 03:55:08.940309 ip-10-0-128-67 kubenswrapper[2571]: E0908 03:55:08.940086 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s2679" podUID="be017881-2b6a-4fd2-b62d-4b5d3bd7b834" Sep 08 03:55:08.942330 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:08.942310 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-cbzhc" Sep 08 03:55:08.944933 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:08.944900 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-xjf8j" Sep 08 03:55:08.945606 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:08.945585 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Sep 08 03:55:08.945963 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:08.945946 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Sep 08 03:55:08.946365 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:08.946345 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-pzq2s\"" Sep 08 03:55:08.946532 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:08.946506 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Sep 08 03:55:08.947228 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:08.947208 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Sep 08 03:55:08.947939 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:08.947771 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Sep 08 03:55:08.947939 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:08.947829 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-9s8nj\"" Sep 08 03:55:08.950953 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:08.950931 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-6gf2k" Sep 08 03:55:08.952804 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:08.951959 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/4c94cf72-6e9d-4f8b-ae71-105e52f051a1-kubelet-config\") pod \"global-pull-secret-syncer-6ffgk\" (UID: \"4c94cf72-6e9d-4f8b-ae71-105e52f051a1\") " pod="kube-system/global-pull-secret-syncer-6ffgk" Sep 08 03:55:08.952804 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:08.951994 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gvq84\" (UniqueName: \"kubernetes.io/projected/a6151e0d-2e3f-44c5-b268-a7adcc60bffe-kube-api-access-gvq84\") pod \"iptables-alerter-cbzhc\" (UID: \"a6151e0d-2e3f-44c5-b268-a7adcc60bffe\") " pod="openshift-network-operator/iptables-alerter-cbzhc" Sep 08 03:55:08.952804 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:08.952018 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/b35366ff-994a-4635-bad2-1ba59bcc640a-run-systemd\") pod \"ovnkube-node-7mnct\" (UID: \"b35366ff-994a-4635-bad2-1ba59bcc640a\") " pod="openshift-ovn-kubernetes/ovnkube-node-7mnct" Sep 08 03:55:08.952804 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:08.952028 2571 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Sep 08 03:55:08.952804 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:08.952042 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/4c94cf72-6e9d-4f8b-ae71-105e52f051a1-dbus\") pod \"global-pull-secret-syncer-6ffgk\" (UID: \"4c94cf72-6e9d-4f8b-ae71-105e52f051a1\") " pod="kube-system/global-pull-secret-syncer-6ffgk" Sep 08 03:55:08.952804 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:08.952066 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/b35366ff-994a-4635-bad2-1ba59bcc640a-ovnkube-config\") pod \"ovnkube-node-7mnct\" (UID: \"b35366ff-994a-4635-bad2-1ba59bcc640a\") " pod="openshift-ovn-kubernetes/ovnkube-node-7mnct" Sep 08 03:55:08.952804 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:08.952089 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bxjck\" (UniqueName: \"kubernetes.io/projected/b35366ff-994a-4635-bad2-1ba59bcc640a-kube-api-access-bxjck\") pod \"ovnkube-node-7mnct\" (UID: \"b35366ff-994a-4635-bad2-1ba59bcc640a\") " pod="openshift-ovn-kubernetes/ovnkube-node-7mnct" Sep 08 03:55:08.952804 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:08.952113 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/be017881-2b6a-4fd2-b62d-4b5d3bd7b834-metrics-certs\") pod \"network-metrics-daemon-s2679\" (UID: \"be017881-2b6a-4fd2-b62d-4b5d3bd7b834\") " pod="openshift-multus/network-metrics-daemon-s2679" Sep 08 03:55:08.952804 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:08.952136 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/a6151e0d-2e3f-44c5-b268-a7adcc60bffe-iptables-alerter-script\") pod \"iptables-alerter-cbzhc\" (UID: \"a6151e0d-2e3f-44c5-b268-a7adcc60bffe\") " pod="openshift-network-operator/iptables-alerter-cbzhc" Sep 08 03:55:08.952804 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:08.952161 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/b35366ff-994a-4635-bad2-1ba59bcc640a-ovnkube-script-lib\") pod \"ovnkube-node-7mnct\" (UID: \"b35366ff-994a-4635-bad2-1ba59bcc640a\") " pod="openshift-ovn-kubernetes/ovnkube-node-7mnct" Sep 08 03:55:08.952804 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:08.952185 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a6151e0d-2e3f-44c5-b268-a7adcc60bffe-host-slash\") pod \"iptables-alerter-cbzhc\" (UID: \"a6151e0d-2e3f-44c5-b268-a7adcc60bffe\") " pod="openshift-network-operator/iptables-alerter-cbzhc" Sep 08 03:55:08.952804 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:08.952208 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/b35366ff-994a-4635-bad2-1ba59bcc640a-ovn-node-metrics-cert\") pod \"ovnkube-node-7mnct\" (UID: \"b35366ff-994a-4635-bad2-1ba59bcc640a\") " pod="openshift-ovn-kubernetes/ovnkube-node-7mnct" Sep 08 03:55:08.952804 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:08.952243 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4c94cf72-6e9d-4f8b-ae71-105e52f051a1-original-pull-secret\") pod \"global-pull-secret-syncer-6ffgk\" (UID: \"4c94cf72-6e9d-4f8b-ae71-105e52f051a1\") " pod="kube-system/global-pull-secret-syncer-6ffgk" Sep 08 03:55:08.952804 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:08.952274 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ksth8\" (UniqueName: \"kubernetes.io/projected/be017881-2b6a-4fd2-b62d-4b5d3bd7b834-kube-api-access-ksth8\") pod \"network-metrics-daemon-s2679\" (UID: \"be017881-2b6a-4fd2-b62d-4b5d3bd7b834\") " pod="openshift-multus/network-metrics-daemon-s2679" Sep 08 03:55:08.952804 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:08.952298 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/b35366ff-994a-4635-bad2-1ba59bcc640a-host-kubelet\") pod \"ovnkube-node-7mnct\" (UID: \"b35366ff-994a-4635-bad2-1ba59bcc640a\") " pod="openshift-ovn-kubernetes/ovnkube-node-7mnct" Sep 08 03:55:08.952804 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:08.952330 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/b35366ff-994a-4635-bad2-1ba59bcc640a-log-socket\") pod \"ovnkube-node-7mnct\" (UID: \"b35366ff-994a-4635-bad2-1ba59bcc640a\") " pod="openshift-ovn-kubernetes/ovnkube-node-7mnct" Sep 08 03:55:08.953670 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:08.952396 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b35366ff-994a-4635-bad2-1ba59bcc640a-host-run-ovn-kubernetes\") pod \"ovnkube-node-7mnct\" (UID: \"b35366ff-994a-4635-bad2-1ba59bcc640a\") " pod="openshift-ovn-kubernetes/ovnkube-node-7mnct" Sep 08 03:55:08.953670 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:08.952459 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/b35366ff-994a-4635-bad2-1ba59bcc640a-systemd-units\") pod \"ovnkube-node-7mnct\" (UID: \"b35366ff-994a-4635-bad2-1ba59bcc640a\") " pod="openshift-ovn-kubernetes/ovnkube-node-7mnct" Sep 08 03:55:08.953670 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:08.952512 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b35366ff-994a-4635-bad2-1ba59bcc640a-host-slash\") pod \"ovnkube-node-7mnct\" (UID: \"b35366ff-994a-4635-bad2-1ba59bcc640a\") " pod="openshift-ovn-kubernetes/ovnkube-node-7mnct" Sep 08 03:55:08.953670 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:08.952529 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/b35366ff-994a-4635-bad2-1ba59bcc640a-node-log\") pod \"ovnkube-node-7mnct\" (UID: \"b35366ff-994a-4635-bad2-1ba59bcc640a\") " pod="openshift-ovn-kubernetes/ovnkube-node-7mnct" Sep 08 03:55:08.953670 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:08.952543 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b35366ff-994a-4635-bad2-1ba59bcc640a-host-cni-bin\") pod \"ovnkube-node-7mnct\" (UID: \"b35366ff-994a-4635-bad2-1ba59bcc640a\") " pod="openshift-ovn-kubernetes/ovnkube-node-7mnct" Sep 08 03:55:08.953670 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:08.952561 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b35366ff-994a-4635-bad2-1ba59bcc640a-host-run-netns\") pod \"ovnkube-node-7mnct\" (UID: \"b35366ff-994a-4635-bad2-1ba59bcc640a\") " pod="openshift-ovn-kubernetes/ovnkube-node-7mnct" Sep 08 03:55:08.953670 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:08.952594 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b35366ff-994a-4635-bad2-1ba59bcc640a-run-openvswitch\") pod \"ovnkube-node-7mnct\" (UID: \"b35366ff-994a-4635-bad2-1ba59bcc640a\") " pod="openshift-ovn-kubernetes/ovnkube-node-7mnct" Sep 08 03:55:08.953670 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:08.952621 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/b35366ff-994a-4635-bad2-1ba59bcc640a-host-cni-netd\") pod \"ovnkube-node-7mnct\" (UID: \"b35366ff-994a-4635-bad2-1ba59bcc640a\") " pod="openshift-ovn-kubernetes/ovnkube-node-7mnct" Sep 08 03:55:08.953670 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:08.952644 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b35366ff-994a-4635-bad2-1ba59bcc640a-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-7mnct\" (UID: \"b35366ff-994a-4635-bad2-1ba59bcc640a\") " pod="openshift-ovn-kubernetes/ovnkube-node-7mnct" Sep 08 03:55:08.953670 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:08.952667 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/b35366ff-994a-4635-bad2-1ba59bcc640a-env-overrides\") pod \"ovnkube-node-7mnct\" (UID: \"b35366ff-994a-4635-bad2-1ba59bcc640a\") " pod="openshift-ovn-kubernetes/ovnkube-node-7mnct" Sep 08 03:55:08.953670 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:08.952693 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b35366ff-994a-4635-bad2-1ba59bcc640a-var-lib-openvswitch\") pod \"ovnkube-node-7mnct\" (UID: \"b35366ff-994a-4635-bad2-1ba59bcc640a\") " pod="openshift-ovn-kubernetes/ovnkube-node-7mnct" Sep 08 03:55:08.953670 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:08.952726 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b35366ff-994a-4635-bad2-1ba59bcc640a-etc-openvswitch\") pod \"ovnkube-node-7mnct\" (UID: \"b35366ff-994a-4635-bad2-1ba59bcc640a\") " pod="openshift-ovn-kubernetes/ovnkube-node-7mnct" Sep 08 03:55:08.953670 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:08.952749 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/b35366ff-994a-4635-bad2-1ba59bcc640a-run-ovn\") pod \"ovnkube-node-7mnct\" (UID: \"b35366ff-994a-4635-bad2-1ba59bcc640a\") " pod="openshift-ovn-kubernetes/ovnkube-node-7mnct" Sep 08 03:55:08.953670 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:08.953155 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Sep 08 03:55:08.953670 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:08.953405 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Sep 08 03:55:08.953670 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:08.953601 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Sep 08 03:55:08.954434 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:08.953601 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-2h5cd\"" Sep 08 03:55:08.954434 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:08.954084 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4wk4q" Sep 08 03:55:08.954434 ip-10-0-128-67 kubenswrapper[2571]: E0908 03:55:08.954141 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4wk4q" podUID="ab426e2f-9c8a-4457-a6b9-b98e4c94f4bf" Sep 08 03:55:08.956675 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:08.956653 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nxtjg" Sep 08 03:55:08.958852 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:08.958833 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-tbtxs" Sep 08 03:55:08.959027 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:08.959004 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Sep 08 03:55:08.959834 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:08.959814 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Sep 08 03:55:08.960075 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:08.960038 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Sep 08 03:55:08.960075 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:08.960043 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-2mkbx\"" Sep 08 03:55:08.961488 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:08.961469 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-t2qd4" Sep 08 03:55:08.962163 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:08.962128 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Sep 08 03:55:08.962523 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:08.962500 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Sep 08 03:55:08.962731 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:08.962714 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Sep 08 03:55:08.963115 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:08.963096 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-wv6xc\"" Sep 08 03:55:08.963872 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:08.963853 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Sep 08 03:55:08.964116 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:08.964097 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Sep 08 03:55:08.964500 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:08.964466 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Sep 08 03:55:08.964865 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:08.964847 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-f2rl6\"" Sep 08 03:55:08.966795 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:08.966746 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-wc8bl" Sep 08 03:55:08.969108 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:08.969088 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Sep 08 03:55:08.969386 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:08.969369 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-rzlv4\"" Sep 08 03:55:08.970143 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:08.970123 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-xgq5w" Sep 08 03:55:08.974169 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:08.974148 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Sep 08 03:55:08.976682 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:08.974351 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Sep 08 03:55:08.976682 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:08.974486 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-njw5q\"" Sep 08 03:55:08.976682 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:08.974937 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Sep 08 03:55:08.991062 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:08.991040 2571 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-ph65l" Sep 08 03:55:09.000079 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:09.000055 2571 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-ph65l" Sep 08 03:55:09.040845 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:09.040736 2571 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Sep 08 03:55:09.053105 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:09.053077 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b35366ff-994a-4635-bad2-1ba59bcc640a-var-lib-openvswitch\") pod \"ovnkube-node-7mnct\" (UID: \"b35366ff-994a-4635-bad2-1ba59bcc640a\") " pod="openshift-ovn-kubernetes/ovnkube-node-7mnct" Sep 08 03:55:09.053227 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:09.053113 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5887ba4c-5c74-4753-b0f0-e83cd30fe7d3-host\") pod \"tuned-xjf8j\" (UID: \"5887ba4c-5c74-4753-b0f0-e83cd30fe7d3\") " pod="openshift-cluster-node-tuning-operator/tuned-xjf8j" Sep 08 03:55:09.053227 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:09.053131 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d9fbef9f-7075-4727-88c9-b5feeaf043db-cni-binary-copy\") pod \"multus-additional-cni-plugins-wc8bl\" (UID: \"d9fbef9f-7075-4727-88c9-b5feeaf043db\") " pod="openshift-multus/multus-additional-cni-plugins-wc8bl" Sep 08 03:55:09.053227 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:09.053152 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/4c94cf72-6e9d-4f8b-ae71-105e52f051a1-kubelet-config\") pod \"global-pull-secret-syncer-6ffgk\" (UID: \"4c94cf72-6e9d-4f8b-ae71-105e52f051a1\") " pod="kube-system/global-pull-secret-syncer-6ffgk" Sep 08 03:55:09.053227 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:09.053174 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gvq84\" (UniqueName: \"kubernetes.io/projected/a6151e0d-2e3f-44c5-b268-a7adcc60bffe-kube-api-access-gvq84\") pod \"iptables-alerter-cbzhc\" (UID: \"a6151e0d-2e3f-44c5-b268-a7adcc60bffe\") " pod="openshift-network-operator/iptables-alerter-cbzhc" Sep 08 03:55:09.053227 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:09.053188 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/b35366ff-994a-4635-bad2-1ba59bcc640a-run-systemd\") pod \"ovnkube-node-7mnct\" (UID: \"b35366ff-994a-4635-bad2-1ba59bcc640a\") " pod="openshift-ovn-kubernetes/ovnkube-node-7mnct" Sep 08 03:55:09.053227 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:09.053200 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b35366ff-994a-4635-bad2-1ba59bcc640a-var-lib-openvswitch\") pod \"ovnkube-node-7mnct\" (UID: \"b35366ff-994a-4635-bad2-1ba59bcc640a\") " pod="openshift-ovn-kubernetes/ovnkube-node-7mnct" Sep 08 03:55:09.053453 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:09.053207 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/5887ba4c-5c74-4753-b0f0-e83cd30fe7d3-etc-systemd\") pod \"tuned-xjf8j\" (UID: \"5887ba4c-5c74-4753-b0f0-e83cd30fe7d3\") " pod="openshift-cluster-node-tuning-operator/tuned-xjf8j" Sep 08 03:55:09.053453 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:09.053264 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f583a7fb-d8f2-4b26-ba64-bb73e3b605c6-cnibin\") pod \"multus-tbtxs\" (UID: \"f583a7fb-d8f2-4b26-ba64-bb73e3b605c6\") " pod="openshift-multus/multus-tbtxs" Sep 08 03:55:09.053453 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:09.053285 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/4c94cf72-6e9d-4f8b-ae71-105e52f051a1-kubelet-config\") pod \"global-pull-secret-syncer-6ffgk\" (UID: \"4c94cf72-6e9d-4f8b-ae71-105e52f051a1\") " pod="kube-system/global-pull-secret-syncer-6ffgk" Sep 08 03:55:09.053453 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:09.053287 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f583a7fb-d8f2-4b26-ba64-bb73e3b605c6-cni-binary-copy\") pod \"multus-tbtxs\" (UID: \"f583a7fb-d8f2-4b26-ba64-bb73e3b605c6\") " pod="openshift-multus/multus-tbtxs" Sep 08 03:55:09.053453 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:09.053327 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/b35366ff-994a-4635-bad2-1ba59bcc640a-ovnkube-config\") pod \"ovnkube-node-7mnct\" (UID: \"b35366ff-994a-4635-bad2-1ba59bcc640a\") " pod="openshift-ovn-kubernetes/ovnkube-node-7mnct" Sep 08 03:55:09.053453 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:09.053355 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/5887ba4c-5c74-4753-b0f0-e83cd30fe7d3-etc-sysconfig\") pod \"tuned-xjf8j\" (UID: \"5887ba4c-5c74-4753-b0f0-e83cd30fe7d3\") " pod="openshift-cluster-node-tuning-operator/tuned-xjf8j" Sep 08 03:55:09.053453 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:09.053377 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5887ba4c-5c74-4753-b0f0-e83cd30fe7d3-sys\") pod \"tuned-xjf8j\" (UID: \"5887ba4c-5c74-4753-b0f0-e83cd30fe7d3\") " pod="openshift-cluster-node-tuning-operator/tuned-xjf8j" Sep 08 03:55:09.053453 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:09.053405 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d9fbef9f-7075-4727-88c9-b5feeaf043db-tuning-conf-dir\") pod \"multus-additional-cni-plugins-wc8bl\" (UID: \"d9fbef9f-7075-4727-88c9-b5feeaf043db\") " pod="openshift-multus/multus-additional-cni-plugins-wc8bl" Sep 08 03:55:09.053453 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:09.053430 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/d9fbef9f-7075-4727-88c9-b5feeaf043db-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-wc8bl\" (UID: \"d9fbef9f-7075-4727-88c9-b5feeaf043db\") " pod="openshift-multus/multus-additional-cni-plugins-wc8bl" Sep 08 03:55:09.053453 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:09.053454 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/f583a7fb-d8f2-4b26-ba64-bb73e3b605c6-host-run-k8s-cni-cncf-io\") pod \"multus-tbtxs\" (UID: \"f583a7fb-d8f2-4b26-ba64-bb73e3b605c6\") " pod="openshift-multus/multus-tbtxs" Sep 08 03:55:09.053901 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:09.053507 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sgxcf\" (UniqueName: \"kubernetes.io/projected/92705af2-1822-4b7f-8852-a8120774230c-kube-api-access-sgxcf\") pod \"node-resolver-t2qd4\" (UID: \"92705af2-1822-4b7f-8852-a8120774230c\") " pod="openshift-dns/node-resolver-t2qd4" Sep 08 03:55:09.053901 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:09.053537 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/be017881-2b6a-4fd2-b62d-4b5d3bd7b834-metrics-certs\") pod \"network-metrics-daemon-s2679\" (UID: \"be017881-2b6a-4fd2-b62d-4b5d3bd7b834\") " pod="openshift-multus/network-metrics-daemon-s2679" Sep 08 03:55:09.053901 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:09.053564 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/a6151e0d-2e3f-44c5-b268-a7adcc60bffe-iptables-alerter-script\") pod \"iptables-alerter-cbzhc\" (UID: \"a6151e0d-2e3f-44c5-b268-a7adcc60bffe\") " pod="openshift-network-operator/iptables-alerter-cbzhc" Sep 08 03:55:09.053901 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:09.053569 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/b35366ff-994a-4635-bad2-1ba59bcc640a-run-systemd\") pod \"ovnkube-node-7mnct\" (UID: \"b35366ff-994a-4635-bad2-1ba59bcc640a\") " pod="openshift-ovn-kubernetes/ovnkube-node-7mnct" Sep 08 03:55:09.053901 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:09.053592 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/b35366ff-994a-4635-bad2-1ba59bcc640a-ovnkube-script-lib\") pod \"ovnkube-node-7mnct\" (UID: \"b35366ff-994a-4635-bad2-1ba59bcc640a\") " pod="openshift-ovn-kubernetes/ovnkube-node-7mnct" Sep 08 03:55:09.053901 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:09.053630 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/5887ba4c-5c74-4753-b0f0-e83cd30fe7d3-etc-tuned\") pod \"tuned-xjf8j\" (UID: \"5887ba4c-5c74-4753-b0f0-e83cd30fe7d3\") " pod="openshift-cluster-node-tuning-operator/tuned-xjf8j" Sep 08 03:55:09.053901 ip-10-0-128-67 kubenswrapper[2571]: E0908 03:55:09.053708 2571 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 08 03:55:09.053901 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:09.053744 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/2c0c6060-83f1-4145-ae8c-7eb94e2201a8-kubelet-dir\") pod \"aws-ebs-csi-driver-node-nxtjg\" (UID: \"2c0c6060-83f1-4145-ae8c-7eb94e2201a8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nxtjg" Sep 08 03:55:09.053901 ip-10-0-128-67 kubenswrapper[2571]: E0908 03:55:09.053810 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/be017881-2b6a-4fd2-b62d-4b5d3bd7b834-metrics-certs podName:be017881-2b6a-4fd2-b62d-4b5d3bd7b834 nodeName:}" failed. No retries permitted until 2026-09-08 03:55:09.553786354 +0000 UTC m=+3.024354717 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/be017881-2b6a-4fd2-b62d-4b5d3bd7b834-metrics-certs") pod "network-metrics-daemon-s2679" (UID: "be017881-2b6a-4fd2-b62d-4b5d3bd7b834") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 08 03:55:09.053901 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:09.053850 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/2c0c6060-83f1-4145-ae8c-7eb94e2201a8-device-dir\") pod \"aws-ebs-csi-driver-node-nxtjg\" (UID: \"2c0c6060-83f1-4145-ae8c-7eb94e2201a8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nxtjg" Sep 08 03:55:09.053901 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:09.053882 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/d9fbef9f-7075-4727-88c9-b5feeaf043db-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-wc8bl\" (UID: \"d9fbef9f-7075-4727-88c9-b5feeaf043db\") " pod="openshift-multus/multus-additional-cni-plugins-wc8bl" Sep 08 03:55:09.054353 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:09.053932 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f583a7fb-d8f2-4b26-ba64-bb73e3b605c6-multus-cni-dir\") pod \"multus-tbtxs\" (UID: \"f583a7fb-d8f2-4b26-ba64-bb73e3b605c6\") " pod="openshift-multus/multus-tbtxs" Sep 08 03:55:09.054353 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:09.053962 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a6151e0d-2e3f-44c5-b268-a7adcc60bffe-host-slash\") pod \"iptables-alerter-cbzhc\" (UID: \"a6151e0d-2e3f-44c5-b268-a7adcc60bffe\") " pod="openshift-network-operator/iptables-alerter-cbzhc" Sep 08 03:55:09.054353 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:09.053990 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tdln8\" (UniqueName: \"kubernetes.io/projected/5887ba4c-5c74-4753-b0f0-e83cd30fe7d3-kube-api-access-tdln8\") pod \"tuned-xjf8j\" (UID: \"5887ba4c-5c74-4753-b0f0-e83cd30fe7d3\") " pod="openshift-cluster-node-tuning-operator/tuned-xjf8j" Sep 08 03:55:09.054353 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:09.054040 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/b35366ff-994a-4635-bad2-1ba59bcc640a-log-socket\") pod \"ovnkube-node-7mnct\" (UID: \"b35366ff-994a-4635-bad2-1ba59bcc640a\") " pod="openshift-ovn-kubernetes/ovnkube-node-7mnct" Sep 08 03:55:09.054353 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:09.054047 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a6151e0d-2e3f-44c5-b268-a7adcc60bffe-host-slash\") pod \"iptables-alerter-cbzhc\" (UID: \"a6151e0d-2e3f-44c5-b268-a7adcc60bffe\") " pod="openshift-network-operator/iptables-alerter-cbzhc" Sep 08 03:55:09.054353 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:09.054075 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5887ba4c-5c74-4753-b0f0-e83cd30fe7d3-var-lib-kubelet\") pod \"tuned-xjf8j\" (UID: \"5887ba4c-5c74-4753-b0f0-e83cd30fe7d3\") " pod="openshift-cluster-node-tuning-operator/tuned-xjf8j" Sep 08 03:55:09.054353 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:09.054140 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/b35366ff-994a-4635-bad2-1ba59bcc640a-log-socket\") pod \"ovnkube-node-7mnct\" (UID: \"b35366ff-994a-4635-bad2-1ba59bcc640a\") " pod="openshift-ovn-kubernetes/ovnkube-node-7mnct" Sep 08 03:55:09.054353 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:09.054141 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f583a7fb-d8f2-4b26-ba64-bb73e3b605c6-host-var-lib-cni-bin\") pod \"multus-tbtxs\" (UID: \"f583a7fb-d8f2-4b26-ba64-bb73e3b605c6\") " pod="openshift-multus/multus-tbtxs" Sep 08 03:55:09.054353 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:09.054179 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/f583a7fb-d8f2-4b26-ba64-bb73e3b605c6-host-var-lib-cni-multus\") pod \"multus-tbtxs\" (UID: \"f583a7fb-d8f2-4b26-ba64-bb73e3b605c6\") " pod="openshift-multus/multus-tbtxs" Sep 08 03:55:09.054353 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:09.054190 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/b35366ff-994a-4635-bad2-1ba59bcc640a-ovnkube-config\") pod \"ovnkube-node-7mnct\" (UID: \"b35366ff-994a-4635-bad2-1ba59bcc640a\") " pod="openshift-ovn-kubernetes/ovnkube-node-7mnct" Sep 08 03:55:09.054353 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:09.054208 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/b35366ff-994a-4635-bad2-1ba59bcc640a-systemd-units\") pod \"ovnkube-node-7mnct\" (UID: \"b35366ff-994a-4635-bad2-1ba59bcc640a\") " pod="openshift-ovn-kubernetes/ovnkube-node-7mnct" Sep 08 03:55:09.054353 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:09.054232 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b35366ff-994a-4635-bad2-1ba59bcc640a-host-cni-bin\") pod \"ovnkube-node-7mnct\" (UID: \"b35366ff-994a-4635-bad2-1ba59bcc640a\") " pod="openshift-ovn-kubernetes/ovnkube-node-7mnct" Sep 08 03:55:09.054353 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:09.054254 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0e85668b-3938-4a44-978b-0fa580d71c06-host\") pod \"node-ca-6gf2k\" (UID: \"0e85668b-3938-4a44-978b-0fa580d71c06\") " pod="openshift-image-registry/node-ca-6gf2k" Sep 08 03:55:09.054353 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:09.054278 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b35366ff-994a-4635-bad2-1ba59bcc640a-host-run-netns\") pod \"ovnkube-node-7mnct\" (UID: \"b35366ff-994a-4635-bad2-1ba59bcc640a\") " pod="openshift-ovn-kubernetes/ovnkube-node-7mnct" Sep 08 03:55:09.054353 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:09.054284 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b35366ff-994a-4635-bad2-1ba59bcc640a-host-cni-bin\") pod \"ovnkube-node-7mnct\" (UID: \"b35366ff-994a-4635-bad2-1ba59bcc640a\") " pod="openshift-ovn-kubernetes/ovnkube-node-7mnct" Sep 08 03:55:09.054353 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:09.054257 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/b35366ff-994a-4635-bad2-1ba59bcc640a-systemd-units\") pod \"ovnkube-node-7mnct\" (UID: \"b35366ff-994a-4635-bad2-1ba59bcc640a\") " pod="openshift-ovn-kubernetes/ovnkube-node-7mnct" Sep 08 03:55:09.054353 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:09.054301 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b35366ff-994a-4635-bad2-1ba59bcc640a-run-openvswitch\") pod \"ovnkube-node-7mnct\" (UID: \"b35366ff-994a-4635-bad2-1ba59bcc640a\") " pod="openshift-ovn-kubernetes/ovnkube-node-7mnct" Sep 08 03:55:09.055189 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:09.054326 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b35366ff-994a-4635-bad2-1ba59bcc640a-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-7mnct\" (UID: \"b35366ff-994a-4635-bad2-1ba59bcc640a\") " pod="openshift-ovn-kubernetes/ovnkube-node-7mnct" Sep 08 03:55:09.055189 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:09.054335 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b35366ff-994a-4635-bad2-1ba59bcc640a-host-run-netns\") pod \"ovnkube-node-7mnct\" (UID: \"b35366ff-994a-4635-bad2-1ba59bcc640a\") " pod="openshift-ovn-kubernetes/ovnkube-node-7mnct" Sep 08 03:55:09.055189 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:09.054352 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/b35366ff-994a-4635-bad2-1ba59bcc640a-env-overrides\") pod \"ovnkube-node-7mnct\" (UID: \"b35366ff-994a-4635-bad2-1ba59bcc640a\") " pod="openshift-ovn-kubernetes/ovnkube-node-7mnct" Sep 08 03:55:09.055189 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:09.054375 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dkjt4\" (UniqueName: \"kubernetes.io/projected/d9fbef9f-7075-4727-88c9-b5feeaf043db-kube-api-access-dkjt4\") pod \"multus-additional-cni-plugins-wc8bl\" (UID: \"d9fbef9f-7075-4727-88c9-b5feeaf043db\") " pod="openshift-multus/multus-additional-cni-plugins-wc8bl" Sep 08 03:55:09.055189 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:09.054391 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b35366ff-994a-4635-bad2-1ba59bcc640a-run-openvswitch\") pod \"ovnkube-node-7mnct\" (UID: \"b35366ff-994a-4635-bad2-1ba59bcc640a\") " pod="openshift-ovn-kubernetes/ovnkube-node-7mnct" Sep 08 03:55:09.055189 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:09.054402 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nvwc2\" (UniqueName: \"kubernetes.io/projected/0e85668b-3938-4a44-978b-0fa580d71c06-kube-api-access-nvwc2\") pod \"node-ca-6gf2k\" (UID: \"0e85668b-3938-4a44-978b-0fa580d71c06\") " pod="openshift-image-registry/node-ca-6gf2k" Sep 08 03:55:09.055189 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:09.054402 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b35366ff-994a-4635-bad2-1ba59bcc640a-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-7mnct\" (UID: \"b35366ff-994a-4635-bad2-1ba59bcc640a\") " pod="openshift-ovn-kubernetes/ovnkube-node-7mnct" Sep 08 03:55:09.055189 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:09.054428 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b35366ff-994a-4635-bad2-1ba59bcc640a-etc-openvswitch\") pod \"ovnkube-node-7mnct\" (UID: \"b35366ff-994a-4635-bad2-1ba59bcc640a\") " pod="openshift-ovn-kubernetes/ovnkube-node-7mnct" Sep 08 03:55:09.055189 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:09.054473 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/b35366ff-994a-4635-bad2-1ba59bcc640a-run-ovn\") pod \"ovnkube-node-7mnct\" (UID: \"b35366ff-994a-4635-bad2-1ba59bcc640a\") " pod="openshift-ovn-kubernetes/ovnkube-node-7mnct" Sep 08 03:55:09.055189 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:09.054539 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/5887ba4c-5c74-4753-b0f0-e83cd30fe7d3-etc-modprobe-d\") pod \"tuned-xjf8j\" (UID: \"5887ba4c-5c74-4753-b0f0-e83cd30fe7d3\") " pod="openshift-cluster-node-tuning-operator/tuned-xjf8j" Sep 08 03:55:09.055189 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:09.054594 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/5887ba4c-5c74-4753-b0f0-e83cd30fe7d3-etc-sysctl-d\") pod \"tuned-xjf8j\" (UID: \"5887ba4c-5c74-4753-b0f0-e83cd30fe7d3\") " pod="openshift-cluster-node-tuning-operator/tuned-xjf8j" Sep 08 03:55:09.055189 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:09.054604 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b35366ff-994a-4635-bad2-1ba59bcc640a-etc-openvswitch\") pod \"ovnkube-node-7mnct\" (UID: \"b35366ff-994a-4635-bad2-1ba59bcc640a\") " pod="openshift-ovn-kubernetes/ovnkube-node-7mnct" Sep 08 03:55:09.055189 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:09.054623 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/5887ba4c-5c74-4753-b0f0-e83cd30fe7d3-run\") pod \"tuned-xjf8j\" (UID: \"5887ba4c-5c74-4753-b0f0-e83cd30fe7d3\") " pod="openshift-cluster-node-tuning-operator/tuned-xjf8j" Sep 08 03:55:09.055189 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:09.054654 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/a6151e0d-2e3f-44c5-b268-a7adcc60bffe-iptables-alerter-script\") pod \"iptables-alerter-cbzhc\" (UID: \"a6151e0d-2e3f-44c5-b268-a7adcc60bffe\") " pod="openshift-network-operator/iptables-alerter-cbzhc" Sep 08 03:55:09.055189 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:09.054663 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/2c0c6060-83f1-4145-ae8c-7eb94e2201a8-registration-dir\") pod \"aws-ebs-csi-driver-node-nxtjg\" (UID: \"2c0c6060-83f1-4145-ae8c-7eb94e2201a8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nxtjg" Sep 08 03:55:09.055189 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:09.054686 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/b35366ff-994a-4635-bad2-1ba59bcc640a-ovnkube-script-lib\") pod \"ovnkube-node-7mnct\" (UID: \"b35366ff-994a-4635-bad2-1ba59bcc640a\") " pod="openshift-ovn-kubernetes/ovnkube-node-7mnct" Sep 08 03:55:09.055189 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:09.054691 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/b35366ff-994a-4635-bad2-1ba59bcc640a-run-ovn\") pod \"ovnkube-node-7mnct\" (UID: \"b35366ff-994a-4635-bad2-1ba59bcc640a\") " pod="openshift-ovn-kubernetes/ovnkube-node-7mnct" Sep 08 03:55:09.056032 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:09.054721 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/2c0c6060-83f1-4145-ae8c-7eb94e2201a8-sys-fs\") pod \"aws-ebs-csi-driver-node-nxtjg\" (UID: \"2c0c6060-83f1-4145-ae8c-7eb94e2201a8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nxtjg" Sep 08 03:55:09.056032 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:09.054764 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/f583a7fb-d8f2-4b26-ba64-bb73e3b605c6-multus-socket-dir-parent\") pod \"multus-tbtxs\" (UID: \"f583a7fb-d8f2-4b26-ba64-bb73e3b605c6\") " pod="openshift-multus/multus-tbtxs" Sep 08 03:55:09.056032 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:09.054808 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5887ba4c-5c74-4753-b0f0-e83cd30fe7d3-etc-kubernetes\") pod \"tuned-xjf8j\" (UID: \"5887ba4c-5c74-4753-b0f0-e83cd30fe7d3\") " pod="openshift-cluster-node-tuning-operator/tuned-xjf8j" Sep 08 03:55:09.056032 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:09.054839 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/5887ba4c-5c74-4753-b0f0-e83cd30fe7d3-etc-sysctl-conf\") pod \"tuned-xjf8j\" (UID: \"5887ba4c-5c74-4753-b0f0-e83cd30fe7d3\") " pod="openshift-cluster-node-tuning-operator/tuned-xjf8j" Sep 08 03:55:09.056032 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:09.054864 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d9fbef9f-7075-4727-88c9-b5feeaf043db-system-cni-dir\") pod \"multus-additional-cni-plugins-wc8bl\" (UID: \"d9fbef9f-7075-4727-88c9-b5feeaf043db\") " pod="openshift-multus/multus-additional-cni-plugins-wc8bl" Sep 08 03:55:09.056032 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:09.054878 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/b35366ff-994a-4635-bad2-1ba59bcc640a-env-overrides\") pod \"ovnkube-node-7mnct\" (UID: \"b35366ff-994a-4635-bad2-1ba59bcc640a\") " pod="openshift-ovn-kubernetes/ovnkube-node-7mnct" Sep 08 03:55:09.056032 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:09.054890 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m9c82\" (UniqueName: \"kubernetes.io/projected/ab426e2f-9c8a-4457-a6b9-b98e4c94f4bf-kube-api-access-m9c82\") pod \"network-check-target-4wk4q\" (UID: \"ab426e2f-9c8a-4457-a6b9-b98e4c94f4bf\") " pod="openshift-network-diagnostics/network-check-target-4wk4q" Sep 08 03:55:09.056032 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:09.054942 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f583a7fb-d8f2-4b26-ba64-bb73e3b605c6-host-run-netns\") pod \"multus-tbtxs\" (UID: \"f583a7fb-d8f2-4b26-ba64-bb73e3b605c6\") " pod="openshift-multus/multus-tbtxs" Sep 08 03:55:09.056032 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:09.054966 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/f583a7fb-d8f2-4b26-ba64-bb73e3b605c6-multus-daemon-config\") pod \"multus-tbtxs\" (UID: \"f583a7fb-d8f2-4b26-ba64-bb73e3b605c6\") " pod="openshift-multus/multus-tbtxs" Sep 08 03:55:09.056032 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:09.054987 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/92705af2-1822-4b7f-8852-a8120774230c-hosts-file\") pod \"node-resolver-t2qd4\" (UID: \"92705af2-1822-4b7f-8852-a8120774230c\") " pod="openshift-dns/node-resolver-t2qd4" Sep 08 03:55:09.056032 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:09.055016 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/4c94cf72-6e9d-4f8b-ae71-105e52f051a1-dbus\") pod \"global-pull-secret-syncer-6ffgk\" (UID: \"4c94cf72-6e9d-4f8b-ae71-105e52f051a1\") " pod="kube-system/global-pull-secret-syncer-6ffgk" Sep 08 03:55:09.056032 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:09.055054 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bxjck\" (UniqueName: \"kubernetes.io/projected/b35366ff-994a-4635-bad2-1ba59bcc640a-kube-api-access-bxjck\") pod \"ovnkube-node-7mnct\" (UID: \"b35366ff-994a-4635-bad2-1ba59bcc640a\") " pod="openshift-ovn-kubernetes/ovnkube-node-7mnct" Sep 08 03:55:09.056032 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:09.055092 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/2c0c6060-83f1-4145-ae8c-7eb94e2201a8-socket-dir\") pod \"aws-ebs-csi-driver-node-nxtjg\" (UID: \"2c0c6060-83f1-4145-ae8c-7eb94e2201a8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nxtjg" Sep 08 03:55:09.056032 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:09.055118 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f583a7fb-d8f2-4b26-ba64-bb73e3b605c6-system-cni-dir\") pod \"multus-tbtxs\" (UID: \"f583a7fb-d8f2-4b26-ba64-bb73e3b605c6\") " pod="openshift-multus/multus-tbtxs" Sep 08 03:55:09.056032 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:09.055141 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/f583a7fb-d8f2-4b26-ba64-bb73e3b605c6-hostroot\") pod \"multus-tbtxs\" (UID: \"f583a7fb-d8f2-4b26-ba64-bb73e3b605c6\") " pod="openshift-multus/multus-tbtxs" Sep 08 03:55:09.056032 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:09.055168 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f583a7fb-d8f2-4b26-ba64-bb73e3b605c6-host-var-lib-kubelet\") pod \"multus-tbtxs\" (UID: \"f583a7fb-d8f2-4b26-ba64-bb73e3b605c6\") " pod="openshift-multus/multus-tbtxs" Sep 08 03:55:09.056032 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:09.055190 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/4c94cf72-6e9d-4f8b-ae71-105e52f051a1-dbus\") pod \"global-pull-secret-syncer-6ffgk\" (UID: \"4c94cf72-6e9d-4f8b-ae71-105e52f051a1\") " pod="kube-system/global-pull-secret-syncer-6ffgk" Sep 08 03:55:09.056728 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:09.055191 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/98f02edd-0112-465f-992b-441a484304a3-konnectivity-ca\") pod \"konnectivity-agent-xgq5w\" (UID: \"98f02edd-0112-465f-992b-441a484304a3\") " pod="kube-system/konnectivity-agent-xgq5w" Sep 08 03:55:09.056728 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:09.055323 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/b35366ff-994a-4635-bad2-1ba59bcc640a-ovn-node-metrics-cert\") pod \"ovnkube-node-7mnct\" (UID: \"b35366ff-994a-4635-bad2-1ba59bcc640a\") " pod="openshift-ovn-kubernetes/ovnkube-node-7mnct" Sep 08 03:55:09.056728 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:09.055353 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/2c0c6060-83f1-4145-ae8c-7eb94e2201a8-etc-selinux\") pod \"aws-ebs-csi-driver-node-nxtjg\" (UID: \"2c0c6060-83f1-4145-ae8c-7eb94e2201a8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nxtjg" Sep 08 03:55:09.056728 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:09.055379 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f583a7fb-d8f2-4b26-ba64-bb73e3b605c6-etc-kubernetes\") pod \"multus-tbtxs\" (UID: \"f583a7fb-d8f2-4b26-ba64-bb73e3b605c6\") " pod="openshift-multus/multus-tbtxs" Sep 08 03:55:09.056728 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:09.055403 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4c94cf72-6e9d-4f8b-ae71-105e52f051a1-original-pull-secret\") pod \"global-pull-secret-syncer-6ffgk\" (UID: \"4c94cf72-6e9d-4f8b-ae71-105e52f051a1\") " pod="kube-system/global-pull-secret-syncer-6ffgk" Sep 08 03:55:09.056728 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:09.055427 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ksth8\" (UniqueName: \"kubernetes.io/projected/be017881-2b6a-4fd2-b62d-4b5d3bd7b834-kube-api-access-ksth8\") pod \"network-metrics-daemon-s2679\" (UID: \"be017881-2b6a-4fd2-b62d-4b5d3bd7b834\") " pod="openshift-multus/network-metrics-daemon-s2679" Sep 08 03:55:09.056728 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:09.055475 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/b35366ff-994a-4635-bad2-1ba59bcc640a-host-kubelet\") pod \"ovnkube-node-7mnct\" (UID: \"b35366ff-994a-4635-bad2-1ba59bcc640a\") " pod="openshift-ovn-kubernetes/ovnkube-node-7mnct" Sep 08 03:55:09.056728 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:09.055505 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b35366ff-994a-4635-bad2-1ba59bcc640a-host-run-ovn-kubernetes\") pod \"ovnkube-node-7mnct\" (UID: \"b35366ff-994a-4635-bad2-1ba59bcc640a\") " pod="openshift-ovn-kubernetes/ovnkube-node-7mnct" Sep 08 03:55:09.056728 ip-10-0-128-67 kubenswrapper[2571]: E0908 03:55:09.055553 2571 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 08 03:55:09.056728 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:09.055583 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5887ba4c-5c74-4753-b0f0-e83cd30fe7d3-lib-modules\") pod \"tuned-xjf8j\" (UID: \"5887ba4c-5c74-4753-b0f0-e83cd30fe7d3\") " pod="openshift-cluster-node-tuning-operator/tuned-xjf8j" Sep 08 03:55:09.056728 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:09.055602 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/0e85668b-3938-4a44-978b-0fa580d71c06-serviceca\") pod \"node-ca-6gf2k\" (UID: \"0e85668b-3938-4a44-978b-0fa580d71c06\") " pod="openshift-image-registry/node-ca-6gf2k" Sep 08 03:55:09.056728 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:09.055633 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/b35366ff-994a-4635-bad2-1ba59bcc640a-host-kubelet\") pod \"ovnkube-node-7mnct\" (UID: \"b35366ff-994a-4635-bad2-1ba59bcc640a\") " pod="openshift-ovn-kubernetes/ovnkube-node-7mnct" Sep 08 03:55:09.056728 ip-10-0-128-67 kubenswrapper[2571]: E0908 03:55:09.055714 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4c94cf72-6e9d-4f8b-ae71-105e52f051a1-original-pull-secret podName:4c94cf72-6e9d-4f8b-ae71-105e52f051a1 nodeName:}" failed. No retries permitted until 2026-09-08 03:55:09.555702677 +0000 UTC m=+3.026271049 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4c94cf72-6e9d-4f8b-ae71-105e52f051a1-original-pull-secret") pod "global-pull-secret-syncer-6ffgk" (UID: "4c94cf72-6e9d-4f8b-ae71-105e52f051a1") : object "kube-system"/"original-pull-secret" not registered Sep 08 03:55:09.056728 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:09.055711 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/98f02edd-0112-465f-992b-441a484304a3-agent-certs\") pod \"konnectivity-agent-xgq5w\" (UID: \"98f02edd-0112-465f-992b-441a484304a3\") " pod="kube-system/konnectivity-agent-xgq5w" Sep 08 03:55:09.056728 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:09.055732 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b35366ff-994a-4635-bad2-1ba59bcc640a-host-run-ovn-kubernetes\") pod \"ovnkube-node-7mnct\" (UID: \"b35366ff-994a-4635-bad2-1ba59bcc640a\") " pod="openshift-ovn-kubernetes/ovnkube-node-7mnct" Sep 08 03:55:09.056728 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:09.055734 2571 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Sep 08 03:55:09.056728 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:09.055775 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b35366ff-994a-4635-bad2-1ba59bcc640a-host-slash\") pod \"ovnkube-node-7mnct\" (UID: \"b35366ff-994a-4635-bad2-1ba59bcc640a\") " pod="openshift-ovn-kubernetes/ovnkube-node-7mnct" Sep 08 03:55:09.057409 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:09.055805 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/b35366ff-994a-4635-bad2-1ba59bcc640a-node-log\") pod \"ovnkube-node-7mnct\" (UID: \"b35366ff-994a-4635-bad2-1ba59bcc640a\") " pod="openshift-ovn-kubernetes/ovnkube-node-7mnct" Sep 08 03:55:09.057409 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:09.055847 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b35366ff-994a-4635-bad2-1ba59bcc640a-host-slash\") pod \"ovnkube-node-7mnct\" (UID: \"b35366ff-994a-4635-bad2-1ba59bcc640a\") " pod="openshift-ovn-kubernetes/ovnkube-node-7mnct" Sep 08 03:55:09.057409 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:09.055900 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/b35366ff-994a-4635-bad2-1ba59bcc640a-node-log\") pod \"ovnkube-node-7mnct\" (UID: \"b35366ff-994a-4635-bad2-1ba59bcc640a\") " pod="openshift-ovn-kubernetes/ovnkube-node-7mnct" Sep 08 03:55:09.057409 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:09.055957 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f583a7fb-d8f2-4b26-ba64-bb73e3b605c6-multus-conf-dir\") pod \"multus-tbtxs\" (UID: \"f583a7fb-d8f2-4b26-ba64-bb73e3b605c6\") " pod="openshift-multus/multus-tbtxs" Sep 08 03:55:09.057409 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:09.055985 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/f583a7fb-d8f2-4b26-ba64-bb73e3b605c6-host-run-multus-certs\") pod \"multus-tbtxs\" (UID: \"f583a7fb-d8f2-4b26-ba64-bb73e3b605c6\") " pod="openshift-multus/multus-tbtxs" Sep 08 03:55:09.057409 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:09.056029 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/b35366ff-994a-4635-bad2-1ba59bcc640a-host-cni-netd\") pod \"ovnkube-node-7mnct\" (UID: \"b35366ff-994a-4635-bad2-1ba59bcc640a\") " pod="openshift-ovn-kubernetes/ovnkube-node-7mnct" Sep 08 03:55:09.057409 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:09.056059 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5887ba4c-5c74-4753-b0f0-e83cd30fe7d3-tmp\") pod \"tuned-xjf8j\" (UID: \"5887ba4c-5c74-4753-b0f0-e83cd30fe7d3\") " pod="openshift-cluster-node-tuning-operator/tuned-xjf8j" Sep 08 03:55:09.057409 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:09.056085 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-84rsd\" (UniqueName: \"kubernetes.io/projected/2c0c6060-83f1-4145-ae8c-7eb94e2201a8-kube-api-access-84rsd\") pod \"aws-ebs-csi-driver-node-nxtjg\" (UID: \"2c0c6060-83f1-4145-ae8c-7eb94e2201a8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nxtjg" Sep 08 03:55:09.057409 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:09.056111 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d9fbef9f-7075-4727-88c9-b5feeaf043db-cnibin\") pod \"multus-additional-cni-plugins-wc8bl\" (UID: \"d9fbef9f-7075-4727-88c9-b5feeaf043db\") " pod="openshift-multus/multus-additional-cni-plugins-wc8bl" Sep 08 03:55:09.057409 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:09.056113 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/b35366ff-994a-4635-bad2-1ba59bcc640a-host-cni-netd\") pod \"ovnkube-node-7mnct\" (UID: \"b35366ff-994a-4635-bad2-1ba59bcc640a\") " pod="openshift-ovn-kubernetes/ovnkube-node-7mnct" Sep 08 03:55:09.057409 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:09.056135 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dntq6\" (UniqueName: \"kubernetes.io/projected/f583a7fb-d8f2-4b26-ba64-bb73e3b605c6-kube-api-access-dntq6\") pod \"multus-tbtxs\" (UID: \"f583a7fb-d8f2-4b26-ba64-bb73e3b605c6\") " pod="openshift-multus/multus-tbtxs" Sep 08 03:55:09.057409 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:09.056161 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/92705af2-1822-4b7f-8852-a8120774230c-tmp-dir\") pod \"node-resolver-t2qd4\" (UID: \"92705af2-1822-4b7f-8852-a8120774230c\") " pod="openshift-dns/node-resolver-t2qd4" Sep 08 03:55:09.060329 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:09.060264 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/b35366ff-994a-4635-bad2-1ba59bcc640a-ovn-node-metrics-cert\") pod \"ovnkube-node-7mnct\" (UID: \"b35366ff-994a-4635-bad2-1ba59bcc640a\") " pod="openshift-ovn-kubernetes/ovnkube-node-7mnct" Sep 08 03:55:09.065208 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:09.065160 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bxjck\" (UniqueName: \"kubernetes.io/projected/b35366ff-994a-4635-bad2-1ba59bcc640a-kube-api-access-bxjck\") pod \"ovnkube-node-7mnct\" (UID: \"b35366ff-994a-4635-bad2-1ba59bcc640a\") " pod="openshift-ovn-kubernetes/ovnkube-node-7mnct" Sep 08 03:55:09.065307 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:09.065216 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ksth8\" (UniqueName: \"kubernetes.io/projected/be017881-2b6a-4fd2-b62d-4b5d3bd7b834-kube-api-access-ksth8\") pod \"network-metrics-daemon-s2679\" (UID: \"be017881-2b6a-4fd2-b62d-4b5d3bd7b834\") " pod="openshift-multus/network-metrics-daemon-s2679" Sep 08 03:55:09.065582 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:09.065561 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gvq84\" (UniqueName: \"kubernetes.io/projected/a6151e0d-2e3f-44c5-b268-a7adcc60bffe-kube-api-access-gvq84\") pod \"iptables-alerter-cbzhc\" (UID: \"a6151e0d-2e3f-44c5-b268-a7adcc60bffe\") " pod="openshift-network-operator/iptables-alerter-cbzhc" Sep 08 03:55:09.067600 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:09.067541 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-67.ec2.internal" event={"ID":"79ed4e7f3bb3545fed2a22b103b1acef","Type":"ContainerStarted","Data":"a3218466800f10955b055dd821f1653f15eb632ed6c51fa99c2fc670048a0d0f"} Sep 08 03:55:09.068871 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:09.068825 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-67.ec2.internal" event={"ID":"c9e8db20add26e2681670793a6ac21cf","Type":"ContainerStarted","Data":"0f36fe3c234a1a00b33a1cbad1cfc119df59714c27d4a79f5cd50a6ffd37b525"} Sep 08 03:55:09.157553 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:09.157516 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0e85668b-3938-4a44-978b-0fa580d71c06-host\") pod \"node-ca-6gf2k\" (UID: \"0e85668b-3938-4a44-978b-0fa580d71c06\") " pod="openshift-image-registry/node-ca-6gf2k" Sep 08 03:55:09.157730 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:09.157581 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dkjt4\" (UniqueName: \"kubernetes.io/projected/d9fbef9f-7075-4727-88c9-b5feeaf043db-kube-api-access-dkjt4\") pod \"multus-additional-cni-plugins-wc8bl\" (UID: \"d9fbef9f-7075-4727-88c9-b5feeaf043db\") " pod="openshift-multus/multus-additional-cni-plugins-wc8bl" Sep 08 03:55:09.157730 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:09.157614 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nvwc2\" (UniqueName: \"kubernetes.io/projected/0e85668b-3938-4a44-978b-0fa580d71c06-kube-api-access-nvwc2\") pod \"node-ca-6gf2k\" (UID: \"0e85668b-3938-4a44-978b-0fa580d71c06\") " pod="openshift-image-registry/node-ca-6gf2k" Sep 08 03:55:09.157730 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:09.157646 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/5887ba4c-5c74-4753-b0f0-e83cd30fe7d3-etc-modprobe-d\") pod \"tuned-xjf8j\" (UID: \"5887ba4c-5c74-4753-b0f0-e83cd30fe7d3\") " pod="openshift-cluster-node-tuning-operator/tuned-xjf8j" Sep 08 03:55:09.157730 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:09.157669 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/5887ba4c-5c74-4753-b0f0-e83cd30fe7d3-etc-sysctl-d\") pod \"tuned-xjf8j\" (UID: \"5887ba4c-5c74-4753-b0f0-e83cd30fe7d3\") " pod="openshift-cluster-node-tuning-operator/tuned-xjf8j" Sep 08 03:55:09.157730 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:09.157714 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/5887ba4c-5c74-4753-b0f0-e83cd30fe7d3-run\") pod \"tuned-xjf8j\" (UID: \"5887ba4c-5c74-4753-b0f0-e83cd30fe7d3\") " pod="openshift-cluster-node-tuning-operator/tuned-xjf8j" Sep 08 03:55:09.157991 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:09.157743 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/2c0c6060-83f1-4145-ae8c-7eb94e2201a8-registration-dir\") pod \"aws-ebs-csi-driver-node-nxtjg\" (UID: \"2c0c6060-83f1-4145-ae8c-7eb94e2201a8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nxtjg" Sep 08 03:55:09.157991 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:09.157772 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/2c0c6060-83f1-4145-ae8c-7eb94e2201a8-sys-fs\") pod \"aws-ebs-csi-driver-node-nxtjg\" (UID: \"2c0c6060-83f1-4145-ae8c-7eb94e2201a8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nxtjg" Sep 08 03:55:09.157991 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:09.157801 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/f583a7fb-d8f2-4b26-ba64-bb73e3b605c6-multus-socket-dir-parent\") pod \"multus-tbtxs\" (UID: \"f583a7fb-d8f2-4b26-ba64-bb73e3b605c6\") " pod="openshift-multus/multus-tbtxs" Sep 08 03:55:09.157991 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:09.157824 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5887ba4c-5c74-4753-b0f0-e83cd30fe7d3-etc-kubernetes\") pod \"tuned-xjf8j\" (UID: \"5887ba4c-5c74-4753-b0f0-e83cd30fe7d3\") " pod="openshift-cluster-node-tuning-operator/tuned-xjf8j" Sep 08 03:55:09.157991 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:09.157851 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/5887ba4c-5c74-4753-b0f0-e83cd30fe7d3-etc-sysctl-conf\") pod \"tuned-xjf8j\" (UID: \"5887ba4c-5c74-4753-b0f0-e83cd30fe7d3\") " pod="openshift-cluster-node-tuning-operator/tuned-xjf8j" Sep 08 03:55:09.157991 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:09.157878 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d9fbef9f-7075-4727-88c9-b5feeaf043db-system-cni-dir\") pod \"multus-additional-cni-plugins-wc8bl\" (UID: \"d9fbef9f-7075-4727-88c9-b5feeaf043db\") " pod="openshift-multus/multus-additional-cni-plugins-wc8bl" Sep 08 03:55:09.157991 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:09.157908 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m9c82\" (UniqueName: \"kubernetes.io/projected/ab426e2f-9c8a-4457-a6b9-b98e4c94f4bf-kube-api-access-m9c82\") pod \"network-check-target-4wk4q\" (UID: \"ab426e2f-9c8a-4457-a6b9-b98e4c94f4bf\") " pod="openshift-network-diagnostics/network-check-target-4wk4q" Sep 08 03:55:09.157991 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:09.157947 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f583a7fb-d8f2-4b26-ba64-bb73e3b605c6-host-run-netns\") pod \"multus-tbtxs\" (UID: \"f583a7fb-d8f2-4b26-ba64-bb73e3b605c6\") " pod="openshift-multus/multus-tbtxs" Sep 08 03:55:09.157991 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:09.157976 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/f583a7fb-d8f2-4b26-ba64-bb73e3b605c6-multus-daemon-config\") pod \"multus-tbtxs\" (UID: \"f583a7fb-d8f2-4b26-ba64-bb73e3b605c6\") " pod="openshift-multus/multus-tbtxs" Sep 08 03:55:09.158425 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:09.158004 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/92705af2-1822-4b7f-8852-a8120774230c-hosts-file\") pod \"node-resolver-t2qd4\" (UID: \"92705af2-1822-4b7f-8852-a8120774230c\") " pod="openshift-dns/node-resolver-t2qd4" Sep 08 03:55:09.158425 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:09.158036 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/2c0c6060-83f1-4145-ae8c-7eb94e2201a8-socket-dir\") pod \"aws-ebs-csi-driver-node-nxtjg\" (UID: \"2c0c6060-83f1-4145-ae8c-7eb94e2201a8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nxtjg" Sep 08 03:55:09.158425 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:09.158066 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f583a7fb-d8f2-4b26-ba64-bb73e3b605c6-system-cni-dir\") pod \"multus-tbtxs\" (UID: \"f583a7fb-d8f2-4b26-ba64-bb73e3b605c6\") " pod="openshift-multus/multus-tbtxs" Sep 08 03:55:09.158425 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:09.158096 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/f583a7fb-d8f2-4b26-ba64-bb73e3b605c6-hostroot\") pod \"multus-tbtxs\" (UID: \"f583a7fb-d8f2-4b26-ba64-bb73e3b605c6\") " pod="openshift-multus/multus-tbtxs" Sep 08 03:55:09.158425 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:09.158126 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f583a7fb-d8f2-4b26-ba64-bb73e3b605c6-host-var-lib-kubelet\") pod \"multus-tbtxs\" (UID: \"f583a7fb-d8f2-4b26-ba64-bb73e3b605c6\") " pod="openshift-multus/multus-tbtxs" Sep 08 03:55:09.158425 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:09.158155 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/98f02edd-0112-465f-992b-441a484304a3-konnectivity-ca\") pod \"konnectivity-agent-xgq5w\" (UID: \"98f02edd-0112-465f-992b-441a484304a3\") " pod="kube-system/konnectivity-agent-xgq5w" Sep 08 03:55:09.158425 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:09.158186 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/2c0c6060-83f1-4145-ae8c-7eb94e2201a8-etc-selinux\") pod \"aws-ebs-csi-driver-node-nxtjg\" (UID: \"2c0c6060-83f1-4145-ae8c-7eb94e2201a8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nxtjg" Sep 08 03:55:09.158425 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:09.158216 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f583a7fb-d8f2-4b26-ba64-bb73e3b605c6-etc-kubernetes\") pod \"multus-tbtxs\" (UID: \"f583a7fb-d8f2-4b26-ba64-bb73e3b605c6\") " pod="openshift-multus/multus-tbtxs" Sep 08 03:55:09.158425 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:09.158267 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5887ba4c-5c74-4753-b0f0-e83cd30fe7d3-lib-modules\") pod \"tuned-xjf8j\" (UID: \"5887ba4c-5c74-4753-b0f0-e83cd30fe7d3\") " pod="openshift-cluster-node-tuning-operator/tuned-xjf8j" Sep 08 03:55:09.158425 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:09.158295 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/0e85668b-3938-4a44-978b-0fa580d71c06-serviceca\") pod \"node-ca-6gf2k\" (UID: \"0e85668b-3938-4a44-978b-0fa580d71c06\") " pod="openshift-image-registry/node-ca-6gf2k" Sep 08 03:55:09.158425 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:09.158319 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/98f02edd-0112-465f-992b-441a484304a3-agent-certs\") pod \"konnectivity-agent-xgq5w\" (UID: \"98f02edd-0112-465f-992b-441a484304a3\") " pod="kube-system/konnectivity-agent-xgq5w" Sep 08 03:55:09.158425 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:09.158349 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f583a7fb-d8f2-4b26-ba64-bb73e3b605c6-multus-conf-dir\") pod \"multus-tbtxs\" (UID: \"f583a7fb-d8f2-4b26-ba64-bb73e3b605c6\") " pod="openshift-multus/multus-tbtxs" Sep 08 03:55:09.158425 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:09.158381 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/f583a7fb-d8f2-4b26-ba64-bb73e3b605c6-host-run-multus-certs\") pod \"multus-tbtxs\" (UID: \"f583a7fb-d8f2-4b26-ba64-bb73e3b605c6\") " pod="openshift-multus/multus-tbtxs" Sep 08 03:55:09.158425 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:09.158410 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5887ba4c-5c74-4753-b0f0-e83cd30fe7d3-tmp\") pod \"tuned-xjf8j\" (UID: \"5887ba4c-5c74-4753-b0f0-e83cd30fe7d3\") " pod="openshift-cluster-node-tuning-operator/tuned-xjf8j" Sep 08 03:55:09.159039 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:09.158442 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-84rsd\" (UniqueName: \"kubernetes.io/projected/2c0c6060-83f1-4145-ae8c-7eb94e2201a8-kube-api-access-84rsd\") pod \"aws-ebs-csi-driver-node-nxtjg\" (UID: \"2c0c6060-83f1-4145-ae8c-7eb94e2201a8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nxtjg" Sep 08 03:55:09.159039 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:09.158466 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d9fbef9f-7075-4727-88c9-b5feeaf043db-cnibin\") pod \"multus-additional-cni-plugins-wc8bl\" (UID: \"d9fbef9f-7075-4727-88c9-b5feeaf043db\") " pod="openshift-multus/multus-additional-cni-plugins-wc8bl" Sep 08 03:55:09.159039 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:09.158494 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dntq6\" (UniqueName: \"kubernetes.io/projected/f583a7fb-d8f2-4b26-ba64-bb73e3b605c6-kube-api-access-dntq6\") pod \"multus-tbtxs\" (UID: \"f583a7fb-d8f2-4b26-ba64-bb73e3b605c6\") " pod="openshift-multus/multus-tbtxs" Sep 08 03:55:09.159039 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:09.158530 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/92705af2-1822-4b7f-8852-a8120774230c-tmp-dir\") pod \"node-resolver-t2qd4\" (UID: \"92705af2-1822-4b7f-8852-a8120774230c\") " pod="openshift-dns/node-resolver-t2qd4" Sep 08 03:55:09.159039 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:09.158559 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5887ba4c-5c74-4753-b0f0-e83cd30fe7d3-host\") pod \"tuned-xjf8j\" (UID: \"5887ba4c-5c74-4753-b0f0-e83cd30fe7d3\") " pod="openshift-cluster-node-tuning-operator/tuned-xjf8j" Sep 08 03:55:09.159039 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:09.158587 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d9fbef9f-7075-4727-88c9-b5feeaf043db-cni-binary-copy\") pod \"multus-additional-cni-plugins-wc8bl\" (UID: \"d9fbef9f-7075-4727-88c9-b5feeaf043db\") " pod="openshift-multus/multus-additional-cni-plugins-wc8bl" Sep 08 03:55:09.159039 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:09.158621 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/5887ba4c-5c74-4753-b0f0-e83cd30fe7d3-etc-systemd\") pod \"tuned-xjf8j\" (UID: \"5887ba4c-5c74-4753-b0f0-e83cd30fe7d3\") " pod="openshift-cluster-node-tuning-operator/tuned-xjf8j" Sep 08 03:55:09.159039 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:09.158645 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f583a7fb-d8f2-4b26-ba64-bb73e3b605c6-cnibin\") pod \"multus-tbtxs\" (UID: \"f583a7fb-d8f2-4b26-ba64-bb73e3b605c6\") " pod="openshift-multus/multus-tbtxs" Sep 08 03:55:09.159039 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:09.158674 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f583a7fb-d8f2-4b26-ba64-bb73e3b605c6-cni-binary-copy\") pod \"multus-tbtxs\" (UID: \"f583a7fb-d8f2-4b26-ba64-bb73e3b605c6\") " pod="openshift-multus/multus-tbtxs" Sep 08 03:55:09.159039 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:09.158703 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/5887ba4c-5c74-4753-b0f0-e83cd30fe7d3-etc-sysconfig\") pod \"tuned-xjf8j\" (UID: \"5887ba4c-5c74-4753-b0f0-e83cd30fe7d3\") " pod="openshift-cluster-node-tuning-operator/tuned-xjf8j" Sep 08 03:55:09.159039 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:09.158730 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5887ba4c-5c74-4753-b0f0-e83cd30fe7d3-sys\") pod \"tuned-xjf8j\" (UID: \"5887ba4c-5c74-4753-b0f0-e83cd30fe7d3\") " pod="openshift-cluster-node-tuning-operator/tuned-xjf8j" Sep 08 03:55:09.159039 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:09.158768 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d9fbef9f-7075-4727-88c9-b5feeaf043db-tuning-conf-dir\") pod \"multus-additional-cni-plugins-wc8bl\" (UID: \"d9fbef9f-7075-4727-88c9-b5feeaf043db\") " pod="openshift-multus/multus-additional-cni-plugins-wc8bl" Sep 08 03:55:09.159039 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:09.158792 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/d9fbef9f-7075-4727-88c9-b5feeaf043db-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-wc8bl\" (UID: \"d9fbef9f-7075-4727-88c9-b5feeaf043db\") " pod="openshift-multus/multus-additional-cni-plugins-wc8bl" Sep 08 03:55:09.159039 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:09.158822 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/f583a7fb-d8f2-4b26-ba64-bb73e3b605c6-host-run-k8s-cni-cncf-io\") pod \"multus-tbtxs\" (UID: \"f583a7fb-d8f2-4b26-ba64-bb73e3b605c6\") " pod="openshift-multus/multus-tbtxs" Sep 08 03:55:09.159039 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:09.158854 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sgxcf\" (UniqueName: \"kubernetes.io/projected/92705af2-1822-4b7f-8852-a8120774230c-kube-api-access-sgxcf\") pod \"node-resolver-t2qd4\" (UID: \"92705af2-1822-4b7f-8852-a8120774230c\") " pod="openshift-dns/node-resolver-t2qd4" Sep 08 03:55:09.159039 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:09.158900 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/5887ba4c-5c74-4753-b0f0-e83cd30fe7d3-etc-tuned\") pod \"tuned-xjf8j\" (UID: \"5887ba4c-5c74-4753-b0f0-e83cd30fe7d3\") " pod="openshift-cluster-node-tuning-operator/tuned-xjf8j" Sep 08 03:55:09.159039 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:09.158947 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/2c0c6060-83f1-4145-ae8c-7eb94e2201a8-kubelet-dir\") pod \"aws-ebs-csi-driver-node-nxtjg\" (UID: \"2c0c6060-83f1-4145-ae8c-7eb94e2201a8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nxtjg" Sep 08 03:55:09.159724 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:09.158976 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/2c0c6060-83f1-4145-ae8c-7eb94e2201a8-device-dir\") pod \"aws-ebs-csi-driver-node-nxtjg\" (UID: \"2c0c6060-83f1-4145-ae8c-7eb94e2201a8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nxtjg" Sep 08 03:55:09.159724 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:09.159007 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/d9fbef9f-7075-4727-88c9-b5feeaf043db-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-wc8bl\" (UID: \"d9fbef9f-7075-4727-88c9-b5feeaf043db\") " pod="openshift-multus/multus-additional-cni-plugins-wc8bl" Sep 08 03:55:09.159724 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:09.159033 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f583a7fb-d8f2-4b26-ba64-bb73e3b605c6-multus-cni-dir\") pod \"multus-tbtxs\" (UID: \"f583a7fb-d8f2-4b26-ba64-bb73e3b605c6\") " pod="openshift-multus/multus-tbtxs" Sep 08 03:55:09.159724 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:09.159066 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tdln8\" (UniqueName: \"kubernetes.io/projected/5887ba4c-5c74-4753-b0f0-e83cd30fe7d3-kube-api-access-tdln8\") pod \"tuned-xjf8j\" (UID: \"5887ba4c-5c74-4753-b0f0-e83cd30fe7d3\") " pod="openshift-cluster-node-tuning-operator/tuned-xjf8j" Sep 08 03:55:09.159724 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:09.159098 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5887ba4c-5c74-4753-b0f0-e83cd30fe7d3-var-lib-kubelet\") pod \"tuned-xjf8j\" (UID: \"5887ba4c-5c74-4753-b0f0-e83cd30fe7d3\") " pod="openshift-cluster-node-tuning-operator/tuned-xjf8j" Sep 08 03:55:09.159724 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:09.159127 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f583a7fb-d8f2-4b26-ba64-bb73e3b605c6-host-var-lib-cni-bin\") pod \"multus-tbtxs\" (UID: \"f583a7fb-d8f2-4b26-ba64-bb73e3b605c6\") " pod="openshift-multus/multus-tbtxs" Sep 08 03:55:09.159724 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:09.159156 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/f583a7fb-d8f2-4b26-ba64-bb73e3b605c6-host-var-lib-cni-multus\") pod \"multus-tbtxs\" (UID: \"f583a7fb-d8f2-4b26-ba64-bb73e3b605c6\") " pod="openshift-multus/multus-tbtxs" Sep 08 03:55:09.159724 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:09.159269 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/f583a7fb-d8f2-4b26-ba64-bb73e3b605c6-host-var-lib-cni-multus\") pod \"multus-tbtxs\" (UID: \"f583a7fb-d8f2-4b26-ba64-bb73e3b605c6\") " pod="openshift-multus/multus-tbtxs" Sep 08 03:55:09.159724 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:09.159325 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0e85668b-3938-4a44-978b-0fa580d71c06-host\") pod \"node-ca-6gf2k\" (UID: \"0e85668b-3938-4a44-978b-0fa580d71c06\") " pod="openshift-image-registry/node-ca-6gf2k" Sep 08 03:55:09.160189 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:09.159830 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/f583a7fb-d8f2-4b26-ba64-bb73e3b605c6-host-run-multus-certs\") pod \"multus-tbtxs\" (UID: \"f583a7fb-d8f2-4b26-ba64-bb73e3b605c6\") " pod="openshift-multus/multus-tbtxs" Sep 08 03:55:09.160189 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:09.159868 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/f583a7fb-d8f2-4b26-ba64-bb73e3b605c6-multus-socket-dir-parent\") pod \"multus-tbtxs\" (UID: \"f583a7fb-d8f2-4b26-ba64-bb73e3b605c6\") " pod="openshift-multus/multus-tbtxs" Sep 08 03:55:09.160189 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:09.159894 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d9fbef9f-7075-4727-88c9-b5feeaf043db-cnibin\") pod \"multus-additional-cni-plugins-wc8bl\" (UID: \"d9fbef9f-7075-4727-88c9-b5feeaf043db\") " pod="openshift-multus/multus-additional-cni-plugins-wc8bl" Sep 08 03:55:09.160189 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:09.159878 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/5887ba4c-5c74-4753-b0f0-e83cd30fe7d3-run\") pod \"tuned-xjf8j\" (UID: \"5887ba4c-5c74-4753-b0f0-e83cd30fe7d3\") " pod="openshift-cluster-node-tuning-operator/tuned-xjf8j" Sep 08 03:55:09.160189 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:09.159914 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/92705af2-1822-4b7f-8852-a8120774230c-hosts-file\") pod \"node-resolver-t2qd4\" (UID: \"92705af2-1822-4b7f-8852-a8120774230c\") " pod="openshift-dns/node-resolver-t2qd4" Sep 08 03:55:09.160189 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:09.160002 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/2c0c6060-83f1-4145-ae8c-7eb94e2201a8-sys-fs\") pod \"aws-ebs-csi-driver-node-nxtjg\" (UID: \"2c0c6060-83f1-4145-ae8c-7eb94e2201a8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nxtjg" Sep 08 03:55:09.160189 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:09.160027 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/5887ba4c-5c74-4753-b0f0-e83cd30fe7d3-etc-modprobe-d\") pod \"tuned-xjf8j\" (UID: \"5887ba4c-5c74-4753-b0f0-e83cd30fe7d3\") " pod="openshift-cluster-node-tuning-operator/tuned-xjf8j" Sep 08 03:55:09.160189 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:09.160073 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/2c0c6060-83f1-4145-ae8c-7eb94e2201a8-registration-dir\") pod \"aws-ebs-csi-driver-node-nxtjg\" (UID: \"2c0c6060-83f1-4145-ae8c-7eb94e2201a8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nxtjg" Sep 08 03:55:09.160520 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:09.160231 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/5887ba4c-5c74-4753-b0f0-e83cd30fe7d3-etc-sysctl-d\") pod \"tuned-xjf8j\" (UID: \"5887ba4c-5c74-4753-b0f0-e83cd30fe7d3\") " pod="openshift-cluster-node-tuning-operator/tuned-xjf8j" Sep 08 03:55:09.160520 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:09.160247 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/f583a7fb-d8f2-4b26-ba64-bb73e3b605c6-hostroot\") pod \"multus-tbtxs\" (UID: \"f583a7fb-d8f2-4b26-ba64-bb73e3b605c6\") " pod="openshift-multus/multus-tbtxs" Sep 08 03:55:09.160520 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:09.160308 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/2c0c6060-83f1-4145-ae8c-7eb94e2201a8-socket-dir\") pod \"aws-ebs-csi-driver-node-nxtjg\" (UID: \"2c0c6060-83f1-4145-ae8c-7eb94e2201a8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nxtjg" Sep 08 03:55:09.160520 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:09.160351 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f583a7fb-d8f2-4b26-ba64-bb73e3b605c6-host-var-lib-kubelet\") pod \"multus-tbtxs\" (UID: \"f583a7fb-d8f2-4b26-ba64-bb73e3b605c6\") " pod="openshift-multus/multus-tbtxs" Sep 08 03:55:09.160520 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:09.160398 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f583a7fb-d8f2-4b26-ba64-bb73e3b605c6-etc-kubernetes\") pod \"multus-tbtxs\" (UID: \"f583a7fb-d8f2-4b26-ba64-bb73e3b605c6\") " pod="openshift-multus/multus-tbtxs" Sep 08 03:55:09.160520 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:09.160444 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/f583a7fb-d8f2-4b26-ba64-bb73e3b605c6-host-run-k8s-cni-cncf-io\") pod \"multus-tbtxs\" (UID: \"f583a7fb-d8f2-4b26-ba64-bb73e3b605c6\") " pod="openshift-multus/multus-tbtxs" Sep 08 03:55:09.160520 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:09.160486 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5887ba4c-5c74-4753-b0f0-e83cd30fe7d3-lib-modules\") pod \"tuned-xjf8j\" (UID: \"5887ba4c-5c74-4753-b0f0-e83cd30fe7d3\") " pod="openshift-cluster-node-tuning-operator/tuned-xjf8j" Sep 08 03:55:09.160826 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:09.160525 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f583a7fb-d8f2-4b26-ba64-bb73e3b605c6-system-cni-dir\") pod \"multus-tbtxs\" (UID: \"f583a7fb-d8f2-4b26-ba64-bb73e3b605c6\") " pod="openshift-multus/multus-tbtxs" Sep 08 03:55:09.160826 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:09.160564 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f583a7fb-d8f2-4b26-ba64-bb73e3b605c6-multus-conf-dir\") pod \"multus-tbtxs\" (UID: \"f583a7fb-d8f2-4b26-ba64-bb73e3b605c6\") " pod="openshift-multus/multus-tbtxs" Sep 08 03:55:09.160826 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:09.160570 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/2c0c6060-83f1-4145-ae8c-7eb94e2201a8-etc-selinux\") pod \"aws-ebs-csi-driver-node-nxtjg\" (UID: \"2c0c6060-83f1-4145-ae8c-7eb94e2201a8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nxtjg" Sep 08 03:55:09.160826 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:09.160727 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5887ba4c-5c74-4753-b0f0-e83cd30fe7d3-host\") pod \"tuned-xjf8j\" (UID: \"5887ba4c-5c74-4753-b0f0-e83cd30fe7d3\") " pod="openshift-cluster-node-tuning-operator/tuned-xjf8j" Sep 08 03:55:09.160826 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:09.160735 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/f583a7fb-d8f2-4b26-ba64-bb73e3b605c6-multus-daemon-config\") pod \"multus-tbtxs\" (UID: \"f583a7fb-d8f2-4b26-ba64-bb73e3b605c6\") " pod="openshift-multus/multus-tbtxs" Sep 08 03:55:09.160826 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:09.160766 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d9fbef9f-7075-4727-88c9-b5feeaf043db-system-cni-dir\") pod \"multus-additional-cni-plugins-wc8bl\" (UID: \"d9fbef9f-7075-4727-88c9-b5feeaf043db\") " pod="openshift-multus/multus-additional-cni-plugins-wc8bl" Sep 08 03:55:09.160826 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:09.160776 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/92705af2-1822-4b7f-8852-a8120774230c-tmp-dir\") pod \"node-resolver-t2qd4\" (UID: \"92705af2-1822-4b7f-8852-a8120774230c\") " pod="openshift-dns/node-resolver-t2qd4" Sep 08 03:55:09.161179 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:09.160826 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5887ba4c-5c74-4753-b0f0-e83cd30fe7d3-etc-kubernetes\") pod \"tuned-xjf8j\" (UID: \"5887ba4c-5c74-4753-b0f0-e83cd30fe7d3\") " pod="openshift-cluster-node-tuning-operator/tuned-xjf8j" Sep 08 03:55:09.161179 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:09.160829 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/98f02edd-0112-465f-992b-441a484304a3-konnectivity-ca\") pod \"konnectivity-agent-xgq5w\" (UID: \"98f02edd-0112-465f-992b-441a484304a3\") " pod="kube-system/konnectivity-agent-xgq5w" Sep 08 03:55:09.161179 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:09.160877 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/5887ba4c-5c74-4753-b0f0-e83cd30fe7d3-etc-sysctl-conf\") pod \"tuned-xjf8j\" (UID: \"5887ba4c-5c74-4753-b0f0-e83cd30fe7d3\") " pod="openshift-cluster-node-tuning-operator/tuned-xjf8j" Sep 08 03:55:09.161179 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:09.160904 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f583a7fb-d8f2-4b26-ba64-bb73e3b605c6-host-run-netns\") pod \"multus-tbtxs\" (UID: \"f583a7fb-d8f2-4b26-ba64-bb73e3b605c6\") " pod="openshift-multus/multus-tbtxs" Sep 08 03:55:09.161179 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:09.161013 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/5887ba4c-5c74-4753-b0f0-e83cd30fe7d3-etc-systemd\") pod \"tuned-xjf8j\" (UID: \"5887ba4c-5c74-4753-b0f0-e83cd30fe7d3\") " pod="openshift-cluster-node-tuning-operator/tuned-xjf8j" Sep 08 03:55:09.161179 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:09.161021 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/2c0c6060-83f1-4145-ae8c-7eb94e2201a8-kubelet-dir\") pod \"aws-ebs-csi-driver-node-nxtjg\" (UID: \"2c0c6060-83f1-4145-ae8c-7eb94e2201a8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nxtjg" Sep 08 03:55:09.161179 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:09.160976 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5887ba4c-5c74-4753-b0f0-e83cd30fe7d3-sys\") pod \"tuned-xjf8j\" (UID: \"5887ba4c-5c74-4753-b0f0-e83cd30fe7d3\") " pod="openshift-cluster-node-tuning-operator/tuned-xjf8j" Sep 08 03:55:09.161498 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:09.161293 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d9fbef9f-7075-4727-88c9-b5feeaf043db-tuning-conf-dir\") pod \"multus-additional-cni-plugins-wc8bl\" (UID: \"d9fbef9f-7075-4727-88c9-b5feeaf043db\") " pod="openshift-multus/multus-additional-cni-plugins-wc8bl" Sep 08 03:55:09.161498 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:09.161383 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f583a7fb-d8f2-4b26-ba64-bb73e3b605c6-multus-cni-dir\") pod \"multus-tbtxs\" (UID: \"f583a7fb-d8f2-4b26-ba64-bb73e3b605c6\") " pod="openshift-multus/multus-tbtxs" Sep 08 03:55:09.161498 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:09.161439 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5887ba4c-5c74-4753-b0f0-e83cd30fe7d3-var-lib-kubelet\") pod \"tuned-xjf8j\" (UID: \"5887ba4c-5c74-4753-b0f0-e83cd30fe7d3\") " pod="openshift-cluster-node-tuning-operator/tuned-xjf8j" Sep 08 03:55:09.161498 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:09.161450 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/d9fbef9f-7075-4727-88c9-b5feeaf043db-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-wc8bl\" (UID: \"d9fbef9f-7075-4727-88c9-b5feeaf043db\") " pod="openshift-multus/multus-additional-cni-plugins-wc8bl" Sep 08 03:55:09.161682 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:09.161518 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/2c0c6060-83f1-4145-ae8c-7eb94e2201a8-device-dir\") pod \"aws-ebs-csi-driver-node-nxtjg\" (UID: \"2c0c6060-83f1-4145-ae8c-7eb94e2201a8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nxtjg" Sep 08 03:55:09.161682 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:09.161566 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f583a7fb-d8f2-4b26-ba64-bb73e3b605c6-host-var-lib-cni-bin\") pod \"multus-tbtxs\" (UID: \"f583a7fb-d8f2-4b26-ba64-bb73e3b605c6\") " pod="openshift-multus/multus-tbtxs" Sep 08 03:55:09.161682 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:09.161663 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f583a7fb-d8f2-4b26-ba64-bb73e3b605c6-cni-binary-copy\") pod \"multus-tbtxs\" (UID: \"f583a7fb-d8f2-4b26-ba64-bb73e3b605c6\") " pod="openshift-multus/multus-tbtxs" Sep 08 03:55:09.161826 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:09.161690 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/0e85668b-3938-4a44-978b-0fa580d71c06-serviceca\") pod \"node-ca-6gf2k\" (UID: \"0e85668b-3938-4a44-978b-0fa580d71c06\") " pod="openshift-image-registry/node-ca-6gf2k" Sep 08 03:55:09.161880 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:09.161821 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d9fbef9f-7075-4727-88c9-b5feeaf043db-cni-binary-copy\") pod \"multus-additional-cni-plugins-wc8bl\" (UID: \"d9fbef9f-7075-4727-88c9-b5feeaf043db\") " pod="openshift-multus/multus-additional-cni-plugins-wc8bl" Sep 08 03:55:09.161880 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:09.161846 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f583a7fb-d8f2-4b26-ba64-bb73e3b605c6-cnibin\") pod \"multus-tbtxs\" (UID: \"f583a7fb-d8f2-4b26-ba64-bb73e3b605c6\") " pod="openshift-multus/multus-tbtxs" Sep 08 03:55:09.161999 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:09.161937 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/5887ba4c-5c74-4753-b0f0-e83cd30fe7d3-etc-sysconfig\") pod \"tuned-xjf8j\" (UID: \"5887ba4c-5c74-4753-b0f0-e83cd30fe7d3\") " pod="openshift-cluster-node-tuning-operator/tuned-xjf8j" Sep 08 03:55:09.162478 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:09.162446 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/d9fbef9f-7075-4727-88c9-b5feeaf043db-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-wc8bl\" (UID: \"d9fbef9f-7075-4727-88c9-b5feeaf043db\") " pod="openshift-multus/multus-additional-cni-plugins-wc8bl" Sep 08 03:55:09.163752 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:09.163724 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5887ba4c-5c74-4753-b0f0-e83cd30fe7d3-tmp\") pod \"tuned-xjf8j\" (UID: \"5887ba4c-5c74-4753-b0f0-e83cd30fe7d3\") " pod="openshift-cluster-node-tuning-operator/tuned-xjf8j" Sep 08 03:55:09.164435 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:09.164408 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/98f02edd-0112-465f-992b-441a484304a3-agent-certs\") pod \"konnectivity-agent-xgq5w\" (UID: \"98f02edd-0112-465f-992b-441a484304a3\") " pod="kube-system/konnectivity-agent-xgq5w" Sep 08 03:55:09.164531 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:09.164409 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/5887ba4c-5c74-4753-b0f0-e83cd30fe7d3-etc-tuned\") pod \"tuned-xjf8j\" (UID: \"5887ba4c-5c74-4753-b0f0-e83cd30fe7d3\") " pod="openshift-cluster-node-tuning-operator/tuned-xjf8j" Sep 08 03:55:09.178313 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:09.177967 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nvwc2\" (UniqueName: \"kubernetes.io/projected/0e85668b-3938-4a44-978b-0fa580d71c06-kube-api-access-nvwc2\") pod \"node-ca-6gf2k\" (UID: \"0e85668b-3938-4a44-978b-0fa580d71c06\") " pod="openshift-image-registry/node-ca-6gf2k" Sep 08 03:55:09.178683 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:09.178663 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-84rsd\" (UniqueName: \"kubernetes.io/projected/2c0c6060-83f1-4145-ae8c-7eb94e2201a8-kube-api-access-84rsd\") pod \"aws-ebs-csi-driver-node-nxtjg\" (UID: \"2c0c6060-83f1-4145-ae8c-7eb94e2201a8\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nxtjg" Sep 08 03:55:09.179063 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:09.179043 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dntq6\" (UniqueName: \"kubernetes.io/projected/f583a7fb-d8f2-4b26-ba64-bb73e3b605c6-kube-api-access-dntq6\") pod \"multus-tbtxs\" (UID: \"f583a7fb-d8f2-4b26-ba64-bb73e3b605c6\") " pod="openshift-multus/multus-tbtxs" Sep 08 03:55:09.179893 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:09.179829 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dkjt4\" (UniqueName: \"kubernetes.io/projected/d9fbef9f-7075-4727-88c9-b5feeaf043db-kube-api-access-dkjt4\") pod \"multus-additional-cni-plugins-wc8bl\" (UID: \"d9fbef9f-7075-4727-88c9-b5feeaf043db\") " pod="openshift-multus/multus-additional-cni-plugins-wc8bl" Sep 08 03:55:09.180324 ip-10-0-128-67 kubenswrapper[2571]: E0908 03:55:09.180304 2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 08 03:55:09.180324 ip-10-0-128-67 kubenswrapper[2571]: E0908 03:55:09.180331 2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 08 03:55:09.180476 ip-10-0-128-67 kubenswrapper[2571]: E0908 03:55:09.180345 2571 projected.go:196] Error preparing data for projected volume kube-api-access-m9c82 for pod openshift-network-diagnostics/network-check-target-4wk4q: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 08 03:55:09.180476 ip-10-0-128-67 kubenswrapper[2571]: E0908 03:55:09.180401 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ab426e2f-9c8a-4457-a6b9-b98e4c94f4bf-kube-api-access-m9c82 podName:ab426e2f-9c8a-4457-a6b9-b98e4c94f4bf nodeName:}" failed. No retries permitted until 2026-09-08 03:55:09.680382818 +0000 UTC m=+3.150951192 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-m9c82" (UniqueName: "kubernetes.io/projected/ab426e2f-9c8a-4457-a6b9-b98e4c94f4bf-kube-api-access-m9c82") pod "network-check-target-4wk4q" (UID: "ab426e2f-9c8a-4457-a6b9-b98e4c94f4bf") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 08 03:55:09.180599 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:09.180580 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tdln8\" (UniqueName: \"kubernetes.io/projected/5887ba4c-5c74-4753-b0f0-e83cd30fe7d3-kube-api-access-tdln8\") pod \"tuned-xjf8j\" (UID: \"5887ba4c-5c74-4753-b0f0-e83cd30fe7d3\") " pod="openshift-cluster-node-tuning-operator/tuned-xjf8j" Sep 08 03:55:09.181494 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:09.181475 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sgxcf\" (UniqueName: \"kubernetes.io/projected/92705af2-1822-4b7f-8852-a8120774230c-kube-api-access-sgxcf\") pod \"node-resolver-t2qd4\" (UID: \"92705af2-1822-4b7f-8852-a8120774230c\") " pod="openshift-dns/node-resolver-t2qd4" Sep 08 03:55:09.242176 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:09.242146 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-7mnct" Sep 08 03:55:09.257012 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:09.256989 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-cbzhc" Sep 08 03:55:09.267622 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:09.267601 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-xjf8j" Sep 08 03:55:09.283050 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:09.283034 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-6gf2k" Sep 08 03:55:09.291586 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:09.291566 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nxtjg" Sep 08 03:55:09.299282 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:09.299261 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-tbtxs" Sep 08 03:55:09.307782 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:09.307762 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-t2qd4" Sep 08 03:55:09.315165 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:09.315145 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-wc8bl" Sep 08 03:55:09.322609 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:09.322588 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-xgq5w" Sep 08 03:55:09.450803 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:09.450727 2571 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Sep 08 03:55:09.561816 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:09.561784 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4c94cf72-6e9d-4f8b-ae71-105e52f051a1-original-pull-secret\") pod \"global-pull-secret-syncer-6ffgk\" (UID: \"4c94cf72-6e9d-4f8b-ae71-105e52f051a1\") " pod="kube-system/global-pull-secret-syncer-6ffgk" Sep 08 03:55:09.561984 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:09.561832 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/be017881-2b6a-4fd2-b62d-4b5d3bd7b834-metrics-certs\") pod \"network-metrics-daemon-s2679\" (UID: \"be017881-2b6a-4fd2-b62d-4b5d3bd7b834\") " pod="openshift-multus/network-metrics-daemon-s2679" Sep 08 03:55:09.561984 ip-10-0-128-67 kubenswrapper[2571]: E0908 03:55:09.561948 2571 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 08 03:55:09.562097 ip-10-0-128-67 kubenswrapper[2571]: E0908 03:55:09.562010 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4c94cf72-6e9d-4f8b-ae71-105e52f051a1-original-pull-secret podName:4c94cf72-6e9d-4f8b-ae71-105e52f051a1 nodeName:}" failed. No retries permitted until 2026-09-08 03:55:10.561997414 +0000 UTC m=+4.032565772 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4c94cf72-6e9d-4f8b-ae71-105e52f051a1-original-pull-secret") pod "global-pull-secret-syncer-6ffgk" (UID: "4c94cf72-6e9d-4f8b-ae71-105e52f051a1") : object "kube-system"/"original-pull-secret" not registered Sep 08 03:55:09.562097 ip-10-0-128-67 kubenswrapper[2571]: E0908 03:55:09.561948 2571 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 08 03:55:09.562097 ip-10-0-128-67 kubenswrapper[2571]: E0908 03:55:09.562073 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/be017881-2b6a-4fd2-b62d-4b5d3bd7b834-metrics-certs podName:be017881-2b6a-4fd2-b62d-4b5d3bd7b834 nodeName:}" failed. No retries permitted until 2026-09-08 03:55:10.562060648 +0000 UTC m=+4.032629012 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/be017881-2b6a-4fd2-b62d-4b5d3bd7b834-metrics-certs") pod "network-metrics-daemon-s2679" (UID: "be017881-2b6a-4fd2-b62d-4b5d3bd7b834") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 08 03:55:09.763740 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:09.763667 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m9c82\" (UniqueName: \"kubernetes.io/projected/ab426e2f-9c8a-4457-a6b9-b98e4c94f4bf-kube-api-access-m9c82\") pod \"network-check-target-4wk4q\" (UID: \"ab426e2f-9c8a-4457-a6b9-b98e4c94f4bf\") " pod="openshift-network-diagnostics/network-check-target-4wk4q" Sep 08 03:55:09.763894 ip-10-0-128-67 kubenswrapper[2571]: E0908 03:55:09.763871 2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 08 03:55:09.763978 ip-10-0-128-67 kubenswrapper[2571]: E0908 03:55:09.763900 2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 08 03:55:09.763978 ip-10-0-128-67 kubenswrapper[2571]: E0908 03:55:09.763913 2571 projected.go:196] Error preparing data for projected volume kube-api-access-m9c82 for pod openshift-network-diagnostics/network-check-target-4wk4q: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 08 03:55:09.764076 ip-10-0-128-67 kubenswrapper[2571]: E0908 03:55:09.763995 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ab426e2f-9c8a-4457-a6b9-b98e4c94f4bf-kube-api-access-m9c82 podName:ab426e2f-9c8a-4457-a6b9-b98e4c94f4bf nodeName:}" failed. No retries permitted until 2026-09-08 03:55:10.763975482 +0000 UTC m=+4.234543862 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-m9c82" (UniqueName: "kubernetes.io/projected/ab426e2f-9c8a-4457-a6b9-b98e4c94f4bf-kube-api-access-m9c82") pod "network-check-target-4wk4q" (UID: "ab426e2f-9c8a-4457-a6b9-b98e4c94f4bf") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 08 03:55:10.003379 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:10.003339 2571 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-07 03:50:08 +0000 UTC" deadline="2028-02-27 10:51:34.178681719 +0000 UTC" Sep 08 03:55:10.003379 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:10.003375 2571 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12894h56m24.175309971s" Sep 08 03:55:10.063131 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:10.063090 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd9fbef9f_7075_4727_88c9_b5feeaf043db.slice/crio-696d5a9ce8e918f113cb27936bb6517d874f4c3b009be3cf184641dec2a51f2b WatchSource:0}: Error finding container 696d5a9ce8e918f113cb27936bb6517d874f4c3b009be3cf184641dec2a51f2b: Status 404 returned error can't find the container with id 696d5a9ce8e918f113cb27936bb6517d874f4c3b009be3cf184641dec2a51f2b Sep 08 03:55:10.064221 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:10.064184 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb35366ff_994a_4635_bad2_1ba59bcc640a.slice/crio-166addd15eb2e67bf5f288cb6ff6abd200f70c294757b524c7fdc963c12e3c6f WatchSource:0}: Error finding container 166addd15eb2e67bf5f288cb6ff6abd200f70c294757b524c7fdc963c12e3c6f: Status 404 returned error can't find the container with id 166addd15eb2e67bf5f288cb6ff6abd200f70c294757b524c7fdc963c12e3c6f Sep 08 03:55:10.065236 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:10.065061 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5887ba4c_5c74_4753_b0f0_e83cd30fe7d3.slice/crio-e11ccffc0dd10f232f2edd0d029dd6aaec6e33c2e3a1b9defd2797e1b19cd57a WatchSource:0}: Error finding container e11ccffc0dd10f232f2edd0d029dd6aaec6e33c2e3a1b9defd2797e1b19cd57a: Status 404 returned error can't find the container with id e11ccffc0dd10f232f2edd0d029dd6aaec6e33c2e3a1b9defd2797e1b19cd57a Sep 08 03:55:10.066016 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:10.065982 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod98f02edd_0112_465f_992b_441a484304a3.slice/crio-570f6559f407052f2251b8b2dee7c7308eb75f1de1c347a882d35c64c24c7c30 WatchSource:0}: Error finding container 570f6559f407052f2251b8b2dee7c7308eb75f1de1c347a882d35c64c24c7c30: Status 404 returned error can't find the container with id 570f6559f407052f2251b8b2dee7c7308eb75f1de1c347a882d35c64c24c7c30 Sep 08 03:55:10.066352 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:10.066330 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2c0c6060_83f1_4145_ae8c_7eb94e2201a8.slice/crio-ca3c7e5f1f9297247ead6e1ec842cec785884843a9d06f1d7d6dbd965aac2396 WatchSource:0}: Error finding container ca3c7e5f1f9297247ead6e1ec842cec785884843a9d06f1d7d6dbd965aac2396: Status 404 returned error can't find the container with id ca3c7e5f1f9297247ead6e1ec842cec785884843a9d06f1d7d6dbd965aac2396 Sep 08 03:55:10.069081 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:10.069062 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf583a7fb_d8f2_4b26_ba64_bb73e3b605c6.slice/crio-860d2e697f3022a12f56f8bf62cc66096208051e23964a722391848d8e51015b WatchSource:0}: Error finding container 860d2e697f3022a12f56f8bf62cc66096208051e23964a722391848d8e51015b: Status 404 returned error can't find the container with id 860d2e697f3022a12f56f8bf62cc66096208051e23964a722391848d8e51015b Sep 08 03:55:10.069409 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:10.069343 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod92705af2_1822_4b7f_8852_a8120774230c.slice/crio-18cf6e74c3c5c5d555a92da4687f3f48dd73f6f334fc39b3a309c6e79540d943 WatchSource:0}: Error finding container 18cf6e74c3c5c5d555a92da4687f3f48dd73f6f334fc39b3a309c6e79540d943: Status 404 returned error can't find the container with id 18cf6e74c3c5c5d555a92da4687f3f48dd73f6f334fc39b3a309c6e79540d943 Sep 08 03:55:10.071690 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:10.070819 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0e85668b_3938_4a44_978b_0fa580d71c06.slice/crio-20d12350fc627e2818f464fc751326f31ed385a624409e8b8c4a221a96bb2313 WatchSource:0}: Error finding container 20d12350fc627e2818f464fc751326f31ed385a624409e8b8c4a221a96bb2313: Status 404 returned error can't find the container with id 20d12350fc627e2818f464fc751326f31ed385a624409e8b8c4a221a96bb2313 Sep 08 03:55:10.073188 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:10.072650 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda6151e0d_2e3f_44c5_b268_a7adcc60bffe.slice/crio-87ef88837e714a74d373c1cdd5c9ae7d120b00461bedee4e445832bd6c8f1a22 WatchSource:0}: Error finding container 87ef88837e714a74d373c1cdd5c9ae7d120b00461bedee4e445832bd6c8f1a22: Status 404 returned error can't find the container with id 87ef88837e714a74d373c1cdd5c9ae7d120b00461bedee4e445832bd6c8f1a22 Sep 08 03:55:10.073417 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:10.073393 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-xjf8j" event={"ID":"5887ba4c-5c74-4753-b0f0-e83cd30fe7d3","Type":"ContainerStarted","Data":"e11ccffc0dd10f232f2edd0d029dd6aaec6e33c2e3a1b9defd2797e1b19cd57a"} Sep 08 03:55:10.075087 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:10.075069 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7mnct" event={"ID":"b35366ff-994a-4635-bad2-1ba59bcc640a","Type":"ContainerStarted","Data":"166addd15eb2e67bf5f288cb6ff6abd200f70c294757b524c7fdc963c12e3c6f"} Sep 08 03:55:10.076481 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:10.076457 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wc8bl" event={"ID":"d9fbef9f-7075-4727-88c9-b5feeaf043db","Type":"ContainerStarted","Data":"696d5a9ce8e918f113cb27936bb6517d874f4c3b009be3cf184641dec2a51f2b"} Sep 08 03:55:10.077837 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:10.077817 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nxtjg" event={"ID":"2c0c6060-83f1-4145-ae8c-7eb94e2201a8","Type":"ContainerStarted","Data":"ca3c7e5f1f9297247ead6e1ec842cec785884843a9d06f1d7d6dbd965aac2396"} Sep 08 03:55:10.079119 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:10.079095 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-xgq5w" event={"ID":"98f02edd-0112-465f-992b-441a484304a3","Type":"ContainerStarted","Data":"570f6559f407052f2251b8b2dee7c7308eb75f1de1c347a882d35c64c24c7c30"} Sep 08 03:55:10.570828 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:10.570008 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/be017881-2b6a-4fd2-b62d-4b5d3bd7b834-metrics-certs\") pod \"network-metrics-daemon-s2679\" (UID: \"be017881-2b6a-4fd2-b62d-4b5d3bd7b834\") " pod="openshift-multus/network-metrics-daemon-s2679" Sep 08 03:55:10.570828 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:10.570092 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4c94cf72-6e9d-4f8b-ae71-105e52f051a1-original-pull-secret\") pod \"global-pull-secret-syncer-6ffgk\" (UID: \"4c94cf72-6e9d-4f8b-ae71-105e52f051a1\") " pod="kube-system/global-pull-secret-syncer-6ffgk" Sep 08 03:55:10.570828 ip-10-0-128-67 kubenswrapper[2571]: E0908 03:55:10.570236 2571 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 08 03:55:10.570828 ip-10-0-128-67 kubenswrapper[2571]: E0908 03:55:10.570300 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4c94cf72-6e9d-4f8b-ae71-105e52f051a1-original-pull-secret podName:4c94cf72-6e9d-4f8b-ae71-105e52f051a1 nodeName:}" failed. No retries permitted until 2026-09-08 03:55:12.570281281 +0000 UTC m=+6.040849655 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4c94cf72-6e9d-4f8b-ae71-105e52f051a1-original-pull-secret") pod "global-pull-secret-syncer-6ffgk" (UID: "4c94cf72-6e9d-4f8b-ae71-105e52f051a1") : object "kube-system"/"original-pull-secret" not registered Sep 08 03:55:10.570828 ip-10-0-128-67 kubenswrapper[2571]: E0908 03:55:10.570675 2571 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 08 03:55:10.570828 ip-10-0-128-67 kubenswrapper[2571]: E0908 03:55:10.570726 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/be017881-2b6a-4fd2-b62d-4b5d3bd7b834-metrics-certs podName:be017881-2b6a-4fd2-b62d-4b5d3bd7b834 nodeName:}" failed. No retries permitted until 2026-09-08 03:55:12.570709884 +0000 UTC m=+6.041278263 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/be017881-2b6a-4fd2-b62d-4b5d3bd7b834-metrics-certs") pod "network-metrics-daemon-s2679" (UID: "be017881-2b6a-4fd2-b62d-4b5d3bd7b834") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 08 03:55:10.772836 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:10.772227 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m9c82\" (UniqueName: \"kubernetes.io/projected/ab426e2f-9c8a-4457-a6b9-b98e4c94f4bf-kube-api-access-m9c82\") pod \"network-check-target-4wk4q\" (UID: \"ab426e2f-9c8a-4457-a6b9-b98e4c94f4bf\") " pod="openshift-network-diagnostics/network-check-target-4wk4q" Sep 08 03:55:10.772836 ip-10-0-128-67 kubenswrapper[2571]: E0908 03:55:10.772418 2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 08 03:55:10.772836 ip-10-0-128-67 kubenswrapper[2571]: E0908 03:55:10.772442 2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 08 03:55:10.772836 ip-10-0-128-67 kubenswrapper[2571]: E0908 03:55:10.772457 2571 projected.go:196] Error preparing data for projected volume kube-api-access-m9c82 for pod openshift-network-diagnostics/network-check-target-4wk4q: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 08 03:55:10.772836 ip-10-0-128-67 kubenswrapper[2571]: E0908 03:55:10.772511 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ab426e2f-9c8a-4457-a6b9-b98e4c94f4bf-kube-api-access-m9c82 podName:ab426e2f-9c8a-4457-a6b9-b98e4c94f4bf nodeName:}" failed. No retries permitted until 2026-09-08 03:55:12.772494185 +0000 UTC m=+6.243062558 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-m9c82" (UniqueName: "kubernetes.io/projected/ab426e2f-9c8a-4457-a6b9-b98e4c94f4bf-kube-api-access-m9c82") pod "network-check-target-4wk4q" (UID: "ab426e2f-9c8a-4457-a6b9-b98e4c94f4bf") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 08 03:55:11.004355 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:11.004249 2571 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-07 03:50:08 +0000 UTC" deadline="2028-02-20 09:49:42.254090297 +0000 UTC" Sep 08 03:55:11.004355 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:11.004285 2571 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12725h54m31.24980995s" Sep 08 03:55:11.062810 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:11.062029 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6ffgk" Sep 08 03:55:11.062810 ip-10-0-128-67 kubenswrapper[2571]: E0908 03:55:11.062146 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6ffgk" podUID="4c94cf72-6e9d-4f8b-ae71-105e52f051a1" Sep 08 03:55:11.062810 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:11.062535 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s2679" Sep 08 03:55:11.062810 ip-10-0-128-67 kubenswrapper[2571]: E0908 03:55:11.062638 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s2679" podUID="be017881-2b6a-4fd2-b62d-4b5d3bd7b834" Sep 08 03:55:11.062810 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:11.062699 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4wk4q" Sep 08 03:55:11.062810 ip-10-0-128-67 kubenswrapper[2571]: E0908 03:55:11.062773 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4wk4q" podUID="ab426e2f-9c8a-4457-a6b9-b98e4c94f4bf" Sep 08 03:55:11.111689 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:11.111650 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-tbtxs" event={"ID":"f583a7fb-d8f2-4b26-ba64-bb73e3b605c6","Type":"ContainerStarted","Data":"860d2e697f3022a12f56f8bf62cc66096208051e23964a722391848d8e51015b"} Sep 08 03:55:11.135699 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:11.135664 2571 generic.go:356] "Generic (PLEG): container finished" podID="79ed4e7f3bb3545fed2a22b103b1acef" containerID="b39dcea084df76fc32b36dd228bb63c9bbd98d313257d2ae8edaa6f4771027ac" exitCode=0 Sep 08 03:55:11.135853 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:11.135761 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-67.ec2.internal" event={"ID":"79ed4e7f3bb3545fed2a22b103b1acef","Type":"ContainerDied","Data":"b39dcea084df76fc32b36dd228bb63c9bbd98d313257d2ae8edaa6f4771027ac"} Sep 08 03:55:11.154712 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:11.154220 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-67.ec2.internal" event={"ID":"c9e8db20add26e2681670793a6ac21cf","Type":"ContainerStarted","Data":"c773aaf1db3e25efa2863eff1045f78128825ea44976622cb3a069998f8532ae"} Sep 08 03:55:11.168701 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:11.168676 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-6gf2k" event={"ID":"0e85668b-3938-4a44-978b-0fa580d71c06","Type":"ContainerStarted","Data":"20d12350fc627e2818f464fc751326f31ed385a624409e8b8c4a221a96bb2313"} Sep 08 03:55:11.181412 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:11.181188 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-cbzhc" event={"ID":"a6151e0d-2e3f-44c5-b268-a7adcc60bffe","Type":"ContainerStarted","Data":"87ef88837e714a74d373c1cdd5c9ae7d120b00461bedee4e445832bd6c8f1a22"} Sep 08 03:55:11.185322 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:11.185269 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-t2qd4" event={"ID":"92705af2-1822-4b7f-8852-a8120774230c","Type":"ContainerStarted","Data":"18cf6e74c3c5c5d555a92da4687f3f48dd73f6f334fc39b3a309c6e79540d943"} Sep 08 03:55:12.196621 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:12.196551 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-67.ec2.internal" event={"ID":"79ed4e7f3bb3545fed2a22b103b1acef","Type":"ContainerStarted","Data":"3fe8e2873a266e23263f683ef7c0c7192e84e61b2b8f9178dc87f4c3a68beceb"} Sep 08 03:55:12.215912 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:12.215859 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-67.ec2.internal" podStartSLOduration=4.215830943 podStartE2EDuration="4.215830943s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 03:55:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 03:55:11.180277084 +0000 UTC m=+4.650845465" watchObservedRunningTime="2026-09-08 03:55:12.215830943 +0000 UTC m=+5.686399324" Sep 08 03:55:12.587534 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:12.587490 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4c94cf72-6e9d-4f8b-ae71-105e52f051a1-original-pull-secret\") pod \"global-pull-secret-syncer-6ffgk\" (UID: \"4c94cf72-6e9d-4f8b-ae71-105e52f051a1\") " pod="kube-system/global-pull-secret-syncer-6ffgk" Sep 08 03:55:12.587710 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:12.587592 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/be017881-2b6a-4fd2-b62d-4b5d3bd7b834-metrics-certs\") pod \"network-metrics-daemon-s2679\" (UID: \"be017881-2b6a-4fd2-b62d-4b5d3bd7b834\") " pod="openshift-multus/network-metrics-daemon-s2679" Sep 08 03:55:12.587779 ip-10-0-128-67 kubenswrapper[2571]: E0908 03:55:12.587757 2571 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 08 03:55:12.587831 ip-10-0-128-67 kubenswrapper[2571]: E0908 03:55:12.587822 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/be017881-2b6a-4fd2-b62d-4b5d3bd7b834-metrics-certs podName:be017881-2b6a-4fd2-b62d-4b5d3bd7b834 nodeName:}" failed. No retries permitted until 2026-09-08 03:55:16.587803833 +0000 UTC m=+10.058372212 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/be017881-2b6a-4fd2-b62d-4b5d3bd7b834-metrics-certs") pod "network-metrics-daemon-s2679" (UID: "be017881-2b6a-4fd2-b62d-4b5d3bd7b834") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 08 03:55:12.587981 ip-10-0-128-67 kubenswrapper[2571]: E0908 03:55:12.587904 2571 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 08 03:55:12.587981 ip-10-0-128-67 kubenswrapper[2571]: E0908 03:55:12.587974 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4c94cf72-6e9d-4f8b-ae71-105e52f051a1-original-pull-secret podName:4c94cf72-6e9d-4f8b-ae71-105e52f051a1 nodeName:}" failed. No retries permitted until 2026-09-08 03:55:16.587960101 +0000 UTC m=+10.058528462 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4c94cf72-6e9d-4f8b-ae71-105e52f051a1-original-pull-secret") pod "global-pull-secret-syncer-6ffgk" (UID: "4c94cf72-6e9d-4f8b-ae71-105e52f051a1") : object "kube-system"/"original-pull-secret" not registered Sep 08 03:55:12.789886 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:12.789822 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m9c82\" (UniqueName: \"kubernetes.io/projected/ab426e2f-9c8a-4457-a6b9-b98e4c94f4bf-kube-api-access-m9c82\") pod \"network-check-target-4wk4q\" (UID: \"ab426e2f-9c8a-4457-a6b9-b98e4c94f4bf\") " pod="openshift-network-diagnostics/network-check-target-4wk4q" Sep 08 03:55:12.790062 ip-10-0-128-67 kubenswrapper[2571]: E0908 03:55:12.790015 2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 08 03:55:12.790062 ip-10-0-128-67 kubenswrapper[2571]: E0908 03:55:12.790037 2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 08 03:55:12.790062 ip-10-0-128-67 kubenswrapper[2571]: E0908 03:55:12.790048 2571 projected.go:196] Error preparing data for projected volume kube-api-access-m9c82 for pod openshift-network-diagnostics/network-check-target-4wk4q: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 08 03:55:12.790220 ip-10-0-128-67 kubenswrapper[2571]: E0908 03:55:12.790105 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ab426e2f-9c8a-4457-a6b9-b98e4c94f4bf-kube-api-access-m9c82 podName:ab426e2f-9c8a-4457-a6b9-b98e4c94f4bf nodeName:}" failed. No retries permitted until 2026-09-08 03:55:16.790087803 +0000 UTC m=+10.260656179 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-m9c82" (UniqueName: "kubernetes.io/projected/ab426e2f-9c8a-4457-a6b9-b98e4c94f4bf-kube-api-access-m9c82") pod "network-check-target-4wk4q" (UID: "ab426e2f-9c8a-4457-a6b9-b98e4c94f4bf") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 08 03:55:13.062160 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:13.062128 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6ffgk" Sep 08 03:55:13.062342 ip-10-0-128-67 kubenswrapper[2571]: E0908 03:55:13.062267 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6ffgk" podUID="4c94cf72-6e9d-4f8b-ae71-105e52f051a1" Sep 08 03:55:13.062682 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:13.062660 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s2679" Sep 08 03:55:13.062795 ip-10-0-128-67 kubenswrapper[2571]: E0908 03:55:13.062775 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s2679" podUID="be017881-2b6a-4fd2-b62d-4b5d3bd7b834" Sep 08 03:55:13.063557 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:13.063535 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4wk4q" Sep 08 03:55:13.065132 ip-10-0-128-67 kubenswrapper[2571]: E0908 03:55:13.065105 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4wk4q" podUID="ab426e2f-9c8a-4457-a6b9-b98e4c94f4bf" Sep 08 03:55:15.061873 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:15.061830 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s2679" Sep 08 03:55:15.062302 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:15.061830 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6ffgk" Sep 08 03:55:15.062302 ip-10-0-128-67 kubenswrapper[2571]: E0908 03:55:15.061993 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s2679" podUID="be017881-2b6a-4fd2-b62d-4b5d3bd7b834" Sep 08 03:55:15.062302 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:15.062183 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4wk4q" Sep 08 03:55:15.062412 ip-10-0-128-67 kubenswrapper[2571]: E0908 03:55:15.062318 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4wk4q" podUID="ab426e2f-9c8a-4457-a6b9-b98e4c94f4bf" Sep 08 03:55:15.062412 ip-10-0-128-67 kubenswrapper[2571]: E0908 03:55:15.062097 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6ffgk" podUID="4c94cf72-6e9d-4f8b-ae71-105e52f051a1" Sep 08 03:55:16.622160 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:16.622117 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4c94cf72-6e9d-4f8b-ae71-105e52f051a1-original-pull-secret\") pod \"global-pull-secret-syncer-6ffgk\" (UID: \"4c94cf72-6e9d-4f8b-ae71-105e52f051a1\") " pod="kube-system/global-pull-secret-syncer-6ffgk" Sep 08 03:55:16.622605 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:16.622198 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/be017881-2b6a-4fd2-b62d-4b5d3bd7b834-metrics-certs\") pod \"network-metrics-daemon-s2679\" (UID: \"be017881-2b6a-4fd2-b62d-4b5d3bd7b834\") " pod="openshift-multus/network-metrics-daemon-s2679" Sep 08 03:55:16.622605 ip-10-0-128-67 kubenswrapper[2571]: E0908 03:55:16.622322 2571 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 08 03:55:16.622605 ip-10-0-128-67 kubenswrapper[2571]: E0908 03:55:16.622343 2571 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 08 03:55:16.622605 ip-10-0-128-67 kubenswrapper[2571]: E0908 03:55:16.622410 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4c94cf72-6e9d-4f8b-ae71-105e52f051a1-original-pull-secret podName:4c94cf72-6e9d-4f8b-ae71-105e52f051a1 nodeName:}" failed. No retries permitted until 2026-09-08 03:55:24.622387981 +0000 UTC m=+18.092956366 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4c94cf72-6e9d-4f8b-ae71-105e52f051a1-original-pull-secret") pod "global-pull-secret-syncer-6ffgk" (UID: "4c94cf72-6e9d-4f8b-ae71-105e52f051a1") : object "kube-system"/"original-pull-secret" not registered Sep 08 03:55:16.622605 ip-10-0-128-67 kubenswrapper[2571]: E0908 03:55:16.622433 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/be017881-2b6a-4fd2-b62d-4b5d3bd7b834-metrics-certs podName:be017881-2b6a-4fd2-b62d-4b5d3bd7b834 nodeName:}" failed. No retries permitted until 2026-09-08 03:55:24.622422441 +0000 UTC m=+18.092990817 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/be017881-2b6a-4fd2-b62d-4b5d3bd7b834-metrics-certs") pod "network-metrics-daemon-s2679" (UID: "be017881-2b6a-4fd2-b62d-4b5d3bd7b834") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 08 03:55:16.823819 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:16.823690 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m9c82\" (UniqueName: \"kubernetes.io/projected/ab426e2f-9c8a-4457-a6b9-b98e4c94f4bf-kube-api-access-m9c82\") pod \"network-check-target-4wk4q\" (UID: \"ab426e2f-9c8a-4457-a6b9-b98e4c94f4bf\") " pod="openshift-network-diagnostics/network-check-target-4wk4q" Sep 08 03:55:16.824031 ip-10-0-128-67 kubenswrapper[2571]: E0908 03:55:16.823886 2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 08 03:55:16.824031 ip-10-0-128-67 kubenswrapper[2571]: E0908 03:55:16.823907 2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 08 03:55:16.824031 ip-10-0-128-67 kubenswrapper[2571]: E0908 03:55:16.823935 2571 projected.go:196] Error preparing data for projected volume kube-api-access-m9c82 for pod openshift-network-diagnostics/network-check-target-4wk4q: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 08 03:55:16.824031 ip-10-0-128-67 kubenswrapper[2571]: E0908 03:55:16.823998 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ab426e2f-9c8a-4457-a6b9-b98e4c94f4bf-kube-api-access-m9c82 podName:ab426e2f-9c8a-4457-a6b9-b98e4c94f4bf nodeName:}" failed. No retries permitted until 2026-09-08 03:55:24.823979071 +0000 UTC m=+18.294547447 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-m9c82" (UniqueName: "kubernetes.io/projected/ab426e2f-9c8a-4457-a6b9-b98e4c94f4bf-kube-api-access-m9c82") pod "network-check-target-4wk4q" (UID: "ab426e2f-9c8a-4457-a6b9-b98e4c94f4bf") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 08 03:55:17.063373 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:17.062910 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6ffgk" Sep 08 03:55:17.063373 ip-10-0-128-67 kubenswrapper[2571]: E0908 03:55:17.063040 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6ffgk" podUID="4c94cf72-6e9d-4f8b-ae71-105e52f051a1" Sep 08 03:55:17.063373 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:17.063132 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s2679" Sep 08 03:55:17.063373 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:17.063146 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4wk4q" Sep 08 03:55:17.063373 ip-10-0-128-67 kubenswrapper[2571]: E0908 03:55:17.063247 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s2679" podUID="be017881-2b6a-4fd2-b62d-4b5d3bd7b834" Sep 08 03:55:17.063373 ip-10-0-128-67 kubenswrapper[2571]: E0908 03:55:17.063336 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4wk4q" podUID="ab426e2f-9c8a-4457-a6b9-b98e4c94f4bf" Sep 08 03:55:19.061993 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:19.061958 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6ffgk" Sep 08 03:55:19.062425 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:19.061958 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4wk4q" Sep 08 03:55:19.062425 ip-10-0-128-67 kubenswrapper[2571]: E0908 03:55:19.062082 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6ffgk" podUID="4c94cf72-6e9d-4f8b-ae71-105e52f051a1" Sep 08 03:55:19.062425 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:19.061962 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s2679" Sep 08 03:55:19.062425 ip-10-0-128-67 kubenswrapper[2571]: E0908 03:55:19.062170 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4wk4q" podUID="ab426e2f-9c8a-4457-a6b9-b98e4c94f4bf" Sep 08 03:55:19.062425 ip-10-0-128-67 kubenswrapper[2571]: E0908 03:55:19.062312 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s2679" podUID="be017881-2b6a-4fd2-b62d-4b5d3bd7b834" Sep 08 03:55:21.062463 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:21.062429 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4wk4q" Sep 08 03:55:21.062938 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:21.062473 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s2679" Sep 08 03:55:21.062938 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:21.062430 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6ffgk" Sep 08 03:55:21.062938 ip-10-0-128-67 kubenswrapper[2571]: E0908 03:55:21.062567 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4wk4q" podUID="ab426e2f-9c8a-4457-a6b9-b98e4c94f4bf" Sep 08 03:55:21.062938 ip-10-0-128-67 kubenswrapper[2571]: E0908 03:55:21.062739 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s2679" podUID="be017881-2b6a-4fd2-b62d-4b5d3bd7b834" Sep 08 03:55:21.062938 ip-10-0-128-67 kubenswrapper[2571]: E0908 03:55:21.062833 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6ffgk" podUID="4c94cf72-6e9d-4f8b-ae71-105e52f051a1" Sep 08 03:55:23.062352 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:23.062322 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6ffgk" Sep 08 03:55:23.062809 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:23.062333 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s2679" Sep 08 03:55:23.062809 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:23.062446 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4wk4q" Sep 08 03:55:23.062809 ip-10-0-128-67 kubenswrapper[2571]: E0908 03:55:23.062438 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6ffgk" podUID="4c94cf72-6e9d-4f8b-ae71-105e52f051a1" Sep 08 03:55:23.062809 ip-10-0-128-67 kubenswrapper[2571]: E0908 03:55:23.062522 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s2679" podUID="be017881-2b6a-4fd2-b62d-4b5d3bd7b834" Sep 08 03:55:23.062809 ip-10-0-128-67 kubenswrapper[2571]: E0908 03:55:23.062592 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4wk4q" podUID="ab426e2f-9c8a-4457-a6b9-b98e4c94f4bf" Sep 08 03:55:24.678841 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:24.678808 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4c94cf72-6e9d-4f8b-ae71-105e52f051a1-original-pull-secret\") pod \"global-pull-secret-syncer-6ffgk\" (UID: \"4c94cf72-6e9d-4f8b-ae71-105e52f051a1\") " pod="kube-system/global-pull-secret-syncer-6ffgk" Sep 08 03:55:24.679329 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:24.678864 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/be017881-2b6a-4fd2-b62d-4b5d3bd7b834-metrics-certs\") pod \"network-metrics-daemon-s2679\" (UID: \"be017881-2b6a-4fd2-b62d-4b5d3bd7b834\") " pod="openshift-multus/network-metrics-daemon-s2679" Sep 08 03:55:24.679329 ip-10-0-128-67 kubenswrapper[2571]: E0908 03:55:24.678988 2571 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 08 03:55:24.679329 ip-10-0-128-67 kubenswrapper[2571]: E0908 03:55:24.679021 2571 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 08 03:55:24.679329 ip-10-0-128-67 kubenswrapper[2571]: E0908 03:55:24.679062 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4c94cf72-6e9d-4f8b-ae71-105e52f051a1-original-pull-secret podName:4c94cf72-6e9d-4f8b-ae71-105e52f051a1 nodeName:}" failed. No retries permitted until 2026-09-08 03:55:40.679046161 +0000 UTC m=+34.149614539 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4c94cf72-6e9d-4f8b-ae71-105e52f051a1-original-pull-secret") pod "global-pull-secret-syncer-6ffgk" (UID: "4c94cf72-6e9d-4f8b-ae71-105e52f051a1") : object "kube-system"/"original-pull-secret" not registered Sep 08 03:55:24.679329 ip-10-0-128-67 kubenswrapper[2571]: E0908 03:55:24.679079 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/be017881-2b6a-4fd2-b62d-4b5d3bd7b834-metrics-certs podName:be017881-2b6a-4fd2-b62d-4b5d3bd7b834 nodeName:}" failed. No retries permitted until 2026-09-08 03:55:40.679072406 +0000 UTC m=+34.149640769 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/be017881-2b6a-4fd2-b62d-4b5d3bd7b834-metrics-certs") pod "network-metrics-daemon-s2679" (UID: "be017881-2b6a-4fd2-b62d-4b5d3bd7b834") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 08 03:55:24.881179 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:24.881149 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m9c82\" (UniqueName: \"kubernetes.io/projected/ab426e2f-9c8a-4457-a6b9-b98e4c94f4bf-kube-api-access-m9c82\") pod \"network-check-target-4wk4q\" (UID: \"ab426e2f-9c8a-4457-a6b9-b98e4c94f4bf\") " pod="openshift-network-diagnostics/network-check-target-4wk4q" Sep 08 03:55:24.881349 ip-10-0-128-67 kubenswrapper[2571]: E0908 03:55:24.881326 2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 08 03:55:24.881399 ip-10-0-128-67 kubenswrapper[2571]: E0908 03:55:24.881355 2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 08 03:55:24.881399 ip-10-0-128-67 kubenswrapper[2571]: E0908 03:55:24.881385 2571 projected.go:196] Error preparing data for projected volume kube-api-access-m9c82 for pod openshift-network-diagnostics/network-check-target-4wk4q: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 08 03:55:24.881467 ip-10-0-128-67 kubenswrapper[2571]: E0908 03:55:24.881431 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ab426e2f-9c8a-4457-a6b9-b98e4c94f4bf-kube-api-access-m9c82 podName:ab426e2f-9c8a-4457-a6b9-b98e4c94f4bf nodeName:}" failed. No retries permitted until 2026-09-08 03:55:40.881417027 +0000 UTC m=+34.351985399 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-m9c82" (UniqueName: "kubernetes.io/projected/ab426e2f-9c8a-4457-a6b9-b98e4c94f4bf-kube-api-access-m9c82") pod "network-check-target-4wk4q" (UID: "ab426e2f-9c8a-4457-a6b9-b98e4c94f4bf") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 08 03:55:25.061501 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:25.061468 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6ffgk" Sep 08 03:55:25.061672 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:25.061468 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4wk4q" Sep 08 03:55:25.061672 ip-10-0-128-67 kubenswrapper[2571]: E0908 03:55:25.061593 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6ffgk" podUID="4c94cf72-6e9d-4f8b-ae71-105e52f051a1" Sep 08 03:55:25.061803 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:25.061468 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s2679" Sep 08 03:55:25.061803 ip-10-0-128-67 kubenswrapper[2571]: E0908 03:55:25.061677 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4wk4q" podUID="ab426e2f-9c8a-4457-a6b9-b98e4c94f4bf" Sep 08 03:55:25.061901 ip-10-0-128-67 kubenswrapper[2571]: E0908 03:55:25.061824 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s2679" podUID="be017881-2b6a-4fd2-b62d-4b5d3bd7b834" Sep 08 03:55:27.063053 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:27.063008 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6ffgk" Sep 08 03:55:27.063542 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:27.063117 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s2679" Sep 08 03:55:27.063542 ip-10-0-128-67 kubenswrapper[2571]: E0908 03:55:27.063156 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6ffgk" podUID="4c94cf72-6e9d-4f8b-ae71-105e52f051a1" Sep 08 03:55:27.063542 ip-10-0-128-67 kubenswrapper[2571]: E0908 03:55:27.063205 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s2679" podUID="be017881-2b6a-4fd2-b62d-4b5d3bd7b834" Sep 08 03:55:27.063542 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:27.063230 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4wk4q" Sep 08 03:55:27.063542 ip-10-0-128-67 kubenswrapper[2571]: E0908 03:55:27.063295 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4wk4q" podUID="ab426e2f-9c8a-4457-a6b9-b98e4c94f4bf" Sep 08 03:55:28.226647 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:28.226377 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nxtjg" event={"ID":"2c0c6060-83f1-4145-ae8c-7eb94e2201a8","Type":"ContainerStarted","Data":"6ae04b44090067b802b05f21bec737629c2d109c2bc9401d071108416c6a33ef"} Sep 08 03:55:28.228031 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:28.228002 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-xgq5w" event={"ID":"98f02edd-0112-465f-992b-441a484304a3","Type":"ContainerStarted","Data":"b731d418c237fdd585703015e41168a64f348ba4af37d6fe1932171462c4c87a"} Sep 08 03:55:28.229763 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:28.229737 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-6gf2k" event={"ID":"0e85668b-3938-4a44-978b-0fa580d71c06","Type":"ContainerStarted","Data":"f1929ecbe925721011b107000852b8897571fe0c7a3c3846f2269e96d265c6fe"} Sep 08 03:55:28.231525 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:28.231466 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-xjf8j" event={"ID":"5887ba4c-5c74-4753-b0f0-e83cd30fe7d3","Type":"ContainerStarted","Data":"81f14ab339eec786d82b1b5ed917ec0d651e80d0eed8dcf6d2a175436468c86a"} Sep 08 03:55:28.235973 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:28.235947 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7mnct" event={"ID":"b35366ff-994a-4635-bad2-1ba59bcc640a","Type":"ContainerStarted","Data":"75ef254416c70422b73bf65e0d296fb1b7403628c3204d8d6fabc7172b247253"} Sep 08 03:55:28.236062 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:28.236021 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7mnct" event={"ID":"b35366ff-994a-4635-bad2-1ba59bcc640a","Type":"ContainerStarted","Data":"05580e56a304d14e18b2ad0e7622fda52306d25a2e2391f343fd79c83b0e2ea3"} Sep 08 03:55:28.236062 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:28.236054 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7mnct" event={"ID":"b35366ff-994a-4635-bad2-1ba59bcc640a","Type":"ContainerStarted","Data":"62459897be7cbfdf587819e7f97f8c0003b543eb254dedefdc30f2757b40221a"} Sep 08 03:55:28.236171 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:28.236083 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7mnct" event={"ID":"b35366ff-994a-4635-bad2-1ba59bcc640a","Type":"ContainerStarted","Data":"15f4de1b9d645440bfb67b42fdbd1e53225347d8a741e0d0aed34a6abb5f0998"} Sep 08 03:55:28.236171 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:28.236109 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7mnct" event={"ID":"b35366ff-994a-4635-bad2-1ba59bcc640a","Type":"ContainerStarted","Data":"ad9c67e7f4b0d53c3b664d3fdaedaad31f57d6fba3d22d9236fa437dc45bc6d7"} Sep 08 03:55:28.236171 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:28.236167 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7mnct" event={"ID":"b35366ff-994a-4635-bad2-1ba59bcc640a","Type":"ContainerStarted","Data":"f300831d32c3688a1c93a3c8a109778887763a8a62cbeb6362ebf37226c2cc5d"} Sep 08 03:55:28.237743 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:28.237699 2571 generic.go:356] "Generic (PLEG): container finished" podID="d9fbef9f-7075-4727-88c9-b5feeaf043db" containerID="6bb9b3e253d5fb201f18293b85ea42a82ecda108047608663a237ade671e55e5" exitCode=0 Sep 08 03:55:28.237743 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:28.237728 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wc8bl" event={"ID":"d9fbef9f-7075-4727-88c9-b5feeaf043db","Type":"ContainerDied","Data":"6bb9b3e253d5fb201f18293b85ea42a82ecda108047608663a237ade671e55e5"} Sep 08 03:55:28.242801 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:28.242681 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-t2qd4" event={"ID":"92705af2-1822-4b7f-8852-a8120774230c","Type":"ContainerStarted","Data":"1fb64a70a0b8f6ba4e1811aaa6dd6f321aa85e4f4f9556a5d92e06fa1e22f166"} Sep 08 03:55:28.244635 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:28.244611 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-tbtxs" event={"ID":"f583a7fb-d8f2-4b26-ba64-bb73e3b605c6","Type":"ContainerStarted","Data":"9512d39c91b0993d3f4c2c056ba59502d4eeaccfb171dec10ca68ccd565462a0"} Sep 08 03:55:28.245430 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:28.245386 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-67.ec2.internal" podStartSLOduration=20.245370719 podStartE2EDuration="20.245370719s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 03:55:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 03:55:12.216426728 +0000 UTC m=+5.686995109" watchObservedRunningTime="2026-09-08 03:55:28.245370719 +0000 UTC m=+21.715939100" Sep 08 03:55:28.245830 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:28.245798 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-xgq5w" podStartSLOduration=3.873763049 podStartE2EDuration="21.245786848s" totalImagesPullingTime="17.372023799s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 03:55:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 03:55:28.245299453 +0000 UTC m=+21.715867838" watchObservedRunningTime="2026-09-08 03:55:28.245786848 +0000 UTC m=+21.716355225" Sep 08 03:55:28.289220 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:28.289171 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-t2qd4" podStartSLOduration=3.921323858 podStartE2EDuration="21.289157189s" totalImagesPullingTime="17.367833331s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 03:55:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 03:55:28.263053988 +0000 UTC m=+21.733622370" watchObservedRunningTime="2026-09-08 03:55:28.289157189 +0000 UTC m=+21.759725571" Sep 08 03:55:28.309049 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:28.308995 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-tbtxs" podStartSLOduration=3.831898323 podStartE2EDuration="21.308974979s" totalImagesPullingTime="17.477076656s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 03:55:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 03:55:28.308609173 +0000 UTC m=+21.779177554" watchObservedRunningTime="2026-09-08 03:55:28.308974979 +0000 UTC m=+21.779543361" Sep 08 03:55:28.326032 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:28.325836 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-xjf8j" podStartSLOduration=3.90461424 podStartE2EDuration="21.325822637s" totalImagesPullingTime="17.421208397s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 03:55:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 03:55:28.32550237 +0000 UTC m=+21.796070752" watchObservedRunningTime="2026-09-08 03:55:28.325822637 +0000 UTC m=+21.796391017" Sep 08 03:55:28.342776 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:28.342726 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-6gf2k" podStartSLOduration=3.930068355 podStartE2EDuration="21.342699885s" totalImagesPullingTime="17.41263153s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 03:55:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 03:55:28.342139567 +0000 UTC m=+21.812707949" watchObservedRunningTime="2026-09-08 03:55:28.342699885 +0000 UTC m=+21.813268265" Sep 08 03:55:28.550113 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:28.550081 2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-xgq5w" Sep 08 03:55:28.550978 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:28.550956 2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-xgq5w" Sep 08 03:55:29.025718 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:29.025688 2571 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Sep 08 03:55:29.061796 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:29.061768 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4wk4q" Sep 08 03:55:29.061796 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:29.061776 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6ffgk" Sep 08 03:55:29.061992 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:29.061884 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s2679" Sep 08 03:55:29.061992 ip-10-0-128-67 kubenswrapper[2571]: E0908 03:55:29.061890 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4wk4q" podUID="ab426e2f-9c8a-4457-a6b9-b98e4c94f4bf" Sep 08 03:55:29.061992 ip-10-0-128-67 kubenswrapper[2571]: E0908 03:55:29.061976 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6ffgk" podUID="4c94cf72-6e9d-4f8b-ae71-105e52f051a1" Sep 08 03:55:29.062094 ip-10-0-128-67 kubenswrapper[2571]: E0908 03:55:29.062049 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s2679" podUID="be017881-2b6a-4fd2-b62d-4b5d3bd7b834" Sep 08 03:55:29.248813 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:29.248733 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-cbzhc" event={"ID":"a6151e0d-2e3f-44c5-b268-a7adcc60bffe","Type":"ContainerStarted","Data":"1bd0b0df039b46f023b02e55bbe3d8686e9ad5c681ee144bcb09a573ba508091"} Sep 08 03:55:29.250985 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:29.250958 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nxtjg" event={"ID":"2c0c6060-83f1-4145-ae8c-7eb94e2201a8","Type":"ContainerStarted","Data":"ee3dbe0edc684cf73568ec4fbee815ac3578b00eedc52f0bd0e2922611970752"} Sep 08 03:55:29.251397 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:29.251354 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-xgq5w" Sep 08 03:55:29.251901 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:29.251871 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-xgq5w" Sep 08 03:55:29.268347 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:29.268309 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-cbzhc" podStartSLOduration=4.902731242 podStartE2EDuration="22.268295858s" totalImagesPullingTime="17.365564616s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 03:55:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 03:55:29.267945846 +0000 UTC m=+22.738514228" watchObservedRunningTime="2026-09-08 03:55:29.268295858 +0000 UTC m=+22.738864239" Sep 08 03:55:30.016092 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:30.015972 2571 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-08T03:55:29.025711761Z","UUID":"66a3055a-dc91-4909-8602-a6368f509eb7","Handler":null,"Name":"","Endpoint":""} Sep 08 03:55:30.017709 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:30.017685 2571 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Sep 08 03:55:30.017819 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:30.017723 2571 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Sep 08 03:55:30.255225 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:30.255194 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nxtjg" event={"ID":"2c0c6060-83f1-4145-ae8c-7eb94e2201a8","Type":"ContainerStarted","Data":"d938d6da0b15be6e6a1ca2df8b730b23a282c6261b50c906e561e8d5e4ebe206"} Sep 08 03:55:30.304502 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:30.304446 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nxtjg" podStartSLOduration=3.690235042 podStartE2EDuration="23.304424961s" totalImagesPullingTime="19.614189919s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 03:55:07 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 03:55:30.304116137 +0000 UTC m=+23.774684523" watchObservedRunningTime="2026-09-08 03:55:30.304424961 +0000 UTC m=+23.774993343" Sep 08 03:55:31.061875 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:31.061834 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4wk4q" Sep 08 03:55:31.061875 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:31.061872 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s2679" Sep 08 03:55:31.062177 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:31.061837 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6ffgk" Sep 08 03:55:31.062177 ip-10-0-128-67 kubenswrapper[2571]: E0908 03:55:31.062009 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4wk4q" podUID="ab426e2f-9c8a-4457-a6b9-b98e4c94f4bf" Sep 08 03:55:31.062177 ip-10-0-128-67 kubenswrapper[2571]: E0908 03:55:31.062119 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6ffgk" podUID="4c94cf72-6e9d-4f8b-ae71-105e52f051a1" Sep 08 03:55:31.062310 ip-10-0-128-67 kubenswrapper[2571]: E0908 03:55:31.062225 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s2679" podUID="be017881-2b6a-4fd2-b62d-4b5d3bd7b834" Sep 08 03:55:31.261311 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:31.261271 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7mnct" event={"ID":"b35366ff-994a-4635-bad2-1ba59bcc640a","Type":"ContainerStarted","Data":"01e994f6fefc2516fd3285f81fb3d400ebafdc090e4600b0dc9d041a96cd482e"} Sep 08 03:55:33.062348 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:33.062316 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4wk4q" Sep 08 03:55:33.063282 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:33.062317 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s2679" Sep 08 03:55:33.063282 ip-10-0-128-67 kubenswrapper[2571]: E0908 03:55:33.062423 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4wk4q" podUID="ab426e2f-9c8a-4457-a6b9-b98e4c94f4bf" Sep 08 03:55:33.063282 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:33.062454 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6ffgk" Sep 08 03:55:33.063282 ip-10-0-128-67 kubenswrapper[2571]: E0908 03:55:33.062539 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s2679" podUID="be017881-2b6a-4fd2-b62d-4b5d3bd7b834" Sep 08 03:55:33.063282 ip-10-0-128-67 kubenswrapper[2571]: E0908 03:55:33.062606 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6ffgk" podUID="4c94cf72-6e9d-4f8b-ae71-105e52f051a1" Sep 08 03:55:33.269525 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:33.269496 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7mnct" event={"ID":"b35366ff-994a-4635-bad2-1ba59bcc640a","Type":"ContainerStarted","Data":"830e0bf72a73c09bdd27b41f7dcecc6402c95403b31c0a0b68a8ee796ad87382"} Sep 08 03:55:33.269751 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:33.269731 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-7mnct" Sep 08 03:55:33.271444 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:33.271419 2571 generic.go:356] "Generic (PLEG): container finished" podID="d9fbef9f-7075-4727-88c9-b5feeaf043db" containerID="d3bfa109948e5df3260ef36af54e48e66d0306ff726644371092e669b256dc81" exitCode=0 Sep 08 03:55:33.271550 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:33.271456 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wc8bl" event={"ID":"d9fbef9f-7075-4727-88c9-b5feeaf043db","Type":"ContainerDied","Data":"d3bfa109948e5df3260ef36af54e48e66d0306ff726644371092e669b256dc81"} Sep 08 03:55:33.284599 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:33.284576 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-7mnct" Sep 08 03:55:33.303936 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:33.303879 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-7mnct" podStartSLOduration=8.822719762 podStartE2EDuration="26.303868029s" totalImagesPullingTime="17.481148267s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 03:55:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 03:55:33.303437629 +0000 UTC m=+26.774006010" watchObservedRunningTime="2026-09-08 03:55:33.303868029 +0000 UTC m=+26.774436409" Sep 08 03:55:34.273668 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:34.273647 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-7mnct" Sep 08 03:55:34.274013 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:34.273731 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-7mnct" Sep 08 03:55:34.287727 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:34.287706 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-7mnct" Sep 08 03:55:34.330581 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:34.330342 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-6ffgk"] Sep 08 03:55:34.330733 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:34.330692 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6ffgk" Sep 08 03:55:34.331496 ip-10-0-128-67 kubenswrapper[2571]: E0908 03:55:34.330815 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6ffgk" podUID="4c94cf72-6e9d-4f8b-ae71-105e52f051a1" Sep 08 03:55:34.334496 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:34.334471 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-4wk4q"] Sep 08 03:55:34.334583 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:34.334569 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4wk4q" Sep 08 03:55:34.334682 ip-10-0-128-67 kubenswrapper[2571]: E0908 03:55:34.334657 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4wk4q" podUID="ab426e2f-9c8a-4457-a6b9-b98e4c94f4bf" Sep 08 03:55:34.337119 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:34.337097 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-s2679"] Sep 08 03:55:34.337209 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:34.337192 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s2679" Sep 08 03:55:34.337311 ip-10-0-128-67 kubenswrapper[2571]: E0908 03:55:34.337290 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s2679" podUID="be017881-2b6a-4fd2-b62d-4b5d3bd7b834" Sep 08 03:55:35.277820 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:35.277788 2571 generic.go:356] "Generic (PLEG): container finished" podID="d9fbef9f-7075-4727-88c9-b5feeaf043db" containerID="33603094ef2c93d31346252dec51c1c82692255ee812bb2a1260745bf3f4af0b" exitCode=0 Sep 08 03:55:35.278291 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:35.277872 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wc8bl" event={"ID":"d9fbef9f-7075-4727-88c9-b5feeaf043db","Type":"ContainerDied","Data":"33603094ef2c93d31346252dec51c1c82692255ee812bb2a1260745bf3f4af0b"} Sep 08 03:55:36.061996 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:36.061967 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4wk4q" Sep 08 03:55:36.062187 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:36.062007 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6ffgk" Sep 08 03:55:36.062187 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:36.062016 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s2679" Sep 08 03:55:36.062187 ip-10-0-128-67 kubenswrapper[2571]: E0908 03:55:36.062083 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4wk4q" podUID="ab426e2f-9c8a-4457-a6b9-b98e4c94f4bf" Sep 08 03:55:36.062187 ip-10-0-128-67 kubenswrapper[2571]: E0908 03:55:36.062174 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6ffgk" podUID="4c94cf72-6e9d-4f8b-ae71-105e52f051a1" Sep 08 03:55:36.062344 ip-10-0-128-67 kubenswrapper[2571]: E0908 03:55:36.062282 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s2679" podUID="be017881-2b6a-4fd2-b62d-4b5d3bd7b834" Sep 08 03:55:37.284020 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:37.283984 2571 generic.go:356] "Generic (PLEG): container finished" podID="d9fbef9f-7075-4727-88c9-b5feeaf043db" containerID="f0ca4d308379d9244d1be1728c441fc086537263a8436c9655f0ca73a60b4386" exitCode=0 Sep 08 03:55:37.284423 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:37.284038 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wc8bl" event={"ID":"d9fbef9f-7075-4727-88c9-b5feeaf043db","Type":"ContainerDied","Data":"f0ca4d308379d9244d1be1728c441fc086537263a8436c9655f0ca73a60b4386"} Sep 08 03:55:38.061805 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:38.061768 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s2679" Sep 08 03:55:38.062000 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:38.061784 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6ffgk" Sep 08 03:55:38.062000 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:38.061784 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4wk4q" Sep 08 03:55:38.062000 ip-10-0-128-67 kubenswrapper[2571]: E0908 03:55:38.061911 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s2679" podUID="be017881-2b6a-4fd2-b62d-4b5d3bd7b834" Sep 08 03:55:38.062000 ip-10-0-128-67 kubenswrapper[2571]: E0908 03:55:38.061991 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6ffgk" podUID="4c94cf72-6e9d-4f8b-ae71-105e52f051a1" Sep 08 03:55:38.062182 ip-10-0-128-67 kubenswrapper[2571]: E0908 03:55:38.062053 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4wk4q" podUID="ab426e2f-9c8a-4457-a6b9-b98e4c94f4bf" Sep 08 03:55:40.062398 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:40.062360 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s2679" Sep 08 03:55:40.062965 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:40.062381 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4wk4q" Sep 08 03:55:40.062965 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:40.062513 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6ffgk" Sep 08 03:55:40.062965 ip-10-0-128-67 kubenswrapper[2571]: E0908 03:55:40.062528 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-s2679" podUID="be017881-2b6a-4fd2-b62d-4b5d3bd7b834" Sep 08 03:55:40.062965 ip-10-0-128-67 kubenswrapper[2571]: E0908 03:55:40.062593 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6ffgk" podUID="4c94cf72-6e9d-4f8b-ae71-105e52f051a1" Sep 08 03:55:40.062965 ip-10-0-128-67 kubenswrapper[2571]: E0908 03:55:40.062655 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4wk4q" podUID="ab426e2f-9c8a-4457-a6b9-b98e4c94f4bf" Sep 08 03:55:40.308089 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:40.306211 2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-67.ec2.internal" event="NodeReady" Sep 08 03:55:40.308089 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:40.306370 2571 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Sep 08 03:55:40.350217 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:40.349738 2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-6599b77f7d-5kvch"] Sep 08 03:55:40.354728 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:40.354698 2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-79977f9844-h4zkr"] Sep 08 03:55:40.354888 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:40.354865 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6599b77f7d-5kvch" Sep 08 03:55:40.357587 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:40.357519 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Sep 08 03:55:40.357587 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:40.357559 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Sep 08 03:55:40.357762 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:40.357688 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-9whqn\"" Sep 08 03:55:40.357813 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:40.357793 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Sep 08 03:55:40.357934 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:40.357900 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-79977f9844-h4zkr" Sep 08 03:55:40.361531 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:40.361409 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-bd2fn\"" Sep 08 03:55:40.361531 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:40.361419 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Sep 08 03:55:40.361531 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:40.361436 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Sep 08 03:55:40.363520 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:40.363499 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Sep 08 03:55:40.366643 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:40.366578 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-79977f9844-h4zkr"] Sep 08 03:55:40.371061 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:40.370988 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6599b77f7d-5kvch"] Sep 08 03:55:40.371779 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:40.371757 2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-hjfnf"] Sep 08 03:55:40.375255 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:40.375237 2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-2gs5x"] Sep 08 03:55:40.375383 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:40.375366 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-hjfnf" Sep 08 03:55:40.378576 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:40.378549 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Sep 08 03:55:40.378652 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:40.378640 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-cprn7\"" Sep 08 03:55:40.378808 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:40.378793 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Sep 08 03:55:40.378881 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:40.378864 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-2gs5x" Sep 08 03:55:40.378926 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:40.378881 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Sep 08 03:55:40.381079 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:40.381054 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-sl2fz\"" Sep 08 03:55:40.381236 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:40.381220 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Sep 08 03:55:40.381307 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:40.381270 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Sep 08 03:55:40.383807 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:40.383133 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-hjfnf"] Sep 08 03:55:40.387131 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:40.387072 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-2gs5x"] Sep 08 03:55:40.495816 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:40.495778 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-87d2l\" (UniqueName: \"kubernetes.io/projected/a832821c-0523-4a74-9e04-c4772b079561-kube-api-access-87d2l\") pod \"ingress-canary-hjfnf\" (UID: \"a832821c-0523-4a74-9e04-c4772b079561\") " pod="openshift-ingress-canary/ingress-canary-hjfnf" Sep 08 03:55:40.496003 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:40.495829 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/c46d90d1-2661-4b22-9f7d-9d2fd5eaabbb-config-volume\") pod \"dns-default-2gs5x\" (UID: \"c46d90d1-2661-4b22-9f7d-9d2fd5eaabbb\") " pod="openshift-dns/dns-default-2gs5x" Sep 08 03:55:40.496003 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:40.495854 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hps4l\" (UniqueName: \"kubernetes.io/projected/c46d90d1-2661-4b22-9f7d-9d2fd5eaabbb-kube-api-access-hps4l\") pod \"dns-default-2gs5x\" (UID: \"c46d90d1-2661-4b22-9f7d-9d2fd5eaabbb\") " pod="openshift-dns/dns-default-2gs5x" Sep 08 03:55:40.496003 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:40.495910 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/2ade1f16-121b-46fc-95be-128ebe6804e0-installation-pull-secrets\") pod \"image-registry-6599b77f7d-5kvch\" (UID: \"2ade1f16-121b-46fc-95be-128ebe6804e0\") " pod="openshift-image-registry/image-registry-6599b77f7d-5kvch" Sep 08 03:55:40.496003 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:40.495978 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2ade1f16-121b-46fc-95be-128ebe6804e0-bound-sa-token\") pod \"image-registry-6599b77f7d-5kvch\" (UID: \"2ade1f16-121b-46fc-95be-128ebe6804e0\") " pod="openshift-image-registry/image-registry-6599b77f7d-5kvch" Sep 08 03:55:40.496217 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:40.496026 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c46d90d1-2661-4b22-9f7d-9d2fd5eaabbb-metrics-tls\") pod \"dns-default-2gs5x\" (UID: \"c46d90d1-2661-4b22-9f7d-9d2fd5eaabbb\") " pod="openshift-dns/dns-default-2gs5x" Sep 08 03:55:40.496217 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:40.496078 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/2ade1f16-121b-46fc-95be-128ebe6804e0-trusted-ca\") pod \"image-registry-6599b77f7d-5kvch\" (UID: \"2ade1f16-121b-46fc-95be-128ebe6804e0\") " pod="openshift-image-registry/image-registry-6599b77f7d-5kvch" Sep 08 03:55:40.496217 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:40.496104 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/2ade1f16-121b-46fc-95be-128ebe6804e0-registry-certificates\") pod \"image-registry-6599b77f7d-5kvch\" (UID: \"2ade1f16-121b-46fc-95be-128ebe6804e0\") " pod="openshift-image-registry/image-registry-6599b77f7d-5kvch" Sep 08 03:55:40.496217 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:40.496125 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/4fd5d5dc-7953-4bd3-b65c-f81092c2af3d-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-h4zkr\" (UID: \"4fd5d5dc-7953-4bd3-b65c-f81092c2af3d\") " pod="openshift-network-console/networking-console-plugin-79977f9844-h4zkr" Sep 08 03:55:40.496217 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:40.496150 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2ade1f16-121b-46fc-95be-128ebe6804e0-registry-tls\") pod \"image-registry-6599b77f7d-5kvch\" (UID: \"2ade1f16-121b-46fc-95be-128ebe6804e0\") " pod="openshift-image-registry/image-registry-6599b77f7d-5kvch" Sep 08 03:55:40.496217 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:40.496185 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a832821c-0523-4a74-9e04-c4772b079561-cert\") pod \"ingress-canary-hjfnf\" (UID: \"a832821c-0523-4a74-9e04-c4772b079561\") " pod="openshift-ingress-canary/ingress-canary-hjfnf" Sep 08 03:55:40.496491 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:40.496223 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/2ade1f16-121b-46fc-95be-128ebe6804e0-image-registry-private-configuration\") pod \"image-registry-6599b77f7d-5kvch\" (UID: \"2ade1f16-121b-46fc-95be-128ebe6804e0\") " pod="openshift-image-registry/image-registry-6599b77f7d-5kvch" Sep 08 03:55:40.496491 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:40.496250 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l2pkm\" (UniqueName: \"kubernetes.io/projected/2ade1f16-121b-46fc-95be-128ebe6804e0-kube-api-access-l2pkm\") pod \"image-registry-6599b77f7d-5kvch\" (UID: \"2ade1f16-121b-46fc-95be-128ebe6804e0\") " pod="openshift-image-registry/image-registry-6599b77f7d-5kvch" Sep 08 03:55:40.496491 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:40.496329 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/4fd5d5dc-7953-4bd3-b65c-f81092c2af3d-nginx-conf\") pod \"networking-console-plugin-79977f9844-h4zkr\" (UID: \"4fd5d5dc-7953-4bd3-b65c-f81092c2af3d\") " pod="openshift-network-console/networking-console-plugin-79977f9844-h4zkr" Sep 08 03:55:40.496491 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:40.496361 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c46d90d1-2661-4b22-9f7d-9d2fd5eaabbb-tmp-dir\") pod \"dns-default-2gs5x\" (UID: \"c46d90d1-2661-4b22-9f7d-9d2fd5eaabbb\") " pod="openshift-dns/dns-default-2gs5x" Sep 08 03:55:40.496491 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:40.496393 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/2ade1f16-121b-46fc-95be-128ebe6804e0-ca-trust-extracted\") pod \"image-registry-6599b77f7d-5kvch\" (UID: \"2ade1f16-121b-46fc-95be-128ebe6804e0\") " pod="openshift-image-registry/image-registry-6599b77f7d-5kvch" Sep 08 03:55:40.597097 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:40.597005 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/2ade1f16-121b-46fc-95be-128ebe6804e0-registry-certificates\") pod \"image-registry-6599b77f7d-5kvch\" (UID: \"2ade1f16-121b-46fc-95be-128ebe6804e0\") " pod="openshift-image-registry/image-registry-6599b77f7d-5kvch" Sep 08 03:55:40.597097 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:40.597046 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/4fd5d5dc-7953-4bd3-b65c-f81092c2af3d-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-h4zkr\" (UID: \"4fd5d5dc-7953-4bd3-b65c-f81092c2af3d\") " pod="openshift-network-console/networking-console-plugin-79977f9844-h4zkr" Sep 08 03:55:40.597097 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:40.597065 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2ade1f16-121b-46fc-95be-128ebe6804e0-registry-tls\") pod \"image-registry-6599b77f7d-5kvch\" (UID: \"2ade1f16-121b-46fc-95be-128ebe6804e0\") " pod="openshift-image-registry/image-registry-6599b77f7d-5kvch" Sep 08 03:55:40.597371 ip-10-0-128-67 kubenswrapper[2571]: E0908 03:55:40.597174 2571 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Sep 08 03:55:40.597371 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:40.597192 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a832821c-0523-4a74-9e04-c4772b079561-cert\") pod \"ingress-canary-hjfnf\" (UID: \"a832821c-0523-4a74-9e04-c4772b079561\") " pod="openshift-ingress-canary/ingress-canary-hjfnf" Sep 08 03:55:40.597371 ip-10-0-128-67 kubenswrapper[2571]: E0908 03:55:40.597237 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4fd5d5dc-7953-4bd3-b65c-f81092c2af3d-networking-console-plugin-cert podName:4fd5d5dc-7953-4bd3-b65c-f81092c2af3d nodeName:}" failed. No retries permitted until 2026-09-08 03:55:41.097219363 +0000 UTC m=+34.567787739 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/4fd5d5dc-7953-4bd3-b65c-f81092c2af3d-networking-console-plugin-cert") pod "networking-console-plugin-79977f9844-h4zkr" (UID: "4fd5d5dc-7953-4bd3-b65c-f81092c2af3d") : secret "networking-console-plugin-cert" not found Sep 08 03:55:40.597371 ip-10-0-128-67 kubenswrapper[2571]: E0908 03:55:40.597178 2571 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 08 03:55:40.597371 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:40.597271 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/2ade1f16-121b-46fc-95be-128ebe6804e0-image-registry-private-configuration\") pod \"image-registry-6599b77f7d-5kvch\" (UID: \"2ade1f16-121b-46fc-95be-128ebe6804e0\") " pod="openshift-image-registry/image-registry-6599b77f7d-5kvch" Sep 08 03:55:40.597371 ip-10-0-128-67 kubenswrapper[2571]: E0908 03:55:40.597282 2571 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6599b77f7d-5kvch: secret "image-registry-tls" not found Sep 08 03:55:40.597371 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:40.597298 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l2pkm\" (UniqueName: \"kubernetes.io/projected/2ade1f16-121b-46fc-95be-128ebe6804e0-kube-api-access-l2pkm\") pod \"image-registry-6599b77f7d-5kvch\" (UID: \"2ade1f16-121b-46fc-95be-128ebe6804e0\") " pod="openshift-image-registry/image-registry-6599b77f7d-5kvch" Sep 08 03:55:40.597371 ip-10-0-128-67 kubenswrapper[2571]: E0908 03:55:40.597340 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2ade1f16-121b-46fc-95be-128ebe6804e0-registry-tls podName:2ade1f16-121b-46fc-95be-128ebe6804e0 nodeName:}" failed. No retries permitted until 2026-09-08 03:55:41.097321372 +0000 UTC m=+34.567889745 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/2ade1f16-121b-46fc-95be-128ebe6804e0-registry-tls") pod "image-registry-6599b77f7d-5kvch" (UID: "2ade1f16-121b-46fc-95be-128ebe6804e0") : secret "image-registry-tls" not found Sep 08 03:55:40.597720 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:40.597388 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/4fd5d5dc-7953-4bd3-b65c-f81092c2af3d-nginx-conf\") pod \"networking-console-plugin-79977f9844-h4zkr\" (UID: \"4fd5d5dc-7953-4bd3-b65c-f81092c2af3d\") " pod="openshift-network-console/networking-console-plugin-79977f9844-h4zkr" Sep 08 03:55:40.597720 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:40.597417 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c46d90d1-2661-4b22-9f7d-9d2fd5eaabbb-tmp-dir\") pod \"dns-default-2gs5x\" (UID: \"c46d90d1-2661-4b22-9f7d-9d2fd5eaabbb\") " pod="openshift-dns/dns-default-2gs5x" Sep 08 03:55:40.597720 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:40.597445 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/2ade1f16-121b-46fc-95be-128ebe6804e0-ca-trust-extracted\") pod \"image-registry-6599b77f7d-5kvch\" (UID: \"2ade1f16-121b-46fc-95be-128ebe6804e0\") " pod="openshift-image-registry/image-registry-6599b77f7d-5kvch" Sep 08 03:55:40.597720 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:40.597497 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-87d2l\" (UniqueName: \"kubernetes.io/projected/a832821c-0523-4a74-9e04-c4772b079561-kube-api-access-87d2l\") pod \"ingress-canary-hjfnf\" (UID: \"a832821c-0523-4a74-9e04-c4772b079561\") " pod="openshift-ingress-canary/ingress-canary-hjfnf" Sep 08 03:55:40.597720 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:40.597524 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/c46d90d1-2661-4b22-9f7d-9d2fd5eaabbb-config-volume\") pod \"dns-default-2gs5x\" (UID: \"c46d90d1-2661-4b22-9f7d-9d2fd5eaabbb\") " pod="openshift-dns/dns-default-2gs5x" Sep 08 03:55:40.597720 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:40.597546 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hps4l\" (UniqueName: \"kubernetes.io/projected/c46d90d1-2661-4b22-9f7d-9d2fd5eaabbb-kube-api-access-hps4l\") pod \"dns-default-2gs5x\" (UID: \"c46d90d1-2661-4b22-9f7d-9d2fd5eaabbb\") " pod="openshift-dns/dns-default-2gs5x" Sep 08 03:55:40.597720 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:40.597568 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/2ade1f16-121b-46fc-95be-128ebe6804e0-installation-pull-secrets\") pod \"image-registry-6599b77f7d-5kvch\" (UID: \"2ade1f16-121b-46fc-95be-128ebe6804e0\") " pod="openshift-image-registry/image-registry-6599b77f7d-5kvch" Sep 08 03:55:40.597720 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:40.597587 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2ade1f16-121b-46fc-95be-128ebe6804e0-bound-sa-token\") pod \"image-registry-6599b77f7d-5kvch\" (UID: \"2ade1f16-121b-46fc-95be-128ebe6804e0\") " pod="openshift-image-registry/image-registry-6599b77f7d-5kvch" Sep 08 03:55:40.597720 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:40.597605 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c46d90d1-2661-4b22-9f7d-9d2fd5eaabbb-metrics-tls\") pod \"dns-default-2gs5x\" (UID: \"c46d90d1-2661-4b22-9f7d-9d2fd5eaabbb\") " pod="openshift-dns/dns-default-2gs5x" Sep 08 03:55:40.597720 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:40.597639 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/2ade1f16-121b-46fc-95be-128ebe6804e0-trusted-ca\") pod \"image-registry-6599b77f7d-5kvch\" (UID: \"2ade1f16-121b-46fc-95be-128ebe6804e0\") " pod="openshift-image-registry/image-registry-6599b77f7d-5kvch" Sep 08 03:55:40.598076 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:40.597754 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/2ade1f16-121b-46fc-95be-128ebe6804e0-registry-certificates\") pod \"image-registry-6599b77f7d-5kvch\" (UID: \"2ade1f16-121b-46fc-95be-128ebe6804e0\") " pod="openshift-image-registry/image-registry-6599b77f7d-5kvch" Sep 08 03:55:40.598194 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:40.598169 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/4fd5d5dc-7953-4bd3-b65c-f81092c2af3d-nginx-conf\") pod \"networking-console-plugin-79977f9844-h4zkr\" (UID: \"4fd5d5dc-7953-4bd3-b65c-f81092c2af3d\") " pod="openshift-network-console/networking-console-plugin-79977f9844-h4zkr" Sep 08 03:55:40.598315 ip-10-0-128-67 kubenswrapper[2571]: E0908 03:55:40.598259 2571 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 08 03:55:40.598315 ip-10-0-128-67 kubenswrapper[2571]: E0908 03:55:40.598299 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c46d90d1-2661-4b22-9f7d-9d2fd5eaabbb-metrics-tls podName:c46d90d1-2661-4b22-9f7d-9d2fd5eaabbb nodeName:}" failed. No retries permitted until 2026-09-08 03:55:41.098285585 +0000 UTC m=+34.568853959 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c46d90d1-2661-4b22-9f7d-9d2fd5eaabbb-metrics-tls") pod "dns-default-2gs5x" (UID: "c46d90d1-2661-4b22-9f7d-9d2fd5eaabbb") : secret "dns-default-metrics-tls" not found Sep 08 03:55:40.598794 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:40.598525 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/2ade1f16-121b-46fc-95be-128ebe6804e0-trusted-ca\") pod \"image-registry-6599b77f7d-5kvch\" (UID: \"2ade1f16-121b-46fc-95be-128ebe6804e0\") " pod="openshift-image-registry/image-registry-6599b77f7d-5kvch" Sep 08 03:55:40.598794 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:40.598569 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/2ade1f16-121b-46fc-95be-128ebe6804e0-ca-trust-extracted\") pod \"image-registry-6599b77f7d-5kvch\" (UID: \"2ade1f16-121b-46fc-95be-128ebe6804e0\") " pod="openshift-image-registry/image-registry-6599b77f7d-5kvch" Sep 08 03:55:40.598794 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:40.598642 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c46d90d1-2661-4b22-9f7d-9d2fd5eaabbb-tmp-dir\") pod \"dns-default-2gs5x\" (UID: \"c46d90d1-2661-4b22-9f7d-9d2fd5eaabbb\") " pod="openshift-dns/dns-default-2gs5x" Sep 08 03:55:40.599018 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:40.598835 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/c46d90d1-2661-4b22-9f7d-9d2fd5eaabbb-config-volume\") pod \"dns-default-2gs5x\" (UID: \"c46d90d1-2661-4b22-9f7d-9d2fd5eaabbb\") " pod="openshift-dns/dns-default-2gs5x" Sep 08 03:55:40.602339 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:40.602167 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/2ade1f16-121b-46fc-95be-128ebe6804e0-installation-pull-secrets\") pod \"image-registry-6599b77f7d-5kvch\" (UID: \"2ade1f16-121b-46fc-95be-128ebe6804e0\") " pod="openshift-image-registry/image-registry-6599b77f7d-5kvch" Sep 08 03:55:40.602439 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:40.602167 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/2ade1f16-121b-46fc-95be-128ebe6804e0-image-registry-private-configuration\") pod \"image-registry-6599b77f7d-5kvch\" (UID: \"2ade1f16-121b-46fc-95be-128ebe6804e0\") " pod="openshift-image-registry/image-registry-6599b77f7d-5kvch" Sep 08 03:55:40.602439 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:40.602194 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a832821c-0523-4a74-9e04-c4772b079561-cert\") pod \"ingress-canary-hjfnf\" (UID: \"a832821c-0523-4a74-9e04-c4772b079561\") " pod="openshift-ingress-canary/ingress-canary-hjfnf" Sep 08 03:55:40.608966 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:40.608913 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l2pkm\" (UniqueName: \"kubernetes.io/projected/2ade1f16-121b-46fc-95be-128ebe6804e0-kube-api-access-l2pkm\") pod \"image-registry-6599b77f7d-5kvch\" (UID: \"2ade1f16-121b-46fc-95be-128ebe6804e0\") " pod="openshift-image-registry/image-registry-6599b77f7d-5kvch" Sep 08 03:55:40.609198 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:40.609175 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2ade1f16-121b-46fc-95be-128ebe6804e0-bound-sa-token\") pod \"image-registry-6599b77f7d-5kvch\" (UID: \"2ade1f16-121b-46fc-95be-128ebe6804e0\") " pod="openshift-image-registry/image-registry-6599b77f7d-5kvch" Sep 08 03:55:40.610229 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:40.610185 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-87d2l\" (UniqueName: \"kubernetes.io/projected/a832821c-0523-4a74-9e04-c4772b079561-kube-api-access-87d2l\") pod \"ingress-canary-hjfnf\" (UID: \"a832821c-0523-4a74-9e04-c4772b079561\") " pod="openshift-ingress-canary/ingress-canary-hjfnf" Sep 08 03:55:40.610354 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:40.610330 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hps4l\" (UniqueName: \"kubernetes.io/projected/c46d90d1-2661-4b22-9f7d-9d2fd5eaabbb-kube-api-access-hps4l\") pod \"dns-default-2gs5x\" (UID: \"c46d90d1-2661-4b22-9f7d-9d2fd5eaabbb\") " pod="openshift-dns/dns-default-2gs5x" Sep 08 03:55:40.685603 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:40.685557 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-hjfnf" Sep 08 03:55:40.698734 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:40.698697 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4c94cf72-6e9d-4f8b-ae71-105e52f051a1-original-pull-secret\") pod \"global-pull-secret-syncer-6ffgk\" (UID: \"4c94cf72-6e9d-4f8b-ae71-105e52f051a1\") " pod="kube-system/global-pull-secret-syncer-6ffgk" Sep 08 03:55:40.698832 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:40.698787 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/be017881-2b6a-4fd2-b62d-4b5d3bd7b834-metrics-certs\") pod \"network-metrics-daemon-s2679\" (UID: \"be017881-2b6a-4fd2-b62d-4b5d3bd7b834\") " pod="openshift-multus/network-metrics-daemon-s2679" Sep 08 03:55:40.698890 ip-10-0-128-67 kubenswrapper[2571]: E0908 03:55:40.698833 2571 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 08 03:55:40.698959 ip-10-0-128-67 kubenswrapper[2571]: E0908 03:55:40.698904 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4c94cf72-6e9d-4f8b-ae71-105e52f051a1-original-pull-secret podName:4c94cf72-6e9d-4f8b-ae71-105e52f051a1 nodeName:}" failed. No retries permitted until 2026-09-08 03:56:12.698884417 +0000 UTC m=+66.169452808 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4c94cf72-6e9d-4f8b-ae71-105e52f051a1-original-pull-secret") pod "global-pull-secret-syncer-6ffgk" (UID: "4c94cf72-6e9d-4f8b-ae71-105e52f051a1") : object "kube-system"/"original-pull-secret" not registered Sep 08 03:55:40.698959 ip-10-0-128-67 kubenswrapper[2571]: E0908 03:55:40.698914 2571 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 08 03:55:40.699061 ip-10-0-128-67 kubenswrapper[2571]: E0908 03:55:40.699009 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/be017881-2b6a-4fd2-b62d-4b5d3bd7b834-metrics-certs podName:be017881-2b6a-4fd2-b62d-4b5d3bd7b834 nodeName:}" failed. No retries permitted until 2026-09-08 03:56:12.698983532 +0000 UTC m=+66.169551909 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/be017881-2b6a-4fd2-b62d-4b5d3bd7b834-metrics-certs") pod "network-metrics-daemon-s2679" (UID: "be017881-2b6a-4fd2-b62d-4b5d3bd7b834") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 08 03:55:40.900284 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:40.900206 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m9c82\" (UniqueName: \"kubernetes.io/projected/ab426e2f-9c8a-4457-a6b9-b98e4c94f4bf-kube-api-access-m9c82\") pod \"network-check-target-4wk4q\" (UID: \"ab426e2f-9c8a-4457-a6b9-b98e4c94f4bf\") " pod="openshift-network-diagnostics/network-check-target-4wk4q" Sep 08 03:55:40.900434 ip-10-0-128-67 kubenswrapper[2571]: E0908 03:55:40.900400 2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 08 03:55:40.900434 ip-10-0-128-67 kubenswrapper[2571]: E0908 03:55:40.900431 2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 08 03:55:40.900513 ip-10-0-128-67 kubenswrapper[2571]: E0908 03:55:40.900444 2571 projected.go:196] Error preparing data for projected volume kube-api-access-m9c82 for pod openshift-network-diagnostics/network-check-target-4wk4q: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 08 03:55:40.900513 ip-10-0-128-67 kubenswrapper[2571]: E0908 03:55:40.900509 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ab426e2f-9c8a-4457-a6b9-b98e4c94f4bf-kube-api-access-m9c82 podName:ab426e2f-9c8a-4457-a6b9-b98e4c94f4bf nodeName:}" failed. No retries permitted until 2026-09-08 03:56:12.900489374 +0000 UTC m=+66.371057752 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-m9c82" (UniqueName: "kubernetes.io/projected/ab426e2f-9c8a-4457-a6b9-b98e4c94f4bf-kube-api-access-m9c82") pod "network-check-target-4wk4q" (UID: "ab426e2f-9c8a-4457-a6b9-b98e4c94f4bf") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 08 03:55:41.101534 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:41.101483 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/4fd5d5dc-7953-4bd3-b65c-f81092c2af3d-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-h4zkr\" (UID: \"4fd5d5dc-7953-4bd3-b65c-f81092c2af3d\") " pod="openshift-network-console/networking-console-plugin-79977f9844-h4zkr" Sep 08 03:55:41.101994 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:41.101541 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2ade1f16-121b-46fc-95be-128ebe6804e0-registry-tls\") pod \"image-registry-6599b77f7d-5kvch\" (UID: \"2ade1f16-121b-46fc-95be-128ebe6804e0\") " pod="openshift-image-registry/image-registry-6599b77f7d-5kvch" Sep 08 03:55:41.101994 ip-10-0-128-67 kubenswrapper[2571]: E0908 03:55:41.101645 2571 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Sep 08 03:55:41.101994 ip-10-0-128-67 kubenswrapper[2571]: E0908 03:55:41.101718 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4fd5d5dc-7953-4bd3-b65c-f81092c2af3d-networking-console-plugin-cert podName:4fd5d5dc-7953-4bd3-b65c-f81092c2af3d nodeName:}" failed. No retries permitted until 2026-09-08 03:55:42.101700919 +0000 UTC m=+35.572269287 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/4fd5d5dc-7953-4bd3-b65c-f81092c2af3d-networking-console-plugin-cert") pod "networking-console-plugin-79977f9844-h4zkr" (UID: "4fd5d5dc-7953-4bd3-b65c-f81092c2af3d") : secret "networking-console-plugin-cert" not found Sep 08 03:55:41.101994 ip-10-0-128-67 kubenswrapper[2571]: E0908 03:55:41.101719 2571 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 08 03:55:41.101994 ip-10-0-128-67 kubenswrapper[2571]: E0908 03:55:41.101739 2571 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6599b77f7d-5kvch: secret "image-registry-tls" not found Sep 08 03:55:41.101994 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:41.101744 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c46d90d1-2661-4b22-9f7d-9d2fd5eaabbb-metrics-tls\") pod \"dns-default-2gs5x\" (UID: \"c46d90d1-2661-4b22-9f7d-9d2fd5eaabbb\") " pod="openshift-dns/dns-default-2gs5x" Sep 08 03:55:41.101994 ip-10-0-128-67 kubenswrapper[2571]: E0908 03:55:41.101804 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2ade1f16-121b-46fc-95be-128ebe6804e0-registry-tls podName:2ade1f16-121b-46fc-95be-128ebe6804e0 nodeName:}" failed. No retries permitted until 2026-09-08 03:55:42.101787758 +0000 UTC m=+35.572356120 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/2ade1f16-121b-46fc-95be-128ebe6804e0-registry-tls") pod "image-registry-6599b77f7d-5kvch" (UID: "2ade1f16-121b-46fc-95be-128ebe6804e0") : secret "image-registry-tls" not found Sep 08 03:55:41.101994 ip-10-0-128-67 kubenswrapper[2571]: E0908 03:55:41.101858 2571 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 08 03:55:41.101994 ip-10-0-128-67 kubenswrapper[2571]: E0908 03:55:41.101901 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c46d90d1-2661-4b22-9f7d-9d2fd5eaabbb-metrics-tls podName:c46d90d1-2661-4b22-9f7d-9d2fd5eaabbb nodeName:}" failed. No retries permitted until 2026-09-08 03:55:42.101889066 +0000 UTC m=+35.572457428 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c46d90d1-2661-4b22-9f7d-9d2fd5eaabbb-metrics-tls") pod "dns-default-2gs5x" (UID: "c46d90d1-2661-4b22-9f7d-9d2fd5eaabbb") : secret "dns-default-metrics-tls" not found Sep 08 03:55:41.762914 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:41.762839 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-hjfnf"] Sep 08 03:55:41.776708 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:41.776682 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda832821c_0523_4a74_9e04_c4772b079561.slice/crio-ebdbf031838a560124d304ba924b9ae1f17a0461f3f428257e370a2e500ef2d4 WatchSource:0}: Error finding container ebdbf031838a560124d304ba924b9ae1f17a0461f3f428257e370a2e500ef2d4: Status 404 returned error can't find the container with id ebdbf031838a560124d304ba924b9ae1f17a0461f3f428257e370a2e500ef2d4 Sep 08 03:55:42.061691 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:42.061656 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6ffgk" Sep 08 03:55:42.061877 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:42.061656 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4wk4q" Sep 08 03:55:42.061877 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:42.061656 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s2679" Sep 08 03:55:42.064583 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:42.064562 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Sep 08 03:55:42.065679 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:42.065645 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Sep 08 03:55:42.065776 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:42.065684 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Sep 08 03:55:42.065776 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:42.065696 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-gr9j5\"" Sep 08 03:55:42.065776 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:42.065730 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-tzmtk\"" Sep 08 03:55:42.065908 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:42.065817 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Sep 08 03:55:42.111354 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:42.111331 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c46d90d1-2661-4b22-9f7d-9d2fd5eaabbb-metrics-tls\") pod \"dns-default-2gs5x\" (UID: \"c46d90d1-2661-4b22-9f7d-9d2fd5eaabbb\") " pod="openshift-dns/dns-default-2gs5x" Sep 08 03:55:42.111905 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:42.111375 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/4fd5d5dc-7953-4bd3-b65c-f81092c2af3d-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-h4zkr\" (UID: \"4fd5d5dc-7953-4bd3-b65c-f81092c2af3d\") " pod="openshift-network-console/networking-console-plugin-79977f9844-h4zkr" Sep 08 03:55:42.111905 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:42.111398 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2ade1f16-121b-46fc-95be-128ebe6804e0-registry-tls\") pod \"image-registry-6599b77f7d-5kvch\" (UID: \"2ade1f16-121b-46fc-95be-128ebe6804e0\") " pod="openshift-image-registry/image-registry-6599b77f7d-5kvch" Sep 08 03:55:42.111905 ip-10-0-128-67 kubenswrapper[2571]: E0908 03:55:42.111470 2571 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 08 03:55:42.111905 ip-10-0-128-67 kubenswrapper[2571]: E0908 03:55:42.111478 2571 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Sep 08 03:55:42.111905 ip-10-0-128-67 kubenswrapper[2571]: E0908 03:55:42.111498 2571 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 08 03:55:42.111905 ip-10-0-128-67 kubenswrapper[2571]: E0908 03:55:42.111510 2571 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6599b77f7d-5kvch: secret "image-registry-tls" not found Sep 08 03:55:42.111905 ip-10-0-128-67 kubenswrapper[2571]: E0908 03:55:42.111526 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c46d90d1-2661-4b22-9f7d-9d2fd5eaabbb-metrics-tls podName:c46d90d1-2661-4b22-9f7d-9d2fd5eaabbb nodeName:}" failed. No retries permitted until 2026-09-08 03:55:44.111511576 +0000 UTC m=+37.582079953 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c46d90d1-2661-4b22-9f7d-9d2fd5eaabbb-metrics-tls") pod "dns-default-2gs5x" (UID: "c46d90d1-2661-4b22-9f7d-9d2fd5eaabbb") : secret "dns-default-metrics-tls" not found Sep 08 03:55:42.111905 ip-10-0-128-67 kubenswrapper[2571]: E0908 03:55:42.111541 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4fd5d5dc-7953-4bd3-b65c-f81092c2af3d-networking-console-plugin-cert podName:4fd5d5dc-7953-4bd3-b65c-f81092c2af3d nodeName:}" failed. No retries permitted until 2026-09-08 03:55:44.111533923 +0000 UTC m=+37.582102282 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/4fd5d5dc-7953-4bd3-b65c-f81092c2af3d-networking-console-plugin-cert") pod "networking-console-plugin-79977f9844-h4zkr" (UID: "4fd5d5dc-7953-4bd3-b65c-f81092c2af3d") : secret "networking-console-plugin-cert" not found Sep 08 03:55:42.111905 ip-10-0-128-67 kubenswrapper[2571]: E0908 03:55:42.111551 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2ade1f16-121b-46fc-95be-128ebe6804e0-registry-tls podName:2ade1f16-121b-46fc-95be-128ebe6804e0 nodeName:}" failed. No retries permitted until 2026-09-08 03:55:44.111546194 +0000 UTC m=+37.582114553 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/2ade1f16-121b-46fc-95be-128ebe6804e0-registry-tls") pod "image-registry-6599b77f7d-5kvch" (UID: "2ade1f16-121b-46fc-95be-128ebe6804e0") : secret "image-registry-tls" not found Sep 08 03:55:42.298440 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:42.298400 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-hjfnf" event={"ID":"a832821c-0523-4a74-9e04-c4772b079561","Type":"ContainerStarted","Data":"ebdbf031838a560124d304ba924b9ae1f17a0461f3f428257e370a2e500ef2d4"} Sep 08 03:55:42.301830 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:42.301798 2571 generic.go:356] "Generic (PLEG): container finished" podID="d9fbef9f-7075-4727-88c9-b5feeaf043db" containerID="f270b6cca390c49eb507aab7ad24ec6e527270f339cb06ecfd48cb5b3c7ba3aa" exitCode=0 Sep 08 03:55:42.301966 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:42.301847 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wc8bl" event={"ID":"d9fbef9f-7075-4727-88c9-b5feeaf043db","Type":"ContainerDied","Data":"f270b6cca390c49eb507aab7ad24ec6e527270f339cb06ecfd48cb5b3c7ba3aa"} Sep 08 03:55:43.307322 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:43.307286 2571 generic.go:356] "Generic (PLEG): container finished" podID="d9fbef9f-7075-4727-88c9-b5feeaf043db" containerID="5820008c86618cc37a968bb51ca4b727e80bf0ecb63dee20f8e551a9d99629b2" exitCode=0 Sep 08 03:55:43.307718 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:43.307348 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wc8bl" event={"ID":"d9fbef9f-7075-4727-88c9-b5feeaf043db","Type":"ContainerDied","Data":"5820008c86618cc37a968bb51ca4b727e80bf0ecb63dee20f8e551a9d99629b2"} Sep 08 03:55:44.129301 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:44.129038 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c46d90d1-2661-4b22-9f7d-9d2fd5eaabbb-metrics-tls\") pod \"dns-default-2gs5x\" (UID: \"c46d90d1-2661-4b22-9f7d-9d2fd5eaabbb\") " pod="openshift-dns/dns-default-2gs5x" Sep 08 03:55:44.129301 ip-10-0-128-67 kubenswrapper[2571]: E0908 03:55:44.129209 2571 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 08 03:55:44.129301 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:44.129251 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/4fd5d5dc-7953-4bd3-b65c-f81092c2af3d-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-h4zkr\" (UID: \"4fd5d5dc-7953-4bd3-b65c-f81092c2af3d\") " pod="openshift-network-console/networking-console-plugin-79977f9844-h4zkr" Sep 08 03:55:44.129301 ip-10-0-128-67 kubenswrapper[2571]: E0908 03:55:44.129276 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c46d90d1-2661-4b22-9f7d-9d2fd5eaabbb-metrics-tls podName:c46d90d1-2661-4b22-9f7d-9d2fd5eaabbb nodeName:}" failed. No retries permitted until 2026-09-08 03:55:48.129259472 +0000 UTC m=+41.599827831 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c46d90d1-2661-4b22-9f7d-9d2fd5eaabbb-metrics-tls") pod "dns-default-2gs5x" (UID: "c46d90d1-2661-4b22-9f7d-9d2fd5eaabbb") : secret "dns-default-metrics-tls" not found Sep 08 03:55:44.129562 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:44.129308 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2ade1f16-121b-46fc-95be-128ebe6804e0-registry-tls\") pod \"image-registry-6599b77f7d-5kvch\" (UID: \"2ade1f16-121b-46fc-95be-128ebe6804e0\") " pod="openshift-image-registry/image-registry-6599b77f7d-5kvch" Sep 08 03:55:44.129562 ip-10-0-128-67 kubenswrapper[2571]: E0908 03:55:44.129322 2571 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Sep 08 03:55:44.129562 ip-10-0-128-67 kubenswrapper[2571]: E0908 03:55:44.129379 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4fd5d5dc-7953-4bd3-b65c-f81092c2af3d-networking-console-plugin-cert podName:4fd5d5dc-7953-4bd3-b65c-f81092c2af3d nodeName:}" failed. No retries permitted until 2026-09-08 03:55:48.129351656 +0000 UTC m=+41.599920029 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/4fd5d5dc-7953-4bd3-b65c-f81092c2af3d-networking-console-plugin-cert") pod "networking-console-plugin-79977f9844-h4zkr" (UID: "4fd5d5dc-7953-4bd3-b65c-f81092c2af3d") : secret "networking-console-plugin-cert" not found Sep 08 03:55:44.129562 ip-10-0-128-67 kubenswrapper[2571]: E0908 03:55:44.129404 2571 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 08 03:55:44.129562 ip-10-0-128-67 kubenswrapper[2571]: E0908 03:55:44.129415 2571 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6599b77f7d-5kvch: secret "image-registry-tls" not found Sep 08 03:55:44.129562 ip-10-0-128-67 kubenswrapper[2571]: E0908 03:55:44.129453 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2ade1f16-121b-46fc-95be-128ebe6804e0-registry-tls podName:2ade1f16-121b-46fc-95be-128ebe6804e0 nodeName:}" failed. No retries permitted until 2026-09-08 03:55:48.129442102 +0000 UTC m=+41.600010466 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/2ade1f16-121b-46fc-95be-128ebe6804e0-registry-tls") pod "image-registry-6599b77f7d-5kvch" (UID: "2ade1f16-121b-46fc-95be-128ebe6804e0") : secret "image-registry-tls" not found Sep 08 03:55:44.311561 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:44.311528 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-hjfnf" event={"ID":"a832821c-0523-4a74-9e04-c4772b079561","Type":"ContainerStarted","Data":"33bcf1b2e9680e9a1e21b034a3fe8dd7ee391f1b6c808f220770daf8a39b51f3"} Sep 08 03:55:44.314795 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:44.314772 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wc8bl" event={"ID":"d9fbef9f-7075-4727-88c9-b5feeaf043db","Type":"ContainerStarted","Data":"47a969f6cfaa6e1003ac58ff406b06f743fc86ef492f7e5790e1d620291dc8a5"} Sep 08 03:55:44.333312 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:44.333262 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-hjfnf" podStartSLOduration=2.189791887 podStartE2EDuration="4.333246375s" totalImagesPullingTime="2.143454488s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 03:55:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 03:55:44.332218319 +0000 UTC m=+37.802786700" watchObservedRunningTime="2026-09-08 03:55:44.333246375 +0000 UTC m=+37.803814755" Sep 08 03:55:44.361232 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:44.361182 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-wc8bl" podStartSLOduration=9.312976976 podStartE2EDuration="37.361166502s" totalImagesPullingTime="28.048189526s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 03:55:07 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 03:55:44.361137902 +0000 UTC m=+37.831706284" watchObservedRunningTime="2026-09-08 03:55:44.361166502 +0000 UTC m=+37.831734883" Sep 08 03:55:48.159604 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:48.159562 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c46d90d1-2661-4b22-9f7d-9d2fd5eaabbb-metrics-tls\") pod \"dns-default-2gs5x\" (UID: \"c46d90d1-2661-4b22-9f7d-9d2fd5eaabbb\") " pod="openshift-dns/dns-default-2gs5x" Sep 08 03:55:48.159604 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:48.159611 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/4fd5d5dc-7953-4bd3-b65c-f81092c2af3d-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-h4zkr\" (UID: \"4fd5d5dc-7953-4bd3-b65c-f81092c2af3d\") " pod="openshift-network-console/networking-console-plugin-79977f9844-h4zkr" Sep 08 03:55:48.160043 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:48.159631 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2ade1f16-121b-46fc-95be-128ebe6804e0-registry-tls\") pod \"image-registry-6599b77f7d-5kvch\" (UID: \"2ade1f16-121b-46fc-95be-128ebe6804e0\") " pod="openshift-image-registry/image-registry-6599b77f7d-5kvch" Sep 08 03:55:48.160043 ip-10-0-128-67 kubenswrapper[2571]: E0908 03:55:48.159736 2571 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Sep 08 03:55:48.160043 ip-10-0-128-67 kubenswrapper[2571]: E0908 03:55:48.159810 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4fd5d5dc-7953-4bd3-b65c-f81092c2af3d-networking-console-plugin-cert podName:4fd5d5dc-7953-4bd3-b65c-f81092c2af3d nodeName:}" failed. No retries permitted until 2026-09-08 03:55:56.159794153 +0000 UTC m=+49.630362515 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/4fd5d5dc-7953-4bd3-b65c-f81092c2af3d-networking-console-plugin-cert") pod "networking-console-plugin-79977f9844-h4zkr" (UID: "4fd5d5dc-7953-4bd3-b65c-f81092c2af3d") : secret "networking-console-plugin-cert" not found Sep 08 03:55:48.160043 ip-10-0-128-67 kubenswrapper[2571]: E0908 03:55:48.159736 2571 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 08 03:55:48.160043 ip-10-0-128-67 kubenswrapper[2571]: E0908 03:55:48.159873 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c46d90d1-2661-4b22-9f7d-9d2fd5eaabbb-metrics-tls podName:c46d90d1-2661-4b22-9f7d-9d2fd5eaabbb nodeName:}" failed. No retries permitted until 2026-09-08 03:55:56.159861729 +0000 UTC m=+49.630430088 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c46d90d1-2661-4b22-9f7d-9d2fd5eaabbb-metrics-tls") pod "dns-default-2gs5x" (UID: "c46d90d1-2661-4b22-9f7d-9d2fd5eaabbb") : secret "dns-default-metrics-tls" not found Sep 08 03:55:48.160043 ip-10-0-128-67 kubenswrapper[2571]: E0908 03:55:48.159742 2571 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 08 03:55:48.160043 ip-10-0-128-67 kubenswrapper[2571]: E0908 03:55:48.159887 2571 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6599b77f7d-5kvch: secret "image-registry-tls" not found Sep 08 03:55:48.160043 ip-10-0-128-67 kubenswrapper[2571]: E0908 03:55:48.159906 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2ade1f16-121b-46fc-95be-128ebe6804e0-registry-tls podName:2ade1f16-121b-46fc-95be-128ebe6804e0 nodeName:}" failed. No retries permitted until 2026-09-08 03:55:56.159900682 +0000 UTC m=+49.630469041 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/2ade1f16-121b-46fc-95be-128ebe6804e0-registry-tls") pod "image-registry-6599b77f7d-5kvch" (UID: "2ade1f16-121b-46fc-95be-128ebe6804e0") : secret "image-registry-tls" not found Sep 08 03:55:50.754966 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:50.754930 2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5b8c949588-5mvgl"] Sep 08 03:55:50.778274 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:50.778247 2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-599d7f6fc4-2flgg"] Sep 08 03:55:50.778411 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:50.778392 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5b8c949588-5mvgl" Sep 08 03:55:50.782423 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:50.782402 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Sep 08 03:55:50.783285 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:50.783265 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" Sep 08 03:55:50.783463 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:50.783440 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Sep 08 03:55:50.783803 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:50.783785 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Sep 08 03:55:50.783865 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:50.783785 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-7ldj4\"" Sep 08 03:55:50.790098 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:50.790078 2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8446f68685-n2jlb"] Sep 08 03:55:50.790196 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:50.790188 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-599d7f6fc4-2flgg" Sep 08 03:55:50.793283 ip-10-0-128-67 kubenswrapper[2571]: E0908 03:55:50.793252 2571 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"work-manager-hub-kubeconfig\" is forbidden: User \"system:node:ip-10-0-128-67.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"open-cluster-management-agent-addon\": no relationship found between node 'ip-10-0-128-67.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\"" type="*v1.Secret" Sep 08 03:55:50.799717 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:50.799696 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5b8c949588-5mvgl"] Sep 08 03:55:50.799799 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:50.799781 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8446f68685-n2jlb" Sep 08 03:55:50.808516 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:50.808495 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\"" Sep 08 03:55:50.808770 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:50.808755 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\"" Sep 08 03:55:50.808770 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:50.808763 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\"" Sep 08 03:55:50.808859 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:50.808784 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\"" Sep 08 03:55:50.819692 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:50.819674 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-599d7f6fc4-2flgg"] Sep 08 03:55:50.838795 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:50.838774 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8446f68685-n2jlb"] Sep 08 03:55:50.879248 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:50.879225 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/07c65540-2698-4a20-b45a-9d5100c729c1-klusterlet-config\") pod \"klusterlet-addon-workmgr-599d7f6fc4-2flgg\" (UID: \"07c65540-2698-4a20-b45a-9d5100c729c1\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-599d7f6fc4-2flgg" Sep 08 03:55:50.879338 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:50.879251 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/aa1a9b42-16d9-4de1-a54e-4ed2cd78447a-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-8446f68685-n2jlb\" (UID: \"aa1a9b42-16d9-4de1-a54e-4ed2cd78447a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8446f68685-n2jlb" Sep 08 03:55:50.879338 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:50.879272 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/aa1a9b42-16d9-4de1-a54e-4ed2cd78447a-additional-service-ca\") pod \"cluster-proxy-proxy-agent-8446f68685-n2jlb\" (UID: \"aa1a9b42-16d9-4de1-a54e-4ed2cd78447a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8446f68685-n2jlb" Sep 08 03:55:50.879338 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:50.879293 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6gzld\" (UniqueName: \"kubernetes.io/projected/ebefc02e-ee24-4a3d-bb9c-a4289b380485-kube-api-access-6gzld\") pod \"managed-serviceaccount-addon-agent-5b8c949588-5mvgl\" (UID: \"ebefc02e-ee24-4a3d-bb9c-a4289b380485\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5b8c949588-5mvgl" Sep 08 03:55:50.879434 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:50.879368 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/07c65540-2698-4a20-b45a-9d5100c729c1-tmp\") pod \"klusterlet-addon-workmgr-599d7f6fc4-2flgg\" (UID: \"07c65540-2698-4a20-b45a-9d5100c729c1\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-599d7f6fc4-2flgg" Sep 08 03:55:50.879434 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:50.879394 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/aa1a9b42-16d9-4de1-a54e-4ed2cd78447a-ca\") pod \"cluster-proxy-proxy-agent-8446f68685-n2jlb\" (UID: \"aa1a9b42-16d9-4de1-a54e-4ed2cd78447a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8446f68685-n2jlb" Sep 08 03:55:50.879434 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:50.879414 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8wzlg\" (UniqueName: \"kubernetes.io/projected/07c65540-2698-4a20-b45a-9d5100c729c1-kube-api-access-8wzlg\") pod \"klusterlet-addon-workmgr-599d7f6fc4-2flgg\" (UID: \"07c65540-2698-4a20-b45a-9d5100c729c1\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-599d7f6fc4-2flgg" Sep 08 03:55:50.879434 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:50.879430 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/aa1a9b42-16d9-4de1-a54e-4ed2cd78447a-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-8446f68685-n2jlb\" (UID: \"aa1a9b42-16d9-4de1-a54e-4ed2cd78447a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8446f68685-n2jlb" Sep 08 03:55:50.879551 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:50.879462 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/aa1a9b42-16d9-4de1-a54e-4ed2cd78447a-hub\") pod \"cluster-proxy-proxy-agent-8446f68685-n2jlb\" (UID: \"aa1a9b42-16d9-4de1-a54e-4ed2cd78447a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8446f68685-n2jlb" Sep 08 03:55:50.879551 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:50.879497 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/ebefc02e-ee24-4a3d-bb9c-a4289b380485-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-5b8c949588-5mvgl\" (UID: \"ebefc02e-ee24-4a3d-bb9c-a4289b380485\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5b8c949588-5mvgl" Sep 08 03:55:50.879551 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:50.879514 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9dmg8\" (UniqueName: \"kubernetes.io/projected/aa1a9b42-16d9-4de1-a54e-4ed2cd78447a-kube-api-access-9dmg8\") pod \"cluster-proxy-proxy-agent-8446f68685-n2jlb\" (UID: \"aa1a9b42-16d9-4de1-a54e-4ed2cd78447a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8446f68685-n2jlb" Sep 08 03:55:50.980722 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:50.980688 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6gzld\" (UniqueName: \"kubernetes.io/projected/ebefc02e-ee24-4a3d-bb9c-a4289b380485-kube-api-access-6gzld\") pod \"managed-serviceaccount-addon-agent-5b8c949588-5mvgl\" (UID: \"ebefc02e-ee24-4a3d-bb9c-a4289b380485\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5b8c949588-5mvgl" Sep 08 03:55:50.980842 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:50.980742 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/07c65540-2698-4a20-b45a-9d5100c729c1-tmp\") pod \"klusterlet-addon-workmgr-599d7f6fc4-2flgg\" (UID: \"07c65540-2698-4a20-b45a-9d5100c729c1\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-599d7f6fc4-2flgg" Sep 08 03:55:50.980883 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:50.980853 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/aa1a9b42-16d9-4de1-a54e-4ed2cd78447a-ca\") pod \"cluster-proxy-proxy-agent-8446f68685-n2jlb\" (UID: \"aa1a9b42-16d9-4de1-a54e-4ed2cd78447a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8446f68685-n2jlb" Sep 08 03:55:50.980994 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:50.980884 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8wzlg\" (UniqueName: \"kubernetes.io/projected/07c65540-2698-4a20-b45a-9d5100c729c1-kube-api-access-8wzlg\") pod \"klusterlet-addon-workmgr-599d7f6fc4-2flgg\" (UID: \"07c65540-2698-4a20-b45a-9d5100c729c1\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-599d7f6fc4-2flgg" Sep 08 03:55:50.980994 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:50.980911 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/aa1a9b42-16d9-4de1-a54e-4ed2cd78447a-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-8446f68685-n2jlb\" (UID: \"aa1a9b42-16d9-4de1-a54e-4ed2cd78447a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8446f68685-n2jlb" Sep 08 03:55:50.981074 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:50.980999 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/aa1a9b42-16d9-4de1-a54e-4ed2cd78447a-hub\") pod \"cluster-proxy-proxy-agent-8446f68685-n2jlb\" (UID: \"aa1a9b42-16d9-4de1-a54e-4ed2cd78447a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8446f68685-n2jlb" Sep 08 03:55:50.981074 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:50.981044 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/ebefc02e-ee24-4a3d-bb9c-a4289b380485-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-5b8c949588-5mvgl\" (UID: \"ebefc02e-ee24-4a3d-bb9c-a4289b380485\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5b8c949588-5mvgl" Sep 08 03:55:50.981074 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:50.981061 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9dmg8\" (UniqueName: \"kubernetes.io/projected/aa1a9b42-16d9-4de1-a54e-4ed2cd78447a-kube-api-access-9dmg8\") pod \"cluster-proxy-proxy-agent-8446f68685-n2jlb\" (UID: \"aa1a9b42-16d9-4de1-a54e-4ed2cd78447a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8446f68685-n2jlb" Sep 08 03:55:50.981212 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:50.981112 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/07c65540-2698-4a20-b45a-9d5100c729c1-tmp\") pod \"klusterlet-addon-workmgr-599d7f6fc4-2flgg\" (UID: \"07c65540-2698-4a20-b45a-9d5100c729c1\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-599d7f6fc4-2flgg" Sep 08 03:55:50.981212 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:50.981125 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/07c65540-2698-4a20-b45a-9d5100c729c1-klusterlet-config\") pod \"klusterlet-addon-workmgr-599d7f6fc4-2flgg\" (UID: \"07c65540-2698-4a20-b45a-9d5100c729c1\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-599d7f6fc4-2flgg" Sep 08 03:55:50.981212 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:50.981156 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/aa1a9b42-16d9-4de1-a54e-4ed2cd78447a-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-8446f68685-n2jlb\" (UID: \"aa1a9b42-16d9-4de1-a54e-4ed2cd78447a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8446f68685-n2jlb" Sep 08 03:55:50.981212 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:50.981189 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/aa1a9b42-16d9-4de1-a54e-4ed2cd78447a-additional-service-ca\") pod \"cluster-proxy-proxy-agent-8446f68685-n2jlb\" (UID: \"aa1a9b42-16d9-4de1-a54e-4ed2cd78447a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8446f68685-n2jlb" Sep 08 03:55:50.981875 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:50.981854 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/aa1a9b42-16d9-4de1-a54e-4ed2cd78447a-additional-service-ca\") pod \"cluster-proxy-proxy-agent-8446f68685-n2jlb\" (UID: \"aa1a9b42-16d9-4de1-a54e-4ed2cd78447a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8446f68685-n2jlb" Sep 08 03:55:50.984440 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:50.984415 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/aa1a9b42-16d9-4de1-a54e-4ed2cd78447a-ca\") pod \"cluster-proxy-proxy-agent-8446f68685-n2jlb\" (UID: \"aa1a9b42-16d9-4de1-a54e-4ed2cd78447a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8446f68685-n2jlb" Sep 08 03:55:50.984518 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:50.984504 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/aa1a9b42-16d9-4de1-a54e-4ed2cd78447a-hub\") pod \"cluster-proxy-proxy-agent-8446f68685-n2jlb\" (UID: \"aa1a9b42-16d9-4de1-a54e-4ed2cd78447a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8446f68685-n2jlb" Sep 08 03:55:50.984584 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:50.984563 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/aa1a9b42-16d9-4de1-a54e-4ed2cd78447a-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-8446f68685-n2jlb\" (UID: \"aa1a9b42-16d9-4de1-a54e-4ed2cd78447a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8446f68685-n2jlb" Sep 08 03:55:50.984620 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:50.984581 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/ebefc02e-ee24-4a3d-bb9c-a4289b380485-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-5b8c949588-5mvgl\" (UID: \"ebefc02e-ee24-4a3d-bb9c-a4289b380485\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5b8c949588-5mvgl" Sep 08 03:55:50.984620 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:50.984613 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/aa1a9b42-16d9-4de1-a54e-4ed2cd78447a-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-8446f68685-n2jlb\" (UID: \"aa1a9b42-16d9-4de1-a54e-4ed2cd78447a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8446f68685-n2jlb" Sep 08 03:55:50.991010 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:50.990990 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6gzld\" (UniqueName: \"kubernetes.io/projected/ebefc02e-ee24-4a3d-bb9c-a4289b380485-kube-api-access-6gzld\") pod \"managed-serviceaccount-addon-agent-5b8c949588-5mvgl\" (UID: \"ebefc02e-ee24-4a3d-bb9c-a4289b380485\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5b8c949588-5mvgl" Sep 08 03:55:50.992782 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:50.992755 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8wzlg\" (UniqueName: \"kubernetes.io/projected/07c65540-2698-4a20-b45a-9d5100c729c1-kube-api-access-8wzlg\") pod \"klusterlet-addon-workmgr-599d7f6fc4-2flgg\" (UID: \"07c65540-2698-4a20-b45a-9d5100c729c1\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-599d7f6fc4-2flgg" Sep 08 03:55:50.993464 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:50.993444 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9dmg8\" (UniqueName: \"kubernetes.io/projected/aa1a9b42-16d9-4de1-a54e-4ed2cd78447a-kube-api-access-9dmg8\") pod \"cluster-proxy-proxy-agent-8446f68685-n2jlb\" (UID: \"aa1a9b42-16d9-4de1-a54e-4ed2cd78447a\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8446f68685-n2jlb" Sep 08 03:55:51.101796 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:51.101767 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5b8c949588-5mvgl" Sep 08 03:55:51.115341 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:51.115316 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8446f68685-n2jlb" Sep 08 03:55:51.393459 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:51.393389 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5b8c949588-5mvgl"] Sep 08 03:55:51.396485 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:51.396459 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podebefc02e_ee24_4a3d_bb9c_a4289b380485.slice/crio-73c3c362b92b4d58b93223232b264f637dc767f29089c03666401d1f85c0970d WatchSource:0}: Error finding container 73c3c362b92b4d58b93223232b264f637dc767f29089c03666401d1f85c0970d: Status 404 returned error can't find the container with id 73c3c362b92b4d58b93223232b264f637dc767f29089c03666401d1f85c0970d Sep 08 03:55:51.429795 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:51.429765 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8446f68685-n2jlb"] Sep 08 03:55:51.432337 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:51.432314 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podaa1a9b42_16d9_4de1_a54e_4ed2cd78447a.slice/crio-10bb21395e5420a8d2b2b124cafe39061bb2da57a85c224b4f3523efa53c15e4 WatchSource:0}: Error finding container 10bb21395e5420a8d2b2b124cafe39061bb2da57a85c224b4f3523efa53c15e4: Status 404 returned error can't find the container with id 10bb21395e5420a8d2b2b124cafe39061bb2da57a85c224b4f3523efa53c15e4 Sep 08 03:55:51.880868 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:51.880833 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\"" Sep 08 03:55:51.884075 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:51.884050 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/07c65540-2698-4a20-b45a-9d5100c729c1-klusterlet-config\") pod \"klusterlet-addon-workmgr-599d7f6fc4-2flgg\" (UID: \"07c65540-2698-4a20-b45a-9d5100c729c1\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-599d7f6fc4-2flgg" Sep 08 03:55:52.010541 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:52.010508 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-599d7f6fc4-2flgg" Sep 08 03:55:52.324137 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:52.324032 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-599d7f6fc4-2flgg"] Sep 08 03:55:52.328514 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:55:52.328454 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod07c65540_2698_4a20_b45a_9d5100c729c1.slice/crio-44adf6394f7740e446d191fe982214172b7976287ffb0af3b3f737920e83cc83 WatchSource:0}: Error finding container 44adf6394f7740e446d191fe982214172b7976287ffb0af3b3f737920e83cc83: Status 404 returned error can't find the container with id 44adf6394f7740e446d191fe982214172b7976287ffb0af3b3f737920e83cc83 Sep 08 03:55:52.337086 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:52.337052 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8446f68685-n2jlb" event={"ID":"aa1a9b42-16d9-4de1-a54e-4ed2cd78447a","Type":"ContainerStarted","Data":"10bb21395e5420a8d2b2b124cafe39061bb2da57a85c224b4f3523efa53c15e4"} Sep 08 03:55:52.338434 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:52.338404 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5b8c949588-5mvgl" event={"ID":"ebefc02e-ee24-4a3d-bb9c-a4289b380485","Type":"ContainerStarted","Data":"73c3c362b92b4d58b93223232b264f637dc767f29089c03666401d1f85c0970d"} Sep 08 03:55:52.339979 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:52.339951 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-599d7f6fc4-2flgg" event={"ID":"07c65540-2698-4a20-b45a-9d5100c729c1","Type":"ContainerStarted","Data":"44adf6394f7740e446d191fe982214172b7976287ffb0af3b3f737920e83cc83"} Sep 08 03:55:56.226695 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:56.226651 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/4fd5d5dc-7953-4bd3-b65c-f81092c2af3d-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-h4zkr\" (UID: \"4fd5d5dc-7953-4bd3-b65c-f81092c2af3d\") " pod="openshift-network-console/networking-console-plugin-79977f9844-h4zkr" Sep 08 03:55:56.227160 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:56.226712 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2ade1f16-121b-46fc-95be-128ebe6804e0-registry-tls\") pod \"image-registry-6599b77f7d-5kvch\" (UID: \"2ade1f16-121b-46fc-95be-128ebe6804e0\") " pod="openshift-image-registry/image-registry-6599b77f7d-5kvch" Sep 08 03:55:56.227160 ip-10-0-128-67 kubenswrapper[2571]: E0908 03:55:56.226813 2571 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 08 03:55:56.227160 ip-10-0-128-67 kubenswrapper[2571]: E0908 03:55:56.226824 2571 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6599b77f7d-5kvch: secret "image-registry-tls" not found Sep 08 03:55:56.227160 ip-10-0-128-67 kubenswrapper[2571]: E0908 03:55:56.226835 2571 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Sep 08 03:55:56.227160 ip-10-0-128-67 kubenswrapper[2571]: E0908 03:55:56.226889 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2ade1f16-121b-46fc-95be-128ebe6804e0-registry-tls podName:2ade1f16-121b-46fc-95be-128ebe6804e0 nodeName:}" failed. No retries permitted until 2026-09-08 03:56:12.226871101 +0000 UTC m=+65.697439478 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/2ade1f16-121b-46fc-95be-128ebe6804e0-registry-tls") pod "image-registry-6599b77f7d-5kvch" (UID: "2ade1f16-121b-46fc-95be-128ebe6804e0") : secret "image-registry-tls" not found Sep 08 03:55:56.227160 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:56.226956 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c46d90d1-2661-4b22-9f7d-9d2fd5eaabbb-metrics-tls\") pod \"dns-default-2gs5x\" (UID: \"c46d90d1-2661-4b22-9f7d-9d2fd5eaabbb\") " pod="openshift-dns/dns-default-2gs5x" Sep 08 03:55:56.227160 ip-10-0-128-67 kubenswrapper[2571]: E0908 03:55:56.227023 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4fd5d5dc-7953-4bd3-b65c-f81092c2af3d-networking-console-plugin-cert podName:4fd5d5dc-7953-4bd3-b65c-f81092c2af3d nodeName:}" failed. No retries permitted until 2026-09-08 03:56:12.227004452 +0000 UTC m=+65.697572815 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/4fd5d5dc-7953-4bd3-b65c-f81092c2af3d-networking-console-plugin-cert") pod "networking-console-plugin-79977f9844-h4zkr" (UID: "4fd5d5dc-7953-4bd3-b65c-f81092c2af3d") : secret "networking-console-plugin-cert" not found Sep 08 03:55:56.227160 ip-10-0-128-67 kubenswrapper[2571]: E0908 03:55:56.227047 2571 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 08 03:55:56.227160 ip-10-0-128-67 kubenswrapper[2571]: E0908 03:55:56.227088 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c46d90d1-2661-4b22-9f7d-9d2fd5eaabbb-metrics-tls podName:c46d90d1-2661-4b22-9f7d-9d2fd5eaabbb nodeName:}" failed. No retries permitted until 2026-09-08 03:56:12.22707598 +0000 UTC m=+65.697644355 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c46d90d1-2661-4b22-9f7d-9d2fd5eaabbb-metrics-tls") pod "dns-default-2gs5x" (UID: "c46d90d1-2661-4b22-9f7d-9d2fd5eaabbb") : secret "dns-default-metrics-tls" not found Sep 08 03:55:59.364477 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:59.364442 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5b8c949588-5mvgl" event={"ID":"ebefc02e-ee24-4a3d-bb9c-a4289b380485","Type":"ContainerStarted","Data":"9f8dc6094f722e6119f932cd22944f91d73e7530ecdc9a85f738282f8c9f9655"} Sep 08 03:55:59.365983 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:59.365950 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-599d7f6fc4-2flgg" event={"ID":"07c65540-2698-4a20-b45a-9d5100c729c1","Type":"ContainerStarted","Data":"eb1c36f2c69589226e297357abc380033afff4780c4ba56ce3e1c0677df9261a"} Sep 08 03:55:59.366126 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:59.366075 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-599d7f6fc4-2flgg" Sep 08 03:55:59.368005 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:59.367981 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-599d7f6fc4-2flgg" Sep 08 03:55:59.368182 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:59.368165 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8446f68685-n2jlb" event={"ID":"aa1a9b42-16d9-4de1-a54e-4ed2cd78447a","Type":"ContainerStarted","Data":"dd79d263c4298e61ebbe47432d05886d7eefda5413eacca0c3d1f95b10613507"} Sep 08 03:55:59.368235 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:59.368191 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8446f68685-n2jlb" event={"ID":"aa1a9b42-16d9-4de1-a54e-4ed2cd78447a","Type":"ContainerStarted","Data":"29f1977680230750ff8fe229d7f45f72e235e4193f3ce85b5eaeaa7d3a171e39"} Sep 08 03:55:59.368235 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:59.368206 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8446f68685-n2jlb" event={"ID":"aa1a9b42-16d9-4de1-a54e-4ed2cd78447a","Type":"ContainerStarted","Data":"d73372526b96a6e728af013eee15d78ec43cc93a025f448cda2aa7114a84f9b2"} Sep 08 03:55:59.390861 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:59.390812 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5b8c949588-5mvgl" podStartSLOduration=2.227902421 podStartE2EDuration="9.390798876s" totalImagesPullingTime="7.162896455s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 03:55:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 03:55:59.386990558 +0000 UTC m=+52.857558940" watchObservedRunningTime="2026-09-08 03:55:59.390798876 +0000 UTC m=+52.861367258" Sep 08 03:55:59.415581 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:59.415541 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8446f68685-n2jlb" podStartSLOduration=2.246264851 podStartE2EDuration="9.415526328s" totalImagesPullingTime="7.169261477s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 03:55:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 03:55:59.41469456 +0000 UTC m=+52.885262931" watchObservedRunningTime="2026-09-08 03:55:59.415526328 +0000 UTC m=+52.886094709" Sep 08 03:55:59.439534 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:55:59.439495 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-599d7f6fc4-2flgg" podStartSLOduration=3.151444505 podStartE2EDuration="9.439481751s" totalImagesPullingTime="6.288037246s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 03:55:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 03:55:59.438071387 +0000 UTC m=+52.908639767" watchObservedRunningTime="2026-09-08 03:55:59.439481751 +0000 UTC m=+52.910050129" Sep 08 03:56:06.293256 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:56:06.293223 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-7mnct" Sep 08 03:56:12.251411 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:56:12.251367 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/4fd5d5dc-7953-4bd3-b65c-f81092c2af3d-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-h4zkr\" (UID: \"4fd5d5dc-7953-4bd3-b65c-f81092c2af3d\") " pod="openshift-network-console/networking-console-plugin-79977f9844-h4zkr" Sep 08 03:56:12.251411 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:56:12.251414 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2ade1f16-121b-46fc-95be-128ebe6804e0-registry-tls\") pod \"image-registry-6599b77f7d-5kvch\" (UID: \"2ade1f16-121b-46fc-95be-128ebe6804e0\") " pod="openshift-image-registry/image-registry-6599b77f7d-5kvch" Sep 08 03:56:12.251913 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:56:12.251494 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c46d90d1-2661-4b22-9f7d-9d2fd5eaabbb-metrics-tls\") pod \"dns-default-2gs5x\" (UID: \"c46d90d1-2661-4b22-9f7d-9d2fd5eaabbb\") " pod="openshift-dns/dns-default-2gs5x" Sep 08 03:56:12.251913 ip-10-0-128-67 kubenswrapper[2571]: E0908 03:56:12.251511 2571 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Sep 08 03:56:12.251913 ip-10-0-128-67 kubenswrapper[2571]: E0908 03:56:12.251568 2571 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 08 03:56:12.251913 ip-10-0-128-67 kubenswrapper[2571]: E0908 03:56:12.251584 2571 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6599b77f7d-5kvch: secret "image-registry-tls" not found Sep 08 03:56:12.251913 ip-10-0-128-67 kubenswrapper[2571]: E0908 03:56:12.251608 2571 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 08 03:56:12.251913 ip-10-0-128-67 kubenswrapper[2571]: E0908 03:56:12.251576 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4fd5d5dc-7953-4bd3-b65c-f81092c2af3d-networking-console-plugin-cert podName:4fd5d5dc-7953-4bd3-b65c-f81092c2af3d nodeName:}" failed. No retries permitted until 2026-09-08 03:56:44.251559757 +0000 UTC m=+97.722128115 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/4fd5d5dc-7953-4bd3-b65c-f81092c2af3d-networking-console-plugin-cert") pod "networking-console-plugin-79977f9844-h4zkr" (UID: "4fd5d5dc-7953-4bd3-b65c-f81092c2af3d") : secret "networking-console-plugin-cert" not found Sep 08 03:56:12.251913 ip-10-0-128-67 kubenswrapper[2571]: E0908 03:56:12.251645 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2ade1f16-121b-46fc-95be-128ebe6804e0-registry-tls podName:2ade1f16-121b-46fc-95be-128ebe6804e0 nodeName:}" failed. No retries permitted until 2026-09-08 03:56:44.251632747 +0000 UTC m=+97.722201106 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/2ade1f16-121b-46fc-95be-128ebe6804e0-registry-tls") pod "image-registry-6599b77f7d-5kvch" (UID: "2ade1f16-121b-46fc-95be-128ebe6804e0") : secret "image-registry-tls" not found Sep 08 03:56:12.251913 ip-10-0-128-67 kubenswrapper[2571]: E0908 03:56:12.251656 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c46d90d1-2661-4b22-9f7d-9d2fd5eaabbb-metrics-tls podName:c46d90d1-2661-4b22-9f7d-9d2fd5eaabbb nodeName:}" failed. No retries permitted until 2026-09-08 03:56:44.251650019 +0000 UTC m=+97.722218377 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c46d90d1-2661-4b22-9f7d-9d2fd5eaabbb-metrics-tls") pod "dns-default-2gs5x" (UID: "c46d90d1-2661-4b22-9f7d-9d2fd5eaabbb") : secret "dns-default-metrics-tls" not found Sep 08 03:56:12.754332 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:56:12.754299 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/be017881-2b6a-4fd2-b62d-4b5d3bd7b834-metrics-certs\") pod \"network-metrics-daemon-s2679\" (UID: \"be017881-2b6a-4fd2-b62d-4b5d3bd7b834\") " pod="openshift-multus/network-metrics-daemon-s2679" Sep 08 03:56:12.754520 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:56:12.754379 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4c94cf72-6e9d-4f8b-ae71-105e52f051a1-original-pull-secret\") pod \"global-pull-secret-syncer-6ffgk\" (UID: \"4c94cf72-6e9d-4f8b-ae71-105e52f051a1\") " pod="kube-system/global-pull-secret-syncer-6ffgk" Sep 08 03:56:12.758308 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:56:12.758283 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Sep 08 03:56:12.758422 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:56:12.758401 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Sep 08 03:56:12.765500 ip-10-0-128-67 kubenswrapper[2571]: E0908 03:56:12.765483 2571 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Sep 08 03:56:12.765549 ip-10-0-128-67 kubenswrapper[2571]: E0908 03:56:12.765534 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/be017881-2b6a-4fd2-b62d-4b5d3bd7b834-metrics-certs podName:be017881-2b6a-4fd2-b62d-4b5d3bd7b834 nodeName:}" failed. No retries permitted until 2026-09-08 03:57:16.765519627 +0000 UTC m=+130.236087998 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/be017881-2b6a-4fd2-b62d-4b5d3bd7b834-metrics-certs") pod "network-metrics-daemon-s2679" (UID: "be017881-2b6a-4fd2-b62d-4b5d3bd7b834") : secret "metrics-daemon-secret" not found Sep 08 03:56:12.767679 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:56:12.767659 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4c94cf72-6e9d-4f8b-ae71-105e52f051a1-original-pull-secret\") pod \"global-pull-secret-syncer-6ffgk\" (UID: \"4c94cf72-6e9d-4f8b-ae71-105e52f051a1\") " pod="kube-system/global-pull-secret-syncer-6ffgk" Sep 08 03:56:12.956110 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:56:12.956075 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m9c82\" (UniqueName: \"kubernetes.io/projected/ab426e2f-9c8a-4457-a6b9-b98e4c94f4bf-kube-api-access-m9c82\") pod \"network-check-target-4wk4q\" (UID: \"ab426e2f-9c8a-4457-a6b9-b98e4c94f4bf\") " pod="openshift-network-diagnostics/network-check-target-4wk4q" Sep 08 03:56:12.958958 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:56:12.958941 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Sep 08 03:56:12.968627 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:56:12.968607 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Sep 08 03:56:12.971996 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:56:12.971980 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6ffgk" Sep 08 03:56:12.979533 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:56:12.979503 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m9c82\" (UniqueName: \"kubernetes.io/projected/ab426e2f-9c8a-4457-a6b9-b98e4c94f4bf-kube-api-access-m9c82\") pod \"network-check-target-4wk4q\" (UID: \"ab426e2f-9c8a-4457-a6b9-b98e4c94f4bf\") " pod="openshift-network-diagnostics/network-check-target-4wk4q" Sep 08 03:56:13.274968 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:56:13.274887 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-6ffgk"] Sep 08 03:56:13.278496 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:56:13.278473 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4c94cf72_6e9d_4f8b_ae71_105e52f051a1.slice/crio-f0e453777d187b9e05c2419bd3d1bea98f17621a036194dc681d88f7e115ada9 WatchSource:0}: Error finding container f0e453777d187b9e05c2419bd3d1bea98f17621a036194dc681d88f7e115ada9: Status 404 returned error can't find the container with id f0e453777d187b9e05c2419bd3d1bea98f17621a036194dc681d88f7e115ada9 Sep 08 03:56:13.280960 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:56:13.280941 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-gr9j5\"" Sep 08 03:56:13.288940 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:56:13.288909 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4wk4q" Sep 08 03:56:13.410218 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:56:13.410187 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-6ffgk" event={"ID":"4c94cf72-6e9d-4f8b-ae71-105e52f051a1","Type":"ContainerStarted","Data":"f0e453777d187b9e05c2419bd3d1bea98f17621a036194dc681d88f7e115ada9"} Sep 08 03:56:13.588204 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:56:13.588181 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-4wk4q"] Sep 08 03:56:13.589771 ip-10-0-128-67 kubenswrapper[2571]: W0908 03:56:13.589745 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podab426e2f_9c8a_4457_a6b9_b98e4c94f4bf.slice/crio-3216799fc508a6368478e9a193839af83ca11fd6ebbfead65592993c1fb49412 WatchSource:0}: Error finding container 3216799fc508a6368478e9a193839af83ca11fd6ebbfead65592993c1fb49412: Status 404 returned error can't find the container with id 3216799fc508a6368478e9a193839af83ca11fd6ebbfead65592993c1fb49412 Sep 08 03:56:14.416651 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:56:14.416609 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-4wk4q" event={"ID":"ab426e2f-9c8a-4457-a6b9-b98e4c94f4bf","Type":"ContainerStarted","Data":"3216799fc508a6368478e9a193839af83ca11fd6ebbfead65592993c1fb49412"} Sep 08 03:56:18.430962 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:56:18.430910 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-4wk4q" event={"ID":"ab426e2f-9c8a-4457-a6b9-b98e4c94f4bf","Type":"ContainerStarted","Data":"fa6fecfb6a26f51905f3416f78cbdc3201a0b3d4f2cb7025eea0b3005146ac94"} Sep 08 03:56:18.431357 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:56:18.431032 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-4wk4q" Sep 08 03:56:18.432490 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:56:18.432463 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-6ffgk" event={"ID":"4c94cf72-6e9d-4f8b-ae71-105e52f051a1","Type":"ContainerStarted","Data":"eae3f55bd67774133445b3b0d98028f1f996d11118995dd3f1610965375d777d"} Sep 08 03:56:18.452540 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:56:18.452497 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-4wk4q" podStartSLOduration=67.024886732 podStartE2EDuration="1m11.452484822s" totalImagesPullingTime="4.42759809s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 03:55:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 03:56:18.450940648 +0000 UTC m=+71.921509023" watchObservedRunningTime="2026-09-08 03:56:18.452484822 +0000 UTC m=+71.923053236" Sep 08 03:56:18.474837 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:56:18.474803 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-6ffgk" podStartSLOduration=66.732258454 podStartE2EDuration="1m11.474791867s" totalImagesPullingTime="4.742533413s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 03:55:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 03:56:18.473324792 +0000 UTC m=+71.943893172" watchObservedRunningTime="2026-09-08 03:56:18.474791867 +0000 UTC m=+71.945360277" Sep 08 03:56:44.282946 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:56:44.282899 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c46d90d1-2661-4b22-9f7d-9d2fd5eaabbb-metrics-tls\") pod \"dns-default-2gs5x\" (UID: \"c46d90d1-2661-4b22-9f7d-9d2fd5eaabbb\") " pod="openshift-dns/dns-default-2gs5x" Sep 08 03:56:44.283428 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:56:44.282971 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/4fd5d5dc-7953-4bd3-b65c-f81092c2af3d-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-h4zkr\" (UID: \"4fd5d5dc-7953-4bd3-b65c-f81092c2af3d\") " pod="openshift-network-console/networking-console-plugin-79977f9844-h4zkr" Sep 08 03:56:44.283428 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:56:44.282994 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2ade1f16-121b-46fc-95be-128ebe6804e0-registry-tls\") pod \"image-registry-6599b77f7d-5kvch\" (UID: \"2ade1f16-121b-46fc-95be-128ebe6804e0\") " pod="openshift-image-registry/image-registry-6599b77f7d-5kvch" Sep 08 03:56:44.283428 ip-10-0-128-67 kubenswrapper[2571]: E0908 03:56:44.283036 2571 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 08 03:56:44.283428 ip-10-0-128-67 kubenswrapper[2571]: E0908 03:56:44.283095 2571 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Sep 08 03:56:44.283428 ip-10-0-128-67 kubenswrapper[2571]: E0908 03:56:44.283134 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c46d90d1-2661-4b22-9f7d-9d2fd5eaabbb-metrics-tls podName:c46d90d1-2661-4b22-9f7d-9d2fd5eaabbb nodeName:}" failed. No retries permitted until 2026-09-08 03:57:48.283111939 +0000 UTC m=+161.753680302 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c46d90d1-2661-4b22-9f7d-9d2fd5eaabbb-metrics-tls") pod "dns-default-2gs5x" (UID: "c46d90d1-2661-4b22-9f7d-9d2fd5eaabbb") : secret "dns-default-metrics-tls" not found Sep 08 03:56:44.283428 ip-10-0-128-67 kubenswrapper[2571]: E0908 03:56:44.283156 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4fd5d5dc-7953-4bd3-b65c-f81092c2af3d-networking-console-plugin-cert podName:4fd5d5dc-7953-4bd3-b65c-f81092c2af3d nodeName:}" failed. No retries permitted until 2026-09-08 03:57:48.283145686 +0000 UTC m=+161.753714067 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/4fd5d5dc-7953-4bd3-b65c-f81092c2af3d-networking-console-plugin-cert") pod "networking-console-plugin-79977f9844-h4zkr" (UID: "4fd5d5dc-7953-4bd3-b65c-f81092c2af3d") : secret "networking-console-plugin-cert" not found Sep 08 03:56:44.283428 ip-10-0-128-67 kubenswrapper[2571]: E0908 03:56:44.283095 2571 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 08 03:56:44.283428 ip-10-0-128-67 kubenswrapper[2571]: E0908 03:56:44.283175 2571 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6599b77f7d-5kvch: secret "image-registry-tls" not found Sep 08 03:56:44.283428 ip-10-0-128-67 kubenswrapper[2571]: E0908 03:56:44.283218 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2ade1f16-121b-46fc-95be-128ebe6804e0-registry-tls podName:2ade1f16-121b-46fc-95be-128ebe6804e0 nodeName:}" failed. No retries permitted until 2026-09-08 03:57:48.283205786 +0000 UTC m=+161.753774169 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/2ade1f16-121b-46fc-95be-128ebe6804e0-registry-tls") pod "image-registry-6599b77f7d-5kvch" (UID: "2ade1f16-121b-46fc-95be-128ebe6804e0") : secret "image-registry-tls" not found Sep 08 03:56:49.437821 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:56:49.437791 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-4wk4q" Sep 08 03:57:16.817616 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:57:16.817577 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/be017881-2b6a-4fd2-b62d-4b5d3bd7b834-metrics-certs\") pod \"network-metrics-daemon-s2679\" (UID: \"be017881-2b6a-4fd2-b62d-4b5d3bd7b834\") " pod="openshift-multus/network-metrics-daemon-s2679" Sep 08 03:57:16.818081 ip-10-0-128-67 kubenswrapper[2571]: E0908 03:57:16.817715 2571 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Sep 08 03:57:16.818081 ip-10-0-128-67 kubenswrapper[2571]: E0908 03:57:16.817778 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/be017881-2b6a-4fd2-b62d-4b5d3bd7b834-metrics-certs podName:be017881-2b6a-4fd2-b62d-4b5d3bd7b834 nodeName:}" failed. No retries permitted until 2026-09-08 03:59:18.817762586 +0000 UTC m=+252.288330961 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/be017881-2b6a-4fd2-b62d-4b5d3bd7b834-metrics-certs") pod "network-metrics-daemon-s2679" (UID: "be017881-2b6a-4fd2-b62d-4b5d3bd7b834") : secret "metrics-daemon-secret" not found Sep 08 03:57:43.369052 ip-10-0-128-67 kubenswrapper[2571]: E0908 03:57:43.369008 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-6599b77f7d-5kvch" podUID="2ade1f16-121b-46fc-95be-128ebe6804e0" Sep 08 03:57:43.375280 ip-10-0-128-67 kubenswrapper[2571]: E0908 03:57:43.375252 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[networking-console-plugin-cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-network-console/networking-console-plugin-79977f9844-h4zkr" podUID="4fd5d5dc-7953-4bd3-b65c-f81092c2af3d" Sep 08 03:57:43.392415 ip-10-0-128-67 kubenswrapper[2571]: E0908 03:57:43.392386 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-2gs5x" podUID="c46d90d1-2661-4b22-9f7d-9d2fd5eaabbb" Sep 08 03:57:43.671725 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:57:43.671654 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-79977f9844-h4zkr" Sep 08 03:57:43.671859 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:57:43.671654 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-2gs5x" Sep 08 03:57:43.671859 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:57:43.671654 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6599b77f7d-5kvch" Sep 08 03:57:45.082010 ip-10-0-128-67 kubenswrapper[2571]: E0908 03:57:45.081972 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-s2679" podUID="be017881-2b6a-4fd2-b62d-4b5d3bd7b834" Sep 08 03:57:48.328007 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:57:48.327971 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c46d90d1-2661-4b22-9f7d-9d2fd5eaabbb-metrics-tls\") pod \"dns-default-2gs5x\" (UID: \"c46d90d1-2661-4b22-9f7d-9d2fd5eaabbb\") " pod="openshift-dns/dns-default-2gs5x" Sep 08 03:57:48.328459 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:57:48.328017 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/4fd5d5dc-7953-4bd3-b65c-f81092c2af3d-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-h4zkr\" (UID: \"4fd5d5dc-7953-4bd3-b65c-f81092c2af3d\") " pod="openshift-network-console/networking-console-plugin-79977f9844-h4zkr" Sep 08 03:57:48.328459 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:57:48.328038 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2ade1f16-121b-46fc-95be-128ebe6804e0-registry-tls\") pod \"image-registry-6599b77f7d-5kvch\" (UID: \"2ade1f16-121b-46fc-95be-128ebe6804e0\") " pod="openshift-image-registry/image-registry-6599b77f7d-5kvch" Sep 08 03:57:48.328459 ip-10-0-128-67 kubenswrapper[2571]: E0908 03:57:48.328138 2571 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 08 03:57:48.328459 ip-10-0-128-67 kubenswrapper[2571]: E0908 03:57:48.328142 2571 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Sep 08 03:57:48.328459 ip-10-0-128-67 kubenswrapper[2571]: E0908 03:57:48.328222 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4fd5d5dc-7953-4bd3-b65c-f81092c2af3d-networking-console-plugin-cert podName:4fd5d5dc-7953-4bd3-b65c-f81092c2af3d nodeName:}" failed. No retries permitted until 2026-09-08 03:59:50.328207194 +0000 UTC m=+283.798775579 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/4fd5d5dc-7953-4bd3-b65c-f81092c2af3d-networking-console-plugin-cert") pod "networking-console-plugin-79977f9844-h4zkr" (UID: "4fd5d5dc-7953-4bd3-b65c-f81092c2af3d") : secret "networking-console-plugin-cert" not found Sep 08 03:57:48.328459 ip-10-0-128-67 kubenswrapper[2571]: E0908 03:57:48.328142 2571 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 08 03:57:48.328459 ip-10-0-128-67 kubenswrapper[2571]: E0908 03:57:48.328282 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c46d90d1-2661-4b22-9f7d-9d2fd5eaabbb-metrics-tls podName:c46d90d1-2661-4b22-9f7d-9d2fd5eaabbb nodeName:}" failed. No retries permitted until 2026-09-08 03:59:50.328270686 +0000 UTC m=+283.798839046 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c46d90d1-2661-4b22-9f7d-9d2fd5eaabbb-metrics-tls") pod "dns-default-2gs5x" (UID: "c46d90d1-2661-4b22-9f7d-9d2fd5eaabbb") : secret "dns-default-metrics-tls" not found Sep 08 03:57:48.328459 ip-10-0-128-67 kubenswrapper[2571]: E0908 03:57:48.328148 2571 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6599b77f7d-5kvch: secret "image-registry-tls" not found Sep 08 03:57:48.328459 ip-10-0-128-67 kubenswrapper[2571]: E0908 03:57:48.328309 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2ade1f16-121b-46fc-95be-128ebe6804e0-registry-tls podName:2ade1f16-121b-46fc-95be-128ebe6804e0 nodeName:}" failed. No retries permitted until 2026-09-08 03:59:50.328303143 +0000 UTC m=+283.798871503 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/2ade1f16-121b-46fc-95be-128ebe6804e0-registry-tls") pod "image-registry-6599b77f7d-5kvch" (UID: "2ade1f16-121b-46fc-95be-128ebe6804e0") : secret "image-registry-tls" not found Sep 08 03:57:56.062380 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:57:56.062329 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s2679" Sep 08 03:57:59.366797 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:57:59.366703 2571 prober.go:120] "Probe failed" probeType="Readiness" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-599d7f6fc4-2flgg" podUID="07c65540-2698-4a20-b45a-9d5100c729c1" containerName="acm-agent" probeResult="failure" output="Get \"http://10.132.0.11:8000/readyz\": dial tcp 10.132.0.11:8000: connect: connection refused" Sep 08 03:57:59.715809 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:57:59.715722 2571 generic.go:356] "Generic (PLEG): container finished" podID="07c65540-2698-4a20-b45a-9d5100c729c1" containerID="eb1c36f2c69589226e297357abc380033afff4780c4ba56ce3e1c0677df9261a" exitCode=1 Sep 08 03:57:59.715997 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:57:59.715797 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-599d7f6fc4-2flgg" event={"ID":"07c65540-2698-4a20-b45a-9d5100c729c1","Type":"ContainerDied","Data":"eb1c36f2c69589226e297357abc380033afff4780c4ba56ce3e1c0677df9261a"} Sep 08 03:57:59.716188 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:57:59.716166 2571 scope.go:117] "RemoveContainer" containerID="eb1c36f2c69589226e297357abc380033afff4780c4ba56ce3e1c0677df9261a" Sep 08 03:57:59.717341 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:57:59.717305 2571 generic.go:356] "Generic (PLEG): container finished" podID="ebefc02e-ee24-4a3d-bb9c-a4289b380485" containerID="9f8dc6094f722e6119f932cd22944f91d73e7530ecdc9a85f738282f8c9f9655" exitCode=255 Sep 08 03:57:59.717341 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:57:59.717330 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5b8c949588-5mvgl" event={"ID":"ebefc02e-ee24-4a3d-bb9c-a4289b380485","Type":"ContainerDied","Data":"9f8dc6094f722e6119f932cd22944f91d73e7530ecdc9a85f738282f8c9f9655"} Sep 08 03:57:59.717576 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:57:59.717564 2571 scope.go:117] "RemoveContainer" containerID="9f8dc6094f722e6119f932cd22944f91d73e7530ecdc9a85f738282f8c9f9655" Sep 08 03:58:00.722137 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:58:00.722097 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5b8c949588-5mvgl" event={"ID":"ebefc02e-ee24-4a3d-bb9c-a4289b380485","Type":"ContainerStarted","Data":"61b536d55bf446aad513add25f5a574afadedb116f2102323a8c530980b36654"} Sep 08 03:58:00.723805 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:58:00.723775 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-599d7f6fc4-2flgg" event={"ID":"07c65540-2698-4a20-b45a-9d5100c729c1","Type":"ContainerStarted","Data":"2c6c4d35b9a235b73daf00f35be6c8dea2e02b7f8482de14ad54dd160ea11a61"} Sep 08 03:58:00.724055 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:58:00.724031 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-599d7f6fc4-2flgg" Sep 08 03:58:00.724633 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:58:00.724617 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-599d7f6fc4-2flgg" Sep 08 03:59:18.850181 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:59:18.850120 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/be017881-2b6a-4fd2-b62d-4b5d3bd7b834-metrics-certs\") pod \"network-metrics-daemon-s2679\" (UID: \"be017881-2b6a-4fd2-b62d-4b5d3bd7b834\") " pod="openshift-multus/network-metrics-daemon-s2679" Sep 08 03:59:18.850687 ip-10-0-128-67 kubenswrapper[2571]: E0908 03:59:18.850274 2571 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Sep 08 03:59:18.850687 ip-10-0-128-67 kubenswrapper[2571]: E0908 03:59:18.850336 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/be017881-2b6a-4fd2-b62d-4b5d3bd7b834-metrics-certs podName:be017881-2b6a-4fd2-b62d-4b5d3bd7b834 nodeName:}" failed. No retries permitted until 2026-09-08 04:01:20.850318807 +0000 UTC m=+374.320887169 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/be017881-2b6a-4fd2-b62d-4b5d3bd7b834-metrics-certs") pod "network-metrics-daemon-s2679" (UID: "be017881-2b6a-4fd2-b62d-4b5d3bd7b834") : secret "metrics-daemon-secret" not found Sep 08 03:59:44.775750 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:59:44.775672 2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-nddv4"] Sep 08 03:59:44.778720 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:59:44.778702 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-nddv4" Sep 08 03:59:44.784131 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:59:44.784102 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Sep 08 03:59:44.784131 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:59:44.784128 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Sep 08 03:59:44.784452 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:59:44.784430 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Sep 08 03:59:44.784538 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:59:44.784465 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Sep 08 03:59:44.785354 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:59:44.785339 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-h24jh\"" Sep 08 03:59:44.797094 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:59:44.797073 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-nddv4"] Sep 08 03:59:44.836388 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:59:44.836365 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q9m9l\" (UniqueName: \"kubernetes.io/projected/86e8b575-81fb-41d3-bcae-7e82bb35dc50-kube-api-access-q9m9l\") pod \"insights-runtime-extractor-nddv4\" (UID: \"86e8b575-81fb-41d3-bcae-7e82bb35dc50\") " pod="openshift-insights/insights-runtime-extractor-nddv4" Sep 08 03:59:44.836502 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:59:44.836417 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/86e8b575-81fb-41d3-bcae-7e82bb35dc50-crio-socket\") pod \"insights-runtime-extractor-nddv4\" (UID: \"86e8b575-81fb-41d3-bcae-7e82bb35dc50\") " pod="openshift-insights/insights-runtime-extractor-nddv4" Sep 08 03:59:44.836502 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:59:44.836473 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/86e8b575-81fb-41d3-bcae-7e82bb35dc50-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nddv4\" (UID: \"86e8b575-81fb-41d3-bcae-7e82bb35dc50\") " pod="openshift-insights/insights-runtime-extractor-nddv4" Sep 08 03:59:44.836502 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:59:44.836496 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/86e8b575-81fb-41d3-bcae-7e82bb35dc50-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nddv4\" (UID: \"86e8b575-81fb-41d3-bcae-7e82bb35dc50\") " pod="openshift-insights/insights-runtime-extractor-nddv4" Sep 08 03:59:44.836604 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:59:44.836519 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/86e8b575-81fb-41d3-bcae-7e82bb35dc50-data-volume\") pod \"insights-runtime-extractor-nddv4\" (UID: \"86e8b575-81fb-41d3-bcae-7e82bb35dc50\") " pod="openshift-insights/insights-runtime-extractor-nddv4" Sep 08 03:59:44.937120 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:59:44.937082 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/86e8b575-81fb-41d3-bcae-7e82bb35dc50-crio-socket\") pod \"insights-runtime-extractor-nddv4\" (UID: \"86e8b575-81fb-41d3-bcae-7e82bb35dc50\") " pod="openshift-insights/insights-runtime-extractor-nddv4" Sep 08 03:59:44.937271 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:59:44.937140 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/86e8b575-81fb-41d3-bcae-7e82bb35dc50-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nddv4\" (UID: \"86e8b575-81fb-41d3-bcae-7e82bb35dc50\") " pod="openshift-insights/insights-runtime-extractor-nddv4" Sep 08 03:59:44.937271 ip-10-0-128-67 kubenswrapper[2571]: E0908 03:59:44.937208 2571 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 08 03:59:44.937271 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:59:44.937217 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/86e8b575-81fb-41d3-bcae-7e82bb35dc50-crio-socket\") pod \"insights-runtime-extractor-nddv4\" (UID: \"86e8b575-81fb-41d3-bcae-7e82bb35dc50\") " pod="openshift-insights/insights-runtime-extractor-nddv4" Sep 08 03:59:44.937271 ip-10-0-128-67 kubenswrapper[2571]: E0908 03:59:44.937267 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/86e8b575-81fb-41d3-bcae-7e82bb35dc50-kube-rbac-proxy-cm podName:86e8b575-81fb-41d3-bcae-7e82bb35dc50 nodeName:}" failed. No retries permitted until 2026-09-08 03:59:45.437250285 +0000 UTC m=+278.907818659 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/86e8b575-81fb-41d3-bcae-7e82bb35dc50-kube-rbac-proxy-cm") pod "insights-runtime-extractor-nddv4" (UID: "86e8b575-81fb-41d3-bcae-7e82bb35dc50") : configmap "kube-rbac-proxy" not found Sep 08 03:59:44.937425 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:59:44.937280 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/86e8b575-81fb-41d3-bcae-7e82bb35dc50-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nddv4\" (UID: \"86e8b575-81fb-41d3-bcae-7e82bb35dc50\") " pod="openshift-insights/insights-runtime-extractor-nddv4" Sep 08 03:59:44.937425 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:59:44.937304 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/86e8b575-81fb-41d3-bcae-7e82bb35dc50-data-volume\") pod \"insights-runtime-extractor-nddv4\" (UID: \"86e8b575-81fb-41d3-bcae-7e82bb35dc50\") " pod="openshift-insights/insights-runtime-extractor-nddv4" Sep 08 03:59:44.937425 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:59:44.937342 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q9m9l\" (UniqueName: \"kubernetes.io/projected/86e8b575-81fb-41d3-bcae-7e82bb35dc50-kube-api-access-q9m9l\") pod \"insights-runtime-extractor-nddv4\" (UID: \"86e8b575-81fb-41d3-bcae-7e82bb35dc50\") " pod="openshift-insights/insights-runtime-extractor-nddv4" Sep 08 03:59:44.937425 ip-10-0-128-67 kubenswrapper[2571]: E0908 03:59:44.937372 2571 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 08 03:59:44.937425 ip-10-0-128-67 kubenswrapper[2571]: E0908 03:59:44.937425 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/86e8b575-81fb-41d3-bcae-7e82bb35dc50-insights-runtime-extractor-tls podName:86e8b575-81fb-41d3-bcae-7e82bb35dc50 nodeName:}" failed. No retries permitted until 2026-09-08 03:59:45.437412001 +0000 UTC m=+278.907980363 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/86e8b575-81fb-41d3-bcae-7e82bb35dc50-insights-runtime-extractor-tls") pod "insights-runtime-extractor-nddv4" (UID: "86e8b575-81fb-41d3-bcae-7e82bb35dc50") : secret "insights-runtime-extractor-tls" not found Sep 08 03:59:44.937700 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:59:44.937684 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/86e8b575-81fb-41d3-bcae-7e82bb35dc50-data-volume\") pod \"insights-runtime-extractor-nddv4\" (UID: \"86e8b575-81fb-41d3-bcae-7e82bb35dc50\") " pod="openshift-insights/insights-runtime-extractor-nddv4" Sep 08 03:59:44.957097 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:59:44.957067 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q9m9l\" (UniqueName: \"kubernetes.io/projected/86e8b575-81fb-41d3-bcae-7e82bb35dc50-kube-api-access-q9m9l\") pod \"insights-runtime-extractor-nddv4\" (UID: \"86e8b575-81fb-41d3-bcae-7e82bb35dc50\") " pod="openshift-insights/insights-runtime-extractor-nddv4" Sep 08 03:59:45.441162 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:59:45.441126 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/86e8b575-81fb-41d3-bcae-7e82bb35dc50-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nddv4\" (UID: \"86e8b575-81fb-41d3-bcae-7e82bb35dc50\") " pod="openshift-insights/insights-runtime-extractor-nddv4" Sep 08 03:59:45.441372 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:59:45.441249 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/86e8b575-81fb-41d3-bcae-7e82bb35dc50-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nddv4\" (UID: \"86e8b575-81fb-41d3-bcae-7e82bb35dc50\") " pod="openshift-insights/insights-runtime-extractor-nddv4" Sep 08 03:59:45.441372 ip-10-0-128-67 kubenswrapper[2571]: E0908 03:59:45.441284 2571 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 08 03:59:45.441372 ip-10-0-128-67 kubenswrapper[2571]: E0908 03:59:45.441338 2571 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 08 03:59:45.441372 ip-10-0-128-67 kubenswrapper[2571]: E0908 03:59:45.441356 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/86e8b575-81fb-41d3-bcae-7e82bb35dc50-insights-runtime-extractor-tls podName:86e8b575-81fb-41d3-bcae-7e82bb35dc50 nodeName:}" failed. No retries permitted until 2026-09-08 03:59:46.441340919 +0000 UTC m=+279.911909278 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/86e8b575-81fb-41d3-bcae-7e82bb35dc50-insights-runtime-extractor-tls") pod "insights-runtime-extractor-nddv4" (UID: "86e8b575-81fb-41d3-bcae-7e82bb35dc50") : secret "insights-runtime-extractor-tls" not found Sep 08 03:59:45.441541 ip-10-0-128-67 kubenswrapper[2571]: E0908 03:59:45.441387 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/86e8b575-81fb-41d3-bcae-7e82bb35dc50-kube-rbac-proxy-cm podName:86e8b575-81fb-41d3-bcae-7e82bb35dc50 nodeName:}" failed. No retries permitted until 2026-09-08 03:59:46.441372915 +0000 UTC m=+279.911941287 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/86e8b575-81fb-41d3-bcae-7e82bb35dc50-kube-rbac-proxy-cm") pod "insights-runtime-extractor-nddv4" (UID: "86e8b575-81fb-41d3-bcae-7e82bb35dc50") : configmap "kube-rbac-proxy" not found Sep 08 03:59:46.448783 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:59:46.448745 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/86e8b575-81fb-41d3-bcae-7e82bb35dc50-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nddv4\" (UID: \"86e8b575-81fb-41d3-bcae-7e82bb35dc50\") " pod="openshift-insights/insights-runtime-extractor-nddv4" Sep 08 03:59:46.449194 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:59:46.448795 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/86e8b575-81fb-41d3-bcae-7e82bb35dc50-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nddv4\" (UID: \"86e8b575-81fb-41d3-bcae-7e82bb35dc50\") " pod="openshift-insights/insights-runtime-extractor-nddv4" Sep 08 03:59:46.449194 ip-10-0-128-67 kubenswrapper[2571]: E0908 03:59:46.448864 2571 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 08 03:59:46.449194 ip-10-0-128-67 kubenswrapper[2571]: E0908 03:59:46.448886 2571 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 08 03:59:46.449194 ip-10-0-128-67 kubenswrapper[2571]: E0908 03:59:46.448950 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/86e8b575-81fb-41d3-bcae-7e82bb35dc50-kube-rbac-proxy-cm podName:86e8b575-81fb-41d3-bcae-7e82bb35dc50 nodeName:}" failed. No retries permitted until 2026-09-08 03:59:48.448910885 +0000 UTC m=+281.919479249 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/86e8b575-81fb-41d3-bcae-7e82bb35dc50-kube-rbac-proxy-cm") pod "insights-runtime-extractor-nddv4" (UID: "86e8b575-81fb-41d3-bcae-7e82bb35dc50") : configmap "kube-rbac-proxy" not found Sep 08 03:59:46.449194 ip-10-0-128-67 kubenswrapper[2571]: E0908 03:59:46.448964 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/86e8b575-81fb-41d3-bcae-7e82bb35dc50-insights-runtime-extractor-tls podName:86e8b575-81fb-41d3-bcae-7e82bb35dc50 nodeName:}" failed. No retries permitted until 2026-09-08 03:59:48.448958007 +0000 UTC m=+281.919526365 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/86e8b575-81fb-41d3-bcae-7e82bb35dc50-insights-runtime-extractor-tls") pod "insights-runtime-extractor-nddv4" (UID: "86e8b575-81fb-41d3-bcae-7e82bb35dc50") : secret "insights-runtime-extractor-tls" not found Sep 08 03:59:46.672238 ip-10-0-128-67 kubenswrapper[2571]: E0908 03:59:46.672194 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[networking-console-plugin-cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-network-console/networking-console-plugin-79977f9844-h4zkr" podUID="4fd5d5dc-7953-4bd3-b65c-f81092c2af3d" Sep 08 03:59:46.672238 ip-10-0-128-67 kubenswrapper[2571]: E0908 03:59:46.672194 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-2gs5x" podUID="c46d90d1-2661-4b22-9f7d-9d2fd5eaabbb" Sep 08 03:59:46.672431 ip-10-0-128-67 kubenswrapper[2571]: E0908 03:59:46.672210 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-6599b77f7d-5kvch" podUID="2ade1f16-121b-46fc-95be-128ebe6804e0" Sep 08 03:59:46.739755 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:59:46.739689 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-t2qd4_92705af2-1822-4b7f-8852-a8120774230c/dns-node-resolver/0.log" Sep 08 03:59:47.020501 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:59:47.020423 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-2gs5x" Sep 08 03:59:47.020659 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:59:47.020424 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-79977f9844-h4zkr" Sep 08 03:59:47.020659 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:59:47.020423 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6599b77f7d-5kvch" Sep 08 03:59:47.545245 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:59:47.545221 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-6gf2k_0e85668b-3938-4a44-978b-0fa580d71c06/node-ca/0.log" Sep 08 03:59:48.466876 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:59:48.466824 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/86e8b575-81fb-41d3-bcae-7e82bb35dc50-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nddv4\" (UID: \"86e8b575-81fb-41d3-bcae-7e82bb35dc50\") " pod="openshift-insights/insights-runtime-extractor-nddv4" Sep 08 03:59:48.466876 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:59:48.466882 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/86e8b575-81fb-41d3-bcae-7e82bb35dc50-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nddv4\" (UID: \"86e8b575-81fb-41d3-bcae-7e82bb35dc50\") " pod="openshift-insights/insights-runtime-extractor-nddv4" Sep 08 03:59:48.467135 ip-10-0-128-67 kubenswrapper[2571]: E0908 03:59:48.466979 2571 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 08 03:59:48.467135 ip-10-0-128-67 kubenswrapper[2571]: E0908 03:59:48.467006 2571 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 08 03:59:48.467135 ip-10-0-128-67 kubenswrapper[2571]: E0908 03:59:48.467042 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/86e8b575-81fb-41d3-bcae-7e82bb35dc50-kube-rbac-proxy-cm podName:86e8b575-81fb-41d3-bcae-7e82bb35dc50 nodeName:}" failed. No retries permitted until 2026-09-08 03:59:52.467026891 +0000 UTC m=+285.937595288 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/86e8b575-81fb-41d3-bcae-7e82bb35dc50-kube-rbac-proxy-cm") pod "insights-runtime-extractor-nddv4" (UID: "86e8b575-81fb-41d3-bcae-7e82bb35dc50") : configmap "kube-rbac-proxy" not found Sep 08 03:59:48.467135 ip-10-0-128-67 kubenswrapper[2571]: E0908 03:59:48.467057 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/86e8b575-81fb-41d3-bcae-7e82bb35dc50-insights-runtime-extractor-tls podName:86e8b575-81fb-41d3-bcae-7e82bb35dc50 nodeName:}" failed. No retries permitted until 2026-09-08 03:59:52.467051135 +0000 UTC m=+285.937619494 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/86e8b575-81fb-41d3-bcae-7e82bb35dc50-insights-runtime-extractor-tls") pod "insights-runtime-extractor-nddv4" (UID: "86e8b575-81fb-41d3-bcae-7e82bb35dc50") : secret "insights-runtime-extractor-tls" not found Sep 08 03:59:48.544175 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:59:48.544152 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-hjfnf_a832821c-0523-4a74-9e04-c4772b079561/serve-healthcheck-canary/0.log" Sep 08 03:59:50.379661 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:59:50.379633 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c46d90d1-2661-4b22-9f7d-9d2fd5eaabbb-metrics-tls\") pod \"dns-default-2gs5x\" (UID: \"c46d90d1-2661-4b22-9f7d-9d2fd5eaabbb\") " pod="openshift-dns/dns-default-2gs5x" Sep 08 03:59:50.380219 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:59:50.379666 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/4fd5d5dc-7953-4bd3-b65c-f81092c2af3d-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-h4zkr\" (UID: \"4fd5d5dc-7953-4bd3-b65c-f81092c2af3d\") " pod="openshift-network-console/networking-console-plugin-79977f9844-h4zkr" Sep 08 03:59:50.380219 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:59:50.379688 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2ade1f16-121b-46fc-95be-128ebe6804e0-registry-tls\") pod \"image-registry-6599b77f7d-5kvch\" (UID: \"2ade1f16-121b-46fc-95be-128ebe6804e0\") " pod="openshift-image-registry/image-registry-6599b77f7d-5kvch" Sep 08 03:59:50.380219 ip-10-0-128-67 kubenswrapper[2571]: E0908 03:59:50.379772 2571 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 08 03:59:50.380219 ip-10-0-128-67 kubenswrapper[2571]: E0908 03:59:50.379791 2571 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Sep 08 03:59:50.380219 ip-10-0-128-67 kubenswrapper[2571]: E0908 03:59:50.379832 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c46d90d1-2661-4b22-9f7d-9d2fd5eaabbb-metrics-tls podName:c46d90d1-2661-4b22-9f7d-9d2fd5eaabbb nodeName:}" failed. No retries permitted until 2026-09-08 04:01:52.379815348 +0000 UTC m=+405.850383707 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c46d90d1-2661-4b22-9f7d-9d2fd5eaabbb-metrics-tls") pod "dns-default-2gs5x" (UID: "c46d90d1-2661-4b22-9f7d-9d2fd5eaabbb") : secret "dns-default-metrics-tls" not found Sep 08 03:59:50.380219 ip-10-0-128-67 kubenswrapper[2571]: E0908 03:59:50.379855 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4fd5d5dc-7953-4bd3-b65c-f81092c2af3d-networking-console-plugin-cert podName:4fd5d5dc-7953-4bd3-b65c-f81092c2af3d nodeName:}" failed. No retries permitted until 2026-09-08 04:01:52.379838141 +0000 UTC m=+405.850406520 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/4fd5d5dc-7953-4bd3-b65c-f81092c2af3d-networking-console-plugin-cert") pod "networking-console-plugin-79977f9844-h4zkr" (UID: "4fd5d5dc-7953-4bd3-b65c-f81092c2af3d") : secret "networking-console-plugin-cert" not found Sep 08 03:59:50.380219 ip-10-0-128-67 kubenswrapper[2571]: E0908 03:59:50.379778 2571 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 08 03:59:50.380219 ip-10-0-128-67 kubenswrapper[2571]: E0908 03:59:50.379871 2571 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6599b77f7d-5kvch: secret "image-registry-tls" not found Sep 08 03:59:50.380219 ip-10-0-128-67 kubenswrapper[2571]: E0908 03:59:50.379904 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2ade1f16-121b-46fc-95be-128ebe6804e0-registry-tls podName:2ade1f16-121b-46fc-95be-128ebe6804e0 nodeName:}" failed. No retries permitted until 2026-09-08 04:01:52.379894515 +0000 UTC m=+405.850462875 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/2ade1f16-121b-46fc-95be-128ebe6804e0-registry-tls") pod "image-registry-6599b77f7d-5kvch" (UID: "2ade1f16-121b-46fc-95be-128ebe6804e0") : secret "image-registry-tls" not found Sep 08 03:59:52.495491 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:59:52.495452 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/86e8b575-81fb-41d3-bcae-7e82bb35dc50-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nddv4\" (UID: \"86e8b575-81fb-41d3-bcae-7e82bb35dc50\") " pod="openshift-insights/insights-runtime-extractor-nddv4" Sep 08 03:59:52.495868 ip-10-0-128-67 kubenswrapper[2571]: I0908 03:59:52.495508 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/86e8b575-81fb-41d3-bcae-7e82bb35dc50-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nddv4\" (UID: \"86e8b575-81fb-41d3-bcae-7e82bb35dc50\") " pod="openshift-insights/insights-runtime-extractor-nddv4" Sep 08 03:59:52.495868 ip-10-0-128-67 kubenswrapper[2571]: E0908 03:59:52.495601 2571 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 08 03:59:52.495868 ip-10-0-128-67 kubenswrapper[2571]: E0908 03:59:52.495665 2571 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 08 03:59:52.495868 ip-10-0-128-67 kubenswrapper[2571]: E0908 03:59:52.495670 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/86e8b575-81fb-41d3-bcae-7e82bb35dc50-kube-rbac-proxy-cm podName:86e8b575-81fb-41d3-bcae-7e82bb35dc50 nodeName:}" failed. No retries permitted until 2026-09-08 04:00:00.495652784 +0000 UTC m=+293.966221159 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/86e8b575-81fb-41d3-bcae-7e82bb35dc50-kube-rbac-proxy-cm") pod "insights-runtime-extractor-nddv4" (UID: "86e8b575-81fb-41d3-bcae-7e82bb35dc50") : configmap "kube-rbac-proxy" not found Sep 08 03:59:52.495868 ip-10-0-128-67 kubenswrapper[2571]: E0908 03:59:52.495724 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/86e8b575-81fb-41d3-bcae-7e82bb35dc50-insights-runtime-extractor-tls podName:86e8b575-81fb-41d3-bcae-7e82bb35dc50 nodeName:}" failed. No retries permitted until 2026-09-08 04:00:00.495711191 +0000 UTC m=+293.966279550 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/86e8b575-81fb-41d3-bcae-7e82bb35dc50-insights-runtime-extractor-tls") pod "insights-runtime-extractor-nddv4" (UID: "86e8b575-81fb-41d3-bcae-7e82bb35dc50") : secret "insights-runtime-extractor-tls" not found Sep 08 03:59:59.063260 ip-10-0-128-67 kubenswrapper[2571]: E0908 03:59:59.063215 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-s2679" podUID="be017881-2b6a-4fd2-b62d-4b5d3bd7b834" Sep 08 04:00:00.061587 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:00:00.061497 2571 generic.go:356] "Generic (PLEG): container finished" podID="07c65540-2698-4a20-b45a-9d5100c729c1" containerID="2c6c4d35b9a235b73daf00f35be6c8dea2e02b7f8482de14ad54dd160ea11a61" exitCode=1 Sep 08 04:00:00.061587 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:00:00.061565 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-599d7f6fc4-2flgg" event={"ID":"07c65540-2698-4a20-b45a-9d5100c729c1","Type":"ContainerDied","Data":"2c6c4d35b9a235b73daf00f35be6c8dea2e02b7f8482de14ad54dd160ea11a61"} Sep 08 04:00:00.061794 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:00:00.061617 2571 scope.go:117] "RemoveContainer" containerID="eb1c36f2c69589226e297357abc380033afff4780c4ba56ce3e1c0677df9261a" Sep 08 04:00:00.061870 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:00:00.061854 2571 scope.go:117] "RemoveContainer" containerID="2c6c4d35b9a235b73daf00f35be6c8dea2e02b7f8482de14ad54dd160ea11a61" Sep 08 04:00:00.062097 ip-10-0-128-67 kubenswrapper[2571]: E0908 04:00:00.062074 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"acm-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=acm-agent pod=klusterlet-addon-workmgr-599d7f6fc4-2flgg_open-cluster-management-agent-addon(07c65540-2698-4a20-b45a-9d5100c729c1)\"" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-599d7f6fc4-2flgg" podUID="07c65540-2698-4a20-b45a-9d5100c729c1" Sep 08 04:00:00.063485 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:00:00.063465 2571 generic.go:356] "Generic (PLEG): container finished" podID="ebefc02e-ee24-4a3d-bb9c-a4289b380485" containerID="61b536d55bf446aad513add25f5a574afadedb116f2102323a8c530980b36654" exitCode=255 Sep 08 04:00:00.063734 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:00:00.063492 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5b8c949588-5mvgl" event={"ID":"ebefc02e-ee24-4a3d-bb9c-a4289b380485","Type":"ContainerDied","Data":"61b536d55bf446aad513add25f5a574afadedb116f2102323a8c530980b36654"} Sep 08 04:00:00.063734 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:00:00.063685 2571 scope.go:117] "RemoveContainer" containerID="61b536d55bf446aad513add25f5a574afadedb116f2102323a8c530980b36654" Sep 08 04:00:00.063809 ip-10-0-128-67 kubenswrapper[2571]: E0908 04:00:00.063781 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"addon-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=addon-agent pod=managed-serviceaccount-addon-agent-5b8c949588-5mvgl_open-cluster-management-agent-addon(ebefc02e-ee24-4a3d-bb9c-a4289b380485)\"" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5b8c949588-5mvgl" podUID="ebefc02e-ee24-4a3d-bb9c-a4289b380485" Sep 08 04:00:00.072656 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:00:00.072640 2571 scope.go:117] "RemoveContainer" containerID="9f8dc6094f722e6119f932cd22944f91d73e7530ecdc9a85f738282f8c9f9655" Sep 08 04:00:00.555676 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:00:00.555636 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/86e8b575-81fb-41d3-bcae-7e82bb35dc50-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nddv4\" (UID: \"86e8b575-81fb-41d3-bcae-7e82bb35dc50\") " pod="openshift-insights/insights-runtime-extractor-nddv4" Sep 08 04:00:00.555863 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:00:00.555767 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/86e8b575-81fb-41d3-bcae-7e82bb35dc50-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nddv4\" (UID: \"86e8b575-81fb-41d3-bcae-7e82bb35dc50\") " pod="openshift-insights/insights-runtime-extractor-nddv4" Sep 08 04:00:00.556269 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:00:00.556245 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/86e8b575-81fb-41d3-bcae-7e82bb35dc50-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nddv4\" (UID: \"86e8b575-81fb-41d3-bcae-7e82bb35dc50\") " pod="openshift-insights/insights-runtime-extractor-nddv4" Sep 08 04:00:00.557849 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:00:00.557829 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/86e8b575-81fb-41d3-bcae-7e82bb35dc50-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nddv4\" (UID: \"86e8b575-81fb-41d3-bcae-7e82bb35dc50\") " pod="openshift-insights/insights-runtime-extractor-nddv4" Sep 08 04:00:00.687761 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:00:00.687725 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-nddv4" Sep 08 04:00:00.724622 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:00:00.724591 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-599d7f6fc4-2flgg" Sep 08 04:00:00.971452 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:00:00.971381 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-nddv4"] Sep 08 04:00:00.974629 ip-10-0-128-67 kubenswrapper[2571]: W0908 04:00:00.974607 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod86e8b575_81fb_41d3_bcae_7e82bb35dc50.slice/crio-26585ab315df368b387890ac55ee6e8c9dab794ecbc24e26f4f9475cc98b04a3 WatchSource:0}: Error finding container 26585ab315df368b387890ac55ee6e8c9dab794ecbc24e26f4f9475cc98b04a3: Status 404 returned error can't find the container with id 26585ab315df368b387890ac55ee6e8c9dab794ecbc24e26f4f9475cc98b04a3 Sep 08 04:00:01.069042 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:00:01.069011 2571 scope.go:117] "RemoveContainer" containerID="2c6c4d35b9a235b73daf00f35be6c8dea2e02b7f8482de14ad54dd160ea11a61" Sep 08 04:00:01.069461 ip-10-0-128-67 kubenswrapper[2571]: E0908 04:00:01.069194 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"acm-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=acm-agent pod=klusterlet-addon-workmgr-599d7f6fc4-2flgg_open-cluster-management-agent-addon(07c65540-2698-4a20-b45a-9d5100c729c1)\"" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-599d7f6fc4-2flgg" podUID="07c65540-2698-4a20-b45a-9d5100c729c1" Sep 08 04:00:01.070174 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:00:01.070151 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-nddv4" event={"ID":"86e8b575-81fb-41d3-bcae-7e82bb35dc50","Type":"ContainerStarted","Data":"f41e7aa64ce2cce5675bb7af0f40c2000c25cb2ebb2ac45761b14a5446059d4b"} Sep 08 04:00:01.070279 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:00:01.070198 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-nddv4" event={"ID":"86e8b575-81fb-41d3-bcae-7e82bb35dc50","Type":"ContainerStarted","Data":"26585ab315df368b387890ac55ee6e8c9dab794ecbc24e26f4f9475cc98b04a3"} Sep 08 04:00:01.102900 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:00:01.102866 2571 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5b8c949588-5mvgl" Sep 08 04:00:01.103185 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:00:01.103172 2571 scope.go:117] "RemoveContainer" containerID="61b536d55bf446aad513add25f5a574afadedb116f2102323a8c530980b36654" Sep 08 04:00:01.103323 ip-10-0-128-67 kubenswrapper[2571]: E0908 04:00:01.103305 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"addon-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=addon-agent pod=managed-serviceaccount-addon-agent-5b8c949588-5mvgl_open-cluster-management-agent-addon(ebefc02e-ee24-4a3d-bb9c-a4289b380485)\"" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5b8c949588-5mvgl" podUID="ebefc02e-ee24-4a3d-bb9c-a4289b380485" Sep 08 04:00:02.010958 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:00:02.010908 2571 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-599d7f6fc4-2flgg" Sep 08 04:00:02.074900 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:00:02.074870 2571 scope.go:117] "RemoveContainer" containerID="2c6c4d35b9a235b73daf00f35be6c8dea2e02b7f8482de14ad54dd160ea11a61" Sep 08 04:00:02.075353 ip-10-0-128-67 kubenswrapper[2571]: E0908 04:00:02.075113 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"acm-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=acm-agent pod=klusterlet-addon-workmgr-599d7f6fc4-2flgg_open-cluster-management-agent-addon(07c65540-2698-4a20-b45a-9d5100c729c1)\"" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-599d7f6fc4-2flgg" podUID="07c65540-2698-4a20-b45a-9d5100c729c1" Sep 08 04:00:03.080434 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:00:03.080398 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-nddv4" event={"ID":"86e8b575-81fb-41d3-bcae-7e82bb35dc50","Type":"ContainerStarted","Data":"8751978ab4fc84453c38bb1cb765e0d1f56181ea149d0eb719a8cfaac0b0768e"} Sep 08 04:00:05.087636 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:00:05.087594 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-nddv4" event={"ID":"86e8b575-81fb-41d3-bcae-7e82bb35dc50","Type":"ContainerStarted","Data":"542343079f8b68904f65c0f1074931333a08ed852519bd61545d88767f393165"} Sep 08 04:00:05.117335 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:00:05.117291 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-nddv4" podStartSLOduration=17.422108772 podStartE2EDuration="21.11727786s" totalImagesPullingTime="3.695169088s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 03:59:44 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 04:00:05.11601476 +0000 UTC m=+298.586583140" watchObservedRunningTime="2026-09-08 04:00:05.11727786 +0000 UTC m=+298.587846260" Sep 08 04:00:06.951657 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:00:06.951633 2571 kubelet.go:1648] "Image garbage collection succeeded" Sep 08 04:00:10.062192 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:00:10.062156 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s2679" Sep 08 04:00:15.061634 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:00:15.061604 2571 scope.go:117] "RemoveContainer" containerID="2c6c4d35b9a235b73daf00f35be6c8dea2e02b7f8482de14ad54dd160ea11a61" Sep 08 04:00:15.062059 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:00:15.061692 2571 scope.go:117] "RemoveContainer" containerID="61b536d55bf446aad513add25f5a574afadedb116f2102323a8c530980b36654" Sep 08 04:00:16.126342 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:00:16.126305 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5b8c949588-5mvgl" event={"ID":"ebefc02e-ee24-4a3d-bb9c-a4289b380485","Type":"ContainerStarted","Data":"ac9578ff31f24d2077c50eb46f8f6c4057e16f37d62cc41050d3268776c4535d"} Sep 08 04:00:16.127938 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:00:16.127901 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-599d7f6fc4-2flgg" event={"ID":"07c65540-2698-4a20-b45a-9d5100c729c1","Type":"ContainerStarted","Data":"81135a75e9fd9be03f17c233d6369097040ee04d0d6ae7e0a6188c98a6a8104b"} Sep 08 04:00:16.128216 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:00:16.128197 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-599d7f6fc4-2flgg" Sep 08 04:00:16.129465 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:00:16.129444 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-599d7f6fc4-2flgg" Sep 08 04:00:24.917019 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:00:24.916985 2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-k9zcg"] Sep 08 04:00:24.920341 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:00:24.920322 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-k9zcg" Sep 08 04:00:24.926684 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:00:24.926306 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Sep 08 04:00:24.926684 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:00:24.926372 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Sep 08 04:00:24.926684 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:00:24.926381 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Sep 08 04:00:24.927546 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:00:24.927522 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Sep 08 04:00:24.927632 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:00:24.927587 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Sep 08 04:00:24.927632 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:00:24.927593 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Sep 08 04:00:24.927743 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:00:24.927689 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-7k9nw\"" Sep 08 04:00:24.930960 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:00:24.930941 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/02e1dce7-d7cb-4540-8a01-2fc63af19226-sys\") pod \"node-exporter-k9zcg\" (UID: \"02e1dce7-d7cb-4540-8a01-2fc63af19226\") " pod="openshift-monitoring/node-exporter-k9zcg" Sep 08 04:00:24.931007 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:00:24.930975 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/02e1dce7-d7cb-4540-8a01-2fc63af19226-node-exporter-textfile\") pod \"node-exporter-k9zcg\" (UID: \"02e1dce7-d7cb-4540-8a01-2fc63af19226\") " pod="openshift-monitoring/node-exporter-k9zcg" Sep 08 04:00:24.931082 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:00:24.931027 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/02e1dce7-d7cb-4540-8a01-2fc63af19226-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-k9zcg\" (UID: \"02e1dce7-d7cb-4540-8a01-2fc63af19226\") " pod="openshift-monitoring/node-exporter-k9zcg" Sep 08 04:00:24.931082 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:00:24.931050 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mcgws\" (UniqueName: \"kubernetes.io/projected/02e1dce7-d7cb-4540-8a01-2fc63af19226-kube-api-access-mcgws\") pod \"node-exporter-k9zcg\" (UID: \"02e1dce7-d7cb-4540-8a01-2fc63af19226\") " pod="openshift-monitoring/node-exporter-k9zcg" Sep 08 04:00:24.931082 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:00:24.931074 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/02e1dce7-d7cb-4540-8a01-2fc63af19226-node-exporter-tls\") pod \"node-exporter-k9zcg\" (UID: \"02e1dce7-d7cb-4540-8a01-2fc63af19226\") " pod="openshift-monitoring/node-exporter-k9zcg" Sep 08 04:00:24.931171 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:00:24.931096 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/02e1dce7-d7cb-4540-8a01-2fc63af19226-root\") pod \"node-exporter-k9zcg\" (UID: \"02e1dce7-d7cb-4540-8a01-2fc63af19226\") " pod="openshift-monitoring/node-exporter-k9zcg" Sep 08 04:00:24.931171 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:00:24.931122 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/02e1dce7-d7cb-4540-8a01-2fc63af19226-node-exporter-wtmp\") pod \"node-exporter-k9zcg\" (UID: \"02e1dce7-d7cb-4540-8a01-2fc63af19226\") " pod="openshift-monitoring/node-exporter-k9zcg" Sep 08 04:00:24.931233 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:00:24.931166 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/02e1dce7-d7cb-4540-8a01-2fc63af19226-metrics-client-ca\") pod \"node-exporter-k9zcg\" (UID: \"02e1dce7-d7cb-4540-8a01-2fc63af19226\") " pod="openshift-monitoring/node-exporter-k9zcg" Sep 08 04:00:24.931233 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:00:24.931208 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/02e1dce7-d7cb-4540-8a01-2fc63af19226-node-exporter-accelerators-collector-config\") pod \"node-exporter-k9zcg\" (UID: \"02e1dce7-d7cb-4540-8a01-2fc63af19226\") " pod="openshift-monitoring/node-exporter-k9zcg" Sep 08 04:00:25.032095 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:00:25.032067 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/02e1dce7-d7cb-4540-8a01-2fc63af19226-metrics-client-ca\") pod \"node-exporter-k9zcg\" (UID: \"02e1dce7-d7cb-4540-8a01-2fc63af19226\") " pod="openshift-monitoring/node-exporter-k9zcg" Sep 08 04:00:25.032219 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:00:25.032116 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/02e1dce7-d7cb-4540-8a01-2fc63af19226-node-exporter-accelerators-collector-config\") pod \"node-exporter-k9zcg\" (UID: \"02e1dce7-d7cb-4540-8a01-2fc63af19226\") " pod="openshift-monitoring/node-exporter-k9zcg" Sep 08 04:00:25.032219 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:00:25.032144 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/02e1dce7-d7cb-4540-8a01-2fc63af19226-sys\") pod \"node-exporter-k9zcg\" (UID: \"02e1dce7-d7cb-4540-8a01-2fc63af19226\") " pod="openshift-monitoring/node-exporter-k9zcg" Sep 08 04:00:25.032219 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:00:25.032164 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/02e1dce7-d7cb-4540-8a01-2fc63af19226-node-exporter-textfile\") pod \"node-exporter-k9zcg\" (UID: \"02e1dce7-d7cb-4540-8a01-2fc63af19226\") " pod="openshift-monitoring/node-exporter-k9zcg" Sep 08 04:00:25.032219 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:00:25.032187 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/02e1dce7-d7cb-4540-8a01-2fc63af19226-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-k9zcg\" (UID: \"02e1dce7-d7cb-4540-8a01-2fc63af19226\") " pod="openshift-monitoring/node-exporter-k9zcg" Sep 08 04:00:25.032219 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:00:25.032206 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mcgws\" (UniqueName: \"kubernetes.io/projected/02e1dce7-d7cb-4540-8a01-2fc63af19226-kube-api-access-mcgws\") pod \"node-exporter-k9zcg\" (UID: \"02e1dce7-d7cb-4540-8a01-2fc63af19226\") " pod="openshift-monitoring/node-exporter-k9zcg" Sep 08 04:00:25.032475 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:00:25.032251 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/02e1dce7-d7cb-4540-8a01-2fc63af19226-sys\") pod \"node-exporter-k9zcg\" (UID: \"02e1dce7-d7cb-4540-8a01-2fc63af19226\") " pod="openshift-monitoring/node-exporter-k9zcg" Sep 08 04:00:25.032475 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:00:25.032288 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/02e1dce7-d7cb-4540-8a01-2fc63af19226-node-exporter-tls\") pod \"node-exporter-k9zcg\" (UID: \"02e1dce7-d7cb-4540-8a01-2fc63af19226\") " pod="openshift-monitoring/node-exporter-k9zcg" Sep 08 04:00:25.032475 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:00:25.032335 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/02e1dce7-d7cb-4540-8a01-2fc63af19226-root\") pod \"node-exporter-k9zcg\" (UID: \"02e1dce7-d7cb-4540-8a01-2fc63af19226\") " pod="openshift-monitoring/node-exporter-k9zcg" Sep 08 04:00:25.032475 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:00:25.032377 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/02e1dce7-d7cb-4540-8a01-2fc63af19226-node-exporter-wtmp\") pod \"node-exporter-k9zcg\" (UID: \"02e1dce7-d7cb-4540-8a01-2fc63af19226\") " pod="openshift-monitoring/node-exporter-k9zcg" Sep 08 04:00:25.032475 ip-10-0-128-67 kubenswrapper[2571]: E0908 04:00:25.032408 2571 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Sep 08 04:00:25.032475 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:00:25.032460 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/02e1dce7-d7cb-4540-8a01-2fc63af19226-root\") pod \"node-exporter-k9zcg\" (UID: \"02e1dce7-d7cb-4540-8a01-2fc63af19226\") " pod="openshift-monitoring/node-exporter-k9zcg" Sep 08 04:00:25.032761 ip-10-0-128-67 kubenswrapper[2571]: E0908 04:00:25.032493 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/02e1dce7-d7cb-4540-8a01-2fc63af19226-node-exporter-tls podName:02e1dce7-d7cb-4540-8a01-2fc63af19226 nodeName:}" failed. No retries permitted until 2026-09-08 04:00:25.532466412 +0000 UTC m=+319.003034771 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/02e1dce7-d7cb-4540-8a01-2fc63af19226-node-exporter-tls") pod "node-exporter-k9zcg" (UID: "02e1dce7-d7cb-4540-8a01-2fc63af19226") : secret "node-exporter-tls" not found Sep 08 04:00:25.032761 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:00:25.032514 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/02e1dce7-d7cb-4540-8a01-2fc63af19226-node-exporter-wtmp\") pod \"node-exporter-k9zcg\" (UID: \"02e1dce7-d7cb-4540-8a01-2fc63af19226\") " pod="openshift-monitoring/node-exporter-k9zcg" Sep 08 04:00:25.032761 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:00:25.032574 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/02e1dce7-d7cb-4540-8a01-2fc63af19226-node-exporter-textfile\") pod \"node-exporter-k9zcg\" (UID: \"02e1dce7-d7cb-4540-8a01-2fc63af19226\") " pod="openshift-monitoring/node-exporter-k9zcg" Sep 08 04:00:25.032761 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:00:25.032733 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/02e1dce7-d7cb-4540-8a01-2fc63af19226-metrics-client-ca\") pod \"node-exporter-k9zcg\" (UID: \"02e1dce7-d7cb-4540-8a01-2fc63af19226\") " pod="openshift-monitoring/node-exporter-k9zcg" Sep 08 04:00:25.032899 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:00:25.032763 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/02e1dce7-d7cb-4540-8a01-2fc63af19226-node-exporter-accelerators-collector-config\") pod \"node-exporter-k9zcg\" (UID: \"02e1dce7-d7cb-4540-8a01-2fc63af19226\") " pod="openshift-monitoring/node-exporter-k9zcg" Sep 08 04:00:25.034466 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:00:25.034439 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/02e1dce7-d7cb-4540-8a01-2fc63af19226-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-k9zcg\" (UID: \"02e1dce7-d7cb-4540-8a01-2fc63af19226\") " pod="openshift-monitoring/node-exporter-k9zcg" Sep 08 04:00:25.048411 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:00:25.048390 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mcgws\" (UniqueName: \"kubernetes.io/projected/02e1dce7-d7cb-4540-8a01-2fc63af19226-kube-api-access-mcgws\") pod \"node-exporter-k9zcg\" (UID: \"02e1dce7-d7cb-4540-8a01-2fc63af19226\") " pod="openshift-monitoring/node-exporter-k9zcg" Sep 08 04:00:25.535291 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:00:25.535255 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/02e1dce7-d7cb-4540-8a01-2fc63af19226-node-exporter-tls\") pod \"node-exporter-k9zcg\" (UID: \"02e1dce7-d7cb-4540-8a01-2fc63af19226\") " pod="openshift-monitoring/node-exporter-k9zcg" Sep 08 04:00:25.537560 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:00:25.537537 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/02e1dce7-d7cb-4540-8a01-2fc63af19226-node-exporter-tls\") pod \"node-exporter-k9zcg\" (UID: \"02e1dce7-d7cb-4540-8a01-2fc63af19226\") " pod="openshift-monitoring/node-exporter-k9zcg" Sep 08 04:00:25.828953 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:00:25.828856 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-k9zcg" Sep 08 04:00:25.839790 ip-10-0-128-67 kubenswrapper[2571]: W0908 04:00:25.839768 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod02e1dce7_d7cb_4540_8a01_2fc63af19226.slice/crio-b3ca214350a3d14eb09331898d122a21b57ab1a57ca5eaad1e68731a7a601748 WatchSource:0}: Error finding container b3ca214350a3d14eb09331898d122a21b57ab1a57ca5eaad1e68731a7a601748: Status 404 returned error can't find the container with id b3ca214350a3d14eb09331898d122a21b57ab1a57ca5eaad1e68731a7a601748 Sep 08 04:00:25.841492 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:00:25.841474 2571 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 08 04:00:26.161145 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:00:26.161043 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-k9zcg" event={"ID":"02e1dce7-d7cb-4540-8a01-2fc63af19226","Type":"ContainerStarted","Data":"b3ca214350a3d14eb09331898d122a21b57ab1a57ca5eaad1e68731a7a601748"} Sep 08 04:00:28.168704 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:00:28.168670 2571 generic.go:356] "Generic (PLEG): container finished" podID="02e1dce7-d7cb-4540-8a01-2fc63af19226" containerID="223a37740217ed09a98e9fe7c268aa2b27513def6e8a1f5f41b3b770231c3991" exitCode=0 Sep 08 04:00:28.169047 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:00:28.168753 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-k9zcg" event={"ID":"02e1dce7-d7cb-4540-8a01-2fc63af19226","Type":"ContainerDied","Data":"223a37740217ed09a98e9fe7c268aa2b27513def6e8a1f5f41b3b770231c3991"} Sep 08 04:00:29.173765 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:00:29.173732 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-k9zcg" event={"ID":"02e1dce7-d7cb-4540-8a01-2fc63af19226","Type":"ContainerStarted","Data":"f19180582599ec9ac937de16b58383edbd104fea8b00e41a7ad64191079804c6"} Sep 08 04:00:29.174117 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:00:29.173782 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-k9zcg" event={"ID":"02e1dce7-d7cb-4540-8a01-2fc63af19226","Type":"ContainerStarted","Data":"28c162471f88ce3903ba10a5a9e09f4b1e69d48547c8b3a50822aa83de153e4c"} Sep 08 04:00:29.199964 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:00:29.199901 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-k9zcg" podStartSLOduration=3.055678841 podStartE2EDuration="5.1998829s" totalImagesPullingTime="2.082646867s" totalInitContainerRuntime="61.557192ms" isStatefulPod=true podCreationTimestamp="2026-09-08 04:00:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 04:00:29.198745581 +0000 UTC m=+322.669313958" watchObservedRunningTime="2026-09-08 04:00:29.1998829 +0000 UTC m=+322.670451282" Sep 08 04:00:37.311545 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:00:37.311512 2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6599b77f7d-5kvch"] Sep 08 04:00:37.311904 ip-10-0-128-67 kubenswrapper[2571]: E0908 04:00:37.311719 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context canceled" pod="openshift-image-registry/image-registry-6599b77f7d-5kvch" podUID="2ade1f16-121b-46fc-95be-128ebe6804e0" Sep 08 04:00:38.199862 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:00:38.199832 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6599b77f7d-5kvch" Sep 08 04:00:38.208743 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:00:38.208719 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6599b77f7d-5kvch" Sep 08 04:00:38.224575 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:00:38.224557 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/2ade1f16-121b-46fc-95be-128ebe6804e0-ca-trust-extracted\") pod \"2ade1f16-121b-46fc-95be-128ebe6804e0\" (UID: \"2ade1f16-121b-46fc-95be-128ebe6804e0\") " Sep 08 04:00:38.224652 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:00:38.224584 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2ade1f16-121b-46fc-95be-128ebe6804e0-bound-sa-token\") pod \"2ade1f16-121b-46fc-95be-128ebe6804e0\" (UID: \"2ade1f16-121b-46fc-95be-128ebe6804e0\") " Sep 08 04:00:38.224652 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:00:38.224605 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/2ade1f16-121b-46fc-95be-128ebe6804e0-trusted-ca\") pod \"2ade1f16-121b-46fc-95be-128ebe6804e0\" (UID: \"2ade1f16-121b-46fc-95be-128ebe6804e0\") " Sep 08 04:00:38.224652 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:00:38.224622 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/2ade1f16-121b-46fc-95be-128ebe6804e0-registry-certificates\") pod \"2ade1f16-121b-46fc-95be-128ebe6804e0\" (UID: \"2ade1f16-121b-46fc-95be-128ebe6804e0\") " Sep 08 04:00:38.224652 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:00:38.224645 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l2pkm\" (UniqueName: \"kubernetes.io/projected/2ade1f16-121b-46fc-95be-128ebe6804e0-kube-api-access-l2pkm\") pod \"2ade1f16-121b-46fc-95be-128ebe6804e0\" (UID: \"2ade1f16-121b-46fc-95be-128ebe6804e0\") " Sep 08 04:00:38.224860 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:00:38.224676 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/2ade1f16-121b-46fc-95be-128ebe6804e0-image-registry-private-configuration\") pod \"2ade1f16-121b-46fc-95be-128ebe6804e0\" (UID: \"2ade1f16-121b-46fc-95be-128ebe6804e0\") " Sep 08 04:00:38.224860 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:00:38.224707 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/2ade1f16-121b-46fc-95be-128ebe6804e0-installation-pull-secrets\") pod \"2ade1f16-121b-46fc-95be-128ebe6804e0\" (UID: \"2ade1f16-121b-46fc-95be-128ebe6804e0\") " Sep 08 04:00:38.224996 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:00:38.224967 2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2ade1f16-121b-46fc-95be-128ebe6804e0-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "2ade1f16-121b-46fc-95be-128ebe6804e0" (UID: "2ade1f16-121b-46fc-95be-128ebe6804e0"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 08 04:00:38.225042 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:00:38.225007 2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2ade1f16-121b-46fc-95be-128ebe6804e0-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "2ade1f16-121b-46fc-95be-128ebe6804e0" (UID: "2ade1f16-121b-46fc-95be-128ebe6804e0"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 08 04:00:38.225078 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:00:38.225033 2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2ade1f16-121b-46fc-95be-128ebe6804e0-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "2ade1f16-121b-46fc-95be-128ebe6804e0" (UID: "2ade1f16-121b-46fc-95be-128ebe6804e0"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 08 04:00:38.226832 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:00:38.226800 2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2ade1f16-121b-46fc-95be-128ebe6804e0-kube-api-access-l2pkm" (OuterVolumeSpecName: "kube-api-access-l2pkm") pod "2ade1f16-121b-46fc-95be-128ebe6804e0" (UID: "2ade1f16-121b-46fc-95be-128ebe6804e0"). InnerVolumeSpecName "kube-api-access-l2pkm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 08 04:00:38.226974 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:00:38.226840 2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2ade1f16-121b-46fc-95be-128ebe6804e0-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "2ade1f16-121b-46fc-95be-128ebe6804e0" (UID: "2ade1f16-121b-46fc-95be-128ebe6804e0"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 08 04:00:38.226974 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:00:38.226865 2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2ade1f16-121b-46fc-95be-128ebe6804e0-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "2ade1f16-121b-46fc-95be-128ebe6804e0" (UID: "2ade1f16-121b-46fc-95be-128ebe6804e0"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 08 04:00:38.226974 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:00:38.226942 2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2ade1f16-121b-46fc-95be-128ebe6804e0-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "2ade1f16-121b-46fc-95be-128ebe6804e0" (UID: "2ade1f16-121b-46fc-95be-128ebe6804e0"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 08 04:00:38.326137 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:00:38.326110 2571 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/2ade1f16-121b-46fc-95be-128ebe6804e0-installation-pull-secrets\") on node \"ip-10-0-128-67.ec2.internal\" DevicePath \"\"" Sep 08 04:00:38.326137 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:00:38.326137 2571 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/2ade1f16-121b-46fc-95be-128ebe6804e0-ca-trust-extracted\") on node \"ip-10-0-128-67.ec2.internal\" DevicePath \"\"" Sep 08 04:00:38.326471 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:00:38.326146 2571 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2ade1f16-121b-46fc-95be-128ebe6804e0-bound-sa-token\") on node \"ip-10-0-128-67.ec2.internal\" DevicePath \"\"" Sep 08 04:00:38.326471 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:00:38.326156 2571 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/2ade1f16-121b-46fc-95be-128ebe6804e0-trusted-ca\") on node \"ip-10-0-128-67.ec2.internal\" DevicePath \"\"" Sep 08 04:00:38.326471 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:00:38.326164 2571 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/2ade1f16-121b-46fc-95be-128ebe6804e0-registry-certificates\") on node \"ip-10-0-128-67.ec2.internal\" DevicePath \"\"" Sep 08 04:00:38.326471 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:00:38.326172 2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l2pkm\" (UniqueName: \"kubernetes.io/projected/2ade1f16-121b-46fc-95be-128ebe6804e0-kube-api-access-l2pkm\") on node \"ip-10-0-128-67.ec2.internal\" DevicePath \"\"" Sep 08 04:00:38.326471 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:00:38.326180 2571 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/2ade1f16-121b-46fc-95be-128ebe6804e0-image-registry-private-configuration\") on node \"ip-10-0-128-67.ec2.internal\" DevicePath \"\"" Sep 08 04:00:39.203235 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:00:39.203205 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6599b77f7d-5kvch" Sep 08 04:00:39.244564 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:00:39.244538 2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6599b77f7d-5kvch"] Sep 08 04:00:39.249366 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:00:39.249344 2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-6599b77f7d-5kvch"] Sep 08 04:00:39.334117 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:00:39.334058 2571 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2ade1f16-121b-46fc-95be-128ebe6804e0-registry-tls\") on node \"ip-10-0-128-67.ec2.internal\" DevicePath \"\"" Sep 08 04:00:41.065684 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:00:41.065650 2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2ade1f16-121b-46fc-95be-128ebe6804e0" path="/var/lib/kubelet/pods/2ade1f16-121b-46fc-95be-128ebe6804e0/volumes" Sep 08 04:00:51.117128 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:00:51.117093 2571 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8446f68685-n2jlb" podUID="aa1a9b42-16d9-4de1-a54e-4ed2cd78447a" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Sep 08 04:01:01.119888 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:01:01.119793 2571 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8446f68685-n2jlb" podUID="aa1a9b42-16d9-4de1-a54e-4ed2cd78447a" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Sep 08 04:01:11.116521 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:01:11.116480 2571 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8446f68685-n2jlb" podUID="aa1a9b42-16d9-4de1-a54e-4ed2cd78447a" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Sep 08 04:01:11.117001 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:01:11.116553 2571 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8446f68685-n2jlb" Sep 08 04:01:11.117162 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:01:11.117129 2571 kuberuntime_manager.go:1192] "Message for Container of pod" containerName="service-proxy" containerStatusID={"Type":"cri-o","ID":"dd79d263c4298e61ebbe47432d05886d7eefda5413eacca0c3d1f95b10613507"} pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8446f68685-n2jlb" containerMessage="Container service-proxy failed liveness probe, will be restarted" Sep 08 04:01:11.117228 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:01:11.117190 2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8446f68685-n2jlb" podUID="aa1a9b42-16d9-4de1-a54e-4ed2cd78447a" containerName="service-proxy" containerID="cri-o://dd79d263c4298e61ebbe47432d05886d7eefda5413eacca0c3d1f95b10613507" gracePeriod=30 Sep 08 04:01:11.305699 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:01:11.305668 2571 generic.go:356] "Generic (PLEG): container finished" podID="aa1a9b42-16d9-4de1-a54e-4ed2cd78447a" containerID="dd79d263c4298e61ebbe47432d05886d7eefda5413eacca0c3d1f95b10613507" exitCode=2 Sep 08 04:01:11.305828 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:01:11.305739 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8446f68685-n2jlb" event={"ID":"aa1a9b42-16d9-4de1-a54e-4ed2cd78447a","Type":"ContainerDied","Data":"dd79d263c4298e61ebbe47432d05886d7eefda5413eacca0c3d1f95b10613507"} Sep 08 04:01:11.305828 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:01:11.305776 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8446f68685-n2jlb" event={"ID":"aa1a9b42-16d9-4de1-a54e-4ed2cd78447a","Type":"ContainerStarted","Data":"37950cccbc1315b4f42db3d1ab62dd8507d45762fae7562fad521b21b211ee8b"} Sep 08 04:01:20.927593 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:01:20.927555 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/be017881-2b6a-4fd2-b62d-4b5d3bd7b834-metrics-certs\") pod \"network-metrics-daemon-s2679\" (UID: \"be017881-2b6a-4fd2-b62d-4b5d3bd7b834\") " pod="openshift-multus/network-metrics-daemon-s2679" Sep 08 04:01:20.929947 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:01:20.929905 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/be017881-2b6a-4fd2-b62d-4b5d3bd7b834-metrics-certs\") pod \"network-metrics-daemon-s2679\" (UID: \"be017881-2b6a-4fd2-b62d-4b5d3bd7b834\") " pod="openshift-multus/network-metrics-daemon-s2679" Sep 08 04:01:21.165307 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:01:21.165274 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-tzmtk\"" Sep 08 04:01:21.173554 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:01:21.173538 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-s2679" Sep 08 04:01:21.444445 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:01:21.444289 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-s2679"] Sep 08 04:01:21.446962 ip-10-0-128-67 kubenswrapper[2571]: W0908 04:01:21.446933 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbe017881_2b6a_4fd2_b62d_4b5d3bd7b834.slice/crio-29213cdfd390a30e709e2a001a1e1e270ab670eeb326134048051f12dc172c1b WatchSource:0}: Error finding container 29213cdfd390a30e709e2a001a1e1e270ab670eeb326134048051f12dc172c1b: Status 404 returned error can't find the container with id 29213cdfd390a30e709e2a001a1e1e270ab670eeb326134048051f12dc172c1b Sep 08 04:01:22.341269 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:01:22.341225 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-s2679" event={"ID":"be017881-2b6a-4fd2-b62d-4b5d3bd7b834","Type":"ContainerStarted","Data":"29213cdfd390a30e709e2a001a1e1e270ab670eeb326134048051f12dc172c1b"} Sep 08 04:01:23.345451 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:01:23.345420 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-s2679" event={"ID":"be017881-2b6a-4fd2-b62d-4b5d3bd7b834","Type":"ContainerStarted","Data":"215035d77ba1b1a0267eeb6a3f62b37101fe281b68e95001eb8241f3ba8c9341"} Sep 08 04:01:23.345790 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:01:23.345467 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-s2679" event={"ID":"be017881-2b6a-4fd2-b62d-4b5d3bd7b834","Type":"ContainerStarted","Data":"ef8bb1d1c85677b74d0f53da75aea24ca9e92b606883a8c772a4d8c6ee3ceb7a"} Sep 08 04:01:23.365709 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:01:23.365661 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-s2679" podStartSLOduration=375.190289509 podStartE2EDuration="6m16.365623196s" totalImagesPullingTime="1.175333687s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 03:55:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 04:01:23.365113134 +0000 UTC m=+376.835681515" watchObservedRunningTime="2026-09-08 04:01:23.365623196 +0000 UTC m=+376.836191577" Sep 08 04:01:50.021206 ip-10-0-128-67 kubenswrapper[2571]: E0908 04:01:50.021146 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-2gs5x" podUID="c46d90d1-2661-4b22-9f7d-9d2fd5eaabbb" Sep 08 04:01:50.021206 ip-10-0-128-67 kubenswrapper[2571]: E0908 04:01:50.021185 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[networking-console-plugin-cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-network-console/networking-console-plugin-79977f9844-h4zkr" podUID="4fd5d5dc-7953-4bd3-b65c-f81092c2af3d" Sep 08 04:01:50.429307 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:01:50.429283 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-2gs5x" Sep 08 04:01:50.429476 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:01:50.429283 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-79977f9844-h4zkr" Sep 08 04:01:52.458574 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:01:52.458545 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c46d90d1-2661-4b22-9f7d-9d2fd5eaabbb-metrics-tls\") pod \"dns-default-2gs5x\" (UID: \"c46d90d1-2661-4b22-9f7d-9d2fd5eaabbb\") " pod="openshift-dns/dns-default-2gs5x" Sep 08 04:01:52.458984 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:01:52.458580 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/4fd5d5dc-7953-4bd3-b65c-f81092c2af3d-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-h4zkr\" (UID: \"4fd5d5dc-7953-4bd3-b65c-f81092c2af3d\") " pod="openshift-network-console/networking-console-plugin-79977f9844-h4zkr" Sep 08 04:01:52.460978 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:01:52.460948 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/4fd5d5dc-7953-4bd3-b65c-f81092c2af3d-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-h4zkr\" (UID: \"4fd5d5dc-7953-4bd3-b65c-f81092c2af3d\") " pod="openshift-network-console/networking-console-plugin-79977f9844-h4zkr" Sep 08 04:01:52.461087 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:01:52.460951 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c46d90d1-2661-4b22-9f7d-9d2fd5eaabbb-metrics-tls\") pod \"dns-default-2gs5x\" (UID: \"c46d90d1-2661-4b22-9f7d-9d2fd5eaabbb\") " pod="openshift-dns/dns-default-2gs5x" Sep 08 04:01:52.537712 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:01:52.537687 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-sl2fz\"" Sep 08 04:01:52.537809 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:01:52.537687 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-bd2fn\"" Sep 08 04:01:52.540034 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:01:52.540013 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-2gs5x" Sep 08 04:01:52.540113 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:01:52.540033 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-79977f9844-h4zkr" Sep 08 04:01:52.820848 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:01:52.820816 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-79977f9844-h4zkr"] Sep 08 04:01:52.825094 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:01:52.825026 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-2gs5x"] Sep 08 04:01:52.825592 ip-10-0-128-67 kubenswrapper[2571]: W0908 04:01:52.825571 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4fd5d5dc_7953_4bd3_b65c_f81092c2af3d.slice/crio-0e095c00b669a3f8cd17b3d9c9efe4a7cc117559d41c30890591bb5dfebc49c4 WatchSource:0}: Error finding container 0e095c00b669a3f8cd17b3d9c9efe4a7cc117559d41c30890591bb5dfebc49c4: Status 404 returned error can't find the container with id 0e095c00b669a3f8cd17b3d9c9efe4a7cc117559d41c30890591bb5dfebc49c4 Sep 08 04:01:52.828431 ip-10-0-128-67 kubenswrapper[2571]: W0908 04:01:52.828379 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc46d90d1_2661_4b22_9f7d_9d2fd5eaabbb.slice/crio-d3ecbc476862abf2138cfb9dde728404bc6b30a79d4a2b5753f8b7dc6f7a3ac2 WatchSource:0}: Error finding container d3ecbc476862abf2138cfb9dde728404bc6b30a79d4a2b5753f8b7dc6f7a3ac2: Status 404 returned error can't find the container with id d3ecbc476862abf2138cfb9dde728404bc6b30a79d4a2b5753f8b7dc6f7a3ac2 Sep 08 04:01:53.441934 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:01:53.441891 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-2gs5x" event={"ID":"c46d90d1-2661-4b22-9f7d-9d2fd5eaabbb","Type":"ContainerStarted","Data":"d3ecbc476862abf2138cfb9dde728404bc6b30a79d4a2b5753f8b7dc6f7a3ac2"} Sep 08 04:01:53.443122 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:01:53.443089 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-79977f9844-h4zkr" event={"ID":"4fd5d5dc-7953-4bd3-b65c-f81092c2af3d","Type":"ContainerStarted","Data":"0e095c00b669a3f8cd17b3d9c9efe4a7cc117559d41c30890591bb5dfebc49c4"} Sep 08 04:01:55.450685 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:01:55.450594 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-79977f9844-h4zkr" event={"ID":"4fd5d5dc-7953-4bd3-b65c-f81092c2af3d","Type":"ContainerStarted","Data":"3e7ece836ea7d0392059fe17acb0f3581242a21344b59ff90399715a101a3bf9"} Sep 08 04:01:55.468661 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:01:55.468616 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-79977f9844-h4zkr" podStartSLOduration=380.115248899 podStartE2EDuration="6m22.468600646s" totalImagesPullingTime="2.353351747s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 03:55:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 04:01:55.467850344 +0000 UTC m=+408.938418724" watchObservedRunningTime="2026-09-08 04:01:55.468600646 +0000 UTC m=+408.939169011" Sep 08 04:01:57.460300 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:01:57.460219 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-2gs5x" event={"ID":"c46d90d1-2661-4b22-9f7d-9d2fd5eaabbb","Type":"ContainerStarted","Data":"ad704855790284e6bfaa11a92352ebe0bf510144fece15839ea37f8adb75711f"} Sep 08 04:01:57.460300 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:01:57.460296 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-2gs5x" event={"ID":"c46d90d1-2661-4b22-9f7d-9d2fd5eaabbb","Type":"ContainerStarted","Data":"a247593445851d8b305aa1f27e8bd2270c1fd0f7be8d1b8cce30e207a521fa2e"} Sep 08 04:01:57.460760 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:01:57.460332 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-2gs5x" Sep 08 04:01:57.481632 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:01:57.481579 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-2gs5x" podStartSLOduration=373.170568679 podStartE2EDuration="6m17.48156504s" totalImagesPullingTime="4.310996361s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 03:55:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 04:01:57.480270907 +0000 UTC m=+410.950839287" watchObservedRunningTime="2026-09-08 04:01:57.48156504 +0000 UTC m=+410.952133418" Sep 08 04:02:07.466502 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:02:07.466464 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-2gs5x" Sep 08 04:04:17.486782 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:04:17.486741 2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qq9bt"] Sep 08 04:04:17.489675 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:04:17.489659 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qq9bt" Sep 08 04:04:17.494885 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:04:17.494863 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-qvw5w\"" Sep 08 04:04:17.495018 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:04:17.494886 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Sep 08 04:04:17.495984 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:04:17.495960 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Sep 08 04:04:17.500792 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:04:17.500772 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qq9bt"] Sep 08 04:04:17.538956 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:04:17.538900 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6b82e94e-ef8f-4cb5-96bc-7215049dc35d-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qq9bt\" (UID: \"6b82e94e-ef8f-4cb5-96bc-7215049dc35d\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qq9bt" Sep 08 04:04:17.539108 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:04:17.538970 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-98ppt\" (UniqueName: \"kubernetes.io/projected/6b82e94e-ef8f-4cb5-96bc-7215049dc35d-kube-api-access-98ppt\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qq9bt\" (UID: \"6b82e94e-ef8f-4cb5-96bc-7215049dc35d\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qq9bt" Sep 08 04:04:17.539108 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:04:17.539011 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6b82e94e-ef8f-4cb5-96bc-7215049dc35d-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qq9bt\" (UID: \"6b82e94e-ef8f-4cb5-96bc-7215049dc35d\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qq9bt" Sep 08 04:04:17.639886 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:04:17.639833 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-98ppt\" (UniqueName: \"kubernetes.io/projected/6b82e94e-ef8f-4cb5-96bc-7215049dc35d-kube-api-access-98ppt\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qq9bt\" (UID: \"6b82e94e-ef8f-4cb5-96bc-7215049dc35d\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qq9bt" Sep 08 04:04:17.640105 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:04:17.639899 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6b82e94e-ef8f-4cb5-96bc-7215049dc35d-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qq9bt\" (UID: \"6b82e94e-ef8f-4cb5-96bc-7215049dc35d\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qq9bt" Sep 08 04:04:17.640105 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:04:17.639980 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6b82e94e-ef8f-4cb5-96bc-7215049dc35d-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qq9bt\" (UID: \"6b82e94e-ef8f-4cb5-96bc-7215049dc35d\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qq9bt" Sep 08 04:04:17.640374 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:04:17.640349 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6b82e94e-ef8f-4cb5-96bc-7215049dc35d-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qq9bt\" (UID: \"6b82e94e-ef8f-4cb5-96bc-7215049dc35d\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qq9bt" Sep 08 04:04:17.640374 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:04:17.640365 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6b82e94e-ef8f-4cb5-96bc-7215049dc35d-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qq9bt\" (UID: \"6b82e94e-ef8f-4cb5-96bc-7215049dc35d\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qq9bt" Sep 08 04:04:17.649901 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:04:17.649868 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-98ppt\" (UniqueName: \"kubernetes.io/projected/6b82e94e-ef8f-4cb5-96bc-7215049dc35d-kube-api-access-98ppt\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qq9bt\" (UID: \"6b82e94e-ef8f-4cb5-96bc-7215049dc35d\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qq9bt" Sep 08 04:04:17.798643 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:04:17.798618 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qq9bt" Sep 08 04:04:18.073300 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:04:18.073277 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qq9bt"] Sep 08 04:04:18.075141 ip-10-0-128-67 kubenswrapper[2571]: W0908 04:04:18.075113 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6b82e94e_ef8f_4cb5_96bc_7215049dc35d.slice/crio-d56518c53cb7f09fe1e952f6f1fbf344008c48bcdcc0279555f729968e04f3b8 WatchSource:0}: Error finding container d56518c53cb7f09fe1e952f6f1fbf344008c48bcdcc0279555f729968e04f3b8: Status 404 returned error can't find the container with id d56518c53cb7f09fe1e952f6f1fbf344008c48bcdcc0279555f729968e04f3b8 Sep 08 04:04:18.328307 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:04:18.328235 2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/978bd81eed4c4dc7896cbc7c21ae91125ef0d2dcd9abf7d17f5d8e954e7ch4w"] Sep 08 04:04:18.332344 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:04:18.332327 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/978bd81eed4c4dc7896cbc7c21ae91125ef0d2dcd9abf7d17f5d8e954e7ch4w" Sep 08 04:04:18.342028 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:04:18.341982 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/978bd81eed4c4dc7896cbc7c21ae91125ef0d2dcd9abf7d17f5d8e954e7ch4w"] Sep 08 04:04:18.445994 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:04:18.445963 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e3d75930-871f-42ec-beda-136d6c2a3383-bundle\") pod \"978bd81eed4c4dc7896cbc7c21ae91125ef0d2dcd9abf7d17f5d8e954e7ch4w\" (UID: \"e3d75930-871f-42ec-beda-136d6c2a3383\") " pod="openshift-marketplace/978bd81eed4c4dc7896cbc7c21ae91125ef0d2dcd9abf7d17f5d8e954e7ch4w" Sep 08 04:04:18.446171 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:04:18.446038 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jd2ch\" (UniqueName: \"kubernetes.io/projected/e3d75930-871f-42ec-beda-136d6c2a3383-kube-api-access-jd2ch\") pod \"978bd81eed4c4dc7896cbc7c21ae91125ef0d2dcd9abf7d17f5d8e954e7ch4w\" (UID: \"e3d75930-871f-42ec-beda-136d6c2a3383\") " pod="openshift-marketplace/978bd81eed4c4dc7896cbc7c21ae91125ef0d2dcd9abf7d17f5d8e954e7ch4w" Sep 08 04:04:18.446171 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:04:18.446125 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e3d75930-871f-42ec-beda-136d6c2a3383-util\") pod \"978bd81eed4c4dc7896cbc7c21ae91125ef0d2dcd9abf7d17f5d8e954e7ch4w\" (UID: \"e3d75930-871f-42ec-beda-136d6c2a3383\") " pod="openshift-marketplace/978bd81eed4c4dc7896cbc7c21ae91125ef0d2dcd9abf7d17f5d8e954e7ch4w" Sep 08 04:04:18.547078 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:04:18.547039 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jd2ch\" (UniqueName: \"kubernetes.io/projected/e3d75930-871f-42ec-beda-136d6c2a3383-kube-api-access-jd2ch\") pod \"978bd81eed4c4dc7896cbc7c21ae91125ef0d2dcd9abf7d17f5d8e954e7ch4w\" (UID: \"e3d75930-871f-42ec-beda-136d6c2a3383\") " pod="openshift-marketplace/978bd81eed4c4dc7896cbc7c21ae91125ef0d2dcd9abf7d17f5d8e954e7ch4w" Sep 08 04:04:18.547524 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:04:18.547199 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e3d75930-871f-42ec-beda-136d6c2a3383-util\") pod \"978bd81eed4c4dc7896cbc7c21ae91125ef0d2dcd9abf7d17f5d8e954e7ch4w\" (UID: \"e3d75930-871f-42ec-beda-136d6c2a3383\") " pod="openshift-marketplace/978bd81eed4c4dc7896cbc7c21ae91125ef0d2dcd9abf7d17f5d8e954e7ch4w" Sep 08 04:04:18.547524 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:04:18.547260 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e3d75930-871f-42ec-beda-136d6c2a3383-bundle\") pod \"978bd81eed4c4dc7896cbc7c21ae91125ef0d2dcd9abf7d17f5d8e954e7ch4w\" (UID: \"e3d75930-871f-42ec-beda-136d6c2a3383\") " pod="openshift-marketplace/978bd81eed4c4dc7896cbc7c21ae91125ef0d2dcd9abf7d17f5d8e954e7ch4w" Sep 08 04:04:18.547642 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:04:18.547544 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e3d75930-871f-42ec-beda-136d6c2a3383-util\") pod \"978bd81eed4c4dc7896cbc7c21ae91125ef0d2dcd9abf7d17f5d8e954e7ch4w\" (UID: \"e3d75930-871f-42ec-beda-136d6c2a3383\") " pod="openshift-marketplace/978bd81eed4c4dc7896cbc7c21ae91125ef0d2dcd9abf7d17f5d8e954e7ch4w" Sep 08 04:04:18.547642 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:04:18.547564 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e3d75930-871f-42ec-beda-136d6c2a3383-bundle\") pod \"978bd81eed4c4dc7896cbc7c21ae91125ef0d2dcd9abf7d17f5d8e954e7ch4w\" (UID: \"e3d75930-871f-42ec-beda-136d6c2a3383\") " pod="openshift-marketplace/978bd81eed4c4dc7896cbc7c21ae91125ef0d2dcd9abf7d17f5d8e954e7ch4w" Sep 08 04:04:18.557550 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:04:18.557519 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jd2ch\" (UniqueName: \"kubernetes.io/projected/e3d75930-871f-42ec-beda-136d6c2a3383-kube-api-access-jd2ch\") pod \"978bd81eed4c4dc7896cbc7c21ae91125ef0d2dcd9abf7d17f5d8e954e7ch4w\" (UID: \"e3d75930-871f-42ec-beda-136d6c2a3383\") " pod="openshift-marketplace/978bd81eed4c4dc7896cbc7c21ae91125ef0d2dcd9abf7d17f5d8e954e7ch4w" Sep 08 04:04:18.641451 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:04:18.641368 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/978bd81eed4c4dc7896cbc7c21ae91125ef0d2dcd9abf7d17f5d8e954e7ch4w" Sep 08 04:04:18.916500 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:04:18.916412 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/978bd81eed4c4dc7896cbc7c21ae91125ef0d2dcd9abf7d17f5d8e954e7ch4w"] Sep 08 04:04:18.920714 ip-10-0-128-67 kubenswrapper[2571]: W0908 04:04:18.920665 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode3d75930_871f_42ec_beda_136d6c2a3383.slice/crio-af602a8dcfe48e70e968e286e05b472ed05dd66a3b52be7ae945a371a8f58597 WatchSource:0}: Error finding container af602a8dcfe48e70e968e286e05b472ed05dd66a3b52be7ae945a371a8f58597: Status 404 returned error can't find the container with id af602a8dcfe48e70e968e286e05b472ed05dd66a3b52be7ae945a371a8f58597 Sep 08 04:04:18.921569 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:04:18.921533 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qq9bt" event={"ID":"6b82e94e-ef8f-4cb5-96bc-7215049dc35d","Type":"ContainerStarted","Data":"d56518c53cb7f09fe1e952f6f1fbf344008c48bcdcc0279555f729968e04f3b8"} Sep 08 04:04:19.928037 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:04:19.927961 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/978bd81eed4c4dc7896cbc7c21ae91125ef0d2dcd9abf7d17f5d8e954e7ch4w" event={"ID":"e3d75930-871f-42ec-beda-136d6c2a3383","Type":"ContainerStarted","Data":"af602a8dcfe48e70e968e286e05b472ed05dd66a3b52be7ae945a371a8f58597"} Sep 08 04:04:20.283029 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:04:20.282996 2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053dsnvm"] Sep 08 04:04:20.286590 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:04:20.286565 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053dsnvm" Sep 08 04:04:20.296196 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:04:20.296146 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053dsnvm"] Sep 08 04:04:20.363039 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:04:20.362995 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/43e4a0ae-d71a-4aca-9bdc-b046145c29d5-util\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053dsnvm\" (UID: \"43e4a0ae-d71a-4aca-9bdc-b046145c29d5\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053dsnvm" Sep 08 04:04:20.363225 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:04:20.363048 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qmbx2\" (UniqueName: \"kubernetes.io/projected/43e4a0ae-d71a-4aca-9bdc-b046145c29d5-kube-api-access-qmbx2\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053dsnvm\" (UID: \"43e4a0ae-d71a-4aca-9bdc-b046145c29d5\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053dsnvm" Sep 08 04:04:20.363225 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:04:20.363125 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/43e4a0ae-d71a-4aca-9bdc-b046145c29d5-bundle\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053dsnvm\" (UID: \"43e4a0ae-d71a-4aca-9bdc-b046145c29d5\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053dsnvm" Sep 08 04:04:20.383472 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:04:20.383371 2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183chd6tq"] Sep 08 04:04:20.387030 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:04:20.386906 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183chd6tq" Sep 08 04:04:20.396893 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:04:20.395805 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183chd6tq"] Sep 08 04:04:20.463936 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:04:20.463884 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/43e4a0ae-d71a-4aca-9bdc-b046145c29d5-bundle\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053dsnvm\" (UID: \"43e4a0ae-d71a-4aca-9bdc-b046145c29d5\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053dsnvm" Sep 08 04:04:20.464129 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:04:20.463972 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7mwr8\" (UniqueName: \"kubernetes.io/projected/d14312c6-2015-4cda-b1d7-72bb5a2dfb5c-kube-api-access-7mwr8\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183chd6tq\" (UID: \"d14312c6-2015-4cda-b1d7-72bb5a2dfb5c\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183chd6tq" Sep 08 04:04:20.464129 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:04:20.464011 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d14312c6-2015-4cda-b1d7-72bb5a2dfb5c-util\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183chd6tq\" (UID: \"d14312c6-2015-4cda-b1d7-72bb5a2dfb5c\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183chd6tq" Sep 08 04:04:20.464129 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:04:20.464066 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/43e4a0ae-d71a-4aca-9bdc-b046145c29d5-util\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053dsnvm\" (UID: \"43e4a0ae-d71a-4aca-9bdc-b046145c29d5\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053dsnvm" Sep 08 04:04:20.464129 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:04:20.464095 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qmbx2\" (UniqueName: \"kubernetes.io/projected/43e4a0ae-d71a-4aca-9bdc-b046145c29d5-kube-api-access-qmbx2\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053dsnvm\" (UID: \"43e4a0ae-d71a-4aca-9bdc-b046145c29d5\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053dsnvm" Sep 08 04:04:20.464129 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:04:20.464126 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d14312c6-2015-4cda-b1d7-72bb5a2dfb5c-bundle\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183chd6tq\" (UID: \"d14312c6-2015-4cda-b1d7-72bb5a2dfb5c\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183chd6tq" Sep 08 04:04:20.464378 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:04:20.464351 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/43e4a0ae-d71a-4aca-9bdc-b046145c29d5-bundle\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053dsnvm\" (UID: \"43e4a0ae-d71a-4aca-9bdc-b046145c29d5\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053dsnvm" Sep 08 04:04:20.464536 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:04:20.464511 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/43e4a0ae-d71a-4aca-9bdc-b046145c29d5-util\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053dsnvm\" (UID: \"43e4a0ae-d71a-4aca-9bdc-b046145c29d5\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053dsnvm" Sep 08 04:04:20.473598 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:04:20.473571 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qmbx2\" (UniqueName: \"kubernetes.io/projected/43e4a0ae-d71a-4aca-9bdc-b046145c29d5-kube-api-access-qmbx2\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053dsnvm\" (UID: \"43e4a0ae-d71a-4aca-9bdc-b046145c29d5\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053dsnvm" Sep 08 04:04:20.482899 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:04:20.482868 2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0msftb"] Sep 08 04:04:20.486386 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:04:20.486364 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0msftb" Sep 08 04:04:20.496004 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:04:20.495952 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0msftb"] Sep 08 04:04:20.565312 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:04:20.565213 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d14312c6-2015-4cda-b1d7-72bb5a2dfb5c-bundle\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183chd6tq\" (UID: \"d14312c6-2015-4cda-b1d7-72bb5a2dfb5c\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183chd6tq" Sep 08 04:04:20.565312 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:04:20.565288 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7mwr8\" (UniqueName: \"kubernetes.io/projected/d14312c6-2015-4cda-b1d7-72bb5a2dfb5c-kube-api-access-7mwr8\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183chd6tq\" (UID: \"d14312c6-2015-4cda-b1d7-72bb5a2dfb5c\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183chd6tq" Sep 08 04:04:20.565535 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:04:20.565343 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d14312c6-2015-4cda-b1d7-72bb5a2dfb5c-util\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183chd6tq\" (UID: \"d14312c6-2015-4cda-b1d7-72bb5a2dfb5c\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183chd6tq" Sep 08 04:04:20.565535 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:04:20.565377 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-45v5c\" (UniqueName: \"kubernetes.io/projected/a1d1c86f-fcdf-4377-8d10-5cbdf847d013-kube-api-access-45v5c\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0msftb\" (UID: \"a1d1c86f-fcdf-4377-8d10-5cbdf847d013\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0msftb" Sep 08 04:04:20.565535 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:04:20.565410 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a1d1c86f-fcdf-4377-8d10-5cbdf847d013-bundle\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0msftb\" (UID: \"a1d1c86f-fcdf-4377-8d10-5cbdf847d013\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0msftb" Sep 08 04:04:20.565535 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:04:20.565436 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a1d1c86f-fcdf-4377-8d10-5cbdf847d013-util\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0msftb\" (UID: \"a1d1c86f-fcdf-4377-8d10-5cbdf847d013\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0msftb" Sep 08 04:04:20.565747 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:04:20.565662 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d14312c6-2015-4cda-b1d7-72bb5a2dfb5c-bundle\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183chd6tq\" (UID: \"d14312c6-2015-4cda-b1d7-72bb5a2dfb5c\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183chd6tq" Sep 08 04:04:20.565802 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:04:20.565777 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d14312c6-2015-4cda-b1d7-72bb5a2dfb5c-util\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183chd6tq\" (UID: \"d14312c6-2015-4cda-b1d7-72bb5a2dfb5c\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183chd6tq" Sep 08 04:04:20.574519 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:04:20.574490 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7mwr8\" (UniqueName: \"kubernetes.io/projected/d14312c6-2015-4cda-b1d7-72bb5a2dfb5c-kube-api-access-7mwr8\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183chd6tq\" (UID: \"d14312c6-2015-4cda-b1d7-72bb5a2dfb5c\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183chd6tq" Sep 08 04:04:20.585828 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:04:20.585802 2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbjv7l4"] Sep 08 04:04:20.589444 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:04:20.589426 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbjv7l4" Sep 08 04:04:20.598678 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:04:20.598654 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbjv7l4"] Sep 08 04:04:20.599216 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:04:20.599177 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053dsnvm" Sep 08 04:04:20.667696 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:04:20.667599 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a73e2e62-1440-4773-a771-1dcaaa878f2f-bundle\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbjv7l4\" (UID: \"a73e2e62-1440-4773-a771-1dcaaa878f2f\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbjv7l4" Sep 08 04:04:20.667696 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:04:20.667646 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a73e2e62-1440-4773-a771-1dcaaa878f2f-util\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbjv7l4\" (UID: \"a73e2e62-1440-4773-a771-1dcaaa878f2f\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbjv7l4" Sep 08 04:04:20.667696 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:04:20.667692 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-45v5c\" (UniqueName: \"kubernetes.io/projected/a1d1c86f-fcdf-4377-8d10-5cbdf847d013-kube-api-access-45v5c\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0msftb\" (UID: \"a1d1c86f-fcdf-4377-8d10-5cbdf847d013\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0msftb" Sep 08 04:04:20.667910 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:04:20.667741 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a1d1c86f-fcdf-4377-8d10-5cbdf847d013-bundle\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0msftb\" (UID: \"a1d1c86f-fcdf-4377-8d10-5cbdf847d013\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0msftb" Sep 08 04:04:20.667910 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:04:20.667786 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a1d1c86f-fcdf-4377-8d10-5cbdf847d013-util\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0msftb\" (UID: \"a1d1c86f-fcdf-4377-8d10-5cbdf847d013\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0msftb" Sep 08 04:04:20.667910 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:04:20.667825 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qn9vp\" (UniqueName: \"kubernetes.io/projected/a73e2e62-1440-4773-a771-1dcaaa878f2f-kube-api-access-qn9vp\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbjv7l4\" (UID: \"a73e2e62-1440-4773-a771-1dcaaa878f2f\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbjv7l4" Sep 08 04:04:20.668475 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:04:20.668260 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a1d1c86f-fcdf-4377-8d10-5cbdf847d013-bundle\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0msftb\" (UID: \"a1d1c86f-fcdf-4377-8d10-5cbdf847d013\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0msftb" Sep 08 04:04:20.668475 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:04:20.668424 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a1d1c86f-fcdf-4377-8d10-5cbdf847d013-util\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0msftb\" (UID: \"a1d1c86f-fcdf-4377-8d10-5cbdf847d013\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0msftb" Sep 08 04:04:20.679599 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:04:20.679550 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-45v5c\" (UniqueName: \"kubernetes.io/projected/a1d1c86f-fcdf-4377-8d10-5cbdf847d013-kube-api-access-45v5c\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0msftb\" (UID: \"a1d1c86f-fcdf-4377-8d10-5cbdf847d013\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0msftb" Sep 08 04:04:20.699754 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:04:20.699729 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183chd6tq" Sep 08 04:04:20.768521 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:04:20.768454 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qn9vp\" (UniqueName: \"kubernetes.io/projected/a73e2e62-1440-4773-a771-1dcaaa878f2f-kube-api-access-qn9vp\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbjv7l4\" (UID: \"a73e2e62-1440-4773-a771-1dcaaa878f2f\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbjv7l4" Sep 08 04:04:20.768629 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:04:20.768538 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a73e2e62-1440-4773-a771-1dcaaa878f2f-bundle\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbjv7l4\" (UID: \"a73e2e62-1440-4773-a771-1dcaaa878f2f\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbjv7l4" Sep 08 04:04:20.768629 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:04:20.768584 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a73e2e62-1440-4773-a771-1dcaaa878f2f-util\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbjv7l4\" (UID: \"a73e2e62-1440-4773-a771-1dcaaa878f2f\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbjv7l4" Sep 08 04:04:20.769069 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:04:20.769047 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a73e2e62-1440-4773-a771-1dcaaa878f2f-bundle\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbjv7l4\" (UID: \"a73e2e62-1440-4773-a771-1dcaaa878f2f\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbjv7l4" Sep 08 04:04:20.769259 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:04:20.769237 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a73e2e62-1440-4773-a771-1dcaaa878f2f-util\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbjv7l4\" (UID: \"a73e2e62-1440-4773-a771-1dcaaa878f2f\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbjv7l4" Sep 08 04:04:20.778246 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:04:20.778223 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qn9vp\" (UniqueName: \"kubernetes.io/projected/a73e2e62-1440-4773-a771-1dcaaa878f2f-kube-api-access-qn9vp\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbjv7l4\" (UID: \"a73e2e62-1440-4773-a771-1dcaaa878f2f\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbjv7l4" Sep 08 04:04:20.799886 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:04:20.799781 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0msftb" Sep 08 04:04:20.896587 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:04:20.896560 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053dsnvm"] Sep 08 04:04:20.898968 ip-10-0-128-67 kubenswrapper[2571]: W0908 04:04:20.898937 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod43e4a0ae_d71a_4aca_9bdc_b046145c29d5.slice/crio-fa2f90c6b64fe142e62d407f54e64c44aefc7bc319c7deaf9031e457d631663c WatchSource:0}: Error finding container fa2f90c6b64fe142e62d407f54e64c44aefc7bc319c7deaf9031e457d631663c: Status 404 returned error can't find the container with id fa2f90c6b64fe142e62d407f54e64c44aefc7bc319c7deaf9031e457d631663c Sep 08 04:04:20.901731 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:04:20.901711 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbjv7l4" Sep 08 04:04:20.934306 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:04:20.934210 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053dsnvm" event={"ID":"43e4a0ae-d71a-4aca-9bdc-b046145c29d5","Type":"ContainerStarted","Data":"fa2f90c6b64fe142e62d407f54e64c44aefc7bc319c7deaf9031e457d631663c"} Sep 08 04:04:20.986690 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:04:20.986631 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183chd6tq"] Sep 08 04:04:20.989888 ip-10-0-128-67 kubenswrapper[2571]: W0908 04:04:20.989853 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd14312c6_2015_4cda_b1d7_72bb5a2dfb5c.slice/crio-5760031125c52ca89d0378357c160ea19452ab6b4e452f7af5f105fcffcfd10c WatchSource:0}: Error finding container 5760031125c52ca89d0378357c160ea19452ab6b4e452f7af5f105fcffcfd10c: Status 404 returned error can't find the container with id 5760031125c52ca89d0378357c160ea19452ab6b4e452f7af5f105fcffcfd10c Sep 08 04:04:21.084145 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:04:21.084109 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0msftb"] Sep 08 04:04:21.088391 ip-10-0-128-67 kubenswrapper[2571]: W0908 04:04:21.088342 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda1d1c86f_fcdf_4377_8d10_5cbdf847d013.slice/crio-0926955c79670d42f470d96ac478c40d0f25ce0d6d3a215bf9d8832e1d67c90f WatchSource:0}: Error finding container 0926955c79670d42f470d96ac478c40d0f25ce0d6d3a215bf9d8832e1d67c90f: Status 404 returned error can't find the container with id 0926955c79670d42f470d96ac478c40d0f25ce0d6d3a215bf9d8832e1d67c90f Sep 08 04:04:21.187265 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:04:21.187191 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbjv7l4"] Sep 08 04:04:21.190557 ip-10-0-128-67 kubenswrapper[2571]: W0908 04:04:21.190525 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda73e2e62_1440_4773_a771_1dcaaa878f2f.slice/crio-a194b894479cca57f1e9345d2b287c0ced06de08b113c38e613b28b09afaf383 WatchSource:0}: Error finding container a194b894479cca57f1e9345d2b287c0ced06de08b113c38e613b28b09afaf383: Status 404 returned error can't find the container with id a194b894479cca57f1e9345d2b287c0ced06de08b113c38e613b28b09afaf383 Sep 08 04:04:21.943266 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:04:21.943229 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183chd6tq" event={"ID":"d14312c6-2015-4cda-b1d7-72bb5a2dfb5c","Type":"ContainerStarted","Data":"5760031125c52ca89d0378357c160ea19452ab6b4e452f7af5f105fcffcfd10c"} Sep 08 04:04:21.948007 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:04:21.947978 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0msftb" event={"ID":"a1d1c86f-fcdf-4377-8d10-5cbdf847d013","Type":"ContainerStarted","Data":"0926955c79670d42f470d96ac478c40d0f25ce0d6d3a215bf9d8832e1d67c90f"} Sep 08 04:04:21.948477 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:04:21.948456 2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-6q6cj"] Sep 08 04:04:21.952314 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:04:21.952266 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbjv7l4" event={"ID":"a73e2e62-1440-4773-a771-1dcaaa878f2f","Type":"ContainerStarted","Data":"a194b894479cca57f1e9345d2b287c0ced06de08b113c38e613b28b09afaf383"} Sep 08 04:04:21.952429 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:04:21.952388 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-6q6cj" Sep 08 04:04:21.955514 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:04:21.955307 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Sep 08 04:04:21.956458 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:04:21.955999 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-vf6zh\"" Sep 08 04:04:21.956458 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:04:21.956311 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Sep 08 04:04:21.958615 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:04:21.958573 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Sep 08 04:04:21.986174 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:04:21.986149 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-6q6cj"] Sep 08 04:04:22.058942 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:04:22.057602 2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/openshift-ai-inference-openshift-ai-inference-5dd944c6f-6j876"] Sep 08 04:04:22.062912 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:04:22.061030 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-5dd944c6f-6j876" Sep 08 04:04:22.065728 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:04:22.064993 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"openshift-ai-inference-openshift-ai-inference-dockercfg-9zfv7\"" Sep 08 04:04:22.074658 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:04:22.074563 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/openshift-ai-inference-openshift-ai-inference-5dd944c6f-6j876"] Sep 08 04:04:22.089430 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:04:22.089396 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-568dk\" (UniqueName: \"kubernetes.io/projected/0fcf38d0-2136-4a43-bee3-47a0addf3605-kube-api-access-568dk\") pod \"maas-default-gateway-openshift-default-78bb78ff78-6q6cj\" (UID: \"0fcf38d0-2136-4a43-bee3-47a0addf3605\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-6q6cj" Sep 08 04:04:22.089536 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:04:22.089460 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0fcf38d0-2136-4a43-bee3-47a0addf3605-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-6q6cj\" (UID: \"0fcf38d0-2136-4a43-bee3-47a0addf3605\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-6q6cj" Sep 08 04:04:22.089536 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:04:22.089498 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0fcf38d0-2136-4a43-bee3-47a0addf3605-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-6q6cj\" (UID: \"0fcf38d0-2136-4a43-bee3-47a0addf3605\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-6q6cj" Sep 08 04:04:22.089536 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:04:22.089524 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0fcf38d0-2136-4a43-bee3-47a0addf3605-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-6q6cj\" (UID: \"0fcf38d0-2136-4a43-bee3-47a0addf3605\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-6q6cj" Sep 08 04:04:22.089698 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:04:22.089593 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0fcf38d0-2136-4a43-bee3-47a0addf3605-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-6q6cj\" (UID: \"0fcf38d0-2136-4a43-bee3-47a0addf3605\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-6q6cj" Sep 08 04:04:22.089698 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:04:22.089632 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0fcf38d0-2136-4a43-bee3-47a0addf3605-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-6q6cj\" (UID: \"0fcf38d0-2136-4a43-bee3-47a0addf3605\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-6q6cj" Sep 08 04:04:22.089698 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:04:22.089693 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0fcf38d0-2136-4a43-bee3-47a0addf3605-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-6q6cj\" (UID: \"0fcf38d0-2136-4a43-bee3-47a0addf3605\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-6q6cj" Sep 08 04:04:22.089848 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:04:22.089719 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0fcf38d0-2136-4a43-bee3-47a0addf3605-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-6q6cj\" (UID: \"0fcf38d0-2136-4a43-bee3-47a0addf3605\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-6q6cj" Sep 08 04:04:22.089848 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:04:22.089742 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0fcf38d0-2136-4a43-bee3-47a0addf3605-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-6q6cj\" (UID: \"0fcf38d0-2136-4a43-bee3-47a0addf3605\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-6q6cj" Sep 08 04:04:22.192914 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:04:22.191102 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e9e85fc8-3836-4b6e-9189-988a2141d478-workload-certs\") pod \"openshift-ai-inference-openshift-ai-inference-5dd944c6f-6j876\" (UID: \"e9e85fc8-3836-4b6e-9189-988a2141d478\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-5dd944c6f-6j876" Sep 08 04:04:22.192914 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:04:22.191154 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0fcf38d0-2136-4a43-bee3-47a0addf3605-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-6q6cj\" (UID: \"0fcf38d0-2136-4a43-bee3-47a0addf3605\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-6q6cj" Sep 08 04:04:22.192914 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:04:22.191183 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e9e85fc8-3836-4b6e-9189-988a2141d478-istio-token\") pod \"openshift-ai-inference-openshift-ai-inference-5dd944c6f-6j876\" (UID: \"e9e85fc8-3836-4b6e-9189-988a2141d478\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-5dd944c6f-6j876" Sep 08 04:04:22.192914 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:04:22.191224 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0fcf38d0-2136-4a43-bee3-47a0addf3605-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-6q6cj\" (UID: \"0fcf38d0-2136-4a43-bee3-47a0addf3605\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-6q6cj" Sep 08 04:04:22.192914 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:04:22.191249 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0fcf38d0-2136-4a43-bee3-47a0addf3605-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-6q6cj\" (UID: \"0fcf38d0-2136-4a43-bee3-47a0addf3605\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-6q6cj" Sep 08 04:04:22.192914 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:04:22.191279 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0fcf38d0-2136-4a43-bee3-47a0addf3605-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-6q6cj\" (UID: \"0fcf38d0-2136-4a43-bee3-47a0addf3605\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-6q6cj" Sep 08 04:04:22.192914 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:04:22.191319 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0fcf38d0-2136-4a43-bee3-47a0addf3605-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-6q6cj\" (UID: \"0fcf38d0-2136-4a43-bee3-47a0addf3605\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-6q6cj" Sep 08 04:04:22.192914 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:04:22.191346 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e9e85fc8-3836-4b6e-9189-988a2141d478-workload-socket\") pod \"openshift-ai-inference-openshift-ai-inference-5dd944c6f-6j876\" (UID: \"e9e85fc8-3836-4b6e-9189-988a2141d478\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-5dd944c6f-6j876" Sep 08 04:04:22.192914 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:04:22.191387 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-568dk\" (UniqueName: \"kubernetes.io/projected/0fcf38d0-2136-4a43-bee3-47a0addf3605-kube-api-access-568dk\") pod \"maas-default-gateway-openshift-default-78bb78ff78-6q6cj\" (UID: \"0fcf38d0-2136-4a43-bee3-47a0addf3605\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-6q6cj" Sep 08 04:04:22.192914 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:04:22.191418 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e9e85fc8-3836-4b6e-9189-988a2141d478-credential-socket\") pod \"openshift-ai-inference-openshift-ai-inference-5dd944c6f-6j876\" (UID: \"e9e85fc8-3836-4b6e-9189-988a2141d478\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-5dd944c6f-6j876" Sep 08 04:04:22.192914 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:04:22.191452 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0fcf38d0-2136-4a43-bee3-47a0addf3605-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-6q6cj\" (UID: \"0fcf38d0-2136-4a43-bee3-47a0addf3605\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-6q6cj" Sep 08 04:04:22.192914 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:04:22.191479 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e9e85fc8-3836-4b6e-9189-988a2141d478-istio-envoy\") pod \"openshift-ai-inference-openshift-ai-inference-5dd944c6f-6j876\" (UID: \"e9e85fc8-3836-4b6e-9189-988a2141d478\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-5dd944c6f-6j876" Sep 08 04:04:22.192914 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:04:22.191505 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e9e85fc8-3836-4b6e-9189-988a2141d478-istio-data\") pod \"openshift-ai-inference-openshift-ai-inference-5dd944c6f-6j876\" (UID: \"e9e85fc8-3836-4b6e-9189-988a2141d478\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-5dd944c6f-6j876" Sep 08 04:04:22.192914 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:04:22.191540 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0fcf38d0-2136-4a43-bee3-47a0addf3605-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-6q6cj\" (UID: \"0fcf38d0-2136-4a43-bee3-47a0addf3605\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-6q6cj" Sep 08 04:04:22.193777 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:04:22.191566 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0fcf38d0-2136-4a43-bee3-47a0addf3605-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-6q6cj\" (UID: \"0fcf38d0-2136-4a43-bee3-47a0addf3605\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-6q6cj" Sep 08 04:04:22.193777 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:04:22.191592 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e9e85fc8-3836-4b6e-9189-988a2141d478-istiod-ca-cert\") pod \"openshift-ai-inference-openshift-ai-inference-5dd944c6f-6j876\" (UID: \"e9e85fc8-3836-4b6e-9189-988a2141d478\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-5dd944c6f-6j876" Sep 08 04:04:22.193777 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:04:22.191640 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e9e85fc8-3836-4b6e-9189-988a2141d478-istio-podinfo\") pod \"openshift-ai-inference-openshift-ai-inference-5dd944c6f-6j876\" (UID: \"e9e85fc8-3836-4b6e-9189-988a2141d478\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-5dd944c6f-6j876" Sep 08 04:04:22.193777 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:04:22.191669 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rrt84\" (UniqueName: \"kubernetes.io/projected/e9e85fc8-3836-4b6e-9189-988a2141d478-kube-api-access-rrt84\") pod \"openshift-ai-inference-openshift-ai-inference-5dd944c6f-6j876\" (UID: \"e9e85fc8-3836-4b6e-9189-988a2141d478\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-5dd944c6f-6j876" Sep 08 04:04:22.193777 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:04:22.192398 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0fcf38d0-2136-4a43-bee3-47a0addf3605-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-6q6cj\" (UID: \"0fcf38d0-2136-4a43-bee3-47a0addf3605\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-6q6cj" Sep 08 04:04:22.193777 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:04:22.192625 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0fcf38d0-2136-4a43-bee3-47a0addf3605-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-6q6cj\" (UID: \"0fcf38d0-2136-4a43-bee3-47a0addf3605\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-6q6cj" Sep 08 04:04:22.193777 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:04:22.192852 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0fcf38d0-2136-4a43-bee3-47a0addf3605-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-6q6cj\" (UID: \"0fcf38d0-2136-4a43-bee3-47a0addf3605\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-6q6cj" Sep 08 04:04:22.193777 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:04:22.193675 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0fcf38d0-2136-4a43-bee3-47a0addf3605-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-6q6cj\" (UID: \"0fcf38d0-2136-4a43-bee3-47a0addf3605\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-6q6cj" Sep 08 04:04:22.194494 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:04:22.194443 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0fcf38d0-2136-4a43-bee3-47a0addf3605-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-6q6cj\" (UID: \"0fcf38d0-2136-4a43-bee3-47a0addf3605\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-6q6cj" Sep 08 04:04:22.198344 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:04:22.198319 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0fcf38d0-2136-4a43-bee3-47a0addf3605-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-6q6cj\" (UID: \"0fcf38d0-2136-4a43-bee3-47a0addf3605\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-6q6cj" Sep 08 04:04:22.199274 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:04:22.199254 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0fcf38d0-2136-4a43-bee3-47a0addf3605-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-6q6cj\" (UID: \"0fcf38d0-2136-4a43-bee3-47a0addf3605\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-6q6cj" Sep 08 04:04:22.207099 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:04:22.207057 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0fcf38d0-2136-4a43-bee3-47a0addf3605-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-6q6cj\" (UID: \"0fcf38d0-2136-4a43-bee3-47a0addf3605\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-6q6cj" Sep 08 04:04:22.209980 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:04:22.209935 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-568dk\" (UniqueName: \"kubernetes.io/projected/0fcf38d0-2136-4a43-bee3-47a0addf3605-kube-api-access-568dk\") pod \"maas-default-gateway-openshift-default-78bb78ff78-6q6cj\" (UID: \"0fcf38d0-2136-4a43-bee3-47a0addf3605\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-6q6cj" Sep 08 04:04:22.268380 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:04:22.268037 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-6q6cj" Sep 08 04:04:22.292723 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:04:22.292684 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e9e85fc8-3836-4b6e-9189-988a2141d478-workload-socket\") pod \"openshift-ai-inference-openshift-ai-inference-5dd944c6f-6j876\" (UID: \"e9e85fc8-3836-4b6e-9189-988a2141d478\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-5dd944c6f-6j876" Sep 08 04:04:22.292868 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:04:22.292754 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e9e85fc8-3836-4b6e-9189-988a2141d478-credential-socket\") pod \"openshift-ai-inference-openshift-ai-inference-5dd944c6f-6j876\" (UID: \"e9e85fc8-3836-4b6e-9189-988a2141d478\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-5dd944c6f-6j876" Sep 08 04:04:22.292868 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:04:22.292787 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e9e85fc8-3836-4b6e-9189-988a2141d478-istio-envoy\") pod \"openshift-ai-inference-openshift-ai-inference-5dd944c6f-6j876\" (UID: \"e9e85fc8-3836-4b6e-9189-988a2141d478\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-5dd944c6f-6j876" Sep 08 04:04:22.292868 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:04:22.292818 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e9e85fc8-3836-4b6e-9189-988a2141d478-istio-data\") pod \"openshift-ai-inference-openshift-ai-inference-5dd944c6f-6j876\" (UID: \"e9e85fc8-3836-4b6e-9189-988a2141d478\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-5dd944c6f-6j876" Sep 08 04:04:22.292868 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:04:22.292860 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e9e85fc8-3836-4b6e-9189-988a2141d478-istiod-ca-cert\") pod \"openshift-ai-inference-openshift-ai-inference-5dd944c6f-6j876\" (UID: \"e9e85fc8-3836-4b6e-9189-988a2141d478\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-5dd944c6f-6j876" Sep 08 04:04:22.293185 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:04:22.292900 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e9e85fc8-3836-4b6e-9189-988a2141d478-istio-podinfo\") pod \"openshift-ai-inference-openshift-ai-inference-5dd944c6f-6j876\" (UID: \"e9e85fc8-3836-4b6e-9189-988a2141d478\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-5dd944c6f-6j876" Sep 08 04:04:22.293185 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:04:22.292956 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rrt84\" (UniqueName: \"kubernetes.io/projected/e9e85fc8-3836-4b6e-9189-988a2141d478-kube-api-access-rrt84\") pod \"openshift-ai-inference-openshift-ai-inference-5dd944c6f-6j876\" (UID: \"e9e85fc8-3836-4b6e-9189-988a2141d478\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-5dd944c6f-6j876" Sep 08 04:04:22.293185 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:04:22.293012 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e9e85fc8-3836-4b6e-9189-988a2141d478-workload-certs\") pod \"openshift-ai-inference-openshift-ai-inference-5dd944c6f-6j876\" (UID: \"e9e85fc8-3836-4b6e-9189-988a2141d478\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-5dd944c6f-6j876" Sep 08 04:04:22.293185 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:04:22.293045 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e9e85fc8-3836-4b6e-9189-988a2141d478-istio-token\") pod \"openshift-ai-inference-openshift-ai-inference-5dd944c6f-6j876\" (UID: \"e9e85fc8-3836-4b6e-9189-988a2141d478\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-5dd944c6f-6j876" Sep 08 04:04:22.294665 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:04:22.293797 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e9e85fc8-3836-4b6e-9189-988a2141d478-workload-socket\") pod \"openshift-ai-inference-openshift-ai-inference-5dd944c6f-6j876\" (UID: \"e9e85fc8-3836-4b6e-9189-988a2141d478\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-5dd944c6f-6j876" Sep 08 04:04:22.294665 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:04:22.294138 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e9e85fc8-3836-4b6e-9189-988a2141d478-workload-certs\") pod \"openshift-ai-inference-openshift-ai-inference-5dd944c6f-6j876\" (UID: \"e9e85fc8-3836-4b6e-9189-988a2141d478\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-5dd944c6f-6j876" Sep 08 04:04:22.294665 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:04:22.294466 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e9e85fc8-3836-4b6e-9189-988a2141d478-istiod-ca-cert\") pod \"openshift-ai-inference-openshift-ai-inference-5dd944c6f-6j876\" (UID: \"e9e85fc8-3836-4b6e-9189-988a2141d478\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-5dd944c6f-6j876" Sep 08 04:04:22.294896 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:04:22.294822 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e9e85fc8-3836-4b6e-9189-988a2141d478-credential-socket\") pod \"openshift-ai-inference-openshift-ai-inference-5dd944c6f-6j876\" (UID: \"e9e85fc8-3836-4b6e-9189-988a2141d478\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-5dd944c6f-6j876" Sep 08 04:04:22.294896 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:04:22.294876 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e9e85fc8-3836-4b6e-9189-988a2141d478-istio-data\") pod \"openshift-ai-inference-openshift-ai-inference-5dd944c6f-6j876\" (UID: \"e9e85fc8-3836-4b6e-9189-988a2141d478\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-5dd944c6f-6j876" Sep 08 04:04:22.297683 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:04:22.297639 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e9e85fc8-3836-4b6e-9189-988a2141d478-istio-podinfo\") pod \"openshift-ai-inference-openshift-ai-inference-5dd944c6f-6j876\" (UID: \"e9e85fc8-3836-4b6e-9189-988a2141d478\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-5dd944c6f-6j876" Sep 08 04:04:22.298249 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:04:22.298209 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e9e85fc8-3836-4b6e-9189-988a2141d478-istio-envoy\") pod \"openshift-ai-inference-openshift-ai-inference-5dd944c6f-6j876\" (UID: \"e9e85fc8-3836-4b6e-9189-988a2141d478\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-5dd944c6f-6j876" Sep 08 04:04:22.305055 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:04:22.305012 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rrt84\" (UniqueName: \"kubernetes.io/projected/e9e85fc8-3836-4b6e-9189-988a2141d478-kube-api-access-rrt84\") pod \"openshift-ai-inference-openshift-ai-inference-5dd944c6f-6j876\" (UID: \"e9e85fc8-3836-4b6e-9189-988a2141d478\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-5dd944c6f-6j876" Sep 08 04:04:22.310730 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:04:22.310699 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e9e85fc8-3836-4b6e-9189-988a2141d478-istio-token\") pod \"openshift-ai-inference-openshift-ai-inference-5dd944c6f-6j876\" (UID: \"e9e85fc8-3836-4b6e-9189-988a2141d478\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-5dd944c6f-6j876" Sep 08 04:04:22.377121 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:04:22.377090 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-5dd944c6f-6j876" Sep 08 04:04:25.324783 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:04:25.324061 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/openshift-ai-inference-openshift-ai-inference-5dd944c6f-6j876"] Sep 08 04:04:25.336828 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:04:25.336802 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-6q6cj"] Sep 08 04:04:25.362503 ip-10-0-128-67 kubenswrapper[2571]: W0908 04:04:25.362467 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode9e85fc8_3836_4b6e_9189_988a2141d478.slice/crio-46870c1c8c19999ebfeb42d13e0ddc8d3539380545bf5a3468579a82975ed036 WatchSource:0}: Error finding container 46870c1c8c19999ebfeb42d13e0ddc8d3539380545bf5a3468579a82975ed036: Status 404 returned error can't find the container with id 46870c1c8c19999ebfeb42d13e0ddc8d3539380545bf5a3468579a82975ed036 Sep 08 04:04:25.410397 ip-10-0-128-67 kubenswrapper[2571]: W0908 04:04:25.410356 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0fcf38d0_2136_4a43_bee3_47a0addf3605.slice/crio-64228e4bf80403f384da29f41101026e831a7269df8c0b0bbb69161f61af57f9 WatchSource:0}: Error finding container 64228e4bf80403f384da29f41101026e831a7269df8c0b0bbb69161f61af57f9: Status 404 returned error can't find the container with id 64228e4bf80403f384da29f41101026e831a7269df8c0b0bbb69161f61af57f9 Sep 08 04:04:25.976829 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:04:25.976784 2571 generic.go:356] "Generic (PLEG): container finished" podID="6b82e94e-ef8f-4cb5-96bc-7215049dc35d" containerID="629e704c915f049bdbf18fdc14bb6852ce93f6529073c0ab548e36924a3749c3" exitCode=0 Sep 08 04:04:25.977047 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:04:25.976880 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qq9bt" event={"ID":"6b82e94e-ef8f-4cb5-96bc-7215049dc35d","Type":"ContainerDied","Data":"629e704c915f049bdbf18fdc14bb6852ce93f6529073c0ab548e36924a3749c3"} Sep 08 04:04:25.979628 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:04:25.979599 2571 generic.go:356] "Generic (PLEG): container finished" podID="e3d75930-871f-42ec-beda-136d6c2a3383" containerID="024d0d3db91e0e93a0b8cf8f89e56fd1bbba3d467b285b33837b485f65785df6" exitCode=0 Sep 08 04:04:25.979753 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:04:25.979696 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/978bd81eed4c4dc7896cbc7c21ae91125ef0d2dcd9abf7d17f5d8e954e7ch4w" event={"ID":"e3d75930-871f-42ec-beda-136d6c2a3383","Type":"ContainerDied","Data":"024d0d3db91e0e93a0b8cf8f89e56fd1bbba3d467b285b33837b485f65785df6"} Sep 08 04:04:25.983682 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:04:25.983583 2571 generic.go:356] "Generic (PLEG): container finished" podID="a73e2e62-1440-4773-a771-1dcaaa878f2f" containerID="e00df19790c3ffa34c31a08139302b191830eb2194bccc691710d35f3b59c4dc" exitCode=0 Sep 08 04:04:25.983682 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:04:25.983663 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbjv7l4" event={"ID":"a73e2e62-1440-4773-a771-1dcaaa878f2f","Type":"ContainerDied","Data":"e00df19790c3ffa34c31a08139302b191830eb2194bccc691710d35f3b59c4dc"} Sep 08 04:04:25.986413 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:04:25.986387 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-5dd944c6f-6j876" event={"ID":"e9e85fc8-3836-4b6e-9189-988a2141d478","Type":"ContainerStarted","Data":"46870c1c8c19999ebfeb42d13e0ddc8d3539380545bf5a3468579a82975ed036"} Sep 08 04:04:25.988321 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:04:25.988298 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-6q6cj" event={"ID":"0fcf38d0-2136-4a43-bee3-47a0addf3605","Type":"ContainerStarted","Data":"64228e4bf80403f384da29f41101026e831a7269df8c0b0bbb69161f61af57f9"} Sep 08 04:04:27.008384 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:04:27.007400 2571 generic.go:356] "Generic (PLEG): container finished" podID="43e4a0ae-d71a-4aca-9bdc-b046145c29d5" containerID="45869aac4a12538125529707f4e78920f3cc44512806e74b07568fd45839c027" exitCode=0 Sep 08 04:04:27.008384 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:04:27.007511 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053dsnvm" event={"ID":"43e4a0ae-d71a-4aca-9bdc-b046145c29d5","Type":"ContainerDied","Data":"45869aac4a12538125529707f4e78920f3cc44512806e74b07568fd45839c027"} Sep 08 04:04:27.015966 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:04:27.014984 2571 generic.go:356] "Generic (PLEG): container finished" podID="a1d1c86f-fcdf-4377-8d10-5cbdf847d013" containerID="79026e0d72ff127d07c873e6046bcaefb2ce7ca9afedd0389cab9ea4498dbc08" exitCode=0 Sep 08 04:04:27.015966 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:04:27.015084 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0msftb" event={"ID":"a1d1c86f-fcdf-4377-8d10-5cbdf847d013","Type":"ContainerDied","Data":"79026e0d72ff127d07c873e6046bcaefb2ce7ca9afedd0389cab9ea4498dbc08"} Sep 08 04:04:27.022735 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:04:27.022295 2571 generic.go:356] "Generic (PLEG): container finished" podID="d14312c6-2015-4cda-b1d7-72bb5a2dfb5c" containerID="2431584b80ac56937a15302158995b0da31332c05d9c60e594ea29c5cfff8bbd" exitCode=0 Sep 08 04:04:27.022735 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:04:27.022382 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183chd6tq" event={"ID":"d14312c6-2015-4cda-b1d7-72bb5a2dfb5c","Type":"ContainerDied","Data":"2431584b80ac56937a15302158995b0da31332c05d9c60e594ea29c5cfff8bbd"} Sep 08 04:04:28.028525 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:04:28.028490 2571 generic.go:356] "Generic (PLEG): container finished" podID="e3d75930-871f-42ec-beda-136d6c2a3383" containerID="a6359d01d50fc9d3f9910c24b3d2c62778e49e1033c61585d6947f3d1005802c" exitCode=0 Sep 08 04:04:28.028976 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:04:28.028578 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/978bd81eed4c4dc7896cbc7c21ae91125ef0d2dcd9abf7d17f5d8e954e7ch4w" event={"ID":"e3d75930-871f-42ec-beda-136d6c2a3383","Type":"ContainerDied","Data":"a6359d01d50fc9d3f9910c24b3d2c62778e49e1033c61585d6947f3d1005802c"} Sep 08 04:04:28.030783 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:04:28.030757 2571 generic.go:356] "Generic (PLEG): container finished" podID="a73e2e62-1440-4773-a771-1dcaaa878f2f" containerID="a49a419bb8db0e6525c6e51a41523457dd525d3f1faf4931b1081dd35a2ed731" exitCode=0 Sep 08 04:04:28.030892 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:04:28.030831 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbjv7l4" event={"ID":"a73e2e62-1440-4773-a771-1dcaaa878f2f","Type":"ContainerDied","Data":"a49a419bb8db0e6525c6e51a41523457dd525d3f1faf4931b1081dd35a2ed731"} Sep 08 04:04:29.468674 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:04:29.468628 2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"} Sep 08 04:04:29.469073 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:04:29.468730 2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"} Sep 08 04:04:29.469073 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:04:29.468769 2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"} Sep 08 04:04:29.477826 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:04:29.477788 2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"} Sep 08 04:04:29.477943 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:04:29.477871 2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"} Sep 08 04:04:29.478074 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:04:29.477940 2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"} Sep 08 04:04:30.044541 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:04:30.044504 2571 generic.go:356] "Generic (PLEG): container finished" podID="d14312c6-2015-4cda-b1d7-72bb5a2dfb5c" containerID="273f529723a5c7acf852b5d8a90000bac9c1ff2c0b719c77f55f237a271b44ba" exitCode=0 Sep 08 04:04:30.044711 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:04:30.044602 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183chd6tq" event={"ID":"d14312c6-2015-4cda-b1d7-72bb5a2dfb5c","Type":"ContainerDied","Data":"273f529723a5c7acf852b5d8a90000bac9c1ff2c0b719c77f55f237a271b44ba"} Sep 08 04:04:30.051267 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:04:30.050818 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-5dd944c6f-6j876" event={"ID":"e9e85fc8-3836-4b6e-9189-988a2141d478","Type":"ContainerStarted","Data":"56a60052b51b949e15406f7b8f55d5f65c1fe5c4038578d90a42b6b8203ed7d5"} Sep 08 04:04:30.053953 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:04:30.053383 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-6q6cj" event={"ID":"0fcf38d0-2136-4a43-bee3-47a0addf3605","Type":"ContainerStarted","Data":"1f61291e267101259c1a05b41deb8567bf09c4bebc709746810dfa8997f487e8"} Sep 08 04:04:30.056912 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:04:30.056320 2571 generic.go:356] "Generic (PLEG): container finished" podID="43e4a0ae-d71a-4aca-9bdc-b046145c29d5" containerID="49959e88fd9b66b3a247c5c0626abc2596fe0fccf1097e21d83e5bf9c7e395a8" exitCode=0 Sep 08 04:04:30.056912 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:04:30.056410 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053dsnvm" event={"ID":"43e4a0ae-d71a-4aca-9bdc-b046145c29d5","Type":"ContainerDied","Data":"49959e88fd9b66b3a247c5c0626abc2596fe0fccf1097e21d83e5bf9c7e395a8"} Sep 08 04:04:30.060155 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:04:30.059547 2571 generic.go:356] "Generic (PLEG): container finished" podID="6b82e94e-ef8f-4cb5-96bc-7215049dc35d" containerID="9dfe5d358a39a37b64d381a297fae2c5abd323b9b8230e30949fbb54caa15c9c" exitCode=0 Sep 08 04:04:30.060155 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:04:30.059624 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qq9bt" event={"ID":"6b82e94e-ef8f-4cb5-96bc-7215049dc35d","Type":"ContainerDied","Data":"9dfe5d358a39a37b64d381a297fae2c5abd323b9b8230e30949fbb54caa15c9c"} Sep 08 04:04:30.068715 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:04:30.068619 2571 generic.go:356] "Generic (PLEG): container finished" podID="a1d1c86f-fcdf-4377-8d10-5cbdf847d013" containerID="704605f15bd9786673b618b2c53d8a087abcc717adefa5aa6a2490c4ae1a4130" exitCode=0 Sep 08 04:04:30.068715 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:04:30.068676 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0msftb" event={"ID":"a1d1c86f-fcdf-4377-8d10-5cbdf847d013","Type":"ContainerDied","Data":"704605f15bd9786673b618b2c53d8a087abcc717adefa5aa6a2490c4ae1a4130"} Sep 08 04:04:30.130255 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:04:30.129312 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-6q6cj" podStartSLOduration=5.064603675 podStartE2EDuration="9.129292491s" totalImagesPullingTime="4.064688816s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 04:04:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 04:04:30.126998335 +0000 UTC m=+563.597566717" watchObservedRunningTime="2026-09-08 04:04:30.129292491 +0000 UTC m=+563.599860872" Sep 08 04:04:30.154378 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:04:30.153841 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-5dd944c6f-6j876" podStartSLOduration=4.051619734 podStartE2EDuration="8.153821438s" totalImagesPullingTime="4.102201704s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 04:04:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 04:04:30.151680336 +0000 UTC m=+563.622248718" watchObservedRunningTime="2026-09-08 04:04:30.153821438 +0000 UTC m=+563.624389819" Sep 08 04:04:30.268862 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:04:30.268825 2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-6q6cj" Sep 08 04:04:30.270692 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:04:30.270340 2571 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-6q6cj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.20:15021/healthz/ready\": dial tcp 10.132.0.20:15021: connect: connection refused" start-of-body= Sep 08 04:04:30.270692 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:04:30.270404 2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-6q6cj" podUID="0fcf38d0-2136-4a43-bee3-47a0addf3605" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.20:15021/healthz/ready\": dial tcp 10.132.0.20:15021: connect: connection refused" Sep 08 04:04:30.378460 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:04:30.378334 2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-5dd944c6f-6j876" Sep 08 04:04:30.379838 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:04:30.379806 2571 patch_prober.go:28] interesting pod/openshift-ai-inference-openshift-ai-inference-5dd944c6f-6j876 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.21:15021/healthz/ready\": dial tcp 10.132.0.21:15021: connect: connection refused" start-of-body= Sep 08 04:04:30.379995 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:04:30.379872 2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-5dd944c6f-6j876" podUID="e9e85fc8-3836-4b6e-9189-988a2141d478" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.21:15021/healthz/ready\": dial tcp 10.132.0.21:15021: connect: connection refused" Sep 08 04:04:31.274774 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:04:31.274516 2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-6q6cj" Sep 08 04:04:31.384499 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:04:31.384361 2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-5dd944c6f-6j876" Sep 08 04:04:32.093071 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:04:32.092778 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-6q6cj" Sep 08 04:04:32.093071 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:04:32.092830 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-5dd944c6f-6j876" Sep 08 04:04:32.094509 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:04:32.094165 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-5dd944c6f-6j876" Sep 08 04:04:32.094509 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:04:32.094465 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-6q6cj" Sep 08 04:04:39.146646 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:04:39.146619 2571 generic.go:356] "Generic (PLEG): container finished" podID="e3d75930-871f-42ec-beda-136d6c2a3383" containerID="e01aeb5407adcd3283fca1d52d9eb8abcdab25a33983a505ce1c820e35e433b8" exitCode=0 Sep 08 04:04:39.147019 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:04:39.146696 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/978bd81eed4c4dc7896cbc7c21ae91125ef0d2dcd9abf7d17f5d8e954e7ch4w" event={"ID":"e3d75930-871f-42ec-beda-136d6c2a3383","Type":"ContainerDied","Data":"e01aeb5407adcd3283fca1d52d9eb8abcdab25a33983a505ce1c820e35e433b8"} Sep 08 04:04:39.148995 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:04:39.148902 2571 generic.go:356] "Generic (PLEG): container finished" podID="a1d1c86f-fcdf-4377-8d10-5cbdf847d013" containerID="e5a74f674478e426066980fc5d9a2b4d8ddc3b2718e1bb72685c9c7dc1fc0d67" exitCode=0 Sep 08 04:04:39.148995 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:04:39.148954 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0msftb" event={"ID":"a1d1c86f-fcdf-4377-8d10-5cbdf847d013","Type":"ContainerDied","Data":"e5a74f674478e426066980fc5d9a2b4d8ddc3b2718e1bb72685c9c7dc1fc0d67"} Sep 08 04:04:39.158663 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:04:39.158633 2571 generic.go:356] "Generic (PLEG): container finished" podID="a73e2e62-1440-4773-a771-1dcaaa878f2f" containerID="19fc407da6e041690bf743c467dea7c44908daa5806b4f43a6f4b95c7a46f534" exitCode=0 Sep 08 04:04:39.158784 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:04:39.158686 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbjv7l4" event={"ID":"a73e2e62-1440-4773-a771-1dcaaa878f2f","Type":"ContainerDied","Data":"19fc407da6e041690bf743c467dea7c44908daa5806b4f43a6f4b95c7a46f534"} Sep 08 04:04:40.165540 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:04:40.165465 2571 generic.go:356] "Generic (PLEG): container finished" podID="43e4a0ae-d71a-4aca-9bdc-b046145c29d5" containerID="eea051ef6a278f3fb13574a1d24459d8e6ce06458ad7a0560ee2f2a3618d5262" exitCode=0 Sep 08 04:04:40.165913 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:04:40.165555 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053dsnvm" event={"ID":"43e4a0ae-d71a-4aca-9bdc-b046145c29d5","Type":"ContainerDied","Data":"eea051ef6a278f3fb13574a1d24459d8e6ce06458ad7a0560ee2f2a3618d5262"} Sep 08 04:04:40.167634 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:04:40.167612 2571 generic.go:356] "Generic (PLEG): container finished" podID="6b82e94e-ef8f-4cb5-96bc-7215049dc35d" containerID="63ac11c3878b157eaf4d49a6cf5a9834407d22ac491244879b26562a889e54a2" exitCode=0 Sep 08 04:04:40.167756 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:04:40.167703 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qq9bt" event={"ID":"6b82e94e-ef8f-4cb5-96bc-7215049dc35d","Type":"ContainerDied","Data":"63ac11c3878b157eaf4d49a6cf5a9834407d22ac491244879b26562a889e54a2"} Sep 08 04:04:40.169679 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:04:40.169658 2571 generic.go:356] "Generic (PLEG): container finished" podID="d14312c6-2015-4cda-b1d7-72bb5a2dfb5c" containerID="7d95570103e477b21eb8c9f1ac7b654664dc1e8023f7ede174dff9594699033e" exitCode=0 Sep 08 04:04:40.169785 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:04:40.169751 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183chd6tq" event={"ID":"d14312c6-2015-4cda-b1d7-72bb5a2dfb5c","Type":"ContainerDied","Data":"7d95570103e477b21eb8c9f1ac7b654664dc1e8023f7ede174dff9594699033e"} Sep 08 04:04:40.324879 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:04:40.324855 2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0msftb" Sep 08 04:04:40.351300 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:04:40.351276 2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbjv7l4" Sep 08 04:04:40.367233 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:04:40.367173 2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/978bd81eed4c4dc7896cbc7c21ae91125ef0d2dcd9abf7d17f5d8e954e7ch4w" Sep 08 04:04:40.472172 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:04:40.472090 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qn9vp\" (UniqueName: \"kubernetes.io/projected/a73e2e62-1440-4773-a771-1dcaaa878f2f-kube-api-access-qn9vp\") pod \"a73e2e62-1440-4773-a771-1dcaaa878f2f\" (UID: \"a73e2e62-1440-4773-a771-1dcaaa878f2f\") " Sep 08 04:04:40.472172 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:04:40.472144 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-45v5c\" (UniqueName: \"kubernetes.io/projected/a1d1c86f-fcdf-4377-8d10-5cbdf847d013-kube-api-access-45v5c\") pod \"a1d1c86f-fcdf-4377-8d10-5cbdf847d013\" (UID: \"a1d1c86f-fcdf-4377-8d10-5cbdf847d013\") " Sep 08 04:04:40.472172 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:04:40.472167 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a73e2e62-1440-4773-a771-1dcaaa878f2f-util\") pod \"a73e2e62-1440-4773-a771-1dcaaa878f2f\" (UID: \"a73e2e62-1440-4773-a771-1dcaaa878f2f\") " Sep 08 04:04:40.472439 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:04:40.472190 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e3d75930-871f-42ec-beda-136d6c2a3383-bundle\") pod \"e3d75930-871f-42ec-beda-136d6c2a3383\" (UID: \"e3d75930-871f-42ec-beda-136d6c2a3383\") " Sep 08 04:04:40.472439 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:04:40.472204 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e3d75930-871f-42ec-beda-136d6c2a3383-util\") pod \"e3d75930-871f-42ec-beda-136d6c2a3383\" (UID: \"e3d75930-871f-42ec-beda-136d6c2a3383\") " Sep 08 04:04:40.472439 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:04:40.472229 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a73e2e62-1440-4773-a771-1dcaaa878f2f-bundle\") pod \"a73e2e62-1440-4773-a771-1dcaaa878f2f\" (UID: \"a73e2e62-1440-4773-a771-1dcaaa878f2f\") " Sep 08 04:04:40.472439 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:04:40.472285 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jd2ch\" (UniqueName: \"kubernetes.io/projected/e3d75930-871f-42ec-beda-136d6c2a3383-kube-api-access-jd2ch\") pod \"e3d75930-871f-42ec-beda-136d6c2a3383\" (UID: \"e3d75930-871f-42ec-beda-136d6c2a3383\") " Sep 08 04:04:40.472439 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:04:40.472309 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a1d1c86f-fcdf-4377-8d10-5cbdf847d013-bundle\") pod \"a1d1c86f-fcdf-4377-8d10-5cbdf847d013\" (UID: \"a1d1c86f-fcdf-4377-8d10-5cbdf847d013\") " Sep 08 04:04:40.472439 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:04:40.472353 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a1d1c86f-fcdf-4377-8d10-5cbdf847d013-util\") pod \"a1d1c86f-fcdf-4377-8d10-5cbdf847d013\" (UID: \"a1d1c86f-fcdf-4377-8d10-5cbdf847d013\") " Sep 08 04:04:40.473447 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:04:40.472979 2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a73e2e62-1440-4773-a771-1dcaaa878f2f-bundle" (OuterVolumeSpecName: "bundle") pod "a73e2e62-1440-4773-a771-1dcaaa878f2f" (UID: "a73e2e62-1440-4773-a771-1dcaaa878f2f"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 08 04:04:40.473447 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:04:40.473069 2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e3d75930-871f-42ec-beda-136d6c2a3383-bundle" (OuterVolumeSpecName: "bundle") pod "e3d75930-871f-42ec-beda-136d6c2a3383" (UID: "e3d75930-871f-42ec-beda-136d6c2a3383"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 08 04:04:40.473902 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:04:40.473875 2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a1d1c86f-fcdf-4377-8d10-5cbdf847d013-bundle" (OuterVolumeSpecName: "bundle") pod "a1d1c86f-fcdf-4377-8d10-5cbdf847d013" (UID: "a1d1c86f-fcdf-4377-8d10-5cbdf847d013"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 08 04:04:40.474727 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:04:40.474706 2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a1d1c86f-fcdf-4377-8d10-5cbdf847d013-kube-api-access-45v5c" (OuterVolumeSpecName: "kube-api-access-45v5c") pod "a1d1c86f-fcdf-4377-8d10-5cbdf847d013" (UID: "a1d1c86f-fcdf-4377-8d10-5cbdf847d013"). InnerVolumeSpecName "kube-api-access-45v5c". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 08 04:04:40.474844 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:04:40.474827 2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a73e2e62-1440-4773-a771-1dcaaa878f2f-kube-api-access-qn9vp" (OuterVolumeSpecName: "kube-api-access-qn9vp") pod "a73e2e62-1440-4773-a771-1dcaaa878f2f" (UID: "a73e2e62-1440-4773-a771-1dcaaa878f2f"). InnerVolumeSpecName "kube-api-access-qn9vp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 08 04:04:40.474906 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:04:40.474855 2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e3d75930-871f-42ec-beda-136d6c2a3383-kube-api-access-jd2ch" (OuterVolumeSpecName: "kube-api-access-jd2ch") pod "e3d75930-871f-42ec-beda-136d6c2a3383" (UID: "e3d75930-871f-42ec-beda-136d6c2a3383"). InnerVolumeSpecName "kube-api-access-jd2ch". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 08 04:04:40.478838 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:04:40.478815 2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e3d75930-871f-42ec-beda-136d6c2a3383-util" (OuterVolumeSpecName: "util") pod "e3d75930-871f-42ec-beda-136d6c2a3383" (UID: "e3d75930-871f-42ec-beda-136d6c2a3383"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 08 04:04:40.478934 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:04:40.478862 2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a73e2e62-1440-4773-a771-1dcaaa878f2f-util" (OuterVolumeSpecName: "util") pod "a73e2e62-1440-4773-a771-1dcaaa878f2f" (UID: "a73e2e62-1440-4773-a771-1dcaaa878f2f"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 08 04:04:40.480334 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:04:40.480316 2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a1d1c86f-fcdf-4377-8d10-5cbdf847d013-util" (OuterVolumeSpecName: "util") pod "a1d1c86f-fcdf-4377-8d10-5cbdf847d013" (UID: "a1d1c86f-fcdf-4377-8d10-5cbdf847d013"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 08 04:04:40.573325 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:04:40.573297 2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qn9vp\" (UniqueName: \"kubernetes.io/projected/a73e2e62-1440-4773-a771-1dcaaa878f2f-kube-api-access-qn9vp\") on node \"ip-10-0-128-67.ec2.internal\" DevicePath \"\"" Sep 08 04:04:40.573325 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:04:40.573324 2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-45v5c\" (UniqueName: \"kubernetes.io/projected/a1d1c86f-fcdf-4377-8d10-5cbdf847d013-kube-api-access-45v5c\") on node \"ip-10-0-128-67.ec2.internal\" DevicePath \"\"" Sep 08 04:04:40.573467 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:04:40.573337 2571 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a73e2e62-1440-4773-a771-1dcaaa878f2f-util\") on node \"ip-10-0-128-67.ec2.internal\" DevicePath \"\"" Sep 08 04:04:40.573467 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:04:40.573347 2571 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e3d75930-871f-42ec-beda-136d6c2a3383-bundle\") on node \"ip-10-0-128-67.ec2.internal\" DevicePath \"\"" Sep 08 04:04:40.573467 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:04:40.573354 2571 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e3d75930-871f-42ec-beda-136d6c2a3383-util\") on node \"ip-10-0-128-67.ec2.internal\" DevicePath \"\"" Sep 08 04:04:40.573467 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:04:40.573362 2571 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a73e2e62-1440-4773-a771-1dcaaa878f2f-bundle\") on node \"ip-10-0-128-67.ec2.internal\" DevicePath \"\"" Sep 08 04:04:40.573467 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:04:40.573369 2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jd2ch\" (UniqueName: \"kubernetes.io/projected/e3d75930-871f-42ec-beda-136d6c2a3383-kube-api-access-jd2ch\") on node \"ip-10-0-128-67.ec2.internal\" DevicePath \"\"" Sep 08 04:04:40.573467 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:04:40.573377 2571 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a1d1c86f-fcdf-4377-8d10-5cbdf847d013-bundle\") on node \"ip-10-0-128-67.ec2.internal\" DevicePath \"\"" Sep 08 04:04:40.573467 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:04:40.573385 2571 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a1d1c86f-fcdf-4377-8d10-5cbdf847d013-util\") on node \"ip-10-0-128-67.ec2.internal\" DevicePath \"\"" Sep 08 04:04:41.175566 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:04:41.175533 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/978bd81eed4c4dc7896cbc7c21ae91125ef0d2dcd9abf7d17f5d8e954e7ch4w" event={"ID":"e3d75930-871f-42ec-beda-136d6c2a3383","Type":"ContainerDied","Data":"af602a8dcfe48e70e968e286e05b472ed05dd66a3b52be7ae945a371a8f58597"} Sep 08 04:04:41.176007 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:04:41.175586 2571 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="af602a8dcfe48e70e968e286e05b472ed05dd66a3b52be7ae945a371a8f58597" Sep 08 04:04:41.176007 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:04:41.175548 2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/978bd81eed4c4dc7896cbc7c21ae91125ef0d2dcd9abf7d17f5d8e954e7ch4w" Sep 08 04:04:41.177619 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:04:41.177594 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0msftb" event={"ID":"a1d1c86f-fcdf-4377-8d10-5cbdf847d013","Type":"ContainerDied","Data":"0926955c79670d42f470d96ac478c40d0f25ce0d6d3a215bf9d8832e1d67c90f"} Sep 08 04:04:41.177802 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:04:41.177784 2571 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0926955c79670d42f470d96ac478c40d0f25ce0d6d3a215bf9d8832e1d67c90f" Sep 08 04:04:41.177886 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:04:41.177603 2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0msftb" Sep 08 04:04:41.179792 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:04:41.179731 2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbjv7l4" Sep 08 04:04:41.179792 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:04:41.179764 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbjv7l4" event={"ID":"a73e2e62-1440-4773-a771-1dcaaa878f2f","Type":"ContainerDied","Data":"a194b894479cca57f1e9345d2b287c0ced06de08b113c38e613b28b09afaf383"} Sep 08 04:04:41.179972 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:04:41.179816 2571 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a194b894479cca57f1e9345d2b287c0ced06de08b113c38e613b28b09afaf383" Sep 08 04:04:41.352218 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:04:41.352194 2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qq9bt" Sep 08 04:04:41.376309 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:04:41.376286 2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053dsnvm" Sep 08 04:04:41.389264 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:04:41.389243 2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183chd6tq" Sep 08 04:04:41.480303 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:04:41.480274 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6b82e94e-ef8f-4cb5-96bc-7215049dc35d-bundle\") pod \"6b82e94e-ef8f-4cb5-96bc-7215049dc35d\" (UID: \"6b82e94e-ef8f-4cb5-96bc-7215049dc35d\") " Sep 08 04:04:41.480453 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:04:41.480345 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-98ppt\" (UniqueName: \"kubernetes.io/projected/6b82e94e-ef8f-4cb5-96bc-7215049dc35d-kube-api-access-98ppt\") pod \"6b82e94e-ef8f-4cb5-96bc-7215049dc35d\" (UID: \"6b82e94e-ef8f-4cb5-96bc-7215049dc35d\") " Sep 08 04:04:41.480453 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:04:41.480426 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/43e4a0ae-d71a-4aca-9bdc-b046145c29d5-bundle\") pod \"43e4a0ae-d71a-4aca-9bdc-b046145c29d5\" (UID: \"43e4a0ae-d71a-4aca-9bdc-b046145c29d5\") " Sep 08 04:04:41.480453 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:04:41.480445 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7mwr8\" (UniqueName: \"kubernetes.io/projected/d14312c6-2015-4cda-b1d7-72bb5a2dfb5c-kube-api-access-7mwr8\") pod \"d14312c6-2015-4cda-b1d7-72bb5a2dfb5c\" (UID: \"d14312c6-2015-4cda-b1d7-72bb5a2dfb5c\") " Sep 08 04:04:41.480592 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:04:41.480482 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d14312c6-2015-4cda-b1d7-72bb5a2dfb5c-bundle\") pod \"d14312c6-2015-4cda-b1d7-72bb5a2dfb5c\" (UID: \"d14312c6-2015-4cda-b1d7-72bb5a2dfb5c\") " Sep 08 04:04:41.480592 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:04:41.480512 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qmbx2\" (UniqueName: \"kubernetes.io/projected/43e4a0ae-d71a-4aca-9bdc-b046145c29d5-kube-api-access-qmbx2\") pod \"43e4a0ae-d71a-4aca-9bdc-b046145c29d5\" (UID: \"43e4a0ae-d71a-4aca-9bdc-b046145c29d5\") " Sep 08 04:04:41.480592 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:04:41.480542 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/43e4a0ae-d71a-4aca-9bdc-b046145c29d5-util\") pod \"43e4a0ae-d71a-4aca-9bdc-b046145c29d5\" (UID: \"43e4a0ae-d71a-4aca-9bdc-b046145c29d5\") " Sep 08 04:04:41.480592 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:04:41.480584 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6b82e94e-ef8f-4cb5-96bc-7215049dc35d-util\") pod \"6b82e94e-ef8f-4cb5-96bc-7215049dc35d\" (UID: \"6b82e94e-ef8f-4cb5-96bc-7215049dc35d\") " Sep 08 04:04:41.481238 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:04:41.481211 2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d14312c6-2015-4cda-b1d7-72bb5a2dfb5c-bundle" (OuterVolumeSpecName: "bundle") pod "d14312c6-2015-4cda-b1d7-72bb5a2dfb5c" (UID: "d14312c6-2015-4cda-b1d7-72bb5a2dfb5c"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 08 04:04:41.481347 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:04:41.481306 2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/43e4a0ae-d71a-4aca-9bdc-b046145c29d5-bundle" (OuterVolumeSpecName: "bundle") pod "43e4a0ae-d71a-4aca-9bdc-b046145c29d5" (UID: "43e4a0ae-d71a-4aca-9bdc-b046145c29d5"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 08 04:04:41.481599 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:04:41.481574 2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6b82e94e-ef8f-4cb5-96bc-7215049dc35d-bundle" (OuterVolumeSpecName: "bundle") pod "6b82e94e-ef8f-4cb5-96bc-7215049dc35d" (UID: "6b82e94e-ef8f-4cb5-96bc-7215049dc35d"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 08 04:04:41.482727 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:04:41.482697 2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d14312c6-2015-4cda-b1d7-72bb5a2dfb5c-kube-api-access-7mwr8" (OuterVolumeSpecName: "kube-api-access-7mwr8") pod "d14312c6-2015-4cda-b1d7-72bb5a2dfb5c" (UID: "d14312c6-2015-4cda-b1d7-72bb5a2dfb5c"). InnerVolumeSpecName "kube-api-access-7mwr8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 08 04:04:41.482841 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:04:41.482816 2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6b82e94e-ef8f-4cb5-96bc-7215049dc35d-kube-api-access-98ppt" (OuterVolumeSpecName: "kube-api-access-98ppt") pod "6b82e94e-ef8f-4cb5-96bc-7215049dc35d" (UID: "6b82e94e-ef8f-4cb5-96bc-7215049dc35d"). InnerVolumeSpecName "kube-api-access-98ppt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 08 04:04:41.483369 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:04:41.483344 2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/43e4a0ae-d71a-4aca-9bdc-b046145c29d5-kube-api-access-qmbx2" (OuterVolumeSpecName: "kube-api-access-qmbx2") pod "43e4a0ae-d71a-4aca-9bdc-b046145c29d5" (UID: "43e4a0ae-d71a-4aca-9bdc-b046145c29d5"). InnerVolumeSpecName "kube-api-access-qmbx2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 08 04:04:41.486892 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:04:41.486873 2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6b82e94e-ef8f-4cb5-96bc-7215049dc35d-util" (OuterVolumeSpecName: "util") pod "6b82e94e-ef8f-4cb5-96bc-7215049dc35d" (UID: "6b82e94e-ef8f-4cb5-96bc-7215049dc35d"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 08 04:04:41.486974 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:04:41.486886 2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/43e4a0ae-d71a-4aca-9bdc-b046145c29d5-util" (OuterVolumeSpecName: "util") pod "43e4a0ae-d71a-4aca-9bdc-b046145c29d5" (UID: "43e4a0ae-d71a-4aca-9bdc-b046145c29d5"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 08 04:04:41.581623 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:04:41.581601 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d14312c6-2015-4cda-b1d7-72bb5a2dfb5c-util\") pod \"d14312c6-2015-4cda-b1d7-72bb5a2dfb5c\" (UID: \"d14312c6-2015-4cda-b1d7-72bb5a2dfb5c\") " Sep 08 04:04:41.581742 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:04:41.581730 2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qmbx2\" (UniqueName: \"kubernetes.io/projected/43e4a0ae-d71a-4aca-9bdc-b046145c29d5-kube-api-access-qmbx2\") on node \"ip-10-0-128-67.ec2.internal\" DevicePath \"\"" Sep 08 04:04:41.581789 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:04:41.581743 2571 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/43e4a0ae-d71a-4aca-9bdc-b046145c29d5-util\") on node \"ip-10-0-128-67.ec2.internal\" DevicePath \"\"" Sep 08 04:04:41.581789 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:04:41.581752 2571 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6b82e94e-ef8f-4cb5-96bc-7215049dc35d-util\") on node \"ip-10-0-128-67.ec2.internal\" DevicePath \"\"" Sep 08 04:04:41.581789 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:04:41.581760 2571 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6b82e94e-ef8f-4cb5-96bc-7215049dc35d-bundle\") on node \"ip-10-0-128-67.ec2.internal\" DevicePath \"\"" Sep 08 04:04:41.581789 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:04:41.581767 2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-98ppt\" (UniqueName: \"kubernetes.io/projected/6b82e94e-ef8f-4cb5-96bc-7215049dc35d-kube-api-access-98ppt\") on node \"ip-10-0-128-67.ec2.internal\" DevicePath \"\"" Sep 08 04:04:41.581789 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:04:41.581776 2571 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/43e4a0ae-d71a-4aca-9bdc-b046145c29d5-bundle\") on node \"ip-10-0-128-67.ec2.internal\" DevicePath \"\"" Sep 08 04:04:41.581950 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:04:41.581785 2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7mwr8\" (UniqueName: \"kubernetes.io/projected/d14312c6-2015-4cda-b1d7-72bb5a2dfb5c-kube-api-access-7mwr8\") on node \"ip-10-0-128-67.ec2.internal\" DevicePath \"\"" Sep 08 04:04:41.581950 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:04:41.581799 2571 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d14312c6-2015-4cda-b1d7-72bb5a2dfb5c-bundle\") on node \"ip-10-0-128-67.ec2.internal\" DevicePath \"\"" Sep 08 04:04:41.586603 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:04:41.586584 2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d14312c6-2015-4cda-b1d7-72bb5a2dfb5c-util" (OuterVolumeSpecName: "util") pod "d14312c6-2015-4cda-b1d7-72bb5a2dfb5c" (UID: "d14312c6-2015-4cda-b1d7-72bb5a2dfb5c"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 08 04:04:41.683021 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:04:41.682962 2571 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d14312c6-2015-4cda-b1d7-72bb5a2dfb5c-util\") on node \"ip-10-0-128-67.ec2.internal\" DevicePath \"\"" Sep 08 04:04:42.185984 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:04:42.185954 2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183chd6tq" Sep 08 04:04:42.185984 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:04:42.185959 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183chd6tq" event={"ID":"d14312c6-2015-4cda-b1d7-72bb5a2dfb5c","Type":"ContainerDied","Data":"5760031125c52ca89d0378357c160ea19452ab6b4e452f7af5f105fcffcfd10c"} Sep 08 04:04:42.186448 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:04:42.186011 2571 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5760031125c52ca89d0378357c160ea19452ab6b4e452f7af5f105fcffcfd10c" Sep 08 04:04:42.188013 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:04:42.187982 2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053dsnvm" Sep 08 04:04:42.188013 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:04:42.187987 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053dsnvm" event={"ID":"43e4a0ae-d71a-4aca-9bdc-b046145c29d5","Type":"ContainerDied","Data":"fa2f90c6b64fe142e62d407f54e64c44aefc7bc319c7deaf9031e457d631663c"} Sep 08 04:04:42.188211 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:04:42.188025 2571 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="fa2f90c6b64fe142e62d407f54e64c44aefc7bc319c7deaf9031e457d631663c" Sep 08 04:04:42.190117 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:04:42.190090 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qq9bt" event={"ID":"6b82e94e-ef8f-4cb5-96bc-7215049dc35d","Type":"ContainerDied","Data":"d56518c53cb7f09fe1e952f6f1fbf344008c48bcdcc0279555f729968e04f3b8"} Sep 08 04:04:42.190202 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:04:42.190128 2571 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d56518c53cb7f09fe1e952f6f1fbf344008c48bcdcc0279555f729968e04f3b8" Sep 08 04:04:42.190202 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:04:42.190104 2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540qq9bt" Sep 08 04:04:50.974117 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:04:50.974081 2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-684f79c9b9-l8jkm"] Sep 08 04:04:50.974558 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:04:50.974330 2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a1d1c86f-fcdf-4377-8d10-5cbdf847d013" containerName="extract" Sep 08 04:04:50.974558 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:04:50.974340 2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="a1d1c86f-fcdf-4377-8d10-5cbdf847d013" containerName="extract" Sep 08 04:04:50.974558 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:04:50.974348 2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a1d1c86f-fcdf-4377-8d10-5cbdf847d013" containerName="pull" Sep 08 04:04:50.974558 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:04:50.974354 2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="a1d1c86f-fcdf-4377-8d10-5cbdf847d013" containerName="pull" Sep 08 04:04:50.974558 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:04:50.974360 2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="43e4a0ae-d71a-4aca-9bdc-b046145c29d5" containerName="pull" Sep 08 04:04:50.974558 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:04:50.974366 2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="43e4a0ae-d71a-4aca-9bdc-b046145c29d5" containerName="pull" Sep 08 04:04:50.974558 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:04:50.974372 2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a73e2e62-1440-4773-a771-1dcaaa878f2f" containerName="extract" Sep 08 04:04:50.974558 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:04:50.974377 2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="a73e2e62-1440-4773-a771-1dcaaa878f2f" containerName="extract" Sep 08 04:04:50.974558 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:04:50.974385 2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d14312c6-2015-4cda-b1d7-72bb5a2dfb5c" containerName="util" Sep 08 04:04:50.974558 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:04:50.974390 2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="d14312c6-2015-4cda-b1d7-72bb5a2dfb5c" containerName="util" Sep 08 04:04:50.974558 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:04:50.974397 2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6b82e94e-ef8f-4cb5-96bc-7215049dc35d" containerName="pull" Sep 08 04:04:50.974558 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:04:50.974402 2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="6b82e94e-ef8f-4cb5-96bc-7215049dc35d" containerName="pull" Sep 08 04:04:50.974558 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:04:50.974408 2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d14312c6-2015-4cda-b1d7-72bb5a2dfb5c" containerName="pull" Sep 08 04:04:50.974558 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:04:50.974412 2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="d14312c6-2015-4cda-b1d7-72bb5a2dfb5c" containerName="pull" Sep 08 04:04:50.974558 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:04:50.974419 2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a73e2e62-1440-4773-a771-1dcaaa878f2f" containerName="pull" Sep 08 04:04:50.974558 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:04:50.974425 2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="a73e2e62-1440-4773-a771-1dcaaa878f2f" containerName="pull" Sep 08 04:04:50.974558 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:04:50.974430 2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6b82e94e-ef8f-4cb5-96bc-7215049dc35d" containerName="util" Sep 08 04:04:50.974558 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:04:50.974434 2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="6b82e94e-ef8f-4cb5-96bc-7215049dc35d" containerName="util" Sep 08 04:04:50.974558 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:04:50.974439 2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="43e4a0ae-d71a-4aca-9bdc-b046145c29d5" containerName="util" Sep 08 04:04:50.974558 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:04:50.974443 2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="43e4a0ae-d71a-4aca-9bdc-b046145c29d5" containerName="util" Sep 08 04:04:50.974558 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:04:50.974449 2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6b82e94e-ef8f-4cb5-96bc-7215049dc35d" containerName="extract" Sep 08 04:04:50.974558 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:04:50.974453 2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="6b82e94e-ef8f-4cb5-96bc-7215049dc35d" containerName="extract" Sep 08 04:04:50.974558 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:04:50.974459 2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="43e4a0ae-d71a-4aca-9bdc-b046145c29d5" containerName="extract" Sep 08 04:04:50.974558 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:04:50.974463 2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="43e4a0ae-d71a-4aca-9bdc-b046145c29d5" containerName="extract" Sep 08 04:04:50.974558 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:04:50.974472 2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d14312c6-2015-4cda-b1d7-72bb5a2dfb5c" containerName="extract" Sep 08 04:04:50.974558 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:04:50.974477 2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="d14312c6-2015-4cda-b1d7-72bb5a2dfb5c" containerName="extract" Sep 08 04:04:50.974558 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:04:50.974483 2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e3d75930-871f-42ec-beda-136d6c2a3383" containerName="util" Sep 08 04:04:50.974558 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:04:50.974487 2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="e3d75930-871f-42ec-beda-136d6c2a3383" containerName="util" Sep 08 04:04:50.974558 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:04:50.974491 2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a1d1c86f-fcdf-4377-8d10-5cbdf847d013" containerName="util" Sep 08 04:04:50.974558 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:04:50.974496 2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="a1d1c86f-fcdf-4377-8d10-5cbdf847d013" containerName="util" Sep 08 04:04:50.974558 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:04:50.974501 2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e3d75930-871f-42ec-beda-136d6c2a3383" containerName="pull" Sep 08 04:04:50.974558 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:04:50.974505 2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="e3d75930-871f-42ec-beda-136d6c2a3383" containerName="pull" Sep 08 04:04:50.974558 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:04:50.974511 2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a73e2e62-1440-4773-a771-1dcaaa878f2f" containerName="util" Sep 08 04:04:50.974558 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:04:50.974516 2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="a73e2e62-1440-4773-a771-1dcaaa878f2f" containerName="util" Sep 08 04:04:50.974558 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:04:50.974521 2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e3d75930-871f-42ec-beda-136d6c2a3383" containerName="extract" Sep 08 04:04:50.974558 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:04:50.974526 2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="e3d75930-871f-42ec-beda-136d6c2a3383" containerName="extract" Sep 08 04:04:50.974558 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:04:50.974562 2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="6b82e94e-ef8f-4cb5-96bc-7215049dc35d" containerName="extract" Sep 08 04:04:50.974558 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:04:50.974568 2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="d14312c6-2015-4cda-b1d7-72bb5a2dfb5c" containerName="extract" Sep 08 04:04:50.974558 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:04:50.974574 2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="43e4a0ae-d71a-4aca-9bdc-b046145c29d5" containerName="extract" Sep 08 04:04:50.975809 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:04:50.974580 2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="a73e2e62-1440-4773-a771-1dcaaa878f2f" containerName="extract" Sep 08 04:04:50.975809 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:04:50.974587 2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="e3d75930-871f-42ec-beda-136d6c2a3383" containerName="extract" Sep 08 04:04:50.975809 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:04:50.974593 2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="a1d1c86f-fcdf-4377-8d10-5cbdf847d013" containerName="extract" Sep 08 04:04:50.978886 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:04:50.978868 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-684f79c9b9-l8jkm" Sep 08 04:04:50.985739 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:04:50.985721 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Sep 08 04:04:50.985941 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:04:50.985928 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Sep 08 04:04:50.986215 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:04:50.986198 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-4tpkm\"" Sep 08 04:04:50.992147 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:04:50.992128 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-684f79c9b9-l8jkm"] Sep 08 04:04:51.049268 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:04:51.049238 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f095fdfb-1f27-4f13-9287-981c5ec876db-tmp\") pod \"cert-manager-operator-controller-manager-684f79c9b9-l8jkm\" (UID: \"f095fdfb-1f27-4f13-9287-981c5ec876db\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-684f79c9b9-l8jkm" Sep 08 04:04:51.049400 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:04:51.049302 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zkclq\" (UniqueName: \"kubernetes.io/projected/f095fdfb-1f27-4f13-9287-981c5ec876db-kube-api-access-zkclq\") pod \"cert-manager-operator-controller-manager-684f79c9b9-l8jkm\" (UID: \"f095fdfb-1f27-4f13-9287-981c5ec876db\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-684f79c9b9-l8jkm" Sep 08 04:04:51.150000 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:04:51.149968 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f095fdfb-1f27-4f13-9287-981c5ec876db-tmp\") pod \"cert-manager-operator-controller-manager-684f79c9b9-l8jkm\" (UID: \"f095fdfb-1f27-4f13-9287-981c5ec876db\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-684f79c9b9-l8jkm" Sep 08 04:04:51.150143 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:04:51.150017 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zkclq\" (UniqueName: \"kubernetes.io/projected/f095fdfb-1f27-4f13-9287-981c5ec876db-kube-api-access-zkclq\") pod \"cert-manager-operator-controller-manager-684f79c9b9-l8jkm\" (UID: \"f095fdfb-1f27-4f13-9287-981c5ec876db\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-684f79c9b9-l8jkm" Sep 08 04:04:51.150333 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:04:51.150315 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f095fdfb-1f27-4f13-9287-981c5ec876db-tmp\") pod \"cert-manager-operator-controller-manager-684f79c9b9-l8jkm\" (UID: \"f095fdfb-1f27-4f13-9287-981c5ec876db\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-684f79c9b9-l8jkm" Sep 08 04:04:51.158714 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:04:51.158689 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zkclq\" (UniqueName: \"kubernetes.io/projected/f095fdfb-1f27-4f13-9287-981c5ec876db-kube-api-access-zkclq\") pod \"cert-manager-operator-controller-manager-684f79c9b9-l8jkm\" (UID: \"f095fdfb-1f27-4f13-9287-981c5ec876db\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-684f79c9b9-l8jkm" Sep 08 04:04:51.287790 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:04:51.287765 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-684f79c9b9-l8jkm" Sep 08 04:04:51.568978 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:04:51.568953 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-684f79c9b9-l8jkm"] Sep 08 04:04:51.571498 ip-10-0-128-67 kubenswrapper[2571]: W0908 04:04:51.571464 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf095fdfb_1f27_4f13_9287_981c5ec876db.slice/crio-5d852d869ba3393d6476de58834552f63553b1637203112f905c89c2b7d856d6 WatchSource:0}: Error finding container 5d852d869ba3393d6476de58834552f63553b1637203112f905c89c2b7d856d6: Status 404 returned error can't find the container with id 5d852d869ba3393d6476de58834552f63553b1637203112f905c89c2b7d856d6 Sep 08 04:04:52.228289 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:04:52.228256 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-684f79c9b9-l8jkm" event={"ID":"f095fdfb-1f27-4f13-9287-981c5ec876db","Type":"ContainerStarted","Data":"5d852d869ba3393d6476de58834552f63553b1637203112f905c89c2b7d856d6"} Sep 08 04:04:54.240243 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:04:54.240209 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-684f79c9b9-l8jkm" event={"ID":"f095fdfb-1f27-4f13-9287-981c5ec876db","Type":"ContainerStarted","Data":"9c6dcd324339eb81c709eb7cf17c4debcda81305c75d756ca2a6c0b239a88f56"} Sep 08 04:04:54.263965 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:04:54.263886 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-684f79c9b9-l8jkm" podStartSLOduration=2.501244884 podStartE2EDuration="4.26386646s" totalImagesPullingTime="1.762621576s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 04:04:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 04:04:54.262295887 +0000 UTC m=+587.732864268" watchObservedRunningTime="2026-09-08 04:04:54.26386646 +0000 UTC m=+587.734434842" Sep 08 04:04:55.465911 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:04:55.465876 2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-ffcddf5cd-xsjzj"] Sep 08 04:04:55.469122 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:04:55.469106 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-ffcddf5cd-xsjzj" Sep 08 04:04:55.472980 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:04:55.472954 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Sep 08 04:04:55.473237 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:04:55.473217 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\"" Sep 08 04:04:55.473327 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:04:55.473254 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Sep 08 04:04:55.474348 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:04:55.474330 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-qzz26\"" Sep 08 04:04:55.481731 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:04:55.481709 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-ffcddf5cd-xsjzj"] Sep 08 04:04:55.578645 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:04:55.578616 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9w7n5\" (UniqueName: \"kubernetes.io/projected/7cfc47c6-cb3f-49e3-96a5-174f07d8cc61-kube-api-access-9w7n5\") pod \"dns-operator-controller-manager-ffcddf5cd-xsjzj\" (UID: \"7cfc47c6-cb3f-49e3-96a5-174f07d8cc61\") " pod="kuadrant-system/dns-operator-controller-manager-ffcddf5cd-xsjzj" Sep 08 04:04:55.679330 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:04:55.679299 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9w7n5\" (UniqueName: \"kubernetes.io/projected/7cfc47c6-cb3f-49e3-96a5-174f07d8cc61-kube-api-access-9w7n5\") pod \"dns-operator-controller-manager-ffcddf5cd-xsjzj\" (UID: \"7cfc47c6-cb3f-49e3-96a5-174f07d8cc61\") " pod="kuadrant-system/dns-operator-controller-manager-ffcddf5cd-xsjzj" Sep 08 04:04:55.703620 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:04:55.703593 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9w7n5\" (UniqueName: \"kubernetes.io/projected/7cfc47c6-cb3f-49e3-96a5-174f07d8cc61-kube-api-access-9w7n5\") pod \"dns-operator-controller-manager-ffcddf5cd-xsjzj\" (UID: \"7cfc47c6-cb3f-49e3-96a5-174f07d8cc61\") " pod="kuadrant-system/dns-operator-controller-manager-ffcddf5cd-xsjzj" Sep 08 04:04:55.778565 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:04:55.778510 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-ffcddf5cd-xsjzj" Sep 08 04:04:56.061394 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:04:56.061369 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-ffcddf5cd-xsjzj"] Sep 08 04:04:56.063349 ip-10-0-128-67 kubenswrapper[2571]: W0908 04:04:56.063321 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7cfc47c6_cb3f_49e3_96a5_174f07d8cc61.slice/crio-386e57d31fb2a0b77b604486e9358bc1472c80cb1f74c609490d0aca5803dfe6 WatchSource:0}: Error finding container 386e57d31fb2a0b77b604486e9358bc1472c80cb1f74c609490d0aca5803dfe6: Status 404 returned error can't find the container with id 386e57d31fb2a0b77b604486e9358bc1472c80cb1f74c609490d0aca5803dfe6 Sep 08 04:04:56.249745 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:04:56.249716 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-ffcddf5cd-xsjzj" event={"ID":"7cfc47c6-cb3f-49e3-96a5-174f07d8cc61","Type":"ContainerStarted","Data":"386e57d31fb2a0b77b604486e9358bc1472c80cb1f74c609490d0aca5803dfe6"} Sep 08 04:04:59.265253 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:04:59.265172 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-ffcddf5cd-xsjzj" event={"ID":"7cfc47c6-cb3f-49e3-96a5-174f07d8cc61","Type":"ContainerStarted","Data":"93b7265f02ff8db0e0e0441a932e385c3d53966f0cd279e8045383b11a4abcb1"} Sep 08 04:04:59.265593 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:04:59.265309 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-ffcddf5cd-xsjzj" Sep 08 04:04:59.284657 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:04:59.284614 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-ffcddf5cd-xsjzj" podStartSLOduration=1.531107522 podStartE2EDuration="4.284600886s" totalImagesPullingTime="2.753493364s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 04:04:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 04:04:59.283319402 +0000 UTC m=+592.753887784" watchObservedRunningTime="2026-09-08 04:04:59.284600886 +0000 UTC m=+592.755169266" Sep 08 04:05:01.906137 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:05:01.906100 2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-xrmrj"] Sep 08 04:05:01.909158 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:05:01.909138 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-xrmrj" Sep 08 04:05:01.912141 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:05:01.912101 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Sep 08 04:05:01.913499 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:05:01.913474 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-x9mtg\"" Sep 08 04:05:01.913614 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:05:01.913482 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Sep 08 04:05:01.918193 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:05:01.918170 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-xrmrj"] Sep 08 04:05:02.026349 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:05:02.026311 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gbj2v\" (UniqueName: \"kubernetes.io/projected/58766b11-fa42-489d-b16d-2637a5b2aa97-kube-api-access-gbj2v\") pod \"cert-manager-cainjector-559cdd8c87-xrmrj\" (UID: \"58766b11-fa42-489d-b16d-2637a5b2aa97\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-xrmrj" Sep 08 04:05:02.026520 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:05:02.026383 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/58766b11-fa42-489d-b16d-2637a5b2aa97-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-xrmrj\" (UID: \"58766b11-fa42-489d-b16d-2637a5b2aa97\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-xrmrj" Sep 08 04:05:02.127657 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:05:02.127623 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gbj2v\" (UniqueName: \"kubernetes.io/projected/58766b11-fa42-489d-b16d-2637a5b2aa97-kube-api-access-gbj2v\") pod \"cert-manager-cainjector-559cdd8c87-xrmrj\" (UID: \"58766b11-fa42-489d-b16d-2637a5b2aa97\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-xrmrj" Sep 08 04:05:02.127657 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:05:02.127657 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/58766b11-fa42-489d-b16d-2637a5b2aa97-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-xrmrj\" (UID: \"58766b11-fa42-489d-b16d-2637a5b2aa97\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-xrmrj" Sep 08 04:05:02.137127 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:05:02.137100 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/58766b11-fa42-489d-b16d-2637a5b2aa97-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-xrmrj\" (UID: \"58766b11-fa42-489d-b16d-2637a5b2aa97\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-xrmrj" Sep 08 04:05:02.137349 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:05:02.137325 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gbj2v\" (UniqueName: \"kubernetes.io/projected/58766b11-fa42-489d-b16d-2637a5b2aa97-kube-api-access-gbj2v\") pod \"cert-manager-cainjector-559cdd8c87-xrmrj\" (UID: \"58766b11-fa42-489d-b16d-2637a5b2aa97\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-xrmrj" Sep 08 04:05:02.218953 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:05:02.218858 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-xrmrj" Sep 08 04:05:02.493213 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:05:02.493126 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-xrmrj"] Sep 08 04:05:02.495813 ip-10-0-128-67 kubenswrapper[2571]: W0908 04:05:02.495786 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod58766b11_fa42_489d_b16d_2637a5b2aa97.slice/crio-95d9b1cc101526d767da02e11479ee5ee88e8936253ae0caf2a832d9264fc0fa WatchSource:0}: Error finding container 95d9b1cc101526d767da02e11479ee5ee88e8936253ae0caf2a832d9264fc0fa: Status 404 returned error can't find the container with id 95d9b1cc101526d767da02e11479ee5ee88e8936253ae0caf2a832d9264fc0fa Sep 08 04:05:03.035521 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:05:03.035488 2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-7456d9997c-srvk4"] Sep 08 04:05:03.039715 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:05:03.039696 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-7456d9997c-srvk4" Sep 08 04:05:03.044468 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:05:03.044451 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-mnmpq\"" Sep 08 04:05:03.069008 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:05:03.068983 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-7456d9997c-srvk4"] Sep 08 04:05:03.135986 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:05:03.135956 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5wl4p\" (UniqueName: \"kubernetes.io/projected/cf765688-c25d-46c2-97e0-48bd36c81666-kube-api-access-5wl4p\") pod \"kuadrant-operator-controller-manager-7456d9997c-srvk4\" (UID: \"cf765688-c25d-46c2-97e0-48bd36c81666\") " pod="kuadrant-system/kuadrant-operator-controller-manager-7456d9997c-srvk4" Sep 08 04:05:03.136149 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:05:03.136000 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/cf765688-c25d-46c2-97e0-48bd36c81666-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-7456d9997c-srvk4\" (UID: \"cf765688-c25d-46c2-97e0-48bd36c81666\") " pod="kuadrant-system/kuadrant-operator-controller-manager-7456d9997c-srvk4" Sep 08 04:05:03.237275 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:05:03.237232 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5wl4p\" (UniqueName: \"kubernetes.io/projected/cf765688-c25d-46c2-97e0-48bd36c81666-kube-api-access-5wl4p\") pod \"kuadrant-operator-controller-manager-7456d9997c-srvk4\" (UID: \"cf765688-c25d-46c2-97e0-48bd36c81666\") " pod="kuadrant-system/kuadrant-operator-controller-manager-7456d9997c-srvk4" Sep 08 04:05:03.237472 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:05:03.237297 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/cf765688-c25d-46c2-97e0-48bd36c81666-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-7456d9997c-srvk4\" (UID: \"cf765688-c25d-46c2-97e0-48bd36c81666\") " pod="kuadrant-system/kuadrant-operator-controller-manager-7456d9997c-srvk4" Sep 08 04:05:03.237684 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:05:03.237664 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/cf765688-c25d-46c2-97e0-48bd36c81666-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-7456d9997c-srvk4\" (UID: \"cf765688-c25d-46c2-97e0-48bd36c81666\") " pod="kuadrant-system/kuadrant-operator-controller-manager-7456d9997c-srvk4" Sep 08 04:05:03.248133 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:05:03.248107 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5wl4p\" (UniqueName: \"kubernetes.io/projected/cf765688-c25d-46c2-97e0-48bd36c81666-kube-api-access-5wl4p\") pod \"kuadrant-operator-controller-manager-7456d9997c-srvk4\" (UID: \"cf765688-c25d-46c2-97e0-48bd36c81666\") " pod="kuadrant-system/kuadrant-operator-controller-manager-7456d9997c-srvk4" Sep 08 04:05:03.286187 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:05:03.286109 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-xrmrj" event={"ID":"58766b11-fa42-489d-b16d-2637a5b2aa97","Type":"ContainerStarted","Data":"95d9b1cc101526d767da02e11479ee5ee88e8936253ae0caf2a832d9264fc0fa"} Sep 08 04:05:03.350237 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:05:03.350202 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-7456d9997c-srvk4" Sep 08 04:05:03.638214 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:05:03.638069 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-7456d9997c-srvk4"] Sep 08 04:05:03.640630 ip-10-0-128-67 kubenswrapper[2571]: W0908 04:05:03.640598 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcf765688_c25d_46c2_97e0_48bd36c81666.slice/crio-ac8c090776b5279495ab38ddd3bf1c0134254e2061f555c7131991d113fbdab8 WatchSource:0}: Error finding container ac8c090776b5279495ab38ddd3bf1c0134254e2061f555c7131991d113fbdab8: Status 404 returned error can't find the container with id ac8c090776b5279495ab38ddd3bf1c0134254e2061f555c7131991d113fbdab8 Sep 08 04:05:04.292083 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:05:04.292052 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-7456d9997c-srvk4" event={"ID":"cf765688-c25d-46c2-97e0-48bd36c81666","Type":"ContainerStarted","Data":"ac8c090776b5279495ab38ddd3bf1c0134254e2061f555c7131991d113fbdab8"} Sep 08 04:05:05.202537 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:05:05.202500 2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub-operator-system/opendatahub-operator-controller-manager-b8484c5b8-hjvvh"] Sep 08 04:05:05.205549 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:05:05.205527 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-b8484c5b8-hjvvh" Sep 08 04:05:05.208441 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:05:05.208423 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub-operator-system\"/\"opendatahub-operator-controller-manager-dockercfg-wdq29\"" Sep 08 04:05:05.208794 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:05:05.208775 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub-operator-system\"/\"openshift-service-ca.crt\"" Sep 08 04:05:05.208960 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:05:05.208938 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub-operator-system\"/\"opendatahub-operator-controller-webhook-cert\"" Sep 08 04:05:05.209017 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:05:05.209004 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub-operator-system\"/\"kube-root-ca.crt\"" Sep 08 04:05:05.209345 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:05:05.209325 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub-operator-system\"/\"opendatahub-operator-metrics-tls\"" Sep 08 04:05:05.209418 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:05:05.209359 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub-operator-system\"/\"opendatahub-operator-controller-manager-service-cert\"" Sep 08 04:05:05.227637 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:05:05.227615 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub-operator-system/opendatahub-operator-controller-manager-b8484c5b8-hjvvh"] Sep 08 04:05:05.256600 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:05:05.256574 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/003f7f61-1f4b-4d31-b819-ee986a60e12e-tmp\") pod \"opendatahub-operator-controller-manager-b8484c5b8-hjvvh\" (UID: \"003f7f61-1f4b-4d31-b819-ee986a60e12e\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-b8484c5b8-hjvvh" Sep 08 04:05:05.256706 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:05:05.256628 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/003f7f61-1f4b-4d31-b819-ee986a60e12e-metrics-cert\") pod \"opendatahub-operator-controller-manager-b8484c5b8-hjvvh\" (UID: \"003f7f61-1f4b-4d31-b819-ee986a60e12e\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-b8484c5b8-hjvvh" Sep 08 04:05:05.256706 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:05:05.256653 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/003f7f61-1f4b-4d31-b819-ee986a60e12e-manifests\") pod \"opendatahub-operator-controller-manager-b8484c5b8-hjvvh\" (UID: \"003f7f61-1f4b-4d31-b819-ee986a60e12e\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-b8484c5b8-hjvvh" Sep 08 04:05:05.256800 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:05:05.256728 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/003f7f61-1f4b-4d31-b819-ee986a60e12e-apiservice-cert\") pod \"opendatahub-operator-controller-manager-b8484c5b8-hjvvh\" (UID: \"003f7f61-1f4b-4d31-b819-ee986a60e12e\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-b8484c5b8-hjvvh" Sep 08 04:05:05.256800 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:05:05.256774 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-skcmb\" (UniqueName: \"kubernetes.io/projected/003f7f61-1f4b-4d31-b819-ee986a60e12e-kube-api-access-skcmb\") pod \"opendatahub-operator-controller-manager-b8484c5b8-hjvvh\" (UID: \"003f7f61-1f4b-4d31-b819-ee986a60e12e\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-b8484c5b8-hjvvh" Sep 08 04:05:05.256942 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:05:05.256800 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/003f7f61-1f4b-4d31-b819-ee986a60e12e-webhook-cert\") pod \"opendatahub-operator-controller-manager-b8484c5b8-hjvvh\" (UID: \"003f7f61-1f4b-4d31-b819-ee986a60e12e\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-b8484c5b8-hjvvh" Sep 08 04:05:05.357646 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:05:05.357611 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/003f7f61-1f4b-4d31-b819-ee986a60e12e-metrics-cert\") pod \"opendatahub-operator-controller-manager-b8484c5b8-hjvvh\" (UID: \"003f7f61-1f4b-4d31-b819-ee986a60e12e\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-b8484c5b8-hjvvh" Sep 08 04:05:05.358127 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:05:05.357653 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/003f7f61-1f4b-4d31-b819-ee986a60e12e-manifests\") pod \"opendatahub-operator-controller-manager-b8484c5b8-hjvvh\" (UID: \"003f7f61-1f4b-4d31-b819-ee986a60e12e\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-b8484c5b8-hjvvh" Sep 08 04:05:05.358127 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:05:05.357679 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/003f7f61-1f4b-4d31-b819-ee986a60e12e-apiservice-cert\") pod \"opendatahub-operator-controller-manager-b8484c5b8-hjvvh\" (UID: \"003f7f61-1f4b-4d31-b819-ee986a60e12e\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-b8484c5b8-hjvvh" Sep 08 04:05:05.358127 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:05:05.357696 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-skcmb\" (UniqueName: \"kubernetes.io/projected/003f7f61-1f4b-4d31-b819-ee986a60e12e-kube-api-access-skcmb\") pod \"opendatahub-operator-controller-manager-b8484c5b8-hjvvh\" (UID: \"003f7f61-1f4b-4d31-b819-ee986a60e12e\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-b8484c5b8-hjvvh" Sep 08 04:05:05.358127 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:05:05.357722 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/003f7f61-1f4b-4d31-b819-ee986a60e12e-webhook-cert\") pod \"opendatahub-operator-controller-manager-b8484c5b8-hjvvh\" (UID: \"003f7f61-1f4b-4d31-b819-ee986a60e12e\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-b8484c5b8-hjvvh" Sep 08 04:05:05.358127 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:05:05.357798 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/003f7f61-1f4b-4d31-b819-ee986a60e12e-tmp\") pod \"opendatahub-operator-controller-manager-b8484c5b8-hjvvh\" (UID: \"003f7f61-1f4b-4d31-b819-ee986a60e12e\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-b8484c5b8-hjvvh" Sep 08 04:05:05.358127 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:05:05.358118 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/003f7f61-1f4b-4d31-b819-ee986a60e12e-manifests\") pod \"opendatahub-operator-controller-manager-b8484c5b8-hjvvh\" (UID: \"003f7f61-1f4b-4d31-b819-ee986a60e12e\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-b8484c5b8-hjvvh" Sep 08 04:05:05.360543 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:05:05.360518 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/003f7f61-1f4b-4d31-b819-ee986a60e12e-tmp\") pod \"opendatahub-operator-controller-manager-b8484c5b8-hjvvh\" (UID: \"003f7f61-1f4b-4d31-b819-ee986a60e12e\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-b8484c5b8-hjvvh" Sep 08 04:05:05.360714 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:05:05.360689 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/003f7f61-1f4b-4d31-b819-ee986a60e12e-webhook-cert\") pod \"opendatahub-operator-controller-manager-b8484c5b8-hjvvh\" (UID: \"003f7f61-1f4b-4d31-b819-ee986a60e12e\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-b8484c5b8-hjvvh" Sep 08 04:05:05.360864 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:05:05.360837 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/003f7f61-1f4b-4d31-b819-ee986a60e12e-apiservice-cert\") pod \"opendatahub-operator-controller-manager-b8484c5b8-hjvvh\" (UID: \"003f7f61-1f4b-4d31-b819-ee986a60e12e\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-b8484c5b8-hjvvh" Sep 08 04:05:05.361313 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:05:05.361289 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/003f7f61-1f4b-4d31-b819-ee986a60e12e-metrics-cert\") pod \"opendatahub-operator-controller-manager-b8484c5b8-hjvvh\" (UID: \"003f7f61-1f4b-4d31-b819-ee986a60e12e\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-b8484c5b8-hjvvh" Sep 08 04:05:05.375835 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:05:05.375803 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-skcmb\" (UniqueName: \"kubernetes.io/projected/003f7f61-1f4b-4d31-b819-ee986a60e12e-kube-api-access-skcmb\") pod \"opendatahub-operator-controller-manager-b8484c5b8-hjvvh\" (UID: \"003f7f61-1f4b-4d31-b819-ee986a60e12e\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-b8484c5b8-hjvvh" Sep 08 04:05:05.515989 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:05:05.515882 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-b8484c5b8-hjvvh" Sep 08 04:05:05.799736 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:05:05.799712 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub-operator-system/opendatahub-operator-controller-manager-b8484c5b8-hjvvh"] Sep 08 04:05:05.801101 ip-10-0-128-67 kubenswrapper[2571]: W0908 04:05:05.801071 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod003f7f61_1f4b_4d31_b819_ee986a60e12e.slice/crio-60f60a1a80f900e4036dbd11a7085b1861cedb29b29a815aa85dcc8c44f7d99a WatchSource:0}: Error finding container 60f60a1a80f900e4036dbd11a7085b1861cedb29b29a815aa85dcc8c44f7d99a: Status 404 returned error can't find the container with id 60f60a1a80f900e4036dbd11a7085b1861cedb29b29a815aa85dcc8c44f7d99a Sep 08 04:05:06.303703 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:05:06.303669 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-b8484c5b8-hjvvh" event={"ID":"003f7f61-1f4b-4d31-b819-ee986a60e12e","Type":"ContainerStarted","Data":"60f60a1a80f900e4036dbd11a7085b1861cedb29b29a815aa85dcc8c44f7d99a"} Sep 08 04:05:06.305109 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:05:06.305082 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-xrmrj" event={"ID":"58766b11-fa42-489d-b16d-2637a5b2aa97","Type":"ContainerStarted","Data":"f52a99287bf39b0ecf8415e8d008d60671bfd1a68f91c512a0a02948e9e8fd47"} Sep 08 04:05:06.334419 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:05:06.334375 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-xrmrj" podStartSLOduration=2.589945879 podStartE2EDuration="5.334360018s" totalImagesPullingTime="2.744414139s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 04:05:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 04:05:06.333976562 +0000 UTC m=+599.804544943" watchObservedRunningTime="2026-09-08 04:05:06.334360018 +0000 UTC m=+599.804928398" Sep 08 04:05:08.183524 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:05:08.183484 2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-84d9bfc694-tmc2z"] Sep 08 04:05:08.187698 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:05:08.187669 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-84d9bfc694-tmc2z" Sep 08 04:05:08.190471 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:05:08.190438 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-mp4nm\"" Sep 08 04:05:08.199474 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:05:08.199414 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-84d9bfc694-tmc2z"] Sep 08 04:05:08.285833 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:05:08.285788 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p97p9\" (UniqueName: \"kubernetes.io/projected/92d30b0c-8690-4fc3-b2c5-eeac54372929-kube-api-access-p97p9\") pod \"authorino-operator-84d9bfc694-tmc2z\" (UID: \"92d30b0c-8690-4fc3-b2c5-eeac54372929\") " pod="kuadrant-system/authorino-operator-84d9bfc694-tmc2z" Sep 08 04:05:08.386365 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:05:08.386274 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p97p9\" (UniqueName: \"kubernetes.io/projected/92d30b0c-8690-4fc3-b2c5-eeac54372929-kube-api-access-p97p9\") pod \"authorino-operator-84d9bfc694-tmc2z\" (UID: \"92d30b0c-8690-4fc3-b2c5-eeac54372929\") " pod="kuadrant-system/authorino-operator-84d9bfc694-tmc2z" Sep 08 04:05:08.395763 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:05:08.395705 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p97p9\" (UniqueName: \"kubernetes.io/projected/92d30b0c-8690-4fc3-b2c5-eeac54372929-kube-api-access-p97p9\") pod \"authorino-operator-84d9bfc694-tmc2z\" (UID: \"92d30b0c-8690-4fc3-b2c5-eeac54372929\") " pod="kuadrant-system/authorino-operator-84d9bfc694-tmc2z" Sep 08 04:05:08.502045 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:05:08.501959 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-84d9bfc694-tmc2z" Sep 08 04:05:09.165764 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:05:09.165736 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-84d9bfc694-tmc2z"] Sep 08 04:05:10.272101 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:05:10.271997 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-ffcddf5cd-xsjzj" Sep 08 04:05:10.785578 ip-10-0-128-67 kubenswrapper[2571]: W0908 04:05:10.341309 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod92d30b0c_8690_4fc3_b2c5_eeac54372929.slice/crio-c3a8ad883ce669d87df676fc69bc10b7229c7f99ae86c7f5436bb50708c74e57 WatchSource:0}: Error finding container c3a8ad883ce669d87df676fc69bc10b7229c7f99ae86c7f5436bb50708c74e57: Status 404 returned error can't find the container with id c3a8ad883ce669d87df676fc69bc10b7229c7f99ae86c7f5436bb50708c74e57 Sep 08 04:05:11.332817 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:05:11.332776 2571 generic.go:356] "Generic (PLEG): container finished" podID="003f7f61-1f4b-4d31-b819-ee986a60e12e" containerID="b082306e6e05190ff38d686da1cb5dbd16fc5773ca79cc22abe7a06cbeecfa46" exitCode=0 Sep 08 04:05:11.333226 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:05:11.332861 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-b8484c5b8-hjvvh" event={"ID":"003f7f61-1f4b-4d31-b819-ee986a60e12e","Type":"ContainerDied","Data":"b082306e6e05190ff38d686da1cb5dbd16fc5773ca79cc22abe7a06cbeecfa46"} Sep 08 04:05:11.334849 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:05:11.334815 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-7456d9997c-srvk4" event={"ID":"cf765688-c25d-46c2-97e0-48bd36c81666","Type":"ContainerStarted","Data":"6fe2034aedebef7b28794cd85bd2fb9d0ffdfd2103fbd2334fd516d7d66eb8d8"} Sep 08 04:05:11.335009 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:05:11.334875 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-7456d9997c-srvk4" Sep 08 04:05:11.336231 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:05:11.336213 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-84d9bfc694-tmc2z" event={"ID":"92d30b0c-8690-4fc3-b2c5-eeac54372929","Type":"ContainerStarted","Data":"c3a8ad883ce669d87df676fc69bc10b7229c7f99ae86c7f5436bb50708c74e57"} Sep 08 04:05:11.401311 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:05:11.401263 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-7456d9997c-srvk4" podStartSLOduration=2.478668412 podStartE2EDuration="9.401248244s" totalImagesPullingTime="6.922579832s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 04:05:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 04:05:11.399233175 +0000 UTC m=+604.869801555" watchObservedRunningTime="2026-09-08 04:05:11.401248244 +0000 UTC m=+604.871816626" Sep 08 04:05:11.962064 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:05:11.962025 2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-565895c755-ggwrk"] Sep 08 04:05:11.984308 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:05:11.984276 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-565895c755-ggwrk" Sep 08 04:05:11.987093 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:05:11.987066 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-565895c755-ggwrk"] Sep 08 04:05:11.987787 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:05:11.987764 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-wjbq2\"" Sep 08 04:05:12.117932 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:05:12.117869 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2fzt9\" (UniqueName: \"kubernetes.io/projected/adad0566-5d7e-4bfc-871c-25b9b1aff5f4-kube-api-access-2fzt9\") pod \"limitador-operator-controller-manager-565895c755-ggwrk\" (UID: \"adad0566-5d7e-4bfc-871c-25b9b1aff5f4\") " pod="kuadrant-system/limitador-operator-controller-manager-565895c755-ggwrk" Sep 08 04:05:12.219296 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:05:12.219203 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2fzt9\" (UniqueName: \"kubernetes.io/projected/adad0566-5d7e-4bfc-871c-25b9b1aff5f4-kube-api-access-2fzt9\") pod \"limitador-operator-controller-manager-565895c755-ggwrk\" (UID: \"adad0566-5d7e-4bfc-871c-25b9b1aff5f4\") " pod="kuadrant-system/limitador-operator-controller-manager-565895c755-ggwrk" Sep 08 04:05:12.230779 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:05:12.230747 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2fzt9\" (UniqueName: \"kubernetes.io/projected/adad0566-5d7e-4bfc-871c-25b9b1aff5f4-kube-api-access-2fzt9\") pod \"limitador-operator-controller-manager-565895c755-ggwrk\" (UID: \"adad0566-5d7e-4bfc-871c-25b9b1aff5f4\") " pod="kuadrant-system/limitador-operator-controller-manager-565895c755-ggwrk" Sep 08 04:05:12.295904 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:05:12.295877 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-565895c755-ggwrk" Sep 08 04:05:12.585906 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:05:12.585879 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-565895c755-ggwrk"] Sep 08 04:05:12.588199 ip-10-0-128-67 kubenswrapper[2571]: W0908 04:05:12.588171 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podadad0566_5d7e_4bfc_871c_25b9b1aff5f4.slice/crio-3ba41347369faa41b491942356837d726d7c67320170c83279c56d10068ce1e6 WatchSource:0}: Error finding container 3ba41347369faa41b491942356837d726d7c67320170c83279c56d10068ce1e6: Status 404 returned error can't find the container with id 3ba41347369faa41b491942356837d726d7c67320170c83279c56d10068ce1e6 Sep 08 04:05:13.350487 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:05:13.350449 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-b8484c5b8-hjvvh" event={"ID":"003f7f61-1f4b-4d31-b819-ee986a60e12e","Type":"ContainerStarted","Data":"6151470c17ed83fbb30d1b943e5f538dab5be63561d00238ae650173bd27beef"} Sep 08 04:05:13.350675 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:05:13.350560 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-b8484c5b8-hjvvh" Sep 08 04:05:13.352055 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:05:13.352025 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-565895c755-ggwrk" event={"ID":"adad0566-5d7e-4bfc-871c-25b9b1aff5f4","Type":"ContainerStarted","Data":"3ba41347369faa41b491942356837d726d7c67320170c83279c56d10068ce1e6"} Sep 08 04:05:13.353909 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:05:13.353882 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-84d9bfc694-tmc2z" event={"ID":"92d30b0c-8690-4fc3-b2c5-eeac54372929","Type":"ContainerStarted","Data":"186d1fc7f21ed1d23b3a5d7f691481c86c8b8934ef24fa75092693d300c44125"} Sep 08 04:05:13.354051 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:05:13.354033 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-84d9bfc694-tmc2z" Sep 08 04:05:13.379486 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:05:13.379423 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-b8484c5b8-hjvvh" podStartSLOduration=2.169017719 podStartE2EDuration="8.379404652s" totalImagesPullingTime="5.647175797s" totalInitContainerRuntime="563.211136ms" isStatefulPod=false podCreationTimestamp="2026-09-08 04:05:05 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 04:05:13.376166221 +0000 UTC m=+606.846734593" watchObservedRunningTime="2026-09-08 04:05:13.379404652 +0000 UTC m=+606.849973033" Sep 08 04:05:13.394849 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:05:13.394789 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-84d9bfc694-tmc2z" podStartSLOduration=3.652979487 podStartE2EDuration="5.394774964s" totalImagesPullingTime="1.741795477s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 04:05:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 04:05:13.393816865 +0000 UTC m=+606.864385249" watchObservedRunningTime="2026-09-08 04:05:13.394774964 +0000 UTC m=+606.865343345" Sep 08 04:05:14.360571 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:05:14.360527 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-565895c755-ggwrk" event={"ID":"adad0566-5d7e-4bfc-871c-25b9b1aff5f4","Type":"ContainerStarted","Data":"8820696462d240da7230cba3d280bd4b41f42d6d7efd451f78a0e5e0cafb9e1b"} Sep 08 04:05:14.360953 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:05:14.360622 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-565895c755-ggwrk" Sep 08 04:05:14.383759 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:05:14.383709 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-565895c755-ggwrk" podStartSLOduration=1.991312678 podStartE2EDuration="3.383680372s" totalImagesPullingTime="1.392367694s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 04:05:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 04:05:14.382699139 +0000 UTC m=+607.853267513" watchObservedRunningTime="2026-09-08 04:05:14.383680372 +0000 UTC m=+607.854248752" Sep 08 04:05:22.345677 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:05:22.345638 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-7456d9997c-srvk4" Sep 08 04:05:24.362865 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:05:24.362823 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-84d9bfc694-tmc2z" Sep 08 04:05:24.363237 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:05:24.362938 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-b8484c5b8-hjvvh" Sep 08 04:05:25.367398 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:05:25.367367 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-565895c755-ggwrk" Sep 08 04:05:41.866237 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:05:41.866158 2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-ctn7f"] Sep 08 04:05:41.946713 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:05:41.946667 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-ctn7f"] Sep 08 04:05:41.946907 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:05:41.946672 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-ctn7f" Sep 08 04:05:41.949961 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:05:41.949940 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-vljc2\"" Sep 08 04:05:42.075540 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:05:42.075499 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7a0003c4-8989-4f28-b1f7-62ed71cfe566-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-ctn7f\" (UID: \"7a0003c4-8989-4f28-b1f7-62ed71cfe566\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-ctn7f" Sep 08 04:05:42.075540 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:05:42.075540 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7a0003c4-8989-4f28-b1f7-62ed71cfe566-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-ctn7f\" (UID: \"7a0003c4-8989-4f28-b1f7-62ed71cfe566\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-ctn7f" Sep 08 04:05:42.075805 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:05:42.075556 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7a0003c4-8989-4f28-b1f7-62ed71cfe566-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-ctn7f\" (UID: \"7a0003c4-8989-4f28-b1f7-62ed71cfe566\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-ctn7f" Sep 08 04:05:42.075805 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:05:42.075574 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7a0003c4-8989-4f28-b1f7-62ed71cfe566-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-ctn7f\" (UID: \"7a0003c4-8989-4f28-b1f7-62ed71cfe566\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-ctn7f" Sep 08 04:05:42.075805 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:05:42.075645 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7a0003c4-8989-4f28-b1f7-62ed71cfe566-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-ctn7f\" (UID: \"7a0003c4-8989-4f28-b1f7-62ed71cfe566\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-ctn7f" Sep 08 04:05:42.075805 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:05:42.075685 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fpbfw\" (UniqueName: \"kubernetes.io/projected/7a0003c4-8989-4f28-b1f7-62ed71cfe566-kube-api-access-fpbfw\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-ctn7f\" (UID: \"7a0003c4-8989-4f28-b1f7-62ed71cfe566\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-ctn7f" Sep 08 04:05:42.075805 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:05:42.075720 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7a0003c4-8989-4f28-b1f7-62ed71cfe566-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-ctn7f\" (UID: \"7a0003c4-8989-4f28-b1f7-62ed71cfe566\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-ctn7f" Sep 08 04:05:42.075805 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:05:42.075756 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7a0003c4-8989-4f28-b1f7-62ed71cfe566-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-ctn7f\" (UID: \"7a0003c4-8989-4f28-b1f7-62ed71cfe566\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-ctn7f" Sep 08 04:05:42.076074 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:05:42.075807 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7a0003c4-8989-4f28-b1f7-62ed71cfe566-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-ctn7f\" (UID: \"7a0003c4-8989-4f28-b1f7-62ed71cfe566\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-ctn7f" Sep 08 04:05:42.177349 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:05:42.177249 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7a0003c4-8989-4f28-b1f7-62ed71cfe566-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-ctn7f\" (UID: \"7a0003c4-8989-4f28-b1f7-62ed71cfe566\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-ctn7f" Sep 08 04:05:42.177349 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:05:42.177295 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7a0003c4-8989-4f28-b1f7-62ed71cfe566-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-ctn7f\" (UID: \"7a0003c4-8989-4f28-b1f7-62ed71cfe566\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-ctn7f" Sep 08 04:05:42.177349 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:05:42.177315 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7a0003c4-8989-4f28-b1f7-62ed71cfe566-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-ctn7f\" (UID: \"7a0003c4-8989-4f28-b1f7-62ed71cfe566\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-ctn7f" Sep 08 04:05:42.177349 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:05:42.177332 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7a0003c4-8989-4f28-b1f7-62ed71cfe566-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-ctn7f\" (UID: \"7a0003c4-8989-4f28-b1f7-62ed71cfe566\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-ctn7f" Sep 08 04:05:42.177349 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:05:42.177351 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7a0003c4-8989-4f28-b1f7-62ed71cfe566-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-ctn7f\" (UID: \"7a0003c4-8989-4f28-b1f7-62ed71cfe566\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-ctn7f" Sep 08 04:05:42.177738 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:05:42.177377 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fpbfw\" (UniqueName: \"kubernetes.io/projected/7a0003c4-8989-4f28-b1f7-62ed71cfe566-kube-api-access-fpbfw\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-ctn7f\" (UID: \"7a0003c4-8989-4f28-b1f7-62ed71cfe566\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-ctn7f" Sep 08 04:05:42.177738 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:05:42.177409 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7a0003c4-8989-4f28-b1f7-62ed71cfe566-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-ctn7f\" (UID: \"7a0003c4-8989-4f28-b1f7-62ed71cfe566\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-ctn7f" Sep 08 04:05:42.177738 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:05:42.177446 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7a0003c4-8989-4f28-b1f7-62ed71cfe566-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-ctn7f\" (UID: \"7a0003c4-8989-4f28-b1f7-62ed71cfe566\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-ctn7f" Sep 08 04:05:42.177738 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:05:42.177485 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7a0003c4-8989-4f28-b1f7-62ed71cfe566-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-ctn7f\" (UID: \"7a0003c4-8989-4f28-b1f7-62ed71cfe566\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-ctn7f" Sep 08 04:05:42.177738 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:05:42.177699 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7a0003c4-8989-4f28-b1f7-62ed71cfe566-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-ctn7f\" (UID: \"7a0003c4-8989-4f28-b1f7-62ed71cfe566\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-ctn7f" Sep 08 04:05:42.178235 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:05:42.178194 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7a0003c4-8989-4f28-b1f7-62ed71cfe566-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-ctn7f\" (UID: \"7a0003c4-8989-4f28-b1f7-62ed71cfe566\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-ctn7f" Sep 08 04:05:42.178369 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:05:42.178235 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7a0003c4-8989-4f28-b1f7-62ed71cfe566-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-ctn7f\" (UID: \"7a0003c4-8989-4f28-b1f7-62ed71cfe566\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-ctn7f" Sep 08 04:05:42.178369 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:05:42.178357 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7a0003c4-8989-4f28-b1f7-62ed71cfe566-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-ctn7f\" (UID: \"7a0003c4-8989-4f28-b1f7-62ed71cfe566\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-ctn7f" Sep 08 04:05:42.178492 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:05:42.178428 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7a0003c4-8989-4f28-b1f7-62ed71cfe566-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-ctn7f\" (UID: \"7a0003c4-8989-4f28-b1f7-62ed71cfe566\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-ctn7f" Sep 08 04:05:42.180008 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:05:42.179990 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7a0003c4-8989-4f28-b1f7-62ed71cfe566-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-ctn7f\" (UID: \"7a0003c4-8989-4f28-b1f7-62ed71cfe566\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-ctn7f" Sep 08 04:05:42.180381 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:05:42.180363 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7a0003c4-8989-4f28-b1f7-62ed71cfe566-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-ctn7f\" (UID: \"7a0003c4-8989-4f28-b1f7-62ed71cfe566\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-ctn7f" Sep 08 04:05:42.196686 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:05:42.196654 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7a0003c4-8989-4f28-b1f7-62ed71cfe566-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-ctn7f\" (UID: \"7a0003c4-8989-4f28-b1f7-62ed71cfe566\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-ctn7f" Sep 08 04:05:42.196832 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:05:42.196686 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fpbfw\" (UniqueName: \"kubernetes.io/projected/7a0003c4-8989-4f28-b1f7-62ed71cfe566-kube-api-access-fpbfw\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-ctn7f\" (UID: \"7a0003c4-8989-4f28-b1f7-62ed71cfe566\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-ctn7f" Sep 08 04:05:42.257550 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:05:42.257514 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-ctn7f" Sep 08 04:05:42.607202 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:05:42.607177 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-ctn7f"] Sep 08 04:05:42.609240 ip-10-0-128-67 kubenswrapper[2571]: W0908 04:05:42.609210 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7a0003c4_8989_4f28_b1f7_62ed71cfe566.slice/crio-4208bc076468bc576a6928208e9acc3bfa0523e8c24e14052bfcf247a208c636 WatchSource:0}: Error finding container 4208bc076468bc576a6928208e9acc3bfa0523e8c24e14052bfcf247a208c636: Status 404 returned error can't find the container with id 4208bc076468bc576a6928208e9acc3bfa0523e8c24e14052bfcf247a208c636 Sep 08 04:05:42.611202 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:05:42.611170 2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"} Sep 08 04:05:42.611268 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:05:42.611237 2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"} Sep 08 04:05:42.611308 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:05:42.611267 2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"} Sep 08 04:05:43.387640 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:05:43.387604 2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-b54df94b4-p5j72"] Sep 08 04:05:43.411161 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:05:43.411122 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-b54df94b4-p5j72"] Sep 08 04:05:43.411335 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:05:43.411268 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-b54df94b4-p5j72" Sep 08 04:05:43.414824 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:05:43.414410 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-v8rr6\"" Sep 08 04:05:43.487065 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:05:43.487027 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r848s\" (UniqueName: \"kubernetes.io/projected/6a0532c5-83f2-462a-9b43-b9b23a02463b-kube-api-access-r848s\") pod \"authorino-b54df94b4-p5j72\" (UID: \"6a0532c5-83f2-462a-9b43-b9b23a02463b\") " pod="kuadrant-system/authorino-b54df94b4-p5j72" Sep 08 04:05:43.502671 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:05:43.502635 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-ctn7f" event={"ID":"7a0003c4-8989-4f28-b1f7-62ed71cfe566","Type":"ContainerStarted","Data":"d9f57c30fb0489f70d713e3b65700bb823dd36f89d823eefa9a9e0fdbb5836ad"} Sep 08 04:05:43.502839 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:05:43.502686 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-ctn7f" event={"ID":"7a0003c4-8989-4f28-b1f7-62ed71cfe566","Type":"ContainerStarted","Data":"4208bc076468bc576a6928208e9acc3bfa0523e8c24e14052bfcf247a208c636"} Sep 08 04:05:43.527096 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:05:43.527042 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-ctn7f" podStartSLOduration=2.527024392 podStartE2EDuration="2.527024392s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 04:05:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 04:05:43.525282957 +0000 UTC m=+636.995851338" watchObservedRunningTime="2026-09-08 04:05:43.527024392 +0000 UTC m=+636.997592773" Sep 08 04:05:43.587518 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:05:43.587479 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r848s\" (UniqueName: \"kubernetes.io/projected/6a0532c5-83f2-462a-9b43-b9b23a02463b-kube-api-access-r848s\") pod \"authorino-b54df94b4-p5j72\" (UID: \"6a0532c5-83f2-462a-9b43-b9b23a02463b\") " pod="kuadrant-system/authorino-b54df94b4-p5j72" Sep 08 04:05:43.610525 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:05:43.610497 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r848s\" (UniqueName: \"kubernetes.io/projected/6a0532c5-83f2-462a-9b43-b9b23a02463b-kube-api-access-r848s\") pod \"authorino-b54df94b4-p5j72\" (UID: \"6a0532c5-83f2-462a-9b43-b9b23a02463b\") " pod="kuadrant-system/authorino-b54df94b4-p5j72" Sep 08 04:05:43.651974 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:05:43.651710 2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-c548b5d7d-jq6l7"] Sep 08 04:05:43.674389 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:05:43.674362 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-c548b5d7d-jq6l7" Sep 08 04:05:43.688064 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:05:43.688034 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5m4fb\" (UniqueName: \"kubernetes.io/projected/aa2c3d76-8806-4b0c-81a7-6e2b7674f523-kube-api-access-5m4fb\") pod \"authorino-c548b5d7d-jq6l7\" (UID: \"aa2c3d76-8806-4b0c-81a7-6e2b7674f523\") " pod="kuadrant-system/authorino-c548b5d7d-jq6l7" Sep 08 04:05:43.688367 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:05:43.688341 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-c548b5d7d-jq6l7"] Sep 08 04:05:43.722314 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:05:43.722286 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-b54df94b4-p5j72" Sep 08 04:05:43.788680 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:05:43.788642 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5m4fb\" (UniqueName: \"kubernetes.io/projected/aa2c3d76-8806-4b0c-81a7-6e2b7674f523-kube-api-access-5m4fb\") pod \"authorino-c548b5d7d-jq6l7\" (UID: \"aa2c3d76-8806-4b0c-81a7-6e2b7674f523\") " pod="kuadrant-system/authorino-c548b5d7d-jq6l7" Sep 08 04:05:43.796843 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:05:43.796818 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5m4fb\" (UniqueName: \"kubernetes.io/projected/aa2c3d76-8806-4b0c-81a7-6e2b7674f523-kube-api-access-5m4fb\") pod \"authorino-c548b5d7d-jq6l7\" (UID: \"aa2c3d76-8806-4b0c-81a7-6e2b7674f523\") " pod="kuadrant-system/authorino-c548b5d7d-jq6l7" Sep 08 04:05:43.984960 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:05:43.984850 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-c548b5d7d-jq6l7" Sep 08 04:05:44.007375 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:05:44.007341 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-b54df94b4-p5j72"] Sep 08 04:05:44.011344 ip-10-0-128-67 kubenswrapper[2571]: W0908 04:05:44.011318 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6a0532c5_83f2_462a_9b43_b9b23a02463b.slice/crio-0ff8cede86ff9df5423251f975c0e95207fc7a60ab4fcd9b4cae24d674f8c150 WatchSource:0}: Error finding container 0ff8cede86ff9df5423251f975c0e95207fc7a60ab4fcd9b4cae24d674f8c150: Status 404 returned error can't find the container with id 0ff8cede86ff9df5423251f975c0e95207fc7a60ab4fcd9b4cae24d674f8c150 Sep 08 04:05:44.012784 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:05:44.012764 2571 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 08 04:05:44.258687 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:05:44.258611 2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-ctn7f" Sep 08 04:05:44.263323 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:05:44.263300 2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-ctn7f" Sep 08 04:05:44.283408 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:05:44.283386 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-c548b5d7d-jq6l7"] Sep 08 04:05:44.285774 ip-10-0-128-67 kubenswrapper[2571]: W0908 04:05:44.285744 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podaa2c3d76_8806_4b0c_81a7_6e2b7674f523.slice/crio-aced8d9c57743b4d2b9a4d96613e09a83d5a1f1fbedbaeeb9611b801031a31ae WatchSource:0}: Error finding container aced8d9c57743b4d2b9a4d96613e09a83d5a1f1fbedbaeeb9611b801031a31ae: Status 404 returned error can't find the container with id aced8d9c57743b4d2b9a4d96613e09a83d5a1f1fbedbaeeb9611b801031a31ae Sep 08 04:05:44.509620 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:05:44.509524 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-c548b5d7d-jq6l7" event={"ID":"aa2c3d76-8806-4b0c-81a7-6e2b7674f523","Type":"ContainerStarted","Data":"aced8d9c57743b4d2b9a4d96613e09a83d5a1f1fbedbaeeb9611b801031a31ae"} Sep 08 04:05:44.510728 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:05:44.510703 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-b54df94b4-p5j72" event={"ID":"6a0532c5-83f2-462a-9b43-b9b23a02463b","Type":"ContainerStarted","Data":"0ff8cede86ff9df5423251f975c0e95207fc7a60ab4fcd9b4cae24d674f8c150"} Sep 08 04:05:44.511048 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:05:44.511024 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-ctn7f" Sep 08 04:05:44.512084 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:05:44.512062 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-ctn7f" Sep 08 04:05:46.524647 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:05:46.524545 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-c548b5d7d-jq6l7" event={"ID":"aa2c3d76-8806-4b0c-81a7-6e2b7674f523","Type":"ContainerStarted","Data":"f39be5aa6bc9846dbb1905240cb1680a3dd005a5438c5dcff2242b36d91dbbd0"} Sep 08 04:05:46.526189 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:05:46.526165 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-b54df94b4-p5j72" event={"ID":"6a0532c5-83f2-462a-9b43-b9b23a02463b","Type":"ContainerStarted","Data":"e489cd85cc6ff87309f3ff3d36670fa2bbed62a7526d1a20db1ee1d5a43043e4"} Sep 08 04:05:46.542607 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:05:46.542555 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-c548b5d7d-jq6l7" podStartSLOduration=1.772871434 podStartE2EDuration="3.542540855s" totalImagesPullingTime="1.769669421s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 04:05:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 04:05:46.540501613 +0000 UTC m=+640.011069988" watchObservedRunningTime="2026-09-08 04:05:46.542540855 +0000 UTC m=+640.013109235" Sep 08 04:05:46.559744 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:05:46.559687 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-b54df94b4-p5j72" podStartSLOduration=1.5266121369999999 podStartE2EDuration="3.559673034s" totalImagesPullingTime="2.033060897s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 04:05:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 04:05:46.558030876 +0000 UTC m=+640.028599284" watchObservedRunningTime="2026-09-08 04:05:46.559673034 +0000 UTC m=+640.030241415" Sep 08 04:05:46.589783 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:05:46.589746 2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-b54df94b4-p5j72"] Sep 08 04:05:48.538313 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:05:48.538273 2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-b54df94b4-p5j72" podUID="6a0532c5-83f2-462a-9b43-b9b23a02463b" containerName="authorino" containerID="cri-o://e489cd85cc6ff87309f3ff3d36670fa2bbed62a7526d1a20db1ee1d5a43043e4" gracePeriod=30 Sep 08 04:05:48.783290 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:05:48.783264 2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-b54df94b4-p5j72" Sep 08 04:05:48.838877 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:05:48.838769 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r848s\" (UniqueName: \"kubernetes.io/projected/6a0532c5-83f2-462a-9b43-b9b23a02463b-kube-api-access-r848s\") pod \"6a0532c5-83f2-462a-9b43-b9b23a02463b\" (UID: \"6a0532c5-83f2-462a-9b43-b9b23a02463b\") " Sep 08 04:05:48.841053 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:05:48.841016 2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6a0532c5-83f2-462a-9b43-b9b23a02463b-kube-api-access-r848s" (OuterVolumeSpecName: "kube-api-access-r848s") pod "6a0532c5-83f2-462a-9b43-b9b23a02463b" (UID: "6a0532c5-83f2-462a-9b43-b9b23a02463b"). InnerVolumeSpecName "kube-api-access-r848s". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 08 04:05:48.939838 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:05:48.939778 2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r848s\" (UniqueName: \"kubernetes.io/projected/6a0532c5-83f2-462a-9b43-b9b23a02463b-kube-api-access-r848s\") on node \"ip-10-0-128-67.ec2.internal\" DevicePath \"\"" Sep 08 04:05:49.544012 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:05:49.543977 2571 generic.go:356] "Generic (PLEG): container finished" podID="6a0532c5-83f2-462a-9b43-b9b23a02463b" containerID="e489cd85cc6ff87309f3ff3d36670fa2bbed62a7526d1a20db1ee1d5a43043e4" exitCode=0 Sep 08 04:05:49.544411 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:05:49.544021 2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-b54df94b4-p5j72" Sep 08 04:05:49.544411 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:05:49.544058 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-b54df94b4-p5j72" event={"ID":"6a0532c5-83f2-462a-9b43-b9b23a02463b","Type":"ContainerDied","Data":"e489cd85cc6ff87309f3ff3d36670fa2bbed62a7526d1a20db1ee1d5a43043e4"} Sep 08 04:05:49.544411 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:05:49.544097 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-b54df94b4-p5j72" event={"ID":"6a0532c5-83f2-462a-9b43-b9b23a02463b","Type":"ContainerDied","Data":"0ff8cede86ff9df5423251f975c0e95207fc7a60ab4fcd9b4cae24d674f8c150"} Sep 08 04:05:49.544411 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:05:49.544114 2571 scope.go:117] "RemoveContainer" containerID="e489cd85cc6ff87309f3ff3d36670fa2bbed62a7526d1a20db1ee1d5a43043e4" Sep 08 04:05:49.552402 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:05:49.552380 2571 scope.go:117] "RemoveContainer" containerID="e489cd85cc6ff87309f3ff3d36670fa2bbed62a7526d1a20db1ee1d5a43043e4" Sep 08 04:05:49.552699 ip-10-0-128-67 kubenswrapper[2571]: E0908 04:05:49.552679 2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e489cd85cc6ff87309f3ff3d36670fa2bbed62a7526d1a20db1ee1d5a43043e4\": container with ID starting with e489cd85cc6ff87309f3ff3d36670fa2bbed62a7526d1a20db1ee1d5a43043e4 not found: ID does not exist" containerID="e489cd85cc6ff87309f3ff3d36670fa2bbed62a7526d1a20db1ee1d5a43043e4" Sep 08 04:05:49.552759 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:05:49.552708 2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e489cd85cc6ff87309f3ff3d36670fa2bbed62a7526d1a20db1ee1d5a43043e4"} err="failed to get container status \"e489cd85cc6ff87309f3ff3d36670fa2bbed62a7526d1a20db1ee1d5a43043e4\": rpc error: code = NotFound desc = could not find container \"e489cd85cc6ff87309f3ff3d36670fa2bbed62a7526d1a20db1ee1d5a43043e4\": container with ID starting with e489cd85cc6ff87309f3ff3d36670fa2bbed62a7526d1a20db1ee1d5a43043e4 not found: ID does not exist" Sep 08 04:05:49.560717 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:05:49.560694 2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-b54df94b4-p5j72"] Sep 08 04:05:49.564106 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:05:49.564086 2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-b54df94b4-p5j72"] Sep 08 04:05:51.067259 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:05:51.067227 2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6a0532c5-83f2-462a-9b43-b9b23a02463b" path="/var/lib/kubelet/pods/6a0532c5-83f2-462a-9b43-b9b23a02463b/volumes" Sep 08 04:06:01.930636 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:06:01.930602 2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-857c55f576-l4b6m"] Sep 08 04:06:01.931091 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:06:01.930905 2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6a0532c5-83f2-462a-9b43-b9b23a02463b" containerName="authorino" Sep 08 04:06:01.931091 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:06:01.930931 2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="6a0532c5-83f2-462a-9b43-b9b23a02463b" containerName="authorino" Sep 08 04:06:01.931091 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:06:01.930983 2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="6a0532c5-83f2-462a-9b43-b9b23a02463b" containerName="authorino" Sep 08 04:06:01.933686 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:06:01.933663 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-857c55f576-l4b6m" Sep 08 04:06:01.937888 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:06:01.937867 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Sep 08 04:06:01.938025 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:06:01.937867 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Sep 08 04:06:01.938025 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:06:01.937866 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-metrics-tls\"" Sep 08 04:06:01.938198 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:06:01.938183 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-gljz6\"" Sep 08 04:06:01.938248 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:06:01.938187 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Sep 08 04:06:01.938248 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:06:01.938209 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Sep 08 04:06:01.944115 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:06:01.944093 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-857c55f576-l4b6m"] Sep 08 04:06:02.045516 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:06:02.045486 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/367577ba-f73d-401b-9642-88f7d97e37c4-webhook-cert\") pod \"maas-controller-857c55f576-l4b6m\" (UID: \"367577ba-f73d-401b-9642-88f7d97e37c4\") " pod="opendatahub/maas-controller-857c55f576-l4b6m" Sep 08 04:06:02.045516 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:06:02.045517 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/367577ba-f73d-401b-9642-88f7d97e37c4-metrics-certs\") pod \"maas-controller-857c55f576-l4b6m\" (UID: \"367577ba-f73d-401b-9642-88f7d97e37c4\") " pod="opendatahub/maas-controller-857c55f576-l4b6m" Sep 08 04:06:02.045768 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:06:02.045601 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5x8p4\" (UniqueName: \"kubernetes.io/projected/367577ba-f73d-401b-9642-88f7d97e37c4-kube-api-access-5x8p4\") pod \"maas-controller-857c55f576-l4b6m\" (UID: \"367577ba-f73d-401b-9642-88f7d97e37c4\") " pod="opendatahub/maas-controller-857c55f576-l4b6m" Sep 08 04:06:02.146650 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:06:02.146598 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5x8p4\" (UniqueName: \"kubernetes.io/projected/367577ba-f73d-401b-9642-88f7d97e37c4-kube-api-access-5x8p4\") pod \"maas-controller-857c55f576-l4b6m\" (UID: \"367577ba-f73d-401b-9642-88f7d97e37c4\") " pod="opendatahub/maas-controller-857c55f576-l4b6m" Sep 08 04:06:02.146832 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:06:02.146680 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/367577ba-f73d-401b-9642-88f7d97e37c4-webhook-cert\") pod \"maas-controller-857c55f576-l4b6m\" (UID: \"367577ba-f73d-401b-9642-88f7d97e37c4\") " pod="opendatahub/maas-controller-857c55f576-l4b6m" Sep 08 04:06:02.146832 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:06:02.146699 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/367577ba-f73d-401b-9642-88f7d97e37c4-metrics-certs\") pod \"maas-controller-857c55f576-l4b6m\" (UID: \"367577ba-f73d-401b-9642-88f7d97e37c4\") " pod="opendatahub/maas-controller-857c55f576-l4b6m" Sep 08 04:06:02.149302 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:06:02.149277 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/367577ba-f73d-401b-9642-88f7d97e37c4-metrics-certs\") pod \"maas-controller-857c55f576-l4b6m\" (UID: \"367577ba-f73d-401b-9642-88f7d97e37c4\") " pod="opendatahub/maas-controller-857c55f576-l4b6m" Sep 08 04:06:02.149424 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:06:02.149311 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/367577ba-f73d-401b-9642-88f7d97e37c4-webhook-cert\") pod \"maas-controller-857c55f576-l4b6m\" (UID: \"367577ba-f73d-401b-9642-88f7d97e37c4\") " pod="opendatahub/maas-controller-857c55f576-l4b6m" Sep 08 04:06:02.154741 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:06:02.154715 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5x8p4\" (UniqueName: \"kubernetes.io/projected/367577ba-f73d-401b-9642-88f7d97e37c4-kube-api-access-5x8p4\") pod \"maas-controller-857c55f576-l4b6m\" (UID: \"367577ba-f73d-401b-9642-88f7d97e37c4\") " pod="opendatahub/maas-controller-857c55f576-l4b6m" Sep 08 04:06:02.243588 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:06:02.243506 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-857c55f576-l4b6m" Sep 08 04:06:02.515133 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:06:02.515109 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-857c55f576-l4b6m"] Sep 08 04:06:02.516801 ip-10-0-128-67 kubenswrapper[2571]: W0908 04:06:02.516775 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod367577ba_f73d_401b_9642_88f7d97e37c4.slice/crio-66be551bc68265797a0e97c2f63d2c3de2eb6ebb82a0f5cf24003dc4ab16425b WatchSource:0}: Error finding container 66be551bc68265797a0e97c2f63d2c3de2eb6ebb82a0f5cf24003dc4ab16425b: Status 404 returned error can't find the container with id 66be551bc68265797a0e97c2f63d2c3de2eb6ebb82a0f5cf24003dc4ab16425b Sep 08 04:06:02.607454 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:06:02.607416 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-857c55f576-l4b6m" event={"ID":"367577ba-f73d-401b-9642-88f7d97e37c4","Type":"ContainerStarted","Data":"66be551bc68265797a0e97c2f63d2c3de2eb6ebb82a0f5cf24003dc4ab16425b"} Sep 08 04:06:04.620258 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:06:04.620214 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-857c55f576-l4b6m" event={"ID":"367577ba-f73d-401b-9642-88f7d97e37c4","Type":"ContainerStarted","Data":"9896f30a14bfd3565b43fb84bfc1f517936494507739cff6794ea61a395c088b"} Sep 08 04:06:04.620773 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:06:04.620276 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-857c55f576-l4b6m" Sep 08 04:06:04.641153 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:06:04.641090 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-857c55f576-l4b6m" podStartSLOduration=2.000326606 podStartE2EDuration="3.641070104s" totalImagesPullingTime="1.640743498s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 04:06:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 04:06:04.640164428 +0000 UTC m=+658.110732809" watchObservedRunningTime="2026-09-08 04:06:04.641070104 +0000 UTC m=+658.111638486" Sep 08 04:06:15.626738 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:06:15.626707 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-857c55f576-l4b6m" Sep 08 04:06:40.566426 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:06:40.566383 2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-85d49875c6-m7sbc"] Sep 08 04:06:40.573472 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:06:40.573444 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-85d49875c6-m7sbc" Sep 08 04:06:40.576669 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:06:40.576643 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\"" Sep 08 04:06:40.576815 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:06:40.576795 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-27f6d\"" Sep 08 04:06:40.583301 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:06:40.583277 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-85d49875c6-m7sbc"] Sep 08 04:06:40.602284 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:06:40.602260 2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-7d6487fcc8-sllvl"] Sep 08 04:06:40.606840 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:06:40.606822 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-7d6487fcc8-sllvl" Sep 08 04:06:40.609586 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:06:40.609565 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\"" Sep 08 04:06:40.609748 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:06:40.609729 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-dockercfg-8rksm\"" Sep 08 04:06:40.635458 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:06:40.635427 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-7d6487fcc8-sllvl"] Sep 08 04:06:40.654014 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:06:40.653982 2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-bb7b75cc4-tdtdw"] Sep 08 04:06:40.658830 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:06:40.658805 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-bb7b75cc4-tdtdw"] Sep 08 04:06:40.659014 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:06:40.658891 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-bb7b75cc4-tdtdw" Sep 08 04:06:40.662744 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:06:40.662717 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-zrw6m\"" Sep 08 04:06:40.663015 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:06:40.662995 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\"" Sep 08 04:06:40.663098 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:06:40.663040 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-metrics-tls\"" Sep 08 04:06:40.757453 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:06:40.757414 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f02e6afd-0df0-41e1-bd43-9f0c5ded9063-tls-certs\") pod \"model-serving-api-7d6487fcc8-sllvl\" (UID: \"f02e6afd-0df0-41e1-bd43-9f0c5ded9063\") " pod="opendatahub/model-serving-api-7d6487fcc8-sllvl" Sep 08 04:06:40.757642 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:06:40.757483 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kwrp9\" (UniqueName: \"kubernetes.io/projected/f9daf336-abd8-4f65-ae0a-995cdc292116-kube-api-access-kwrp9\") pod \"kserve-controller-manager-85d49875c6-m7sbc\" (UID: \"f9daf336-abd8-4f65-ae0a-995cdc292116\") " pod="opendatahub/kserve-controller-manager-85d49875c6-m7sbc" Sep 08 04:06:40.757642 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:06:40.757506 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f9daf336-abd8-4f65-ae0a-995cdc292116-cert\") pod \"kserve-controller-manager-85d49875c6-m7sbc\" (UID: \"f9daf336-abd8-4f65-ae0a-995cdc292116\") " pod="opendatahub/kserve-controller-manager-85d49875c6-m7sbc" Sep 08 04:06:40.757642 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:06:40.757532 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vxnm5\" (UniqueName: \"kubernetes.io/projected/f02e6afd-0df0-41e1-bd43-9f0c5ded9063-kube-api-access-vxnm5\") pod \"model-serving-api-7d6487fcc8-sllvl\" (UID: \"f02e6afd-0df0-41e1-bd43-9f0c5ded9063\") " pod="opendatahub/model-serving-api-7d6487fcc8-sllvl" Sep 08 04:06:40.858392 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:06:40.858304 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vxnm5\" (UniqueName: \"kubernetes.io/projected/f02e6afd-0df0-41e1-bd43-9f0c5ded9063-kube-api-access-vxnm5\") pod \"model-serving-api-7d6487fcc8-sllvl\" (UID: \"f02e6afd-0df0-41e1-bd43-9f0c5ded9063\") " pod="opendatahub/model-serving-api-7d6487fcc8-sllvl" Sep 08 04:06:40.858661 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:06:40.858632 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z5wjm\" (UniqueName: \"kubernetes.io/projected/9b9b51ce-0d32-4e32-934c-ab278a141141-kube-api-access-z5wjm\") pod \"odh-model-controller-bb7b75cc4-tdtdw\" (UID: \"9b9b51ce-0d32-4e32-934c-ab278a141141\") " pod="opendatahub/odh-model-controller-bb7b75cc4-tdtdw" Sep 08 04:06:40.858790 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:06:40.858691 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9b9b51ce-0d32-4e32-934c-ab278a141141-cert\") pod \"odh-model-controller-bb7b75cc4-tdtdw\" (UID: \"9b9b51ce-0d32-4e32-934c-ab278a141141\") " pod="opendatahub/odh-model-controller-bb7b75cc4-tdtdw" Sep 08 04:06:40.858790 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:06:40.858761 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f02e6afd-0df0-41e1-bd43-9f0c5ded9063-tls-certs\") pod \"model-serving-api-7d6487fcc8-sllvl\" (UID: \"f02e6afd-0df0-41e1-bd43-9f0c5ded9063\") " pod="opendatahub/model-serving-api-7d6487fcc8-sllvl" Sep 08 04:06:40.858871 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:06:40.858820 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kwrp9\" (UniqueName: \"kubernetes.io/projected/f9daf336-abd8-4f65-ae0a-995cdc292116-kube-api-access-kwrp9\") pod \"kserve-controller-manager-85d49875c6-m7sbc\" (UID: \"f9daf336-abd8-4f65-ae0a-995cdc292116\") " pod="opendatahub/kserve-controller-manager-85d49875c6-m7sbc" Sep 08 04:06:40.858871 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:06:40.858845 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9b9b51ce-0d32-4e32-934c-ab278a141141-metrics-certs\") pod \"odh-model-controller-bb7b75cc4-tdtdw\" (UID: \"9b9b51ce-0d32-4e32-934c-ab278a141141\") " pod="opendatahub/odh-model-controller-bb7b75cc4-tdtdw" Sep 08 04:06:40.858871 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:06:40.858860 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f9daf336-abd8-4f65-ae0a-995cdc292116-cert\") pod \"kserve-controller-manager-85d49875c6-m7sbc\" (UID: \"f9daf336-abd8-4f65-ae0a-995cdc292116\") " pod="opendatahub/kserve-controller-manager-85d49875c6-m7sbc" Sep 08 04:06:40.859058 ip-10-0-128-67 kubenswrapper[2571]: E0908 04:06:40.858948 2571 secret.go:189] Couldn't get secret opendatahub/model-serving-api-tls: secret "model-serving-api-tls" not found Sep 08 04:06:40.859058 ip-10-0-128-67 kubenswrapper[2571]: E0908 04:06:40.859018 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f02e6afd-0df0-41e1-bd43-9f0c5ded9063-tls-certs podName:f02e6afd-0df0-41e1-bd43-9f0c5ded9063 nodeName:}" failed. No retries permitted until 2026-09-08 04:06:41.358998857 +0000 UTC m=+694.829567216 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/f02e6afd-0df0-41e1-bd43-9f0c5ded9063-tls-certs") pod "model-serving-api-7d6487fcc8-sllvl" (UID: "f02e6afd-0df0-41e1-bd43-9f0c5ded9063") : secret "model-serving-api-tls" not found Sep 08 04:06:40.861351 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:06:40.861327 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f9daf336-abd8-4f65-ae0a-995cdc292116-cert\") pod \"kserve-controller-manager-85d49875c6-m7sbc\" (UID: \"f9daf336-abd8-4f65-ae0a-995cdc292116\") " pod="opendatahub/kserve-controller-manager-85d49875c6-m7sbc" Sep 08 04:06:40.883911 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:06:40.883891 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kwrp9\" (UniqueName: \"kubernetes.io/projected/f9daf336-abd8-4f65-ae0a-995cdc292116-kube-api-access-kwrp9\") pod \"kserve-controller-manager-85d49875c6-m7sbc\" (UID: \"f9daf336-abd8-4f65-ae0a-995cdc292116\") " pod="opendatahub/kserve-controller-manager-85d49875c6-m7sbc" Sep 08 04:06:40.884255 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:06:40.884236 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vxnm5\" (UniqueName: \"kubernetes.io/projected/f02e6afd-0df0-41e1-bd43-9f0c5ded9063-kube-api-access-vxnm5\") pod \"model-serving-api-7d6487fcc8-sllvl\" (UID: \"f02e6afd-0df0-41e1-bd43-9f0c5ded9063\") " pod="opendatahub/model-serving-api-7d6487fcc8-sllvl" Sep 08 04:06:40.884784 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:06:40.884758 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-85d49875c6-m7sbc" Sep 08 04:06:40.959405 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:06:40.959375 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9b9b51ce-0d32-4e32-934c-ab278a141141-metrics-certs\") pod \"odh-model-controller-bb7b75cc4-tdtdw\" (UID: \"9b9b51ce-0d32-4e32-934c-ab278a141141\") " pod="opendatahub/odh-model-controller-bb7b75cc4-tdtdw" Sep 08 04:06:40.959511 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:06:40.959449 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z5wjm\" (UniqueName: \"kubernetes.io/projected/9b9b51ce-0d32-4e32-934c-ab278a141141-kube-api-access-z5wjm\") pod \"odh-model-controller-bb7b75cc4-tdtdw\" (UID: \"9b9b51ce-0d32-4e32-934c-ab278a141141\") " pod="opendatahub/odh-model-controller-bb7b75cc4-tdtdw" Sep 08 04:06:40.959511 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:06:40.959484 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9b9b51ce-0d32-4e32-934c-ab278a141141-cert\") pod \"odh-model-controller-bb7b75cc4-tdtdw\" (UID: \"9b9b51ce-0d32-4e32-934c-ab278a141141\") " pod="opendatahub/odh-model-controller-bb7b75cc4-tdtdw" Sep 08 04:06:40.959682 ip-10-0-128-67 kubenswrapper[2571]: E0908 04:06:40.959660 2571 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found Sep 08 04:06:40.959745 ip-10-0-128-67 kubenswrapper[2571]: E0908 04:06:40.959733 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9b9b51ce-0d32-4e32-934c-ab278a141141-cert podName:9b9b51ce-0d32-4e32-934c-ab278a141141 nodeName:}" failed. No retries permitted until 2026-09-08 04:06:41.459713 +0000 UTC m=+694.930281359 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/9b9b51ce-0d32-4e32-934c-ab278a141141-cert") pod "odh-model-controller-bb7b75cc4-tdtdw" (UID: "9b9b51ce-0d32-4e32-934c-ab278a141141") : secret "odh-model-controller-webhook-cert" not found Sep 08 04:06:40.962869 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:06:40.962841 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9b9b51ce-0d32-4e32-934c-ab278a141141-metrics-certs\") pod \"odh-model-controller-bb7b75cc4-tdtdw\" (UID: \"9b9b51ce-0d32-4e32-934c-ab278a141141\") " pod="opendatahub/odh-model-controller-bb7b75cc4-tdtdw" Sep 08 04:06:40.981140 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:06:40.981113 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z5wjm\" (UniqueName: \"kubernetes.io/projected/9b9b51ce-0d32-4e32-934c-ab278a141141-kube-api-access-z5wjm\") pod \"odh-model-controller-bb7b75cc4-tdtdw\" (UID: \"9b9b51ce-0d32-4e32-934c-ab278a141141\") " pod="opendatahub/odh-model-controller-bb7b75cc4-tdtdw" Sep 08 04:06:41.183765 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:06:41.183729 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-85d49875c6-m7sbc"] Sep 08 04:06:41.186089 ip-10-0-128-67 kubenswrapper[2571]: W0908 04:06:41.186061 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf9daf336_abd8_4f65_ae0a_995cdc292116.slice/crio-2773a9572de7b18208b2f75de374003ffd345627c84ad7ef7dc5c57092c45ce3 WatchSource:0}: Error finding container 2773a9572de7b18208b2f75de374003ffd345627c84ad7ef7dc5c57092c45ce3: Status 404 returned error can't find the container with id 2773a9572de7b18208b2f75de374003ffd345627c84ad7ef7dc5c57092c45ce3 Sep 08 04:06:41.362345 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:06:41.362305 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f02e6afd-0df0-41e1-bd43-9f0c5ded9063-tls-certs\") pod \"model-serving-api-7d6487fcc8-sllvl\" (UID: \"f02e6afd-0df0-41e1-bd43-9f0c5ded9063\") " pod="opendatahub/model-serving-api-7d6487fcc8-sllvl" Sep 08 04:06:41.362530 ip-10-0-128-67 kubenswrapper[2571]: E0908 04:06:41.362505 2571 secret.go:189] Couldn't get secret opendatahub/model-serving-api-tls: secret "model-serving-api-tls" not found Sep 08 04:06:41.362609 ip-10-0-128-67 kubenswrapper[2571]: E0908 04:06:41.362588 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f02e6afd-0df0-41e1-bd43-9f0c5ded9063-tls-certs podName:f02e6afd-0df0-41e1-bd43-9f0c5ded9063 nodeName:}" failed. No retries permitted until 2026-09-08 04:06:42.362566567 +0000 UTC m=+695.833134942 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/f02e6afd-0df0-41e1-bd43-9f0c5ded9063-tls-certs") pod "model-serving-api-7d6487fcc8-sllvl" (UID: "f02e6afd-0df0-41e1-bd43-9f0c5ded9063") : secret "model-serving-api-tls" not found Sep 08 04:06:41.463520 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:06:41.463439 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9b9b51ce-0d32-4e32-934c-ab278a141141-cert\") pod \"odh-model-controller-bb7b75cc4-tdtdw\" (UID: \"9b9b51ce-0d32-4e32-934c-ab278a141141\") " pod="opendatahub/odh-model-controller-bb7b75cc4-tdtdw" Sep 08 04:06:41.465899 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:06:41.465877 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9b9b51ce-0d32-4e32-934c-ab278a141141-cert\") pod \"odh-model-controller-bb7b75cc4-tdtdw\" (UID: \"9b9b51ce-0d32-4e32-934c-ab278a141141\") " pod="opendatahub/odh-model-controller-bb7b75cc4-tdtdw" Sep 08 04:06:41.568968 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:06:41.568914 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-bb7b75cc4-tdtdw" Sep 08 04:06:41.802641 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:06:41.802607 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-85d49875c6-m7sbc" event={"ID":"f9daf336-abd8-4f65-ae0a-995cdc292116","Type":"ContainerStarted","Data":"2773a9572de7b18208b2f75de374003ffd345627c84ad7ef7dc5c57092c45ce3"} Sep 08 04:06:41.859441 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:06:41.859415 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-bb7b75cc4-tdtdw"] Sep 08 04:06:41.861778 ip-10-0-128-67 kubenswrapper[2571]: W0908 04:06:41.861751 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9b9b51ce_0d32_4e32_934c_ab278a141141.slice/crio-16655a5f40dc5b2dee91c0b588afdde8fb4c19a52c1b55b04dc5252304c42ae7 WatchSource:0}: Error finding container 16655a5f40dc5b2dee91c0b588afdde8fb4c19a52c1b55b04dc5252304c42ae7: Status 404 returned error can't find the container with id 16655a5f40dc5b2dee91c0b588afdde8fb4c19a52c1b55b04dc5252304c42ae7 Sep 08 04:06:42.369578 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:06:42.369539 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f02e6afd-0df0-41e1-bd43-9f0c5ded9063-tls-certs\") pod \"model-serving-api-7d6487fcc8-sllvl\" (UID: \"f02e6afd-0df0-41e1-bd43-9f0c5ded9063\") " pod="opendatahub/model-serving-api-7d6487fcc8-sllvl" Sep 08 04:06:42.372428 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:06:42.372398 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f02e6afd-0df0-41e1-bd43-9f0c5ded9063-tls-certs\") pod \"model-serving-api-7d6487fcc8-sllvl\" (UID: \"f02e6afd-0df0-41e1-bd43-9f0c5ded9063\") " pod="opendatahub/model-serving-api-7d6487fcc8-sllvl" Sep 08 04:06:42.445227 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:06:42.445188 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-7d6487fcc8-sllvl" Sep 08 04:06:42.737020 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:06:42.733583 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-7d6487fcc8-sllvl"] Sep 08 04:06:42.741731 ip-10-0-128-67 kubenswrapper[2571]: W0908 04:06:42.741009 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf02e6afd_0df0_41e1_bd43_9f0c5ded9063.slice/crio-cb9b4958f4d50cc2393bba88aa7f81554777b389d34b779d0b6815743c7eb945 WatchSource:0}: Error finding container cb9b4958f4d50cc2393bba88aa7f81554777b389d34b779d0b6815743c7eb945: Status 404 returned error can't find the container with id cb9b4958f4d50cc2393bba88aa7f81554777b389d34b779d0b6815743c7eb945 Sep 08 04:06:42.836275 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:06:42.836216 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-bb7b75cc4-tdtdw" event={"ID":"9b9b51ce-0d32-4e32-934c-ab278a141141","Type":"ContainerStarted","Data":"16655a5f40dc5b2dee91c0b588afdde8fb4c19a52c1b55b04dc5252304c42ae7"} Sep 08 04:06:42.839071 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:06:42.839038 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-7d6487fcc8-sllvl" event={"ID":"f02e6afd-0df0-41e1-bd43-9f0c5ded9063","Type":"ContainerStarted","Data":"cb9b4958f4d50cc2393bba88aa7f81554777b389d34b779d0b6815743c7eb945"} Sep 08 04:06:46.868245 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:06:46.868185 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-7d6487fcc8-sllvl" event={"ID":"f02e6afd-0df0-41e1-bd43-9f0c5ded9063","Type":"ContainerStarted","Data":"5357bd2f8f384287e1a262cae48f8a649d420b0271ef00d5f15e894f6ee00328"} Sep 08 04:06:46.868689 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:06:46.868275 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-7d6487fcc8-sllvl" Sep 08 04:06:46.869857 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:06:46.869828 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-85d49875c6-m7sbc" event={"ID":"f9daf336-abd8-4f65-ae0a-995cdc292116","Type":"ContainerStarted","Data":"e9c444010b273be43f2ccb4082ad7183990675dd5d5a5a0a9fe6758ff919a85e"} Sep 08 04:06:46.870005 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:06:46.869943 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-85d49875c6-m7sbc" Sep 08 04:06:46.871342 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:06:46.871294 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-bb7b75cc4-tdtdw" event={"ID":"9b9b51ce-0d32-4e32-934c-ab278a141141","Type":"ContainerStarted","Data":"273aac2bc4fb44c7dddfc8414f76834c822dc04d4e42e2288d9b95df08527e4b"} Sep 08 04:06:46.871448 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:06:46.871347 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-bb7b75cc4-tdtdw" Sep 08 04:06:46.886286 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:06:46.886248 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-7d6487fcc8-sllvl" podStartSLOduration=3.564376098 podStartE2EDuration="6.88623173s" totalImagesPullingTime="3.321855632s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 04:06:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 04:06:46.886151259 +0000 UTC m=+700.356719630" watchObservedRunningTime="2026-09-08 04:06:46.88623173 +0000 UTC m=+700.356800111" Sep 08 04:06:46.915599 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:06:46.915556 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-85d49875c6-m7sbc" podStartSLOduration=2.037857781 podStartE2EDuration="6.915540851s" totalImagesPullingTime="4.87768307s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 04:06:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 04:06:46.913174316 +0000 UTC m=+700.383742698" watchObservedRunningTime="2026-09-08 04:06:46.915540851 +0000 UTC m=+700.386109228" Sep 08 04:06:46.958550 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:06:46.958499 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-bb7b75cc4-tdtdw" podStartSLOduration=2.745568721 podStartE2EDuration="6.958484848s" totalImagesPullingTime="4.212916127s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 04:06:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 04:06:46.955795428 +0000 UTC m=+700.426363809" watchObservedRunningTime="2026-09-08 04:06:46.958484848 +0000 UTC m=+700.429053256" Sep 08 04:06:47.323592 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:06:47.323392 2571 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-6q6cj container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.20:15021/healthz/ready\": read tcp 10.132.0.2:51648->10.132.0.20:15021: read: connection reset by peer" start-of-body= Sep 08 04:06:47.323592 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:06:47.323539 2571 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-6q6cj" podUID="0fcf38d0-2136-4a43-bee3-47a0addf3605" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.20:15021/healthz/ready\": read tcp 10.132.0.2:51648->10.132.0.20:15021: read: connection reset by peer" Sep 08 04:06:47.636453 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:06:47.636347 2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7c94588b8b-sxdnn"] Sep 08 04:06:47.640155 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:06:47.640124 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7c94588b8b-sxdnn" Sep 08 04:06:47.646523 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:06:47.646497 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7c94588b8b-sxdnn"] Sep 08 04:06:47.684644 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:06:47.684610 2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7c94588b8b-sxdnn"] Sep 08 04:06:47.684867 ip-10-0-128-67 kubenswrapper[2571]: E0908 04:06:47.684847 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-lc8rh], unattached volumes=[], failed to process volumes=[kube-api-access-lc8rh]: context canceled" pod="kuadrant-system/authorino-7c94588b8b-sxdnn" podUID="115e61d5-3ad7-4307-8f75-d4433fb2fac6" Sep 08 04:06:47.719244 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:06:47.719220 2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-9df44d876-md5vf"] Sep 08 04:06:47.719943 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:06:47.719904 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lc8rh\" (UniqueName: \"kubernetes.io/projected/115e61d5-3ad7-4307-8f75-d4433fb2fac6-kube-api-access-lc8rh\") pod \"authorino-7c94588b8b-sxdnn\" (UID: \"115e61d5-3ad7-4307-8f75-d4433fb2fac6\") " pod="kuadrant-system/authorino-7c94588b8b-sxdnn" Sep 08 04:06:47.722398 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:06:47.722381 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-9df44d876-md5vf" Sep 08 04:06:47.725957 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:06:47.725912 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" Sep 08 04:06:47.733479 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:06:47.733455 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-9df44d876-md5vf"] Sep 08 04:06:47.821288 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:06:47.821254 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lc8rh\" (UniqueName: \"kubernetes.io/projected/115e61d5-3ad7-4307-8f75-d4433fb2fac6-kube-api-access-lc8rh\") pod \"authorino-7c94588b8b-sxdnn\" (UID: \"115e61d5-3ad7-4307-8f75-d4433fb2fac6\") " pod="kuadrant-system/authorino-7c94588b8b-sxdnn" Sep 08 04:06:47.821410 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:06:47.821371 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/8c7f8fb2-e2bd-49a5-953e-498c353d5884-tls-cert\") pod \"authorino-9df44d876-md5vf\" (UID: \"8c7f8fb2-e2bd-49a5-953e-498c353d5884\") " pod="kuadrant-system/authorino-9df44d876-md5vf" Sep 08 04:06:47.821410 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:06:47.821404 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qqttt\" (UniqueName: \"kubernetes.io/projected/8c7f8fb2-e2bd-49a5-953e-498c353d5884-kube-api-access-qqttt\") pod \"authorino-9df44d876-md5vf\" (UID: \"8c7f8fb2-e2bd-49a5-953e-498c353d5884\") " pod="kuadrant-system/authorino-9df44d876-md5vf" Sep 08 04:06:47.829896 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:06:47.829864 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lc8rh\" (UniqueName: \"kubernetes.io/projected/115e61d5-3ad7-4307-8f75-d4433fb2fac6-kube-api-access-lc8rh\") pod \"authorino-7c94588b8b-sxdnn\" (UID: \"115e61d5-3ad7-4307-8f75-d4433fb2fac6\") " pod="kuadrant-system/authorino-7c94588b8b-sxdnn" Sep 08 04:06:47.877596 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:06:47.877568 2571 generic.go:356] "Generic (PLEG): container finished" podID="0fcf38d0-2136-4a43-bee3-47a0addf3605" containerID="1f61291e267101259c1a05b41deb8567bf09c4bebc709746810dfa8997f487e8" exitCode=0 Sep 08 04:06:47.877956 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:06:47.877662 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7c94588b8b-sxdnn" Sep 08 04:06:47.877956 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:06:47.877670 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-6q6cj" event={"ID":"0fcf38d0-2136-4a43-bee3-47a0addf3605","Type":"ContainerDied","Data":"1f61291e267101259c1a05b41deb8567bf09c4bebc709746810dfa8997f487e8"} Sep 08 04:06:47.878432 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:06:47.878416 2571 scope.go:117] "RemoveContainer" containerID="1f61291e267101259c1a05b41deb8567bf09c4bebc709746810dfa8997f487e8" Sep 08 04:06:47.879468 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:06:47.879442 2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"} Sep 08 04:06:47.879556 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:06:47.879504 2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"} Sep 08 04:06:47.879556 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:06:47.879536 2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"} Sep 08 04:06:47.886408 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:06:47.886389 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7c94588b8b-sxdnn" Sep 08 04:06:47.921970 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:06:47.921934 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lc8rh\" (UniqueName: \"kubernetes.io/projected/115e61d5-3ad7-4307-8f75-d4433fb2fac6-kube-api-access-lc8rh\") pod \"115e61d5-3ad7-4307-8f75-d4433fb2fac6\" (UID: \"115e61d5-3ad7-4307-8f75-d4433fb2fac6\") " Sep 08 04:06:47.922095 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:06:47.922082 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/8c7f8fb2-e2bd-49a5-953e-498c353d5884-tls-cert\") pod \"authorino-9df44d876-md5vf\" (UID: \"8c7f8fb2-e2bd-49a5-953e-498c353d5884\") " pod="kuadrant-system/authorino-9df44d876-md5vf" Sep 08 04:06:47.922147 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:06:47.922105 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qqttt\" (UniqueName: \"kubernetes.io/projected/8c7f8fb2-e2bd-49a5-953e-498c353d5884-kube-api-access-qqttt\") pod \"authorino-9df44d876-md5vf\" (UID: \"8c7f8fb2-e2bd-49a5-953e-498c353d5884\") " pod="kuadrant-system/authorino-9df44d876-md5vf" Sep 08 04:06:47.924355 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:06:47.924325 2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/115e61d5-3ad7-4307-8f75-d4433fb2fac6-kube-api-access-lc8rh" (OuterVolumeSpecName: "kube-api-access-lc8rh") pod "115e61d5-3ad7-4307-8f75-d4433fb2fac6" (UID: "115e61d5-3ad7-4307-8f75-d4433fb2fac6"). InnerVolumeSpecName "kube-api-access-lc8rh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 08 04:06:47.925047 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:06:47.925026 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/8c7f8fb2-e2bd-49a5-953e-498c353d5884-tls-cert\") pod \"authorino-9df44d876-md5vf\" (UID: \"8c7f8fb2-e2bd-49a5-953e-498c353d5884\") " pod="kuadrant-system/authorino-9df44d876-md5vf" Sep 08 04:06:47.932827 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:06:47.932782 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qqttt\" (UniqueName: \"kubernetes.io/projected/8c7f8fb2-e2bd-49a5-953e-498c353d5884-kube-api-access-qqttt\") pod \"authorino-9df44d876-md5vf\" (UID: \"8c7f8fb2-e2bd-49a5-953e-498c353d5884\") " pod="kuadrant-system/authorino-9df44d876-md5vf" Sep 08 04:06:48.024005 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:06:48.023968 2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lc8rh\" (UniqueName: \"kubernetes.io/projected/115e61d5-3ad7-4307-8f75-d4433fb2fac6-kube-api-access-lc8rh\") on node \"ip-10-0-128-67.ec2.internal\" DevicePath \"\"" Sep 08 04:06:48.031860 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:06:48.031834 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-9df44d876-md5vf" Sep 08 04:06:48.308715 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:06:48.308692 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-9df44d876-md5vf"] Sep 08 04:06:48.310539 ip-10-0-128-67 kubenswrapper[2571]: W0908 04:06:48.310503 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8c7f8fb2_e2bd_49a5_953e_498c353d5884.slice/crio-63510eb88a47be7f337f7204f18355a6b6064d380727e197b32b0b22b6ea21d7 WatchSource:0}: Error finding container 63510eb88a47be7f337f7204f18355a6b6064d380727e197b32b0b22b6ea21d7: Status 404 returned error can't find the container with id 63510eb88a47be7f337f7204f18355a6b6064d380727e197b32b0b22b6ea21d7 Sep 08 04:06:48.885159 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:06:48.885110 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-6q6cj" event={"ID":"0fcf38d0-2136-4a43-bee3-47a0addf3605","Type":"ContainerStarted","Data":"68943a79e0a9d3c7cd2f010510f59107066c725d5356f5c130f11b7df63df0c7"} Sep 08 04:06:48.886434 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:06:48.886410 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-9df44d876-md5vf" event={"ID":"8c7f8fb2-e2bd-49a5-953e-498c353d5884","Type":"ContainerStarted","Data":"63510eb88a47be7f337f7204f18355a6b6064d380727e197b32b0b22b6ea21d7"} Sep 08 04:06:48.886434 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:06:48.886428 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7c94588b8b-sxdnn" Sep 08 04:06:48.932940 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:06:48.930622 2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7c94588b8b-sxdnn"] Sep 08 04:06:48.938954 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:06:48.937453 2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-7c94588b8b-sxdnn"] Sep 08 04:06:49.070495 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:06:49.070449 2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="115e61d5-3ad7-4307-8f75-d4433fb2fac6" path="/var/lib/kubelet/pods/115e61d5-3ad7-4307-8f75-d4433fb2fac6/volumes" Sep 08 04:06:49.269141 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:06:49.269054 2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-6q6cj" Sep 08 04:06:49.269286 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:06:49.269262 2571 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-6q6cj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.20:15021/healthz/ready\": dial tcp 10.132.0.20:15021: connect: connection refused" start-of-body= Sep 08 04:06:49.269329 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:06:49.269312 2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-6q6cj" podUID="0fcf38d0-2136-4a43-bee3-47a0addf3605" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.20:15021/healthz/ready\": dial tcp 10.132.0.20:15021: connect: connection refused" Sep 08 04:06:50.268667 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:06:50.268632 2571 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-6q6cj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.20:15021/healthz/ready\": dial tcp 10.132.0.20:15021: connect: connection refused" start-of-body= Sep 08 04:06:50.269075 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:06:50.268689 2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-6q6cj" podUID="0fcf38d0-2136-4a43-bee3-47a0addf3605" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.20:15021/healthz/ready\": dial tcp 10.132.0.20:15021: connect: connection refused" Sep 08 04:06:51.269125 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:06:51.269051 2571 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-6q6cj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.20:15021/healthz/ready\": dial tcp 10.132.0.20:15021: connect: connection refused" start-of-body= Sep 08 04:06:51.269125 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:06:51.269109 2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-6q6cj" podUID="0fcf38d0-2136-4a43-bee3-47a0addf3605" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.20:15021/healthz/ready\": dial tcp 10.132.0.20:15021: connect: connection refused" Sep 08 04:06:51.906618 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:06:51.906584 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-9df44d876-md5vf" event={"ID":"8c7f8fb2-e2bd-49a5-953e-498c353d5884","Type":"ContainerStarted","Data":"99f960667f20a99e1b83d1440d32446c322f33cf89ca2655418dcc22404c4cd3"} Sep 08 04:06:51.931122 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:06:51.931062 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-9df44d876-md5vf" podStartSLOduration=2.406336505 podStartE2EDuration="4.931043427s" totalImagesPullingTime="2.524706922s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 04:06:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 04:06:51.926861653 +0000 UTC m=+705.397430036" watchObservedRunningTime="2026-09-08 04:06:51.931043427 +0000 UTC m=+705.401611812" Sep 08 04:06:51.953720 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:06:51.953689 2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-c548b5d7d-jq6l7"] Sep 08 04:06:51.953892 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:06:51.953858 2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-c548b5d7d-jq6l7" podUID="aa2c3d76-8806-4b0c-81a7-6e2b7674f523" containerName="authorino" containerID="cri-o://f39be5aa6bc9846dbb1905240cb1680a3dd005a5438c5dcff2242b36d91dbbd0" gracePeriod=30 Sep 08 04:06:52.207080 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:06:52.207057 2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-c548b5d7d-jq6l7" Sep 08 04:06:52.269026 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:06:52.268994 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5m4fb\" (UniqueName: \"kubernetes.io/projected/aa2c3d76-8806-4b0c-81a7-6e2b7674f523-kube-api-access-5m4fb\") pod \"aa2c3d76-8806-4b0c-81a7-6e2b7674f523\" (UID: \"aa2c3d76-8806-4b0c-81a7-6e2b7674f523\") " Sep 08 04:06:52.269222 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:06:52.269041 2571 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-6q6cj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.20:15021/healthz/ready\": dial tcp 10.132.0.20:15021: connect: connection refused" start-of-body= Sep 08 04:06:52.269222 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:06:52.269098 2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-6q6cj" podUID="0fcf38d0-2136-4a43-bee3-47a0addf3605" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.20:15021/healthz/ready\": dial tcp 10.132.0.20:15021: connect: connection refused" Sep 08 04:06:52.271080 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:06:52.271041 2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aa2c3d76-8806-4b0c-81a7-6e2b7674f523-kube-api-access-5m4fb" (OuterVolumeSpecName: "kube-api-access-5m4fb") pod "aa2c3d76-8806-4b0c-81a7-6e2b7674f523" (UID: "aa2c3d76-8806-4b0c-81a7-6e2b7674f523"). InnerVolumeSpecName "kube-api-access-5m4fb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 08 04:06:52.370429 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:06:52.370396 2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5m4fb\" (UniqueName: \"kubernetes.io/projected/aa2c3d76-8806-4b0c-81a7-6e2b7674f523-kube-api-access-5m4fb\") on node \"ip-10-0-128-67.ec2.internal\" DevicePath \"\"" Sep 08 04:06:52.913958 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:06:52.913901 2571 generic.go:356] "Generic (PLEG): container finished" podID="aa2c3d76-8806-4b0c-81a7-6e2b7674f523" containerID="f39be5aa6bc9846dbb1905240cb1680a3dd005a5438c5dcff2242b36d91dbbd0" exitCode=0 Sep 08 04:06:52.914584 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:06:52.914551 2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-c548b5d7d-jq6l7" Sep 08 04:06:52.914833 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:06:52.914619 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-c548b5d7d-jq6l7" event={"ID":"aa2c3d76-8806-4b0c-81a7-6e2b7674f523","Type":"ContainerDied","Data":"f39be5aa6bc9846dbb1905240cb1680a3dd005a5438c5dcff2242b36d91dbbd0"} Sep 08 04:06:52.914938 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:06:52.914861 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-c548b5d7d-jq6l7" event={"ID":"aa2c3d76-8806-4b0c-81a7-6e2b7674f523","Type":"ContainerDied","Data":"aced8d9c57743b4d2b9a4d96613e09a83d5a1f1fbedbaeeb9611b801031a31ae"} Sep 08 04:06:52.914938 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:06:52.914889 2571 scope.go:117] "RemoveContainer" containerID="f39be5aa6bc9846dbb1905240cb1680a3dd005a5438c5dcff2242b36d91dbbd0" Sep 08 04:06:52.942278 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:06:52.942257 2571 scope.go:117] "RemoveContainer" containerID="f39be5aa6bc9846dbb1905240cb1680a3dd005a5438c5dcff2242b36d91dbbd0" Sep 08 04:06:52.942569 ip-10-0-128-67 kubenswrapper[2571]: E0908 04:06:52.942551 2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f39be5aa6bc9846dbb1905240cb1680a3dd005a5438c5dcff2242b36d91dbbd0\": container with ID starting with f39be5aa6bc9846dbb1905240cb1680a3dd005a5438c5dcff2242b36d91dbbd0 not found: ID does not exist" containerID="f39be5aa6bc9846dbb1905240cb1680a3dd005a5438c5dcff2242b36d91dbbd0" Sep 08 04:06:52.942611 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:06:52.942579 2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f39be5aa6bc9846dbb1905240cb1680a3dd005a5438c5dcff2242b36d91dbbd0"} err="failed to get container status \"f39be5aa6bc9846dbb1905240cb1680a3dd005a5438c5dcff2242b36d91dbbd0\": rpc error: code = NotFound desc = could not find container \"f39be5aa6bc9846dbb1905240cb1680a3dd005a5438c5dcff2242b36d91dbbd0\": container with ID starting with f39be5aa6bc9846dbb1905240cb1680a3dd005a5438c5dcff2242b36d91dbbd0 not found: ID does not exist" Sep 08 04:06:52.952729 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:06:52.952709 2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-c548b5d7d-jq6l7"] Sep 08 04:06:52.954486 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:06:52.954467 2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-c548b5d7d-jq6l7"] Sep 08 04:06:53.067437 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:06:53.067363 2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="aa2c3d76-8806-4b0c-81a7-6e2b7674f523" path="/var/lib/kubelet/pods/aa2c3d76-8806-4b0c-81a7-6e2b7674f523/volumes" Sep 08 04:06:53.268847 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:06:53.268810 2571 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-6q6cj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.20:15021/healthz/ready\": dial tcp 10.132.0.20:15021: connect: connection refused" start-of-body= Sep 08 04:06:53.269000 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:06:53.268863 2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-6q6cj" podUID="0fcf38d0-2136-4a43-bee3-47a0addf3605" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.20:15021/healthz/ready\": dial tcp 10.132.0.20:15021: connect: connection refused" Sep 08 04:06:54.272527 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:06:54.272497 2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-6q6cj" Sep 08 04:06:54.272878 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:06:54.272840 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-6q6cj" Sep 08 04:06:54.273531 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:06:54.273509 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-6q6cj" Sep 08 04:06:57.880428 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:06:57.880394 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-bb7b75cc4-tdtdw" Sep 08 04:06:57.882372 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:06:57.882346 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-7d6487fcc8-sllvl" Sep 08 04:07:17.882941 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:07:17.882891 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-85d49875c6-m7sbc" Sep 08 04:08:13.784072 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:08:13.784039 2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-embedding-simulated-kserve-698db7d589-98z94"] Sep 08 04:08:13.784603 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:08:13.784365 2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aa2c3d76-8806-4b0c-81a7-6e2b7674f523" containerName="authorino" Sep 08 04:08:13.784603 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:08:13.784377 2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="aa2c3d76-8806-4b0c-81a7-6e2b7674f523" containerName="authorino" Sep 08 04:08:13.784603 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:08:13.784434 2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="aa2c3d76-8806-4b0c-81a7-6e2b7674f523" containerName="authorino" Sep 08 04:08:13.787433 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:08:13.787412 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-embedding-simulated-kserve-698db7d589-98z94" Sep 08 04:08:13.790266 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:08:13.790239 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Sep 08 04:08:13.791371 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:08:13.791347 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Sep 08 04:08:13.791499 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:08:13.791349 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-flhsn\"" Sep 08 04:08:13.791601 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:08:13.791585 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-embedding-simulated-kserve-self-signed-certs\"" Sep 08 04:08:13.792109 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:08:13.792087 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-embedding-simulated-kserve-698db7d589-98z94"] Sep 08 04:08:13.943987 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:08:13.943938 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/990bc925-9497-4379-a46c-ca2ceb1f154d-model-cache\") pod \"e2e-embedding-simulated-kserve-698db7d589-98z94\" (UID: \"990bc925-9497-4379-a46c-ca2ceb1f154d\") " pod="llm/e2e-embedding-simulated-kserve-698db7d589-98z94" Sep 08 04:08:13.943987 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:08:13.944001 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/990bc925-9497-4379-a46c-ca2ceb1f154d-home\") pod \"e2e-embedding-simulated-kserve-698db7d589-98z94\" (UID: \"990bc925-9497-4379-a46c-ca2ceb1f154d\") " pod="llm/e2e-embedding-simulated-kserve-698db7d589-98z94" Sep 08 04:08:13.944246 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:08:13.944073 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pgq76\" (UniqueName: \"kubernetes.io/projected/990bc925-9497-4379-a46c-ca2ceb1f154d-kube-api-access-pgq76\") pod \"e2e-embedding-simulated-kserve-698db7d589-98z94\" (UID: \"990bc925-9497-4379-a46c-ca2ceb1f154d\") " pod="llm/e2e-embedding-simulated-kserve-698db7d589-98z94" Sep 08 04:08:13.944246 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:08:13.944127 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/990bc925-9497-4379-a46c-ca2ceb1f154d-tmp-dir\") pod \"e2e-embedding-simulated-kserve-698db7d589-98z94\" (UID: \"990bc925-9497-4379-a46c-ca2ceb1f154d\") " pod="llm/e2e-embedding-simulated-kserve-698db7d589-98z94" Sep 08 04:08:13.944246 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:08:13.944177 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/990bc925-9497-4379-a46c-ca2ceb1f154d-dshm\") pod \"e2e-embedding-simulated-kserve-698db7d589-98z94\" (UID: \"990bc925-9497-4379-a46c-ca2ceb1f154d\") " pod="llm/e2e-embedding-simulated-kserve-698db7d589-98z94" Sep 08 04:08:13.944246 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:08:13.944209 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/990bc925-9497-4379-a46c-ca2ceb1f154d-tls-certs\") pod \"e2e-embedding-simulated-kserve-698db7d589-98z94\" (UID: \"990bc925-9497-4379-a46c-ca2ceb1f154d\") " pod="llm/e2e-embedding-simulated-kserve-698db7d589-98z94" Sep 08 04:08:14.045487 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:08:14.045401 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/990bc925-9497-4379-a46c-ca2ceb1f154d-model-cache\") pod \"e2e-embedding-simulated-kserve-698db7d589-98z94\" (UID: \"990bc925-9497-4379-a46c-ca2ceb1f154d\") " pod="llm/e2e-embedding-simulated-kserve-698db7d589-98z94" Sep 08 04:08:14.045487 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:08:14.045440 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/990bc925-9497-4379-a46c-ca2ceb1f154d-home\") pod \"e2e-embedding-simulated-kserve-698db7d589-98z94\" (UID: \"990bc925-9497-4379-a46c-ca2ceb1f154d\") " pod="llm/e2e-embedding-simulated-kserve-698db7d589-98z94" Sep 08 04:08:14.045487 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:08:14.045465 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pgq76\" (UniqueName: \"kubernetes.io/projected/990bc925-9497-4379-a46c-ca2ceb1f154d-kube-api-access-pgq76\") pod \"e2e-embedding-simulated-kserve-698db7d589-98z94\" (UID: \"990bc925-9497-4379-a46c-ca2ceb1f154d\") " pod="llm/e2e-embedding-simulated-kserve-698db7d589-98z94" Sep 08 04:08:14.045763 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:08:14.045499 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/990bc925-9497-4379-a46c-ca2ceb1f154d-tmp-dir\") pod \"e2e-embedding-simulated-kserve-698db7d589-98z94\" (UID: \"990bc925-9497-4379-a46c-ca2ceb1f154d\") " pod="llm/e2e-embedding-simulated-kserve-698db7d589-98z94" Sep 08 04:08:14.045763 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:08:14.045541 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/990bc925-9497-4379-a46c-ca2ceb1f154d-dshm\") pod \"e2e-embedding-simulated-kserve-698db7d589-98z94\" (UID: \"990bc925-9497-4379-a46c-ca2ceb1f154d\") " pod="llm/e2e-embedding-simulated-kserve-698db7d589-98z94" Sep 08 04:08:14.045763 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:08:14.045664 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/990bc925-9497-4379-a46c-ca2ceb1f154d-tls-certs\") pod \"e2e-embedding-simulated-kserve-698db7d589-98z94\" (UID: \"990bc925-9497-4379-a46c-ca2ceb1f154d\") " pod="llm/e2e-embedding-simulated-kserve-698db7d589-98z94" Sep 08 04:08:14.045948 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:08:14.045796 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/990bc925-9497-4379-a46c-ca2ceb1f154d-model-cache\") pod \"e2e-embedding-simulated-kserve-698db7d589-98z94\" (UID: \"990bc925-9497-4379-a46c-ca2ceb1f154d\") " pod="llm/e2e-embedding-simulated-kserve-698db7d589-98z94" Sep 08 04:08:14.045948 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:08:14.045847 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/990bc925-9497-4379-a46c-ca2ceb1f154d-home\") pod \"e2e-embedding-simulated-kserve-698db7d589-98z94\" (UID: \"990bc925-9497-4379-a46c-ca2ceb1f154d\") " pod="llm/e2e-embedding-simulated-kserve-698db7d589-98z94" Sep 08 04:08:14.045948 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:08:14.045883 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/990bc925-9497-4379-a46c-ca2ceb1f154d-tmp-dir\") pod \"e2e-embedding-simulated-kserve-698db7d589-98z94\" (UID: \"990bc925-9497-4379-a46c-ca2ceb1f154d\") " pod="llm/e2e-embedding-simulated-kserve-698db7d589-98z94" Sep 08 04:08:14.047984 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:08:14.047954 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/990bc925-9497-4379-a46c-ca2ceb1f154d-dshm\") pod \"e2e-embedding-simulated-kserve-698db7d589-98z94\" (UID: \"990bc925-9497-4379-a46c-ca2ceb1f154d\") " pod="llm/e2e-embedding-simulated-kserve-698db7d589-98z94" Sep 08 04:08:14.048150 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:08:14.048134 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/990bc925-9497-4379-a46c-ca2ceb1f154d-tls-certs\") pod \"e2e-embedding-simulated-kserve-698db7d589-98z94\" (UID: \"990bc925-9497-4379-a46c-ca2ceb1f154d\") " pod="llm/e2e-embedding-simulated-kserve-698db7d589-98z94" Sep 08 04:08:14.053473 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:08:14.053455 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pgq76\" (UniqueName: \"kubernetes.io/projected/990bc925-9497-4379-a46c-ca2ceb1f154d-kube-api-access-pgq76\") pod \"e2e-embedding-simulated-kserve-698db7d589-98z94\" (UID: \"990bc925-9497-4379-a46c-ca2ceb1f154d\") " pod="llm/e2e-embedding-simulated-kserve-698db7d589-98z94" Sep 08 04:08:14.099119 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:08:14.099094 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-embedding-simulated-kserve-698db7d589-98z94" Sep 08 04:08:14.380636 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:08:14.380615 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-embedding-simulated-kserve-698db7d589-98z94"] Sep 08 04:08:14.382321 ip-10-0-128-67 kubenswrapper[2571]: W0908 04:08:14.382295 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod990bc925_9497_4379_a46c_ca2ceb1f154d.slice/crio-b6593f9445526c97a42564a529bec8422bd52dda782638e08449107b6b2606bb WatchSource:0}: Error finding container b6593f9445526c97a42564a529bec8422bd52dda782638e08449107b6b2606bb: Status 404 returned error can't find the container with id b6593f9445526c97a42564a529bec8422bd52dda782638e08449107b6b2606bb Sep 08 04:08:15.323351 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:08:15.323318 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-embedding-simulated-kserve-698db7d589-98z94" event={"ID":"990bc925-9497-4379-a46c-ca2ceb1f154d","Type":"ContainerStarted","Data":"b6593f9445526c97a42564a529bec8422bd52dda782638e08449107b6b2606bb"} Sep 08 04:08:16.332537 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:08:16.332502 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-embedding-simulated-kserve-698db7d589-98z94" event={"ID":"990bc925-9497-4379-a46c-ca2ceb1f154d","Type":"ContainerStarted","Data":"dc02e8f357327500cece14f385340912f5950e41564d37f5d24408da716b3dbd"} Sep 08 04:08:16.357839 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:08:16.357773 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-embedding-simulated-kserve-698db7d589-98z94" podStartSLOduration=2.395213267 podStartE2EDuration="3.357751651s" totalImagesPullingTime="962.538384ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 04:08:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 04:08:16.354731336 +0000 UTC m=+789.825299735" watchObservedRunningTime="2026-09-08 04:08:16.357751651 +0000 UTC m=+789.828320033" Sep 08 04:08:17.099161 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:08:17.099134 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-embedding-simulated-kserve-698db7d589-98z94" Sep 08 04:08:23.092321 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:08:23.092283 2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-5bccb7bbf7-l54xn"] Sep 08 04:08:23.096342 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:08:23.096319 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-5bccb7bbf7-l54xn" Sep 08 04:08:23.099186 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:08:23.099163 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\"" Sep 08 04:08:23.105336 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:08:23.105229 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-5bccb7bbf7-l54xn"] Sep 08 04:08:23.222545 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:08:23.222506 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/633e3cbc-3f28-4aff-9b3f-3f5421cec044-model-cache\") pod \"e2e-trlp-test-simulated-kserve-5bccb7bbf7-l54xn\" (UID: \"633e3cbc-3f28-4aff-9b3f-3f5421cec044\") " pod="llm/e2e-trlp-test-simulated-kserve-5bccb7bbf7-l54xn" Sep 08 04:08:23.222545 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:08:23.222548 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/633e3cbc-3f28-4aff-9b3f-3f5421cec044-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-5bccb7bbf7-l54xn\" (UID: \"633e3cbc-3f28-4aff-9b3f-3f5421cec044\") " pod="llm/e2e-trlp-test-simulated-kserve-5bccb7bbf7-l54xn" Sep 08 04:08:23.222798 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:08:23.222577 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2nc4m\" (UniqueName: \"kubernetes.io/projected/633e3cbc-3f28-4aff-9b3f-3f5421cec044-kube-api-access-2nc4m\") pod \"e2e-trlp-test-simulated-kserve-5bccb7bbf7-l54xn\" (UID: \"633e3cbc-3f28-4aff-9b3f-3f5421cec044\") " pod="llm/e2e-trlp-test-simulated-kserve-5bccb7bbf7-l54xn" Sep 08 04:08:23.222798 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:08:23.222607 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/633e3cbc-3f28-4aff-9b3f-3f5421cec044-dshm\") pod \"e2e-trlp-test-simulated-kserve-5bccb7bbf7-l54xn\" (UID: \"633e3cbc-3f28-4aff-9b3f-3f5421cec044\") " pod="llm/e2e-trlp-test-simulated-kserve-5bccb7bbf7-l54xn" Sep 08 04:08:23.222798 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:08:23.222654 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/633e3cbc-3f28-4aff-9b3f-3f5421cec044-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-5bccb7bbf7-l54xn\" (UID: \"633e3cbc-3f28-4aff-9b3f-3f5421cec044\") " pod="llm/e2e-trlp-test-simulated-kserve-5bccb7bbf7-l54xn" Sep 08 04:08:23.222798 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:08:23.222713 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/633e3cbc-3f28-4aff-9b3f-3f5421cec044-home\") pod \"e2e-trlp-test-simulated-kserve-5bccb7bbf7-l54xn\" (UID: \"633e3cbc-3f28-4aff-9b3f-3f5421cec044\") " pod="llm/e2e-trlp-test-simulated-kserve-5bccb7bbf7-l54xn" Sep 08 04:08:23.323813 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:08:23.323772 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/633e3cbc-3f28-4aff-9b3f-3f5421cec044-model-cache\") pod \"e2e-trlp-test-simulated-kserve-5bccb7bbf7-l54xn\" (UID: \"633e3cbc-3f28-4aff-9b3f-3f5421cec044\") " pod="llm/e2e-trlp-test-simulated-kserve-5bccb7bbf7-l54xn" Sep 08 04:08:23.324006 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:08:23.323831 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/633e3cbc-3f28-4aff-9b3f-3f5421cec044-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-5bccb7bbf7-l54xn\" (UID: \"633e3cbc-3f28-4aff-9b3f-3f5421cec044\") " pod="llm/e2e-trlp-test-simulated-kserve-5bccb7bbf7-l54xn" Sep 08 04:08:23.324006 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:08:23.323886 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2nc4m\" (UniqueName: \"kubernetes.io/projected/633e3cbc-3f28-4aff-9b3f-3f5421cec044-kube-api-access-2nc4m\") pod \"e2e-trlp-test-simulated-kserve-5bccb7bbf7-l54xn\" (UID: \"633e3cbc-3f28-4aff-9b3f-3f5421cec044\") " pod="llm/e2e-trlp-test-simulated-kserve-5bccb7bbf7-l54xn" Sep 08 04:08:23.324006 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:08:23.323954 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/633e3cbc-3f28-4aff-9b3f-3f5421cec044-dshm\") pod \"e2e-trlp-test-simulated-kserve-5bccb7bbf7-l54xn\" (UID: \"633e3cbc-3f28-4aff-9b3f-3f5421cec044\") " pod="llm/e2e-trlp-test-simulated-kserve-5bccb7bbf7-l54xn" Sep 08 04:08:23.324006 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:08:23.323978 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/633e3cbc-3f28-4aff-9b3f-3f5421cec044-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-5bccb7bbf7-l54xn\" (UID: \"633e3cbc-3f28-4aff-9b3f-3f5421cec044\") " pod="llm/e2e-trlp-test-simulated-kserve-5bccb7bbf7-l54xn" Sep 08 04:08:23.324241 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:08:23.324017 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/633e3cbc-3f28-4aff-9b3f-3f5421cec044-home\") pod \"e2e-trlp-test-simulated-kserve-5bccb7bbf7-l54xn\" (UID: \"633e3cbc-3f28-4aff-9b3f-3f5421cec044\") " pod="llm/e2e-trlp-test-simulated-kserve-5bccb7bbf7-l54xn" Sep 08 04:08:23.324341 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:08:23.324310 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/633e3cbc-3f28-4aff-9b3f-3f5421cec044-model-cache\") pod \"e2e-trlp-test-simulated-kserve-5bccb7bbf7-l54xn\" (UID: \"633e3cbc-3f28-4aff-9b3f-3f5421cec044\") " pod="llm/e2e-trlp-test-simulated-kserve-5bccb7bbf7-l54xn" Sep 08 04:08:23.324568 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:08:23.324542 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/633e3cbc-3f28-4aff-9b3f-3f5421cec044-home\") pod \"e2e-trlp-test-simulated-kserve-5bccb7bbf7-l54xn\" (UID: \"633e3cbc-3f28-4aff-9b3f-3f5421cec044\") " pod="llm/e2e-trlp-test-simulated-kserve-5bccb7bbf7-l54xn" Sep 08 04:08:23.324801 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:08:23.324776 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/633e3cbc-3f28-4aff-9b3f-3f5421cec044-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-5bccb7bbf7-l54xn\" (UID: \"633e3cbc-3f28-4aff-9b3f-3f5421cec044\") " pod="llm/e2e-trlp-test-simulated-kserve-5bccb7bbf7-l54xn" Sep 08 04:08:23.326790 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:08:23.326764 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/633e3cbc-3f28-4aff-9b3f-3f5421cec044-dshm\") pod \"e2e-trlp-test-simulated-kserve-5bccb7bbf7-l54xn\" (UID: \"633e3cbc-3f28-4aff-9b3f-3f5421cec044\") " pod="llm/e2e-trlp-test-simulated-kserve-5bccb7bbf7-l54xn" Sep 08 04:08:23.327014 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:08:23.326991 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/633e3cbc-3f28-4aff-9b3f-3f5421cec044-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-5bccb7bbf7-l54xn\" (UID: \"633e3cbc-3f28-4aff-9b3f-3f5421cec044\") " pod="llm/e2e-trlp-test-simulated-kserve-5bccb7bbf7-l54xn" Sep 08 04:08:23.341670 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:08:23.341644 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2nc4m\" (UniqueName: \"kubernetes.io/projected/633e3cbc-3f28-4aff-9b3f-3f5421cec044-kube-api-access-2nc4m\") pod \"e2e-trlp-test-simulated-kserve-5bccb7bbf7-l54xn\" (UID: \"633e3cbc-3f28-4aff-9b3f-3f5421cec044\") " pod="llm/e2e-trlp-test-simulated-kserve-5bccb7bbf7-l54xn" Sep 08 04:08:23.408857 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:08:23.408782 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-5bccb7bbf7-l54xn" Sep 08 04:08:23.697230 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:08:23.697179 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-5bccb7bbf7-l54xn"] Sep 08 04:08:23.699531 ip-10-0-128-67 kubenswrapper[2571]: W0908 04:08:23.699504 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod633e3cbc_3f28_4aff_9b3f_3f5421cec044.slice/crio-f06ae053b8addeb530529f7b64d642fc4b21c3f2768035fa505972b5a71a00a2 WatchSource:0}: Error finding container f06ae053b8addeb530529f7b64d642fc4b21c3f2768035fa505972b5a71a00a2: Status 404 returned error can't find the container with id f06ae053b8addeb530529f7b64d642fc4b21c3f2768035fa505972b5a71a00a2 Sep 08 04:08:24.100114 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:08:24.100075 2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-embedding-simulated-kserve-698db7d589-98z94" Sep 08 04:08:24.112876 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:08:24.112845 2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-embedding-simulated-kserve-698db7d589-98z94" Sep 08 04:08:24.376331 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:08:24.376249 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-5bccb7bbf7-l54xn" event={"ID":"633e3cbc-3f28-4aff-9b3f-3f5421cec044","Type":"ContainerStarted","Data":"58c86cbb69fd909cf553c878f9c7505696ebda9e03bfc5e7065dda1724eb8daa"} Sep 08 04:08:24.376331 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:08:24.376307 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-5bccb7bbf7-l54xn" event={"ID":"633e3cbc-3f28-4aff-9b3f-3f5421cec044","Type":"ContainerStarted","Data":"f06ae053b8addeb530529f7b64d642fc4b21c3f2768035fa505972b5a71a00a2"} Sep 08 04:08:24.387700 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:08:24.387673 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-embedding-simulated-kserve-698db7d589-98z94" Sep 08 04:08:24.399180 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:08:24.399127 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-5bccb7bbf7-l54xn" podStartSLOduration=1.22403246 podStartE2EDuration="1.399114152s" totalImagesPullingTime="175.081692ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 04:08:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 04:08:24.397704547 +0000 UTC m=+797.868272929" watchObservedRunningTime="2026-09-08 04:08:24.399114152 +0000 UTC m=+797.869682591" Sep 08 04:08:24.409496 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:08:24.409468 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-5bccb7bbf7-l54xn" Sep 08 04:08:33.409862 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:08:33.409775 2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-5bccb7bbf7-l54xn" Sep 08 04:08:33.422630 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:08:33.422607 2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-5bccb7bbf7-l54xn" Sep 08 04:08:33.442188 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:08:33.442154 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-5bccb7bbf7-l54xn" Sep 08 04:15:00.150690 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:15:00.150644 2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29814015-4vzrp"] Sep 08 04:15:00.154462 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:15:00.154435 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29814015-4vzrp" Sep 08 04:15:00.157333 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:15:00.157306 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-kc6mf\"" Sep 08 04:15:00.164022 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:15:00.164004 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29814015-4vzrp" Sep 08 04:15:00.171210 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:15:00.171177 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29814015-4vzrp"] Sep 08 04:15:00.439381 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:15:00.439353 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29814015-4vzrp"] Sep 08 04:15:00.441003 ip-10-0-128-67 kubenswrapper[2571]: W0908 04:15:00.440976 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1c9465f8_18e0_45c5_82bd_b18a3426ec09.slice/crio-b423d5cd1f29664de1b2f8db8b03c7102f01fa71ed2b84310e5f18cb0f875dd0 WatchSource:0}: Error finding container b423d5cd1f29664de1b2f8db8b03c7102f01fa71ed2b84310e5f18cb0f875dd0: Status 404 returned error can't find the container with id b423d5cd1f29664de1b2f8db8b03c7102f01fa71ed2b84310e5f18cb0f875dd0 Sep 08 04:15:00.442998 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:15:00.442980 2571 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 08 04:15:01.401981 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:15:01.401935 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29814015-4vzrp" event={"ID":"1c9465f8-18e0-45c5-82bd-b18a3426ec09","Type":"ContainerStarted","Data":"b423d5cd1f29664de1b2f8db8b03c7102f01fa71ed2b84310e5f18cb0f875dd0"} Sep 08 04:15:04.422875 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:15:04.422842 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29814015-4vzrp" event={"ID":"1c9465f8-18e0-45c5-82bd-b18a3426ec09","Type":"ContainerStarted","Data":"b34839f8b898914b74b31c387fdf27a31a5364a483a2a7bb49602266b1427b26"} Sep 08 04:15:04.440717 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:15:04.440670 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29814015-4vzrp" podStartSLOduration=1.386722336 podStartE2EDuration="4.440654277s" totalImagesPullingTime="3.053931941s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 04:15:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 04:15:04.439267367 +0000 UTC m=+1197.909835748" watchObservedRunningTime="2026-09-08 04:15:04.440654277 +0000 UTC m=+1197.911222658" Sep 08 04:15:05.429333 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:15:05.429297 2571 generic.go:356] "Generic (PLEG): container finished" podID="1c9465f8-18e0-45c5-82bd-b18a3426ec09" containerID="b34839f8b898914b74b31c387fdf27a31a5364a483a2a7bb49602266b1427b26" exitCode=0 Sep 08 04:15:05.429791 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:15:05.429385 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29814015-4vzrp" event={"ID":"1c9465f8-18e0-45c5-82bd-b18a3426ec09","Type":"ContainerDied","Data":"b34839f8b898914b74b31c387fdf27a31a5364a483a2a7bb49602266b1427b26"} Sep 08 04:15:06.566402 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:15:06.566377 2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29814015-4vzrp" Sep 08 04:15:07.441137 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:15:07.441056 2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29814015-4vzrp" Sep 08 04:15:07.441137 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:15:07.441094 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29814015-4vzrp" event={"ID":"1c9465f8-18e0-45c5-82bd-b18a3426ec09","Type":"ContainerDied","Data":"b423d5cd1f29664de1b2f8db8b03c7102f01fa71ed2b84310e5f18cb0f875dd0"} Sep 08 04:15:07.441137 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:15:07.441139 2571 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b423d5cd1f29664de1b2f8db8b03c7102f01fa71ed2b84310e5f18cb0f875dd0" Sep 08 04:15:25.331652 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:15:25.331620 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-857c55f576-l4b6m_367577ba-f73d-401b-9642-88f7d97e37c4/manager/0.log" Sep 08 04:15:25.736666 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:15:25.736590 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-9df44d876-md5vf_8c7f8fb2-e2bd-49a5-953e-498c353d5884/authorino/0.log" Sep 08 04:15:31.503740 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:15:31.503708 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-85d49875c6-m7sbc_f9daf336-abd8-4f65-ae0a-995cdc292116/manager/0.log" Sep 08 04:15:31.936297 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:15:31.936264 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-857c55f576-l4b6m_367577ba-f73d-401b-9642-88f7d97e37c4/manager/0.log" Sep 08 04:15:32.066225 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:15:32.066195 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-7d6487fcc8-sllvl_f02e6afd-0df0-41e1-bd43-9f0c5ded9063/server/0.log" Sep 08 04:15:32.193083 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:15:32.192989 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-bb7b75cc4-tdtdw_9b9b51ce-0d32-4e32-934c-ab278a141141/manager/0.log" Sep 08 04:15:32.678322 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:15:32.678287 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29814015-4vzrp_1c9465f8-18e0-45c5-82bd-b18a3426ec09/cleanup/0.log" Sep 08 04:15:33.680838 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:15:33.680808 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-9df44d876-md5vf_8c7f8fb2-e2bd-49a5-953e-498c353d5884/authorino/0.log" Sep 08 04:15:33.818549 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:15:33.818516 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-84d9bfc694-tmc2z_92d30b0c-8690-4fc3-b2c5-eeac54372929/manager/0.log" Sep 08 04:15:33.960375 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:15:33.960297 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-ffcddf5cd-xsjzj_7cfc47c6-cb3f-49e3-96a5-174f07d8cc61/manager/0.log" Sep 08 04:15:34.266974 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:15:34.266881 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-7456d9997c-srvk4_cf765688-c25d-46c2-97e0-48bd36c81666/manager/0.log" Sep 08 04:15:34.524073 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:15:34.523993 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-565895c755-ggwrk_adad0566-5d7e-4bfc-871c-25b9b1aff5f4/manager/0.log" Sep 08 04:15:34.936582 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:15:34.936553 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-ctn7f_7a0003c4-8989-4f28-b1f7-62ed71cfe566/istio-proxy/0.log" Sep 08 04:15:35.449367 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:15:35.449336 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-6q6cj_0fcf38d0-2136-4a43-bee3-47a0addf3605/istio-proxy/1.log" Sep 08 04:15:35.584463 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:15:35.584428 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_openshift-ai-inference-openshift-ai-inference-5dd944c6f-6j876_e9e85fc8-3836-4b6e-9189-988a2141d478/istio-proxy/0.log" Sep 08 04:15:36.624596 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:15:36.624561 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-embedding-simulated-kserve-698db7d589-98z94_990bc925-9497-4379-a46c-ca2ceb1f154d/main/0.log" Sep 08 04:15:36.748458 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:15:36.748433 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-5bccb7bbf7-l54xn_633e3cbc-3f28-4aff-9b3f-3f5421cec044/main/0.log" Sep 08 04:15:45.699389 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:15:45.699357 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-6ffgk_4c94cf72-6e9d-4f8b-ae71-105e52f051a1/global-pull-secret-syncer/0.log" Sep 08 04:15:45.827278 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:15:45.827247 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-xgq5w_98f02edd-0112-465f-992b-441a484304a3/konnectivity-agent/0.log" Sep 08 04:15:45.863221 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:15:45.863187 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-128-67.ec2.internal_c9e8db20add26e2681670793a6ac21cf/haproxy/0.log" Sep 08 04:15:50.140850 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:15:50.140791 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-9df44d876-md5vf_8c7f8fb2-e2bd-49a5-953e-498c353d5884/authorino/0.log" Sep 08 04:15:50.164370 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:15:50.164340 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-84d9bfc694-tmc2z_92d30b0c-8690-4fc3-b2c5-eeac54372929/manager/0.log" Sep 08 04:15:50.197108 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:15:50.197082 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-ffcddf5cd-xsjzj_7cfc47c6-cb3f-49e3-96a5-174f07d8cc61/manager/0.log" Sep 08 04:15:50.271249 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:15:50.271218 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-7456d9997c-srvk4_cf765688-c25d-46c2-97e0-48bd36c81666/manager/0.log" Sep 08 04:15:50.322819 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:15:50.322791 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-565895c755-ggwrk_adad0566-5d7e-4bfc-871c-25b9b1aff5f4/manager/0.log" Sep 08 04:15:52.175319 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:15:52.175290 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-k9zcg_02e1dce7-d7cb-4540-8a01-2fc63af19226/node-exporter/0.log" Sep 08 04:15:52.192161 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:15:52.192138 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-k9zcg_02e1dce7-d7cb-4540-8a01-2fc63af19226/kube-rbac-proxy/0.log" Sep 08 04:15:52.210340 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:15:52.210313 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-k9zcg_02e1dce7-d7cb-4540-8a01-2fc63af19226/init-textfile/0.log" Sep 08 04:15:54.480146 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:15:54.480107 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-79977f9844-h4zkr_4fd5d5dc-7953-4bd3-b65c-f81092c2af3d/networking-console-plugin/0.log" Sep 08 04:15:55.645763 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:15:55.645723 2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-qbfdx/perf-node-gather-daemonset-xf2fb"] Sep 08 04:15:55.646191 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:15:55.646130 2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1c9465f8-18e0-45c5-82bd-b18a3426ec09" containerName="cleanup" Sep 08 04:15:55.646191 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:15:55.646145 2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="1c9465f8-18e0-45c5-82bd-b18a3426ec09" containerName="cleanup" Sep 08 04:15:55.646268 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:15:55.646223 2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="1c9465f8-18e0-45c5-82bd-b18a3426ec09" containerName="cleanup" Sep 08 04:15:55.649390 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:15:55.649370 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-qbfdx/perf-node-gather-daemonset-xf2fb" Sep 08 04:15:55.652152 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:15:55.652132 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-qbfdx\"/\"kube-root-ca.crt\"" Sep 08 04:15:55.653169 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:15:55.653150 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-qbfdx\"/\"default-dockercfg-qwfzv\"" Sep 08 04:15:55.653270 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:15:55.653219 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-qbfdx\"/\"openshift-service-ca.crt\"" Sep 08 04:15:55.658225 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:15:55.658204 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-qbfdx/perf-node-gather-daemonset-xf2fb"] Sep 08 04:15:55.754489 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:15:55.754461 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/0de4a58b-56c0-4753-a318-ae388248876f-podres\") pod \"perf-node-gather-daemonset-xf2fb\" (UID: \"0de4a58b-56c0-4753-a318-ae388248876f\") " pod="openshift-must-gather-qbfdx/perf-node-gather-daemonset-xf2fb" Sep 08 04:15:55.754645 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:15:55.754498 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0de4a58b-56c0-4753-a318-ae388248876f-lib-modules\") pod \"perf-node-gather-daemonset-xf2fb\" (UID: \"0de4a58b-56c0-4753-a318-ae388248876f\") " pod="openshift-must-gather-qbfdx/perf-node-gather-daemonset-xf2fb" Sep 08 04:15:55.754645 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:15:55.754519 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7rd5q\" (UniqueName: \"kubernetes.io/projected/0de4a58b-56c0-4753-a318-ae388248876f-kube-api-access-7rd5q\") pod \"perf-node-gather-daemonset-xf2fb\" (UID: \"0de4a58b-56c0-4753-a318-ae388248876f\") " pod="openshift-must-gather-qbfdx/perf-node-gather-daemonset-xf2fb" Sep 08 04:15:55.754645 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:15:55.754589 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0de4a58b-56c0-4753-a318-ae388248876f-sys\") pod \"perf-node-gather-daemonset-xf2fb\" (UID: \"0de4a58b-56c0-4753-a318-ae388248876f\") " pod="openshift-must-gather-qbfdx/perf-node-gather-daemonset-xf2fb" Sep 08 04:15:55.754746 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:15:55.754654 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/0de4a58b-56c0-4753-a318-ae388248876f-proc\") pod \"perf-node-gather-daemonset-xf2fb\" (UID: \"0de4a58b-56c0-4753-a318-ae388248876f\") " pod="openshift-must-gather-qbfdx/perf-node-gather-daemonset-xf2fb" Sep 08 04:15:55.856062 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:15:55.856033 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/0de4a58b-56c0-4753-a318-ae388248876f-proc\") pod \"perf-node-gather-daemonset-xf2fb\" (UID: \"0de4a58b-56c0-4753-a318-ae388248876f\") " pod="openshift-must-gather-qbfdx/perf-node-gather-daemonset-xf2fb" Sep 08 04:15:55.856204 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:15:55.856086 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/0de4a58b-56c0-4753-a318-ae388248876f-podres\") pod \"perf-node-gather-daemonset-xf2fb\" (UID: \"0de4a58b-56c0-4753-a318-ae388248876f\") " pod="openshift-must-gather-qbfdx/perf-node-gather-daemonset-xf2fb" Sep 08 04:15:55.856204 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:15:55.856112 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0de4a58b-56c0-4753-a318-ae388248876f-lib-modules\") pod \"perf-node-gather-daemonset-xf2fb\" (UID: \"0de4a58b-56c0-4753-a318-ae388248876f\") " pod="openshift-must-gather-qbfdx/perf-node-gather-daemonset-xf2fb" Sep 08 04:15:55.856204 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:15:55.856134 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7rd5q\" (UniqueName: \"kubernetes.io/projected/0de4a58b-56c0-4753-a318-ae388248876f-kube-api-access-7rd5q\") pod \"perf-node-gather-daemonset-xf2fb\" (UID: \"0de4a58b-56c0-4753-a318-ae388248876f\") " pod="openshift-must-gather-qbfdx/perf-node-gather-daemonset-xf2fb" Sep 08 04:15:55.856204 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:15:55.856153 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0de4a58b-56c0-4753-a318-ae388248876f-sys\") pod \"perf-node-gather-daemonset-xf2fb\" (UID: \"0de4a58b-56c0-4753-a318-ae388248876f\") " pod="openshift-must-gather-qbfdx/perf-node-gather-daemonset-xf2fb" Sep 08 04:15:55.856204 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:15:55.856159 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/0de4a58b-56c0-4753-a318-ae388248876f-proc\") pod \"perf-node-gather-daemonset-xf2fb\" (UID: \"0de4a58b-56c0-4753-a318-ae388248876f\") " pod="openshift-must-gather-qbfdx/perf-node-gather-daemonset-xf2fb" Sep 08 04:15:55.856367 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:15:55.856206 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/0de4a58b-56c0-4753-a318-ae388248876f-podres\") pod \"perf-node-gather-daemonset-xf2fb\" (UID: \"0de4a58b-56c0-4753-a318-ae388248876f\") " pod="openshift-must-gather-qbfdx/perf-node-gather-daemonset-xf2fb" Sep 08 04:15:55.856367 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:15:55.856230 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0de4a58b-56c0-4753-a318-ae388248876f-sys\") pod \"perf-node-gather-daemonset-xf2fb\" (UID: \"0de4a58b-56c0-4753-a318-ae388248876f\") " pod="openshift-must-gather-qbfdx/perf-node-gather-daemonset-xf2fb" Sep 08 04:15:55.856367 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:15:55.856275 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0de4a58b-56c0-4753-a318-ae388248876f-lib-modules\") pod \"perf-node-gather-daemonset-xf2fb\" (UID: \"0de4a58b-56c0-4753-a318-ae388248876f\") " pod="openshift-must-gather-qbfdx/perf-node-gather-daemonset-xf2fb" Sep 08 04:15:55.864409 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:15:55.864384 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7rd5q\" (UniqueName: \"kubernetes.io/projected/0de4a58b-56c0-4753-a318-ae388248876f-kube-api-access-7rd5q\") pod \"perf-node-gather-daemonset-xf2fb\" (UID: \"0de4a58b-56c0-4753-a318-ae388248876f\") " pod="openshift-must-gather-qbfdx/perf-node-gather-daemonset-xf2fb" Sep 08 04:15:55.959852 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:15:55.959768 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-qbfdx/perf-node-gather-daemonset-xf2fb" Sep 08 04:15:56.237092 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:15:56.237071 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-qbfdx/perf-node-gather-daemonset-xf2fb"] Sep 08 04:15:56.239363 ip-10-0-128-67 kubenswrapper[2571]: W0908 04:15:56.239335 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod0de4a58b_56c0_4753_a318_ae388248876f.slice/crio-1153af0fbef54bc7e256d9f23864cf8aa7ebb2e4ebb3a3789074a7ae8264ada0 WatchSource:0}: Error finding container 1153af0fbef54bc7e256d9f23864cf8aa7ebb2e4ebb3a3789074a7ae8264ada0: Status 404 returned error can't find the container with id 1153af0fbef54bc7e256d9f23864cf8aa7ebb2e4ebb3a3789074a7ae8264ada0 Sep 08 04:15:56.698113 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:15:56.698074 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-qbfdx/perf-node-gather-daemonset-xf2fb" event={"ID":"0de4a58b-56c0-4753-a318-ae388248876f","Type":"ContainerStarted","Data":"9c10c33d7afe6878f349f9991f6ddd7fd2ac517e2b12c1ba23f48ba291163a6e"} Sep 08 04:15:56.698659 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:15:56.698129 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-qbfdx/perf-node-gather-daemonset-xf2fb" event={"ID":"0de4a58b-56c0-4753-a318-ae388248876f","Type":"ContainerStarted","Data":"1153af0fbef54bc7e256d9f23864cf8aa7ebb2e4ebb3a3789074a7ae8264ada0"} Sep 08 04:15:56.698659 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:15:56.698233 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-qbfdx/perf-node-gather-daemonset-xf2fb" Sep 08 04:15:56.714890 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:15:56.714842 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-qbfdx/perf-node-gather-daemonset-xf2fb" podStartSLOduration=1.71482924 podStartE2EDuration="1.71482924s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 04:15:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 04:15:56.714168035 +0000 UTC m=+1250.184736417" watchObservedRunningTime="2026-09-08 04:15:56.71482924 +0000 UTC m=+1250.185397621" Sep 08 04:15:57.363680 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:15:57.363652 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-2gs5x_c46d90d1-2661-4b22-9f7d-9d2fd5eaabbb/dns/0.log" Sep 08 04:15:57.379856 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:15:57.379828 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-2gs5x_c46d90d1-2661-4b22-9f7d-9d2fd5eaabbb/kube-rbac-proxy/0.log" Sep 08 04:15:57.510370 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:15:57.510345 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-t2qd4_92705af2-1822-4b7f-8852-a8120774230c/dns-node-resolver/0.log" Sep 08 04:15:58.036083 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:15:58.036052 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-6gf2k_0e85668b-3938-4a44-978b-0fa580d71c06/node-ca/0.log" Sep 08 04:15:58.958119 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:15:58.958087 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-ctn7f_7a0003c4-8989-4f28-b1f7-62ed71cfe566/istio-proxy/0.log" Sep 08 04:15:59.075246 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:15:59.075215 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-6q6cj_0fcf38d0-2136-4a43-bee3-47a0addf3605/istio-proxy/0.log" Sep 08 04:15:59.075622 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:15:59.075306 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-6q6cj_0fcf38d0-2136-4a43-bee3-47a0addf3605/istio-proxy/1.log" Sep 08 04:15:59.096004 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:15:59.095980 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_openshift-ai-inference-openshift-ai-inference-5dd944c6f-6j876_e9e85fc8-3836-4b6e-9189-988a2141d478/istio-proxy/0.log" Sep 08 04:15:59.804128 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:15:59.804096 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-hjfnf_a832821c-0523-4a74-9e04-c4772b079561/serve-healthcheck-canary/0.log" Sep 08 04:16:00.378097 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:16:00.378067 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-nddv4_86e8b575-81fb-41d3-bcae-7e82bb35dc50/kube-rbac-proxy/0.log" Sep 08 04:16:00.394496 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:16:00.394470 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-nddv4_86e8b575-81fb-41d3-bcae-7e82bb35dc50/exporter/0.log" Sep 08 04:16:00.411727 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:16:00.411707 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-nddv4_86e8b575-81fb-41d3-bcae-7e82bb35dc50/extractor/0.log" Sep 08 04:16:02.713984 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:16:02.713957 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-qbfdx/perf-node-gather-daemonset-xf2fb" Sep 08 04:16:02.742745 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:16:02.742713 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub-operator-system_opendatahub-operator-controller-manager-b8484c5b8-hjvvh_003f7f61-1f4b-4d31-b819-ee986a60e12e/manager/0.log" Sep 08 04:16:02.759771 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:16:02.759738 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub-operator-system_opendatahub-operator-controller-manager-b8484c5b8-hjvvh_003f7f61-1f4b-4d31-b819-ee986a60e12e/copy-manifests/0.log" Sep 08 04:16:04.617443 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:16:04.617414 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-85d49875c6-m7sbc_f9daf336-abd8-4f65-ae0a-995cdc292116/manager/0.log" Sep 08 04:16:04.719849 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:16:04.719817 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-857c55f576-l4b6m_367577ba-f73d-401b-9642-88f7d97e37c4/manager/0.log" Sep 08 04:16:04.737900 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:16:04.737871 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-7d6487fcc8-sllvl_f02e6afd-0df0-41e1-bd43-9f0c5ded9063/server/0.log" Sep 08 04:16:04.786682 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:16:04.786653 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-bb7b75cc4-tdtdw_9b9b51ce-0d32-4e32-934c-ab278a141141/manager/0.log" Sep 08 04:16:04.845225 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:16:04.845198 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-ctn7f_7a0003c4-8989-4f28-b1f7-62ed71cfe566/istio-proxy/0.log" Sep 08 04:16:04.938322 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:16:04.938235 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-6q6cj_0fcf38d0-2136-4a43-bee3-47a0addf3605/istio-proxy/0.log" Sep 08 04:16:04.938623 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:16:04.938608 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-6q6cj_0fcf38d0-2136-4a43-bee3-47a0addf3605/istio-proxy/1.log" Sep 08 04:16:04.953933 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:16:04.953897 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_openshift-ai-inference-openshift-ai-inference-5dd944c6f-6j876_e9e85fc8-3836-4b6e-9189-988a2141d478/istio-proxy/0.log" Sep 08 04:16:06.204212 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:16:06.204184 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-ctn7f_7a0003c4-8989-4f28-b1f7-62ed71cfe566/istio-proxy/0.log" Sep 08 04:16:06.293346 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:16:06.293321 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-6q6cj_0fcf38d0-2136-4a43-bee3-47a0addf3605/istio-proxy/0.log" Sep 08 04:16:06.293531 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:16:06.293509 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-6q6cj_0fcf38d0-2136-4a43-bee3-47a0addf3605/istio-proxy/1.log" Sep 08 04:16:06.308803 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:16:06.308777 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_openshift-ai-inference-openshift-ai-inference-5dd944c6f-6j876_e9e85fc8-3836-4b6e-9189-988a2141d478/istio-proxy/0.log" Sep 08 04:16:11.044892 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:16:11.044864 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-wc8bl_d9fbef9f-7075-4727-88c9-b5feeaf043db/kube-multus-additional-cni-plugins/0.log" Sep 08 04:16:11.060539 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:16:11.060508 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-wc8bl_d9fbef9f-7075-4727-88c9-b5feeaf043db/egress-router-binary-copy/0.log" Sep 08 04:16:11.075687 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:16:11.075660 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-wc8bl_d9fbef9f-7075-4727-88c9-b5feeaf043db/cni-plugins/0.log" Sep 08 04:16:11.094395 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:16:11.094375 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-wc8bl_d9fbef9f-7075-4727-88c9-b5feeaf043db/bond-cni-plugin/0.log" Sep 08 04:16:11.110207 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:16:11.110185 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-wc8bl_d9fbef9f-7075-4727-88c9-b5feeaf043db/routeoverride-cni/0.log" Sep 08 04:16:11.125158 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:16:11.125138 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-wc8bl_d9fbef9f-7075-4727-88c9-b5feeaf043db/whereabouts-cni-bincopy/0.log" Sep 08 04:16:11.142409 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:16:11.142391 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-wc8bl_d9fbef9f-7075-4727-88c9-b5feeaf043db/whereabouts-cni/0.log" Sep 08 04:16:11.316135 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:16:11.316052 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-tbtxs_f583a7fb-d8f2-4b26-ba64-bb73e3b605c6/kube-multus/0.log" Sep 08 04:16:11.460209 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:16:11.460182 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-s2679_be017881-2b6a-4fd2-b62d-4b5d3bd7b834/network-metrics-daemon/0.log" Sep 08 04:16:11.489013 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:16:11.488983 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-s2679_be017881-2b6a-4fd2-b62d-4b5d3bd7b834/kube-rbac-proxy/0.log" Sep 08 04:16:12.468215 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:16:12.468186 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7mnct_b35366ff-994a-4635-bad2-1ba59bcc640a/ovn-controller/0.log" Sep 08 04:16:12.481050 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:16:12.481028 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7mnct_b35366ff-994a-4635-bad2-1ba59bcc640a/ovn-acl-logging/0.log" Sep 08 04:16:12.512480 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:16:12.512445 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7mnct_b35366ff-994a-4635-bad2-1ba59bcc640a/kube-rbac-proxy-node/0.log" Sep 08 04:16:12.536651 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:16:12.536626 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7mnct_b35366ff-994a-4635-bad2-1ba59bcc640a/kube-rbac-proxy-ovn-metrics/0.log" Sep 08 04:16:12.549864 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:16:12.549847 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7mnct_b35366ff-994a-4635-bad2-1ba59bcc640a/northd/0.log" Sep 08 04:16:12.565539 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:16:12.565521 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7mnct_b35366ff-994a-4635-bad2-1ba59bcc640a/nbdb/0.log" Sep 08 04:16:12.580013 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:16:12.579991 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7mnct_b35366ff-994a-4635-bad2-1ba59bcc640a/sbdb/0.log" Sep 08 04:16:12.630630 ip-10-0-128-67 kubenswrapper[2571]: I0908 04:16:12.630608 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7mnct_b35366ff-994a-4635-bad2-1ba59bcc640a/ovnkube-controller/0.log"