Jul 06 13:39:42.500459 ip-10-0-138-163 systemd[1]: Starting Kubernetes Kubelet... Jul 06 13:39:42.931692 ip-10-0-138-163 kubenswrapper[2573]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 06 13:39:42.931692 ip-10-0-138-163 kubenswrapper[2573]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 06 13:39:42.931692 ip-10-0-138-163 kubenswrapper[2573]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 06 13:39:42.931692 ip-10-0-138-163 kubenswrapper[2573]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 06 13:39:42.931692 ip-10-0-138-163 kubenswrapper[2573]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 06 13:39:42.934261 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:42.934177 2573 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 06 13:39:42.938832 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.938817 2573 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 06 13:39:42.938872 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.938834 2573 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 06 13:39:42.938872 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.938838 2573 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 06 13:39:42.938872 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.938841 2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 06 13:39:42.938872 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.938844 2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 06 13:39:42.938872 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.938846 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 06 13:39:42.938872 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.938849 2573 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 06 13:39:42.938872 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.938852 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 06 13:39:42.938872 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.938854 2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 06 13:39:42.938872 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.938857 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 06 13:39:42.938872 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.938859 2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 06 13:39:42.938872 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.938862 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 06 13:39:42.938872 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.938865 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 06 13:39:42.938872 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.938868 2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 06 13:39:42.938872 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.938870 2573 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 06 13:39:42.938872 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.938873 2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 06 13:39:42.938872 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.938877 2573 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 06 13:39:42.938872 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.938879 2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 06 13:39:42.939317 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.938883 2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 06 13:39:42.939317 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.938885 2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 06 13:39:42.939317 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.938888 2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 06 13:39:42.939317 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.938891 2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 06 13:39:42.939317 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.938894 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 06 13:39:42.939317 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.938896 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 06 13:39:42.939317 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.938899 2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 06 13:39:42.939317 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.938901 2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 06 13:39:42.939317 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.938904 2573 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 06 13:39:42.939317 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.938906 2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 06 13:39:42.939317 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.938909 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 06 13:39:42.939317 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.938911 2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 06 13:39:42.939317 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.938914 2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 06 13:39:42.939317 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.938917 2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 06 13:39:42.939317 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.938919 2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 06 13:39:42.939317 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.938921 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 06 13:39:42.939317 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.938924 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 06 13:39:42.939317 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.938926 2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 06 13:39:42.939317 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.938929 2573 feature_gate.go:328] unrecognized feature gate: Example Jul 06 13:39:42.939317 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.938931 2573 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 06 13:39:42.939820 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.938934 2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 06 13:39:42.939820 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.938937 2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 06 13:39:42.939820 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.938939 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 06 13:39:42.939820 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.938942 2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 06 13:39:42.939820 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.938944 2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 06 13:39:42.939820 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.938947 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 06 13:39:42.939820 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.938949 2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 06 13:39:42.939820 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.938951 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 06 13:39:42.939820 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.938954 2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 06 13:39:42.939820 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.938956 2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 06 13:39:42.939820 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.938959 2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 06 13:39:42.939820 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.938961 2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 06 13:39:42.939820 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.938963 2573 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 06 13:39:42.939820 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.938967 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 06 13:39:42.939820 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.938972 2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 06 13:39:42.939820 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.938976 2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 06 13:39:42.939820 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.938979 2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 06 13:39:42.939820 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.938982 2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 06 13:39:42.939820 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.938984 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 06 13:39:42.939820 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.938987 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 06 13:39:42.940345 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.938990 2573 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 06 13:39:42.940345 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.938992 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 06 13:39:42.940345 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.938995 2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 06 13:39:42.940345 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.938997 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 06 13:39:42.940345 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.939000 2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 06 13:39:42.940345 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.939003 2573 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 06 13:39:42.940345 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.939005 2573 feature_gate.go:328] unrecognized feature gate: Example2 Jul 06 13:39:42.940345 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.939008 2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 06 13:39:42.940345 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.939010 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 06 13:39:42.940345 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.939013 2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 06 13:39:42.940345 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.939015 2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 06 13:39:42.940345 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.939017 2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 06 13:39:42.940345 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.939020 2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 06 13:39:42.940345 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.939023 2573 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 06 13:39:42.940345 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.939025 2573 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 06 13:39:42.940345 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.939028 2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 06 13:39:42.940345 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.939030 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 06 13:39:42.940345 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.939049 2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 06 13:39:42.940345 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.939052 2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 06 13:39:42.940345 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.939054 2573 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 06 13:39:42.940909 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.939057 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 06 13:39:42.940909 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.939059 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 06 13:39:42.940909 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.939062 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 06 13:39:42.940909 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.939064 2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 06 13:39:42.940909 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.939067 2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 06 13:39:42.940909 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.939072 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 06 13:39:42.940909 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.939074 2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 06 13:39:42.940909 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.939077 2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 06 13:39:42.940909 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.939080 2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 06 13:39:42.940909 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.939083 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 06 13:39:42.940909 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.939085 2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 06 13:39:42.940909 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.939088 2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 06 13:39:42.940909 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.939093 2573 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 06 13:39:42.940909 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.939097 2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 06 13:39:42.940909 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.939100 2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 06 13:39:42.940909 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.939102 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 06 13:39:42.940909 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.939105 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 06 13:39:42.940909 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.939108 2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 06 13:39:42.940909 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.939111 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 06 13:39:42.941396 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.939113 2573 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 06 13:39:42.941396 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.939117 2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 06 13:39:42.941396 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.939826 2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 06 13:39:42.941396 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.939832 2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 06 13:39:42.941396 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.939835 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 06 13:39:42.941396 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.939838 2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 06 13:39:42.941396 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.939841 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 06 13:39:42.941396 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.939845 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 06 13:39:42.941396 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.939847 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 06 13:39:42.941396 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.939851 2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 06 13:39:42.941396 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.939854 2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 06 13:39:42.941396 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.939857 2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 06 13:39:42.941396 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.939860 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 06 13:39:42.941396 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.939862 2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 06 13:39:42.941396 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.939865 2573 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 06 13:39:42.941396 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.939867 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 06 13:39:42.941396 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.939870 2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 06 13:39:42.941396 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.939872 2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 06 13:39:42.941396 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.939875 2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 06 13:39:42.941396 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.939878 2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 06 13:39:42.941913 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.939880 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 06 13:39:42.941913 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.939883 2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 06 13:39:42.941913 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.939886 2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 06 13:39:42.941913 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.939888 2573 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 06 13:39:42.941913 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.939891 2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 06 13:39:42.941913 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.939893 2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 06 13:39:42.941913 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.939896 2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 06 13:39:42.941913 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.939898 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 06 13:39:42.941913 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.939901 2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 06 13:39:42.941913 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.939903 2573 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 06 13:39:42.941913 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.939906 2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 06 13:39:42.941913 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.939908 2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 06 13:39:42.941913 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.939911 2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 06 13:39:42.941913 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.939913 2573 feature_gate.go:328] unrecognized feature gate: Example Jul 06 13:39:42.941913 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.939916 2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 06 13:39:42.941913 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.939918 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 06 13:39:42.941913 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.939920 2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 06 13:39:42.941913 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.939923 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 06 13:39:42.941913 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.939926 2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 06 13:39:42.941913 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.939928 2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 06 13:39:42.942468 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.939931 2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 06 13:39:42.942468 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.939935 2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 06 13:39:42.942468 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.939939 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 06 13:39:42.942468 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.939942 2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 06 13:39:42.942468 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.939945 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 06 13:39:42.942468 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.939948 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 06 13:39:42.942468 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.939951 2573 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 06 13:39:42.942468 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.939954 2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 06 13:39:42.942468 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.939956 2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 06 13:39:42.942468 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.939959 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 06 13:39:42.942468 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.939962 2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 06 13:39:42.942468 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.939965 2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 06 13:39:42.942468 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.939968 2573 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 06 13:39:42.942468 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.939970 2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 06 13:39:42.942468 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.939972 2573 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 06 13:39:42.942468 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.939975 2573 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 06 13:39:42.942468 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.939977 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 06 13:39:42.942468 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.939981 2573 feature_gate.go:328] unrecognized feature gate: Example2 Jul 06 13:39:42.942468 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.939985 2573 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 06 13:39:42.942918 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.939988 2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 06 13:39:42.942918 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.939991 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 06 13:39:42.942918 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.939994 2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 06 13:39:42.942918 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.940014 2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 06 13:39:42.942918 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.940018 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 06 13:39:42.942918 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.940021 2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 06 13:39:42.942918 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.940024 2573 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 06 13:39:42.942918 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.940027 2573 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 06 13:39:42.942918 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.940030 2573 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 06 13:39:42.942918 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.940047 2573 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 06 13:39:42.942918 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.940052 2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 06 13:39:42.942918 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.940059 2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 06 13:39:42.942918 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.940064 2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 06 13:39:42.942918 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.940068 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 06 13:39:42.942918 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.940072 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 06 13:39:42.942918 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.940075 2573 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 06 13:39:42.942918 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.940078 2573 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 06 13:39:42.942918 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.940081 2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 06 13:39:42.942918 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.940083 2573 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 06 13:39:42.942918 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.940086 2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 06 13:39:42.943422 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.940088 2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 06 13:39:42.943422 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.940091 2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 06 13:39:42.943422 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.940094 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 06 13:39:42.943422 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.940097 2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 06 13:39:42.943422 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.940100 2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 06 13:39:42.943422 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.940102 2573 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 06 13:39:42.943422 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.940105 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 06 13:39:42.943422 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.940107 2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 06 13:39:42.943422 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.940110 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 06 13:39:42.943422 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.940112 2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 06 13:39:42.943422 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.940115 2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 06 13:39:42.943422 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.940118 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 06 13:39:42.943422 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.940120 2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 06 13:39:42.943422 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.940123 2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 06 13:39:42.943422 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.940125 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 06 13:39:42.943422 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.940128 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 06 13:39:42.943422 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.940130 2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 06 13:39:42.943422 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.940133 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 06 13:39:42.943422 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.940135 2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 06 13:39:42.943907 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.940138 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 06 13:39:42.943907 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.940140 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 06 13:39:42.943907 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.940143 2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 06 13:39:42.943907 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.940505 2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 06 13:39:42.943907 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.940509 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 06 13:39:42.943907 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.940512 2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 06 13:39:42.943907 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.940515 2573 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 06 13:39:42.943907 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.940519 2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 06 13:39:42.943907 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.940524 2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 06 13:39:42.943907 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.940527 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 06 13:39:42.943907 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.940529 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 06 13:39:42.943907 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.940532 2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 06 13:39:42.943907 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.940535 2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 06 13:39:42.943907 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.940537 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 06 13:39:42.943907 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.940539 2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 06 13:39:42.943907 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.940542 2573 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 06 13:39:42.943907 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.940546 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 06 13:39:42.943907 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.940549 2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 06 13:39:42.943907 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.940552 2573 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 06 13:39:42.943907 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.940555 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 06 13:39:42.944412 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.940557 2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 06 13:39:42.944412 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.940560 2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 06 13:39:42.944412 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.940562 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 06 13:39:42.944412 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.940565 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 06 13:39:42.944412 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.940567 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 06 13:39:42.944412 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.940570 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 06 13:39:42.944412 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.940572 2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 06 13:39:42.944412 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.940575 2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 06 13:39:42.944412 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.940579 2573 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 06 13:39:42.944412 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.940582 2573 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 06 13:39:42.944412 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.940585 2573 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 06 13:39:42.944412 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.940588 2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 06 13:39:42.944412 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.940591 2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 06 13:39:42.944412 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.940594 2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 06 13:39:42.944412 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.940597 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 06 13:39:42.944412 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.940599 2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 06 13:39:42.944412 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.940602 2573 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 06 13:39:42.944412 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.940605 2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 06 13:39:42.944412 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.940607 2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 06 13:39:42.944412 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.940610 2573 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 06 13:39:42.944887 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.940616 2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 06 13:39:42.944887 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.940619 2573 feature_gate.go:328] unrecognized feature gate: Example Jul 06 13:39:42.944887 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.940622 2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 06 13:39:42.944887 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.940624 2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 06 13:39:42.944887 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.940626 2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 06 13:39:42.944887 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.940629 2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 06 13:39:42.944887 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.940632 2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 06 13:39:42.944887 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.940634 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 06 13:39:42.944887 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.940638 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 06 13:39:42.944887 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.940641 2573 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 06 13:39:42.944887 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.940643 2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 06 13:39:42.944887 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.940646 2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 06 13:39:42.944887 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.940649 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 06 13:39:42.944887 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.940651 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 06 13:39:42.944887 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.940654 2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 06 13:39:42.944887 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.940656 2573 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 06 13:39:42.944887 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.940659 2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 06 13:39:42.944887 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.940661 2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 06 13:39:42.944887 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.940665 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 06 13:39:42.944887 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.940667 2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 06 13:39:42.945408 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.940670 2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 06 13:39:42.945408 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.940672 2573 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 06 13:39:42.945408 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.940675 2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 06 13:39:42.945408 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.940677 2573 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 06 13:39:42.945408 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.940680 2573 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 06 13:39:42.945408 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.940682 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 06 13:39:42.945408 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.940684 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 06 13:39:42.945408 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.940687 2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 06 13:39:42.945408 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.940690 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 06 13:39:42.945408 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.940692 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 06 13:39:42.945408 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.940695 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 06 13:39:42.945408 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.940697 2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 06 13:39:42.945408 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.940702 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 06 13:39:42.945408 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.940705 2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 06 13:39:42.945408 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.940707 2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 06 13:39:42.945408 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.940709 2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 06 13:39:42.945408 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.940712 2573 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 06 13:39:42.945408 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.940714 2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 06 13:39:42.945408 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.940717 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 06 13:39:42.945408 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.940719 2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 06 13:39:42.945888 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.940723 2573 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 06 13:39:42.945888 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.940726 2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 06 13:39:42.945888 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.940728 2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 06 13:39:42.945888 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.940731 2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 06 13:39:42.945888 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.940733 2573 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 06 13:39:42.945888 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.940737 2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 06 13:39:42.945888 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.940740 2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 06 13:39:42.945888 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.940743 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 06 13:39:42.945888 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.940746 2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 06 13:39:42.945888 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.940748 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 06 13:39:42.945888 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.940751 2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 06 13:39:42.945888 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.940754 2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 06 13:39:42.945888 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.940756 2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 06 13:39:42.945888 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.940759 2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 06 13:39:42.945888 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.940761 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 06 13:39:42.945888 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.940764 2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 06 13:39:42.945888 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.940767 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 06 13:39:42.945888 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.940769 2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 06 13:39:42.945888 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.940772 2573 feature_gate.go:328] unrecognized feature gate: Example2 Jul 06 13:39:42.946354 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.940775 2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 06 13:39:42.946354 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.940778 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 06 13:39:42.946354 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.940780 2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 06 13:39:42.946354 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:42.940845 2573 flags.go:64] FLAG: --address="0.0.0.0" Jul 06 13:39:42.946354 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:42.940852 2573 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 06 13:39:42.946354 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:42.940860 2573 flags.go:64] FLAG: --anonymous-auth="true" Jul 06 13:39:42.946354 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:42.940864 2573 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 06 13:39:42.946354 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:42.940869 2573 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 06 13:39:42.946354 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:42.940872 2573 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 06 13:39:42.946354 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:42.940876 2573 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 06 13:39:42.946354 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:42.940880 2573 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 06 13:39:42.946354 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:42.940883 2573 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 06 13:39:42.946354 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:42.940886 2573 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 06 13:39:42.946354 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:42.940891 2573 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 06 13:39:42.946354 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:42.940894 2573 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 06 13:39:42.946354 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:42.940897 2573 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 06 13:39:42.946354 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:42.940900 2573 flags.go:64] FLAG: --cgroup-root="" Jul 06 13:39:42.946354 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:42.940903 2573 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 06 13:39:42.946354 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:42.940906 2573 flags.go:64] FLAG: --client-ca-file="" Jul 06 13:39:42.946354 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:42.940909 2573 flags.go:64] FLAG: --cloud-provider="external" Jul 06 13:39:42.946354 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:42.940911 2573 flags.go:64] FLAG: --cluster-dns="[]" Jul 06 13:39:42.946354 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:42.940916 2573 flags.go:64] FLAG: --cluster-domain="" Jul 06 13:39:42.946354 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:42.940919 2573 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 06 13:39:42.946354 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:42.940922 2573 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 06 13:39:42.946938 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:42.940925 2573 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 06 13:39:42.946938 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:42.940928 2573 flags.go:64] FLAG: --container-log-max-files="5" Jul 06 13:39:42.946938 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:42.940932 2573 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 06 13:39:42.946938 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:42.940935 2573 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 06 13:39:42.946938 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:42.940938 2573 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 06 13:39:42.946938 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:42.940941 2573 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 06 13:39:42.946938 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:42.940943 2573 flags.go:64] FLAG: --contention-profiling="false" Jul 06 13:39:42.946938 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:42.940946 2573 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 06 13:39:42.946938 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:42.940949 2573 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 06 13:39:42.946938 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:42.940952 2573 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 06 13:39:42.946938 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:42.940955 2573 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 06 13:39:42.946938 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:42.940958 2573 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 06 13:39:42.946938 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:42.940961 2573 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 06 13:39:42.946938 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:42.940965 2573 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 06 13:39:42.946938 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:42.940968 2573 flags.go:64] FLAG: --enable-load-reader="false" Jul 06 13:39:42.946938 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:42.940971 2573 flags.go:64] FLAG: --enable-server="true" Jul 06 13:39:42.946938 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:42.940974 2573 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 06 13:39:42.946938 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:42.940978 2573 flags.go:64] FLAG: --event-burst="100" Jul 06 13:39:42.946938 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:42.940981 2573 flags.go:64] FLAG: --event-qps="50" Jul 06 13:39:42.946938 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:42.940984 2573 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 06 13:39:42.946938 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:42.940987 2573 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 06 13:39:42.946938 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:42.940991 2573 flags.go:64] FLAG: --eviction-hard="" Jul 06 13:39:42.946938 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:42.940994 2573 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 06 13:39:42.946938 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:42.940997 2573 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 06 13:39:42.947530 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:42.941000 2573 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 06 13:39:42.947530 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:42.941003 2573 flags.go:64] FLAG: --eviction-soft="" Jul 06 13:39:42.947530 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:42.941006 2573 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 06 13:39:42.947530 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:42.941009 2573 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 06 13:39:42.947530 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:42.941011 2573 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 06 13:39:42.947530 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:42.941014 2573 flags.go:64] FLAG: --experimental-mounter-path="" Jul 06 13:39:42.947530 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:42.941017 2573 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 06 13:39:42.947530 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:42.941020 2573 flags.go:64] FLAG: --fail-swap-on="true" Jul 06 13:39:42.947530 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:42.941022 2573 flags.go:64] FLAG: --feature-gates="" Jul 06 13:39:42.947530 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:42.941026 2573 flags.go:64] FLAG: --file-check-frequency="20s" Jul 06 13:39:42.947530 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:42.941029 2573 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 06 13:39:42.947530 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:42.941032 2573 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 06 13:39:42.947530 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:42.941050 2573 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 06 13:39:42.947530 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:42.941053 2573 flags.go:64] FLAG: --healthz-port="10248" Jul 06 13:39:42.947530 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:42.941056 2573 flags.go:64] FLAG: --help="false" Jul 06 13:39:42.947530 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:42.941058 2573 flags.go:64] FLAG: --hostname-override="ip-10-0-138-163.ec2.internal" Jul 06 13:39:42.947530 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:42.941061 2573 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 06 13:39:42.947530 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:42.941064 2573 flags.go:64] FLAG: --http-check-frequency="20s" Jul 06 13:39:42.947530 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:42.941067 2573 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 06 13:39:42.947530 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:42.941070 2573 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 06 13:39:42.947530 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:42.941074 2573 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 06 13:39:42.947530 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:42.941077 2573 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 06 13:39:42.947530 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:42.941080 2573 flags.go:64] FLAG: --image-service-endpoint="" Jul 06 13:39:42.948136 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:42.941083 2573 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 06 13:39:42.948136 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:42.941086 2573 flags.go:64] FLAG: --kube-api-burst="100" Jul 06 13:39:42.948136 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:42.941089 2573 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 06 13:39:42.948136 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:42.941092 2573 flags.go:64] FLAG: --kube-api-qps="50" Jul 06 13:39:42.948136 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:42.941095 2573 flags.go:64] FLAG: --kube-reserved="" Jul 06 13:39:42.948136 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:42.941098 2573 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 06 13:39:42.948136 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:42.941101 2573 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 06 13:39:42.948136 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:42.941104 2573 flags.go:64] FLAG: --kubelet-cgroups="" Jul 06 13:39:42.948136 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:42.941107 2573 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 06 13:39:42.948136 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:42.941110 2573 flags.go:64] FLAG: --lock-file="" Jul 06 13:39:42.948136 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:42.941112 2573 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 06 13:39:42.948136 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:42.941115 2573 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 06 13:39:42.948136 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:42.941118 2573 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 06 13:39:42.948136 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:42.941123 2573 flags.go:64] FLAG: --log-json-split-stream="false" Jul 06 13:39:42.948136 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:42.941126 2573 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 06 13:39:42.948136 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:42.941129 2573 flags.go:64] FLAG: --log-text-split-stream="false" Jul 06 13:39:42.948136 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:42.941132 2573 flags.go:64] FLAG: --logging-format="text" Jul 06 13:39:42.948136 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:42.941134 2573 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 06 13:39:42.948136 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:42.941138 2573 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 06 13:39:42.948136 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:42.941140 2573 flags.go:64] FLAG: --manifest-url="" Jul 06 13:39:42.948136 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:42.941143 2573 flags.go:64] FLAG: --manifest-url-header="" Jul 06 13:39:42.948136 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:42.941147 2573 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 06 13:39:42.948136 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:42.941150 2573 flags.go:64] FLAG: --max-open-files="1000000" Jul 06 13:39:42.948136 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:42.941154 2573 flags.go:64] FLAG: --max-pods="110" Jul 06 13:39:42.948136 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:42.941157 2573 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 06 13:39:42.948735 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:42.941160 2573 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 06 13:39:42.948735 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:42.941162 2573 flags.go:64] FLAG: --memory-manager-policy="None" Jul 06 13:39:42.948735 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:42.941165 2573 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 06 13:39:42.948735 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:42.941168 2573 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 06 13:39:42.948735 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:42.941171 2573 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 06 13:39:42.948735 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:42.941174 2573 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 06 13:39:42.948735 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:42.941181 2573 flags.go:64] FLAG: --node-status-max-images="50" Jul 06 13:39:42.948735 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:42.941184 2573 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 06 13:39:42.948735 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:42.941187 2573 flags.go:64] FLAG: --oom-score-adj="-999" Jul 06 13:39:42.948735 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:42.941190 2573 flags.go:64] FLAG: --pod-cidr="" Jul 06 13:39:42.948735 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:42.941194 2573 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce93f6b4197b9c62a26a3131f8057ffe9c9379c5079a4f62e5919b75151394e5" Jul 06 13:39:42.948735 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:42.941199 2573 flags.go:64] FLAG: --pod-manifest-path="" Jul 06 13:39:42.948735 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:42.941201 2573 flags.go:64] FLAG: --pod-max-pids="-1" Jul 06 13:39:42.948735 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:42.941204 2573 flags.go:64] FLAG: --pods-per-core="0" Jul 06 13:39:42.948735 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:42.941207 2573 flags.go:64] FLAG: --port="10250" Jul 06 13:39:42.948735 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:42.941211 2573 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 06 13:39:42.948735 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:42.941214 2573 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-06ae121016d1a1af9" Jul 06 13:39:42.948735 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:42.941217 2573 flags.go:64] FLAG: --qos-reserved="" Jul 06 13:39:42.948735 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:42.941219 2573 flags.go:64] FLAG: --read-only-port="10255" Jul 06 13:39:42.948735 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:42.941223 2573 flags.go:64] FLAG: --register-node="true" Jul 06 13:39:42.948735 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:42.941225 2573 flags.go:64] FLAG: --register-with-taints="" Jul 06 13:39:42.948735 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:42.941229 2573 flags.go:64] FLAG: --registry-burst="10" Jul 06 13:39:42.948735 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:42.941232 2573 flags.go:64] FLAG: --registry-qps="5" Jul 06 13:39:42.948735 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:42.941234 2573 flags.go:64] FLAG: --reserved-cpus="" Jul 06 13:39:42.949336 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:42.941237 2573 flags.go:64] FLAG: --reserved-memory="" Jul 06 13:39:42.949336 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:42.941240 2573 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 06 13:39:42.949336 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:42.941243 2573 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 06 13:39:42.949336 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:42.941246 2573 flags.go:64] FLAG: --rotate-certificates="false" Jul 06 13:39:42.949336 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:42.941249 2573 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 06 13:39:42.949336 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:42.941252 2573 flags.go:64] FLAG: --runonce="false" Jul 06 13:39:42.949336 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:42.941255 2573 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 06 13:39:42.949336 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:42.941258 2573 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 06 13:39:42.949336 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:42.941262 2573 flags.go:64] FLAG: --seccomp-default="false" Jul 06 13:39:42.949336 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:42.941264 2573 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 06 13:39:42.949336 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:42.941267 2573 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 06 13:39:42.949336 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:42.941270 2573 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 06 13:39:42.949336 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:42.941274 2573 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 06 13:39:42.949336 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:42.941277 2573 flags.go:64] FLAG: --storage-driver-password="root" Jul 06 13:39:42.949336 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:42.941280 2573 flags.go:64] FLAG: --storage-driver-secure="false" Jul 06 13:39:42.949336 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:42.941282 2573 flags.go:64] FLAG: --storage-driver-table="stats" Jul 06 13:39:42.949336 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:42.941285 2573 flags.go:64] FLAG: --storage-driver-user="root" Jul 06 13:39:42.949336 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:42.941288 2573 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 06 13:39:42.949336 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:42.941291 2573 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 06 13:39:42.949336 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:42.941294 2573 flags.go:64] FLAG: --system-cgroups="" Jul 06 13:39:42.949336 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:42.941297 2573 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 06 13:39:42.949336 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:42.941302 2573 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 06 13:39:42.949336 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:42.941305 2573 flags.go:64] FLAG: --tls-cert-file="" Jul 06 13:39:42.949336 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:42.941307 2573 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 06 13:39:42.949336 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:42.941312 2573 flags.go:64] FLAG: --tls-min-version="" Jul 06 13:39:42.949942 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:42.941314 2573 flags.go:64] FLAG: --tls-private-key-file="" Jul 06 13:39:42.949942 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:42.941317 2573 flags.go:64] FLAG: --topology-manager-policy="none" Jul 06 13:39:42.949942 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:42.941320 2573 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 06 13:39:42.949942 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:42.941322 2573 flags.go:64] FLAG: --topology-manager-scope="container" Jul 06 13:39:42.949942 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:42.941325 2573 flags.go:64] FLAG: --v="2" Jul 06 13:39:42.949942 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:42.941328 2573 flags.go:64] FLAG: --version="false" Jul 06 13:39:42.949942 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:42.941332 2573 flags.go:64] FLAG: --vmodule="" Jul 06 13:39:42.949942 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:42.941336 2573 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 06 13:39:42.949942 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:42.941339 2573 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 06 13:39:42.949942 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.941457 2573 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 06 13:39:42.949942 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.941460 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 06 13:39:42.949942 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.941464 2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 06 13:39:42.949942 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.941467 2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 06 13:39:42.949942 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.941470 2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 06 13:39:42.949942 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.941472 2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 06 13:39:42.949942 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.941475 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 06 13:39:42.949942 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.941477 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 06 13:39:42.949942 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.941480 2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 06 13:39:42.949942 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.941482 2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 06 13:39:42.949942 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.941485 2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 06 13:39:42.949942 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.941489 2573 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 06 13:39:42.949942 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.941492 2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 06 13:39:42.950672 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.941494 2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 06 13:39:42.950672 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.941497 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 06 13:39:42.950672 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.941499 2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 06 13:39:42.950672 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.941503 2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 06 13:39:42.950672 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.941505 2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 06 13:39:42.950672 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.941509 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 06 13:39:42.950672 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.941511 2573 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 06 13:39:42.950672 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.941514 2573 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 06 13:39:42.950672 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.941516 2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 06 13:39:42.950672 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.941519 2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 06 13:39:42.950672 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.941521 2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 06 13:39:42.950672 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.941524 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 06 13:39:42.950672 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.941526 2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 06 13:39:42.950672 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.941529 2573 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 06 13:39:42.950672 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.941533 2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 06 13:39:42.950672 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.941536 2573 feature_gate.go:328] unrecognized feature gate: Example Jul 06 13:39:42.950672 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.941539 2573 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 06 13:39:42.950672 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.941542 2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 06 13:39:42.950672 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.941545 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 06 13:39:42.950672 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.941548 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 06 13:39:42.951409 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.941550 2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 06 13:39:42.951409 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.941555 2573 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 06 13:39:42.951409 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.941558 2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 06 13:39:42.951409 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.941561 2573 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 06 13:39:42.951409 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.941564 2573 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 06 13:39:42.951409 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.941567 2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 06 13:39:42.951409 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.941570 2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 06 13:39:42.951409 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.941572 2573 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 06 13:39:42.951409 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.941575 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 06 13:39:42.951409 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.941578 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 06 13:39:42.951409 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.941581 2573 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 06 13:39:42.951409 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.941584 2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 06 13:39:42.951409 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.941586 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 06 13:39:42.951409 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.941589 2573 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 06 13:39:42.951409 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.941592 2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 06 13:39:42.951409 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.941595 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 06 13:39:42.951409 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.941598 2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 06 13:39:42.951409 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.941600 2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 06 13:39:42.951409 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.941603 2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 06 13:39:42.951957 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.941607 2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 06 13:39:42.951957 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.941610 2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 06 13:39:42.951957 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.941612 2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 06 13:39:42.951957 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.941615 2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 06 13:39:42.951957 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.941618 2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 06 13:39:42.951957 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.941620 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 06 13:39:42.951957 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.941623 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 06 13:39:42.951957 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.941625 2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 06 13:39:42.951957 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.941627 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 06 13:39:42.951957 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.941630 2573 feature_gate.go:328] unrecognized feature gate: Example2 Jul 06 13:39:42.951957 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.941633 2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 06 13:39:42.951957 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.941635 2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 06 13:39:42.951957 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.941638 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 06 13:39:42.951957 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.941641 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 06 13:39:42.951957 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.941643 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 06 13:39:42.951957 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.941646 2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 06 13:39:42.951957 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.941648 2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 06 13:39:42.951957 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.941651 2573 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 06 13:39:42.951957 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.941653 2573 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 06 13:39:42.952445 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.941655 2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 06 13:39:42.952445 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.941658 2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 06 13:39:42.952445 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.941661 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 06 13:39:42.952445 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.941663 2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 06 13:39:42.952445 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.941668 2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 06 13:39:42.952445 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.941670 2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 06 13:39:42.952445 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.941673 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 06 13:39:42.952445 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.941675 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 06 13:39:42.952445 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.941678 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 06 13:39:42.952445 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.941682 2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 06 13:39:42.952445 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.941685 2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 06 13:39:42.952445 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.941687 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 06 13:39:42.952445 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.941690 2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 06 13:39:42.952445 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.941693 2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 06 13:39:42.952445 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.941695 2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 06 13:39:42.952445 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.941698 2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 06 13:39:42.952445 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.941700 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 06 13:39:42.952445 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.941703 2573 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 06 13:39:42.952445 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.941705 2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 06 13:39:42.952445 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.941708 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 06 13:39:42.952941 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.941710 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 06 13:39:42.952941 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.941713 2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 06 13:39:42.952941 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.941715 2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 06 13:39:42.952941 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.941717 2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 06 13:39:42.952941 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.941720 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 06 13:39:42.952941 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.941722 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 06 13:39:42.952941 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.941724 2573 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 06 13:39:42.952941 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.941727 2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 06 13:39:42.952941 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:42.942339 2573 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 06 13:39:42.952941 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:42.949290 2573 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jul 06 13:39:42.952941 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:42.949303 2573 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 06 13:39:42.952941 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:42.949324 2573 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 06 13:39:42.952941 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:42.949330 2573 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 06 13:39:42.952941 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.949384 2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 06 13:39:42.952941 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.949389 2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 06 13:39:42.953324 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.949394 2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 06 13:39:42.953324 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.949398 2573 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 06 13:39:42.953324 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.949401 2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 06 13:39:42.953324 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.949404 2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 06 13:39:42.953324 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.949406 2573 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 06 13:39:42.953324 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.949409 2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 06 13:39:42.953324 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.949412 2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 06 13:39:42.953324 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.949414 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 06 13:39:42.953324 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.949417 2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 06 13:39:42.953324 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.949420 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 06 13:39:42.953324 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.949422 2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 06 13:39:42.953324 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.949426 2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 06 13:39:42.953324 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.949428 2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 06 13:39:42.953324 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.949431 2573 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 06 13:39:42.953324 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.949434 2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 06 13:39:42.953324 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.949436 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 06 13:39:42.953324 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.949439 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 06 13:39:42.953324 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.949442 2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 06 13:39:42.953324 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.949444 2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 06 13:39:42.953772 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.949447 2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 06 13:39:42.953772 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.949449 2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 06 13:39:42.953772 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.949451 2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 06 13:39:42.953772 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.949454 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 06 13:39:42.953772 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.949457 2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 06 13:39:42.953772 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.949459 2573 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 06 13:39:42.953772 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.949462 2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 06 13:39:42.953772 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.949464 2573 feature_gate.go:328] unrecognized feature gate: Example2 Jul 06 13:39:42.953772 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.949468 2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 06 13:39:42.953772 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.949471 2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 06 13:39:42.953772 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.949473 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 06 13:39:42.953772 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.949476 2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 06 13:39:42.953772 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.949478 2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 06 13:39:42.953772 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.949481 2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 06 13:39:42.953772 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.949484 2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 06 13:39:42.953772 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.949486 2573 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 06 13:39:42.953772 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.949489 2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 06 13:39:42.953772 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.949492 2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 06 13:39:42.953772 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.949494 2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 06 13:39:42.953772 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.949496 2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 06 13:39:42.954340 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.949500 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 06 13:39:42.954340 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.949502 2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 06 13:39:42.954340 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.949505 2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 06 13:39:42.954340 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.949507 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 06 13:39:42.954340 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.949510 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 06 13:39:42.954340 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.949513 2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 06 13:39:42.954340 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.949516 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 06 13:39:42.954340 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.949518 2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 06 13:39:42.954340 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.949521 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 06 13:39:42.954340 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.949524 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 06 13:39:42.954340 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.949526 2573 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 06 13:39:42.954340 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.949529 2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 06 13:39:42.954340 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.949532 2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 06 13:39:42.954340 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.949534 2573 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 06 13:39:42.954340 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.949536 2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 06 13:39:42.954340 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.949539 2573 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 06 13:39:42.954340 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.949541 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 06 13:39:42.954340 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.949544 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 06 13:39:42.954340 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.949546 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 06 13:39:42.954340 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.949548 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 06 13:39:42.954828 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.949552 2573 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 06 13:39:42.954828 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.949554 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 06 13:39:42.954828 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.949557 2573 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 06 13:39:42.954828 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.949560 2573 feature_gate.go:328] unrecognized feature gate: Example Jul 06 13:39:42.954828 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.949562 2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 06 13:39:42.954828 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.949565 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 06 13:39:42.954828 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.949567 2573 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 06 13:39:42.954828 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.949570 2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 06 13:39:42.954828 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.949572 2573 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 06 13:39:42.954828 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.949575 2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 06 13:39:42.954828 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.949577 2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 06 13:39:42.954828 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.949579 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 06 13:39:42.954828 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.949582 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 06 13:39:42.954828 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.949584 2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 06 13:39:42.954828 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.949587 2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 06 13:39:42.954828 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.949589 2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 06 13:39:42.954828 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.949592 2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 06 13:39:42.954828 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.949594 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 06 13:39:42.954828 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.949597 2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 06 13:39:42.954828 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.949601 2573 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 06 13:39:42.955343 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.949604 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 06 13:39:42.955343 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.949608 2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 06 13:39:42.955343 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.949611 2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 06 13:39:42.955343 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.949614 2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 06 13:39:42.955343 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.949617 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 06 13:39:42.955343 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.949620 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 06 13:39:42.955343 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.949622 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 06 13:39:42.955343 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.949625 2573 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 06 13:39:42.955343 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.949627 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 06 13:39:42.955343 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.949630 2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 06 13:39:42.955343 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.949632 2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 06 13:39:42.955343 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.949634 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 06 13:39:42.955343 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.949637 2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 06 13:39:42.955343 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.949640 2573 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 06 13:39:42.955343 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.949642 2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 06 13:39:42.955343 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.949645 2573 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 06 13:39:42.955343 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.949648 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 06 13:39:42.955343 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.949650 2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 06 13:39:42.955782 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:42.949655 2573 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 06 13:39:42.955782 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.949764 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 06 13:39:42.955782 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.949768 2573 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 06 13:39:42.955782 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.949771 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 06 13:39:42.955782 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.949773 2573 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 06 13:39:42.955782 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.949776 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 06 13:39:42.955782 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.949779 2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 06 13:39:42.955782 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.949781 2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 06 13:39:42.955782 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.949784 2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 06 13:39:42.955782 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.949786 2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 06 13:39:42.955782 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.949789 2573 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 06 13:39:42.955782 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.949792 2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 06 13:39:42.955782 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.949794 2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 06 13:39:42.955782 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.949797 2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 06 13:39:42.955782 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.949800 2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 06 13:39:42.956167 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.949802 2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 06 13:39:42.956167 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.949805 2573 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 06 13:39:42.956167 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.949807 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 06 13:39:42.956167 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.949810 2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 06 13:39:42.956167 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.949812 2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 06 13:39:42.956167 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.949815 2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 06 13:39:42.956167 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.949817 2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 06 13:39:42.956167 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.949820 2573 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 06 13:39:42.956167 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.949822 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 06 13:39:42.956167 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.949825 2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 06 13:39:42.956167 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.949827 2573 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 06 13:39:42.956167 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.949829 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 06 13:39:42.956167 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.949832 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 06 13:39:42.956167 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.949834 2573 feature_gate.go:328] unrecognized feature gate: Example2 Jul 06 13:39:42.956167 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.949837 2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 06 13:39:42.956167 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.949840 2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 06 13:39:42.956167 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.949842 2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 06 13:39:42.956167 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.949844 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 06 13:39:42.956167 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.949847 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 06 13:39:42.956167 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.949849 2573 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 06 13:39:42.956657 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.949852 2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 06 13:39:42.956657 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.949856 2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 06 13:39:42.956657 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.949859 2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 06 13:39:42.956657 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.949862 2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 06 13:39:42.956657 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.949865 2573 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 06 13:39:42.956657 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.949868 2573 feature_gate.go:328] unrecognized feature gate: Example Jul 06 13:39:42.956657 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.949871 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 06 13:39:42.956657 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.949873 2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 06 13:39:42.956657 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.949876 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 06 13:39:42.956657 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.949879 2573 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 06 13:39:42.956657 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.949882 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 06 13:39:42.956657 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.949885 2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 06 13:39:42.956657 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.949888 2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 06 13:39:42.956657 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.949890 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 06 13:39:42.956657 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.949893 2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 06 13:39:42.956657 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.949895 2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 06 13:39:42.956657 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.949898 2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 06 13:39:42.956657 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.949900 2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 06 13:39:42.956657 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.949903 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 06 13:39:42.956657 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.949905 2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 06 13:39:42.957171 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.949908 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 06 13:39:42.957171 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.949910 2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 06 13:39:42.957171 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.949914 2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 06 13:39:42.957171 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.949917 2573 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 06 13:39:42.957171 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.949920 2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 06 13:39:42.957171 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.949923 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 06 13:39:42.957171 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.949925 2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 06 13:39:42.957171 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.949928 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 06 13:39:42.957171 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.949930 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 06 13:39:42.957171 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.949933 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 06 13:39:42.957171 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.949936 2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 06 13:39:42.957171 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.949938 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 06 13:39:42.957171 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.949940 2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 06 13:39:42.957171 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.949943 2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 06 13:39:42.957171 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.949946 2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 06 13:39:42.957171 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.949948 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 06 13:39:42.957171 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.949951 2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 06 13:39:42.957171 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.949954 2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 06 13:39:42.957171 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.949956 2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 06 13:39:42.957622 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.949959 2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 06 13:39:42.957622 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.949961 2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 06 13:39:42.957622 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.949963 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 06 13:39:42.957622 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.949966 2573 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 06 13:39:42.957622 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.949969 2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 06 13:39:42.957622 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.949972 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 06 13:39:42.957622 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.949974 2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 06 13:39:42.957622 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.949976 2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 06 13:39:42.957622 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.949979 2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 06 13:39:42.957622 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.949982 2573 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 06 13:39:42.957622 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.949985 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 06 13:39:42.957622 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.949987 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 06 13:39:42.957622 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.949991 2573 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 06 13:39:42.957622 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.949994 2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 06 13:39:42.957622 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.949997 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 06 13:39:42.957622 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.950000 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 06 13:39:42.957622 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.950003 2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 06 13:39:42.957622 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.950005 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 06 13:39:42.957622 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.950008 2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 06 13:39:42.957622 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.950010 2573 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 06 13:39:42.958108 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.950013 2573 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 06 13:39:42.958108 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.950015 2573 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 06 13:39:42.958108 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.950018 2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 06 13:39:42.958108 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.950020 2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 06 13:39:42.958108 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.950023 2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 06 13:39:42.958108 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:42.950025 2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 06 13:39:42.958108 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:42.950030 2573 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 06 13:39:42.958108 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:42.950138 2573 server.go:962] "Client rotation is on, will bootstrap in background" Jul 06 13:39:42.958108 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:42.952935 2573 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 06 13:39:42.958108 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:42.954174 2573 server.go:1019] "Starting client certificate rotation" Jul 06 13:39:42.958108 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:42.954269 2573 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 06 13:39:42.958108 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:42.955143 2573 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 06 13:39:42.958108 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:42.956748 2573 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 06 13:39:42.958426 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:42.957873 2573 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 06 13:39:42.965662 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:42.965646 2573 log.go:25] "Validated CRI v1 runtime API" Jul 06 13:39:42.967624 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:42.967608 2573 log.go:25] "Validated CRI v1 image API" Jul 06 13:39:42.968427 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:42.968412 2573 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 06 13:39:42.970843 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:42.970825 2573 fs.go:135] Filesystem UUIDs: map[22c29e5e-f248-408a-9fd5-26be3a2a9b9f:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 b21730ae-8a37-4499-96dd-76d1ce17a16e:/dev/nvme0n1p4] Jul 06 13:39:42.970898 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:42.970842 2573 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 06 13:39:42.975407 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:42.975305 2573 manager.go:216] Machine: {Timestamp:2026-07-06 13:39:42.974810543 +0000 UTC m=+0.351409494 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099696 MemoryCapacity:33164492800 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec20a59c196ea139080dca44ca685828 SystemUUID:ec20a59c-196e-a139-080d-ca44ca685828 BootID:74316b3a-21f1-4703-82e0-b2faf9796c1e Filesystems:[{Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:05:f3:78:9c:dd Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:05:f3:78:9c:dd Speed:0 Mtu:9001} {Name:ovs-system MacAddress:a2:b1:a5:6e:20:a9 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164492800 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 06 13:39:42.975407 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:42.975398 2573 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 06 13:39:42.975542 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:42.975467 2573 manager.go:232] Version: {KernelVersion:5.14.0-570.125.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260630-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 06 13:39:42.977011 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:42.976985 2573 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 06 13:39:42.977165 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:42.977013 2573 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-138-163.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 06 13:39:42.977922 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:42.977912 2573 topology_manager.go:138] "Creating topology manager with none policy" Jul 06 13:39:42.977953 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:42.977924 2573 container_manager_linux.go:309] "Creating device plugin manager" Jul 06 13:39:42.977953 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:42.977931 2573 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 06 13:39:42.979464 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:42.979452 2573 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 06 13:39:42.981307 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:42.981296 2573 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 06 13:39:42.987087 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:42.987068 2573 state_mem.go:36] "Initialized new in-memory state store" Jul 06 13:39:42.987378 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:42.987367 2573 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 06 13:39:42.987410 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:42.987401 2573 kubelet.go:486] "Attempting to sync node with API server" Jul 06 13:39:42.987437 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:42.987411 2573 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 06 13:39:42.987437 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:42.987426 2573 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 06 13:39:42.987437 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:42.987436 2573 kubelet.go:398] "Adding apiserver pod source" Jul 06 13:39:42.987534 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:42.987445 2573 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 06 13:39:42.987790 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:42.987777 2573 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 06 13:39:42.987838 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:42.987815 2573 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 06 13:39:42.988366 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:42.988352 2573 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 06 13:39:42.990446 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:42.990430 2573 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jul 06 13:39:42.992488 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:42.992476 2573 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 06 13:39:42.992540 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:42.992505 2573 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 06 13:39:42.993826 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:42.993814 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 06 13:39:42.993885 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:42.993829 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 06 13:39:42.993885 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:42.993836 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 06 13:39:42.993885 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:42.993841 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 06 13:39:42.993885 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:42.993850 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 06 13:39:42.993885 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:42.993855 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 06 13:39:42.993885 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:42.993864 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 06 13:39:42.993885 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:42.993869 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 06 13:39:42.993885 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:42.993876 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 06 13:39:42.993885 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:42.993881 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 06 13:39:42.994138 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:42.993894 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 06 13:39:42.994138 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:42.993900 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 06 13:39:42.995182 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:42.995173 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 06 13:39:42.995182 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:42.995182 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 06 13:39:42.998248 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:42.998228 2573 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-138-163.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 06 13:39:42.998248 ip-10-0-138-163 kubenswrapper[2573]: E0706 13:39:42.998231 2573 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-138-163.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 06 13:39:42.998374 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:42.998264 2573 server.go:1268] "Started kubelet" Jul 06 13:39:42.998374 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:42.998304 2573 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 06 13:39:42.998437 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:42.998385 2573 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 06 13:39:42.998471 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:42.998452 2573 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 06 13:39:42.998712 ip-10-0-138-163 kubenswrapper[2573]: E0706 13:39:42.998682 2573 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 06 13:39:42.999228 ip-10-0-138-163 systemd[1]: Started Kubernetes Kubelet. Jul 06 13:39:43.000241 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:43.000228 2573 server.go:310] "Adding debug handlers to kubelet server" Jul 06 13:39:43.000590 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:43.000572 2573 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 06 13:39:43.003989 ip-10-0-138-163 kubenswrapper[2573]: E0706 13:39:43.003973 2573 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 06 13:39:43.007519 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:43.007503 2573 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 06 13:39:43.007519 ip-10-0-138-163 kubenswrapper[2573]: E0706 13:39:43.006669 2573 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-163.ec2.internal.18bfb6fed0836dce default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-163.ec2.internal,UID:ip-10-0-138-163.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-138-163.ec2.internal,},FirstTimestamp:2026-07-06 13:39:42.99822843 +0000 UTC m=+0.374827382,LastTimestamp:2026-07-06 13:39:42.99822843 +0000 UTC m=+0.374827382,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-163.ec2.internal,}" Jul 06 13:39:43.007665 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:43.007521 2573 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 06 13:39:43.007665 ip-10-0-138-163 kubenswrapper[2573]: E0706 13:39:43.007580 2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-163.ec2.internal\" not found" Jul 06 13:39:43.008090 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:43.008073 2573 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 06 13:39:43.008090 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:43.008074 2573 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 06 13:39:43.008241 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:43.008098 2573 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 06 13:39:43.008241 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:43.008206 2573 reconstruct.go:97] "Volume reconstruction finished" Jul 06 13:39:43.008241 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:43.008213 2573 reconciler.go:29] "Reconciler: start to sync state" Jul 06 13:39:43.008559 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:43.008542 2573 factory.go:153] Registering CRI-O factory Jul 06 13:39:43.008632 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:43.008562 2573 factory.go:223] Registration of the crio container factory successfully Jul 06 13:39:43.008632 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:43.008613 2573 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 06 13:39:43.008632 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:43.008622 2573 factory.go:55] Registering systemd factory Jul 06 13:39:43.008632 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:43.008628 2573 factory.go:223] Registration of the systemd container factory successfully Jul 06 13:39:43.008846 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:43.008650 2573 factory.go:103] Registering Raw factory Jul 06 13:39:43.008846 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:43.008668 2573 manager.go:1196] Started watching for new ooms in manager Jul 06 13:39:43.009817 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:43.009795 2573 manager.go:349] Starting recovery of all containers Jul 06 13:39:43.021073 ip-10-0-138-163 kubenswrapper[2573]: E0706 13:39:43.020935 2573 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 06 13:39:43.021073 ip-10-0-138-163 kubenswrapper[2573]: E0706 13:39:43.020973 2573 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-138-163.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 06 13:39:43.021656 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:43.021637 2573 manager.go:354] Recovery completed Jul 06 13:39:43.026094 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:43.026082 2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 13:39:43.027921 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:43.027899 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-163.ec2.internal" event="NodeHasSufficientMemory" Jul 06 13:39:43.027976 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:43.027936 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-163.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 13:39:43.027976 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:43.027949 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-163.ec2.internal" event="NodeHasSufficientPID" Jul 06 13:39:43.028420 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:43.028403 2573 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 06 13:39:43.028420 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:43.028419 2573 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 06 13:39:43.028526 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:43.028425 2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 13:39:43.028526 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:43.028437 2573 state_mem.go:36] "Initialized new in-memory state store" Jul 06 13:39:43.029021 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:43.029008 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-163.ec2.internal" event="NodeHasSufficientMemory" Jul 06 13:39:43.029094 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:43.029051 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-163.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 13:39:43.029094 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:43.029068 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-163.ec2.internal" event="NodeHasSufficientPID" Jul 06 13:39:43.030425 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:43.030414 2573 policy_none.go:49] "None policy: Start" Jul 06 13:39:43.030485 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:43.030429 2573 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 06 13:39:43.030485 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:43.030440 2573 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 06 13:39:43.032136 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:43.032125 2573 policy_none.go:47] "Start" Jul 06 13:39:43.039076 ip-10-0-138-163 kubenswrapper[2573]: E0706 13:39:43.038980 2573 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-163.ec2.internal.18bfb6fed24881d4 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-163.ec2.internal,UID:ip-10-0-138-163.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-138-163.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-138-163.ec2.internal,},FirstTimestamp:2026-07-06 13:39:43.027921364 +0000 UTC m=+0.404520314,LastTimestamp:2026-07-06 13:39:43.027921364 +0000 UTC m=+0.404520314,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-163.ec2.internal,}" Jul 06 13:39:43.039433 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:43.039411 2573 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-6vjl7" Jul 06 13:39:43.045515 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:43.045498 2573 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-6vjl7" Jul 06 13:39:43.047149 ip-10-0-138-163 kubenswrapper[2573]: E0706 13:39:43.047090 2573 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-163.ec2.internal.18bfb6fed248d95c default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-163.ec2.internal,UID:ip-10-0-138-163.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-138-163.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-138-163.ec2.internal,},FirstTimestamp:2026-07-06 13:39:43.027943772 +0000 UTC m=+0.404542723,LastTimestamp:2026-07-06 13:39:43.027943772 +0000 UTC m=+0.404542723,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-163.ec2.internal,}" Jul 06 13:39:43.074767 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:43.074750 2573 manager.go:337] "Starting Device Plugin manager" Jul 06 13:39:43.074849 ip-10-0-138-163 kubenswrapper[2573]: E0706 13:39:43.074783 2573 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 06 13:39:43.074849 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:43.074793 2573 server.go:87] "Starting device plugin registration server" Jul 06 13:39:43.075068 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:43.075055 2573 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 06 13:39:43.075161 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:43.075069 2573 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 06 13:39:43.075224 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:43.075171 2573 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 06 13:39:43.075275 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:43.075260 2573 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 06 13:39:43.075275 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:43.075269 2573 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 06 13:39:43.075822 ip-10-0-138-163 kubenswrapper[2573]: E0706 13:39:43.075798 2573 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 06 13:39:43.075927 ip-10-0-138-163 kubenswrapper[2573]: E0706 13:39:43.075857 2573 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-138-163.ec2.internal\" not found" Jul 06 13:39:43.154250 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:43.154206 2573 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 06 13:39:43.155890 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:43.155487 2573 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 06 13:39:43.155890 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:43.155527 2573 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 06 13:39:43.155890 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:43.155551 2573 kubelet.go:2448] "Starting kubelet main sync loop" Jul 06 13:39:43.155890 ip-10-0-138-163 kubenswrapper[2573]: E0706 13:39:43.155591 2573 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 06 13:39:43.158841 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:43.158824 2573 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 06 13:39:43.175448 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:43.175431 2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 13:39:43.177089 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:43.177064 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-163.ec2.internal" event="NodeHasSufficientMemory" Jul 06 13:39:43.177206 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:43.177122 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-163.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 13:39:43.177206 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:43.177149 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-163.ec2.internal" event="NodeHasSufficientPID" Jul 06 13:39:43.177206 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:43.177182 2573 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-138-163.ec2.internal" Jul 06 13:39:43.188199 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:43.188150 2573 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-138-163.ec2.internal" Jul 06 13:39:43.188199 ip-10-0-138-163 kubenswrapper[2573]: E0706 13:39:43.188179 2573 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-138-163.ec2.internal\": node \"ip-10-0-138-163.ec2.internal\" not found" Jul 06 13:39:43.225844 ip-10-0-138-163 kubenswrapper[2573]: E0706 13:39:43.225819 2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-163.ec2.internal\" not found" Jul 06 13:39:43.257818 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:43.257191 2573 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-163.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-138-163.ec2.internal"] Jul 06 13:39:43.257937 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:43.257855 2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 13:39:43.258816 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:43.258800 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-163.ec2.internal" event="NodeHasSufficientMemory" Jul 06 13:39:43.258915 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:43.258829 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-163.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 13:39:43.258915 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:43.258842 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-163.ec2.internal" event="NodeHasSufficientPID" Jul 06 13:39:43.260214 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:43.260199 2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 13:39:43.260322 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:43.260305 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-163.ec2.internal" Jul 06 13:39:43.260380 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:43.260349 2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 13:39:43.260954 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:43.260938 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-163.ec2.internal" event="NodeHasSufficientMemory" Jul 06 13:39:43.261035 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:43.260965 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-163.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 13:39:43.261035 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:43.260982 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-163.ec2.internal" event="NodeHasSufficientPID" Jul 06 13:39:43.261143 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:43.261063 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-163.ec2.internal" event="NodeHasSufficientMemory" Jul 06 13:39:43.261143 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:43.261085 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-163.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 13:39:43.261143 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:43.261095 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-163.ec2.internal" event="NodeHasSufficientPID" Jul 06 13:39:43.262232 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:43.262215 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-163.ec2.internal" Jul 06 13:39:43.262326 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:43.262242 2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 13:39:43.262923 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:43.262896 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-163.ec2.internal" event="NodeHasSufficientMemory" Jul 06 13:39:43.262923 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:43.262926 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-163.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 13:39:43.263079 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:43.262940 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-163.ec2.internal" event="NodeHasSufficientPID" Jul 06 13:39:43.277668 ip-10-0-138-163 kubenswrapper[2573]: E0706 13:39:43.277644 2573 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-138-163.ec2.internal\" not found" node="ip-10-0-138-163.ec2.internal" Jul 06 13:39:43.281227 ip-10-0-138-163 kubenswrapper[2573]: E0706 13:39:43.281211 2573 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-138-163.ec2.internal\" not found" node="ip-10-0-138-163.ec2.internal" Jul 06 13:39:43.309698 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:43.309678 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ad032e325f69035c6ca1e0e6476b91fe-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-163.ec2.internal\" (UID: \"ad032e325f69035c6ca1e0e6476b91fe\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-163.ec2.internal" Jul 06 13:39:43.309795 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:43.309706 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ad032e325f69035c6ca1e0e6476b91fe-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-163.ec2.internal\" (UID: \"ad032e325f69035c6ca1e0e6476b91fe\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-163.ec2.internal" Jul 06 13:39:43.309795 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:43.309724 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/e455a0f97ea051574dbd820a3603ff90-config\") pod \"kube-apiserver-proxy-ip-10-0-138-163.ec2.internal\" (UID: \"e455a0f97ea051574dbd820a3603ff90\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-163.ec2.internal" Jul 06 13:39:43.326845 ip-10-0-138-163 kubenswrapper[2573]: E0706 13:39:43.326822 2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-163.ec2.internal\" not found" Jul 06 13:39:43.410192 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:43.410163 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ad032e325f69035c6ca1e0e6476b91fe-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-163.ec2.internal\" (UID: \"ad032e325f69035c6ca1e0e6476b91fe\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-163.ec2.internal" Jul 06 13:39:43.410323 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:43.410170 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ad032e325f69035c6ca1e0e6476b91fe-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-163.ec2.internal\" (UID: \"ad032e325f69035c6ca1e0e6476b91fe\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-163.ec2.internal" Jul 06 13:39:43.410323 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:43.410228 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ad032e325f69035c6ca1e0e6476b91fe-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-163.ec2.internal\" (UID: \"ad032e325f69035c6ca1e0e6476b91fe\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-163.ec2.internal" Jul 06 13:39:43.410323 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:43.410248 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/e455a0f97ea051574dbd820a3603ff90-config\") pod \"kube-apiserver-proxy-ip-10-0-138-163.ec2.internal\" (UID: \"e455a0f97ea051574dbd820a3603ff90\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-163.ec2.internal" Jul 06 13:39:43.410323 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:43.410283 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/e455a0f97ea051574dbd820a3603ff90-config\") pod \"kube-apiserver-proxy-ip-10-0-138-163.ec2.internal\" (UID: \"e455a0f97ea051574dbd820a3603ff90\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-163.ec2.internal" Jul 06 13:39:43.410323 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:43.410301 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ad032e325f69035c6ca1e0e6476b91fe-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-163.ec2.internal\" (UID: \"ad032e325f69035c6ca1e0e6476b91fe\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-163.ec2.internal" Jul 06 13:39:43.427199 ip-10-0-138-163 kubenswrapper[2573]: E0706 13:39:43.427172 2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-163.ec2.internal\" not found" Jul 06 13:39:43.528523 ip-10-0-138-163 kubenswrapper[2573]: E0706 13:39:43.528441 2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-163.ec2.internal\" not found" Jul 06 13:39:43.586010 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:43.585986 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-163.ec2.internal" Jul 06 13:39:43.586010 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:43.586004 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-163.ec2.internal" Jul 06 13:39:43.629258 ip-10-0-138-163 kubenswrapper[2573]: E0706 13:39:43.629225 2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-163.ec2.internal\" not found" Jul 06 13:39:43.730218 ip-10-0-138-163 kubenswrapper[2573]: E0706 13:39:43.730182 2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-163.ec2.internal\" not found" Jul 06 13:39:43.831324 ip-10-0-138-163 kubenswrapper[2573]: E0706 13:39:43.831239 2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-163.ec2.internal\" not found" Jul 06 13:39:43.931816 ip-10-0-138-163 kubenswrapper[2573]: E0706 13:39:43.931782 2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-163.ec2.internal\" not found" Jul 06 13:39:43.954146 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:43.954123 2573 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 06 13:39:43.954320 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:43.954293 2573 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 06 13:39:43.966982 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:43.966962 2573 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 06 13:39:43.998918 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:43.998894 2573 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 06 13:39:44.008510 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:44.008490 2573 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-163.ec2.internal" Jul 06 13:39:44.008595 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:44.008498 2573 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 06 13:39:44.018340 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:44.018319 2573 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 06 13:39:44.022124 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:44.022110 2573 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 06 13:39:44.024362 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:44.024348 2573 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-163.ec2.internal" Jul 06 13:39:44.034266 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:44.034250 2573 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 06 13:39:44.048222 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:44.048197 2573 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-4hqw9" Jul 06 13:39:44.049334 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:44.049311 2573 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-05 13:34:43 +0000 UTC" deadline="2028-01-30 21:26:33.094345842 +0000 UTC" Jul 06 13:39:44.049386 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:44.049334 2573 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13759h46m49.045014713s" Jul 06 13:39:44.054999 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:44.054986 2573 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-4hqw9" Jul 06 13:39:44.208033 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:44.208001 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podad032e325f69035c6ca1e0e6476b91fe.slice/crio-f7df46728e28a787c68c77df498a622c9f8e3950f5101f6f01693d020624fe3c WatchSource:0}: Error finding container f7df46728e28a787c68c77df498a622c9f8e3950f5101f6f01693d020624fe3c: Status 404 returned error can't find the container with id f7df46728e28a787c68c77df498a622c9f8e3950f5101f6f01693d020624fe3c Jul 06 13:39:44.208293 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:44.208270 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode455a0f97ea051574dbd820a3603ff90.slice/crio-a181a633e46e28c02f3e528da3f66f27cdcd0bf23aa1197a26120ec56f6ac6e2 WatchSource:0}: Error finding container a181a633e46e28c02f3e528da3f66f27cdcd0bf23aa1197a26120ec56f6ac6e2: Status 404 returned error can't find the container with id a181a633e46e28c02f3e528da3f66f27cdcd0bf23aa1197a26120ec56f6ac6e2 Jul 06 13:39:44.214481 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:44.214462 2573 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 06 13:39:44.554736 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:44.554660 2573 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 06 13:39:44.988800 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:44.988723 2573 apiserver.go:52] "Watching apiserver" Jul 06 13:39:44.997542 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:44.997503 2573 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 06 13:39:44.999642 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:44.999613 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/node-resolver-5qvhz","openshift-image-registry/node-ca-8flhb","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-163.ec2.internal","openshift-multus/multus-r49sw","openshift-cluster-node-tuning-operator/tuned-v9c8w","openshift-multus/multus-additional-cni-plugins-8l59v","openshift-multus/network-metrics-daemon-jj6vh","openshift-network-diagnostics/network-check-target-dr8q7","openshift-network-operator/iptables-alerter-dhts8","openshift-ovn-kubernetes/ovnkube-node-6zfjs","kube-system/global-pull-secret-syncer-hsn8z","kube-system/konnectivity-agent-9r5x9","kube-system/kube-apiserver-proxy-ip-10-0-138-163.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gmp8k"] Jul 06 13:39:45.001356 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:45.001332 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-5qvhz" Jul 06 13:39:45.002779 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:45.002752 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-8flhb" Jul 06 13:39:45.004368 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:45.003946 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-r49sw" Jul 06 13:39:45.004368 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:45.004065 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 06 13:39:45.004368 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:45.004252 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-xbv25\"" Jul 06 13:39:45.004368 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:45.004068 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 06 13:39:45.005134 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:45.005114 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 06 13:39:45.005362 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:45.005343 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 06 13:39:45.005599 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:45.005579 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-hksb5\"" Jul 06 13:39:45.005762 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:45.005744 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-v9c8w" Jul 06 13:39:45.005882 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:45.005865 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 06 13:39:45.006414 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:45.006396 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 06 13:39:45.006517 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:45.006414 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-7zd4x\"" Jul 06 13:39:45.006902 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:45.006881 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 06 13:39:45.006988 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:45.006921 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 06 13:39:45.007046 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:45.006921 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 06 13:39:45.008063 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:45.008009 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 06 13:39:45.008193 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:45.008171 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 06 13:39:45.008263 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:45.008210 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-wgf6c\"" Jul 06 13:39:45.008450 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:45.008424 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-8l59v" Jul 06 13:39:45.008861 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:45.008833 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jj6vh" Jul 06 13:39:45.008938 ip-10-0-138-163 kubenswrapper[2573]: E0706 13:39:45.008911 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jj6vh" podUID="8250b72b-73e5-442c-9e18-11a3cbceee8e" Jul 06 13:39:45.010209 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:45.010169 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dr8q7" Jul 06 13:39:45.010305 ip-10-0-138-163 kubenswrapper[2573]: E0706 13:39:45.010239 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dr8q7" podUID="1aeba52d-6db7-4cb7-bdc8-eb9eda49b30f" Jul 06 13:39:45.010721 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:45.010701 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 06 13:39:45.010820 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:45.010777 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-z7thk\"" Jul 06 13:39:45.011120 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:45.011050 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 06 13:39:45.011713 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:45.011695 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-dhts8" Jul 06 13:39:45.014230 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:45.014067 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 06 13:39:45.014230 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:45.014077 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 06 13:39:45.014230 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:45.014090 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 06 13:39:45.014230 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:45.014099 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-6zfjs" Jul 06 13:39:45.014585 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:45.014569 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-v2g9f\"" Jul 06 13:39:45.016380 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:45.016361 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 06 13:39:45.016741 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:45.016593 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 06 13:39:45.016741 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:45.016690 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hsn8z" Jul 06 13:39:45.016741 ip-10-0-138-163 kubenswrapper[2573]: E0706 13:39:45.016733 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hsn8z" podUID="038d9ebd-ecce-4e27-bc8b-e661a606932e" Jul 06 13:39:45.017046 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:45.016930 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 06 13:39:45.017046 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:45.016998 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-j49zs\"" Jul 06 13:39:45.017046 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:45.017021 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 06 13:39:45.017293 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:45.017273 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 06 13:39:45.017733 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:45.017712 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 06 13:39:45.018414 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:45.018394 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-9r5x9" Jul 06 13:39:45.019987 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:45.019967 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/ea708850-a059-4fb9-973f-5460acad0659-etc-modprobe-d\") pod \"tuned-v9c8w\" (UID: \"ea708850-a059-4fb9-973f-5460acad0659\") " pod="openshift-cluster-node-tuning-operator/tuned-v9c8w" Jul 06 13:39:45.020107 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:45.019998 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/1e9a1360-d243-4b99-9dbe-b37d77b43a78-serviceca\") pod \"node-ca-8flhb\" (UID: \"1e9a1360-d243-4b99-9dbe-b37d77b43a78\") " pod="openshift-image-registry/node-ca-8flhb" Jul 06 13:39:45.020107 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:45.020029 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/99283577-cbc0-4406-a369-c958a1b6d1dc-multus-cni-dir\") pod \"multus-r49sw\" (UID: \"99283577-cbc0-4406-a369-c958a1b6d1dc\") " pod="openshift-multus/multus-r49sw" Jul 06 13:39:45.020107 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:45.020053 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/99283577-cbc0-4406-a369-c958a1b6d1dc-cni-binary-copy\") pod \"multus-r49sw\" (UID: \"99283577-cbc0-4406-a369-c958a1b6d1dc\") " pod="openshift-multus/multus-r49sw" Jul 06 13:39:45.020107 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:45.020080 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/99283577-cbc0-4406-a369-c958a1b6d1dc-multus-socket-dir-parent\") pod \"multus-r49sw\" (UID: \"99283577-cbc0-4406-a369-c958a1b6d1dc\") " pod="openshift-multus/multus-r49sw" Jul 06 13:39:45.020317 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:45.020104 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/ea708850-a059-4fb9-973f-5460acad0659-run\") pod \"tuned-v9c8w\" (UID: \"ea708850-a059-4fb9-973f-5460acad0659\") " pod="openshift-cluster-node-tuning-operator/tuned-v9c8w" Jul 06 13:39:45.020317 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:45.020147 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ea708850-a059-4fb9-973f-5460acad0659-lib-modules\") pod \"tuned-v9c8w\" (UID: \"ea708850-a059-4fb9-973f-5460acad0659\") " pod="openshift-cluster-node-tuning-operator/tuned-v9c8w" Jul 06 13:39:45.020317 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:45.020185 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gmp8k" Jul 06 13:39:45.020317 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:45.020191 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8250b72b-73e5-442c-9e18-11a3cbceee8e-metrics-certs\") pod \"network-metrics-daemon-jj6vh\" (UID: \"8250b72b-73e5-442c-9e18-11a3cbceee8e\") " pod="openshift-multus/network-metrics-daemon-jj6vh" Jul 06 13:39:45.020317 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:45.020227 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1e9a1360-d243-4b99-9dbe-b37d77b43a78-host\") pod \"node-ca-8flhb\" (UID: \"1e9a1360-d243-4b99-9dbe-b37d77b43a78\") " pod="openshift-image-registry/node-ca-8flhb" Jul 06 13:39:45.020317 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:45.020256 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j2kgc\" (UniqueName: \"kubernetes.io/projected/1e9a1360-d243-4b99-9dbe-b37d77b43a78-kube-api-access-j2kgc\") pod \"node-ca-8flhb\" (UID: \"1e9a1360-d243-4b99-9dbe-b37d77b43a78\") " pod="openshift-image-registry/node-ca-8flhb" Jul 06 13:39:45.020317 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:45.020281 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/99283577-cbc0-4406-a369-c958a1b6d1dc-cnibin\") pod \"multus-r49sw\" (UID: \"99283577-cbc0-4406-a369-c958a1b6d1dc\") " pod="openshift-multus/multus-r49sw" Jul 06 13:39:45.020317 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:45.020305 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/99283577-cbc0-4406-a369-c958a1b6d1dc-hostroot\") pod \"multus-r49sw\" (UID: \"99283577-cbc0-4406-a369-c958a1b6d1dc\") " pod="openshift-multus/multus-r49sw" Jul 06 13:39:45.020701 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:45.020327 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ea708850-a059-4fb9-973f-5460acad0659-var-lib-kubelet\") pod \"tuned-v9c8w\" (UID: \"ea708850-a059-4fb9-973f-5460acad0659\") " pod="openshift-cluster-node-tuning-operator/tuned-v9c8w" Jul 06 13:39:45.020701 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:45.020351 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/ea708850-a059-4fb9-973f-5460acad0659-etc-tuned\") pod \"tuned-v9c8w\" (UID: \"ea708850-a059-4fb9-973f-5460acad0659\") " pod="openshift-cluster-node-tuning-operator/tuned-v9c8w" Jul 06 13:39:45.020701 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:45.020376 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-92gcz\" (UniqueName: \"kubernetes.io/projected/8250b72b-73e5-442c-9e18-11a3cbceee8e-kube-api-access-92gcz\") pod \"network-metrics-daemon-jj6vh\" (UID: \"8250b72b-73e5-442c-9e18-11a3cbceee8e\") " pod="openshift-multus/network-metrics-daemon-jj6vh" Jul 06 13:39:45.020701 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:45.020404 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-56758\" (UniqueName: \"kubernetes.io/projected/99283577-cbc0-4406-a369-c958a1b6d1dc-kube-api-access-56758\") pod \"multus-r49sw\" (UID: \"99283577-cbc0-4406-a369-c958a1b6d1dc\") " pod="openshift-multus/multus-r49sw" Jul 06 13:39:45.020701 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:45.020427 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ea708850-a059-4fb9-973f-5460acad0659-etc-kubernetes\") pod \"tuned-v9c8w\" (UID: \"ea708850-a059-4fb9-973f-5460acad0659\") " pod="openshift-cluster-node-tuning-operator/tuned-v9c8w" Jul 06 13:39:45.020701 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:45.020453 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/ea708850-a059-4fb9-973f-5460acad0659-etc-sysctl-d\") pod \"tuned-v9c8w\" (UID: \"ea708850-a059-4fb9-973f-5460acad0659\") " pod="openshift-cluster-node-tuning-operator/tuned-v9c8w" Jul 06 13:39:45.020701 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:45.020475 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ea708850-a059-4fb9-973f-5460acad0659-tmp\") pod \"tuned-v9c8w\" (UID: \"ea708850-a059-4fb9-973f-5460acad0659\") " pod="openshift-cluster-node-tuning-operator/tuned-v9c8w" Jul 06 13:39:45.020701 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:45.020527 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6zr7t\" (UniqueName: \"kubernetes.io/projected/ea708850-a059-4fb9-973f-5460acad0659-kube-api-access-6zr7t\") pod \"tuned-v9c8w\" (UID: \"ea708850-a059-4fb9-973f-5460acad0659\") " pod="openshift-cluster-node-tuning-operator/tuned-v9c8w" Jul 06 13:39:45.020701 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:45.020550 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/010dfdbb-622e-4931-a618-8e465448aa80-os-release\") pod \"multus-additional-cni-plugins-8l59v\" (UID: \"010dfdbb-622e-4931-a618-8e465448aa80\") " pod="openshift-multus/multus-additional-cni-plugins-8l59v" Jul 06 13:39:45.020701 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:45.020603 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/99283577-cbc0-4406-a369-c958a1b6d1dc-etc-kubernetes\") pod \"multus-r49sw\" (UID: \"99283577-cbc0-4406-a369-c958a1b6d1dc\") " pod="openshift-multus/multus-r49sw" Jul 06 13:39:45.020701 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:45.020642 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/ea708850-a059-4fb9-973f-5460acad0659-etc-sysconfig\") pod \"tuned-v9c8w\" (UID: \"ea708850-a059-4fb9-973f-5460acad0659\") " pod="openshift-cluster-node-tuning-operator/tuned-v9c8w" Jul 06 13:39:45.020701 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:45.020667 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/ea708850-a059-4fb9-973f-5460acad0659-etc-systemd\") pod \"tuned-v9c8w\" (UID: \"ea708850-a059-4fb9-973f-5460acad0659\") " pod="openshift-cluster-node-tuning-operator/tuned-v9c8w" Jul 06 13:39:45.021324 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:45.020744 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/010dfdbb-622e-4931-a618-8e465448aa80-system-cni-dir\") pod \"multus-additional-cni-plugins-8l59v\" (UID: \"010dfdbb-622e-4931-a618-8e465448aa80\") " pod="openshift-multus/multus-additional-cni-plugins-8l59v" Jul 06 13:39:45.021324 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:45.020775 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/99283577-cbc0-4406-a369-c958a1b6d1dc-multus-daemon-config\") pod \"multus-r49sw\" (UID: \"99283577-cbc0-4406-a369-c958a1b6d1dc\") " pod="openshift-multus/multus-r49sw" Jul 06 13:39:45.021324 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:45.020784 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-sc6fj\"" Jul 06 13:39:45.021324 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:45.020803 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/99283577-cbc0-4406-a369-c958a1b6d1dc-host-run-multus-certs\") pod \"multus-r49sw\" (UID: \"99283577-cbc0-4406-a369-c958a1b6d1dc\") " pod="openshift-multus/multus-r49sw" Jul 06 13:39:45.021324 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:45.020830 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5hlzz\" (UniqueName: \"kubernetes.io/projected/c3396eac-840e-41a5-9639-a78c864904af-kube-api-access-5hlzz\") pod \"node-resolver-5qvhz\" (UID: \"c3396eac-840e-41a5-9639-a78c864904af\") " pod="openshift-dns/node-resolver-5qvhz" Jul 06 13:39:45.021324 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:45.020878 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/99283577-cbc0-4406-a369-c958a1b6d1dc-host-run-netns\") pod \"multus-r49sw\" (UID: \"99283577-cbc0-4406-a369-c958a1b6d1dc\") " pod="openshift-multus/multus-r49sw" Jul 06 13:39:45.021324 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:45.020905 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/99283577-cbc0-4406-a369-c958a1b6d1dc-host-var-lib-cni-bin\") pod \"multus-r49sw\" (UID: \"99283577-cbc0-4406-a369-c958a1b6d1dc\") " pod="openshift-multus/multus-r49sw" Jul 06 13:39:45.021324 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:45.020949 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/99283577-cbc0-4406-a369-c958a1b6d1dc-host-var-lib-kubelet\") pod \"multus-r49sw\" (UID: \"99283577-cbc0-4406-a369-c958a1b6d1dc\") " pod="openshift-multus/multus-r49sw" Jul 06 13:39:45.021324 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:45.020978 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/010dfdbb-622e-4931-a618-8e465448aa80-tuning-conf-dir\") pod \"multus-additional-cni-plugins-8l59v\" (UID: \"010dfdbb-622e-4931-a618-8e465448aa80\") " pod="openshift-multus/multus-additional-cni-plugins-8l59v" Jul 06 13:39:45.021324 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:45.021045 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/99283577-cbc0-4406-a369-c958a1b6d1dc-os-release\") pod \"multus-r49sw\" (UID: \"99283577-cbc0-4406-a369-c958a1b6d1dc\") " pod="openshift-multus/multus-r49sw" Jul 06 13:39:45.021324 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:45.021079 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/99283577-cbc0-4406-a369-c958a1b6d1dc-host-run-k8s-cni-cncf-io\") pod \"multus-r49sw\" (UID: \"99283577-cbc0-4406-a369-c958a1b6d1dc\") " pod="openshift-multus/multus-r49sw" Jul 06 13:39:45.021324 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:45.021089 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 06 13:39:45.021324 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:45.021123 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/99283577-cbc0-4406-a369-c958a1b6d1dc-host-var-lib-cni-multus\") pod \"multus-r49sw\" (UID: \"99283577-cbc0-4406-a369-c958a1b6d1dc\") " pod="openshift-multus/multus-r49sw" Jul 06 13:39:45.021324 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:45.021147 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/99283577-cbc0-4406-a369-c958a1b6d1dc-multus-conf-dir\") pod \"multus-r49sw\" (UID: \"99283577-cbc0-4406-a369-c958a1b6d1dc\") " pod="openshift-multus/multus-r49sw" Jul 06 13:39:45.021324 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:45.021180 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/010dfdbb-622e-4931-a618-8e465448aa80-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-8l59v\" (UID: \"010dfdbb-622e-4931-a618-8e465448aa80\") " pod="openshift-multus/multus-additional-cni-plugins-8l59v" Jul 06 13:39:45.021324 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:45.021261 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vg8nv\" (UniqueName: \"kubernetes.io/projected/010dfdbb-622e-4931-a618-8e465448aa80-kube-api-access-vg8nv\") pod \"multus-additional-cni-plugins-8l59v\" (UID: \"010dfdbb-622e-4931-a618-8e465448aa80\") " pod="openshift-multus/multus-additional-cni-plugins-8l59v" Jul 06 13:39:45.021324 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:45.021305 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/99283577-cbc0-4406-a369-c958a1b6d1dc-system-cni-dir\") pod \"multus-r49sw\" (UID: \"99283577-cbc0-4406-a369-c958a1b6d1dc\") " pod="openshift-multus/multus-r49sw" Jul 06 13:39:45.021997 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:45.021367 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 06 13:39:45.021997 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:45.021376 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/ea708850-a059-4fb9-973f-5460acad0659-etc-sysctl-conf\") pod \"tuned-v9c8w\" (UID: \"ea708850-a059-4fb9-973f-5460acad0659\") " pod="openshift-cluster-node-tuning-operator/tuned-v9c8w" Jul 06 13:39:45.021997 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:45.021415 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ea708850-a059-4fb9-973f-5460acad0659-sys\") pod \"tuned-v9c8w\" (UID: \"ea708850-a059-4fb9-973f-5460acad0659\") " pod="openshift-cluster-node-tuning-operator/tuned-v9c8w" Jul 06 13:39:45.021997 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:45.021449 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/010dfdbb-622e-4931-a618-8e465448aa80-cni-binary-copy\") pod \"multus-additional-cni-plugins-8l59v\" (UID: \"010dfdbb-622e-4931-a618-8e465448aa80\") " pod="openshift-multus/multus-additional-cni-plugins-8l59v" Jul 06 13:39:45.021997 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:45.021479 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/010dfdbb-622e-4931-a618-8e465448aa80-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-8l59v\" (UID: \"010dfdbb-622e-4931-a618-8e465448aa80\") " pod="openshift-multus/multus-additional-cni-plugins-8l59v" Jul 06 13:39:45.021997 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:45.021504 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/c3396eac-840e-41a5-9639-a78c864904af-hosts-file\") pod \"node-resolver-5qvhz\" (UID: \"c3396eac-840e-41a5-9639-a78c864904af\") " pod="openshift-dns/node-resolver-5qvhz" Jul 06 13:39:45.021997 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:45.021535 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c3396eac-840e-41a5-9639-a78c864904af-tmp-dir\") pod \"node-resolver-5qvhz\" (UID: \"c3396eac-840e-41a5-9639-a78c864904af\") " pod="openshift-dns/node-resolver-5qvhz" Jul 06 13:39:45.021997 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:45.021557 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ea708850-a059-4fb9-973f-5460acad0659-host\") pod \"tuned-v9c8w\" (UID: \"ea708850-a059-4fb9-973f-5460acad0659\") " pod="openshift-cluster-node-tuning-operator/tuned-v9c8w" Jul 06 13:39:45.021997 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:45.021574 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/010dfdbb-622e-4931-a618-8e465448aa80-cnibin\") pod \"multus-additional-cni-plugins-8l59v\" (UID: \"010dfdbb-622e-4931-a618-8e465448aa80\") " pod="openshift-multus/multus-additional-cni-plugins-8l59v" Jul 06 13:39:45.023594 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:45.023558 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 06 13:39:45.023594 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:45.023563 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-bc2ps\"" Jul 06 13:39:45.023751 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:45.023594 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 06 13:39:45.023751 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:45.023607 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 06 13:39:45.057366 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:45.057318 2573 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-05 13:34:44 +0000 UTC" deadline="2028-04-16 20:39:37.152657792 +0000 UTC" Jul 06 13:39:45.057468 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:45.057359 2573 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15606h59m52.09530159s" Jul 06 13:39:45.110357 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:45.110328 2573 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 06 13:39:45.122932 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:45.122136 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/010dfdbb-622e-4931-a618-8e465448aa80-tuning-conf-dir\") pod \"multus-additional-cni-plugins-8l59v\" (UID: \"010dfdbb-622e-4931-a618-8e465448aa80\") " pod="openshift-multus/multus-additional-cni-plugins-8l59v" Jul 06 13:39:45.122932 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:45.122184 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/038d9ebd-ecce-4e27-bc8b-e661a606932e-dbus\") pod \"global-pull-secret-syncer-hsn8z\" (UID: \"038d9ebd-ecce-4e27-bc8b-e661a606932e\") " pod="kube-system/global-pull-secret-syncer-hsn8z" Jul 06 13:39:45.122932 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:45.122209 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ebea8265-9021-4744-82b9-f2b904b7e3b1-run-openvswitch\") pod \"ovnkube-node-6zfjs\" (UID: \"ebea8265-9021-4744-82b9-f2b904b7e3b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-6zfjs" Jul 06 13:39:45.122932 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:45.122239 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/99283577-cbc0-4406-a369-c958a1b6d1dc-os-release\") pod \"multus-r49sw\" (UID: \"99283577-cbc0-4406-a369-c958a1b6d1dc\") " pod="openshift-multus/multus-r49sw" Jul 06 13:39:45.122932 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:45.122268 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/99283577-cbc0-4406-a369-c958a1b6d1dc-host-var-lib-cni-multus\") pod \"multus-r49sw\" (UID: \"99283577-cbc0-4406-a369-c958a1b6d1dc\") " pod="openshift-multus/multus-r49sw" Jul 06 13:39:45.122932 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:45.122293 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vg8nv\" (UniqueName: \"kubernetes.io/projected/010dfdbb-622e-4931-a618-8e465448aa80-kube-api-access-vg8nv\") pod \"multus-additional-cni-plugins-8l59v\" (UID: \"010dfdbb-622e-4931-a618-8e465448aa80\") " pod="openshift-multus/multus-additional-cni-plugins-8l59v" Jul 06 13:39:45.122932 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:45.122322 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/038d9ebd-ecce-4e27-bc8b-e661a606932e-kubelet-config\") pod \"global-pull-secret-syncer-hsn8z\" (UID: \"038d9ebd-ecce-4e27-bc8b-e661a606932e\") " pod="kube-system/global-pull-secret-syncer-hsn8z" Jul 06 13:39:45.122932 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:45.122347 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/e4db2c9b-0534-4fda-a860-1457816e7a88-agent-certs\") pod \"konnectivity-agent-9r5x9\" (UID: \"e4db2c9b-0534-4fda-a860-1457816e7a88\") " pod="kube-system/konnectivity-agent-9r5x9" Jul 06 13:39:45.122932 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:45.122372 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/cb39fc40-fab7-4adf-ab7a-25d1f3994549-kubelet-dir\") pod \"aws-ebs-csi-driver-node-gmp8k\" (UID: \"cb39fc40-fab7-4adf-ab7a-25d1f3994549\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gmp8k" Jul 06 13:39:45.122932 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:45.122398 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/99283577-cbc0-4406-a369-c958a1b6d1dc-system-cni-dir\") pod \"multus-r49sw\" (UID: \"99283577-cbc0-4406-a369-c958a1b6d1dc\") " pod="openshift-multus/multus-r49sw" Jul 06 13:39:45.122932 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:45.122424 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/ea708850-a059-4fb9-973f-5460acad0659-etc-sysctl-conf\") pod \"tuned-v9c8w\" (UID: \"ea708850-a059-4fb9-973f-5460acad0659\") " pod="openshift-cluster-node-tuning-operator/tuned-v9c8w" Jul 06 13:39:45.122932 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:45.122450 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/010dfdbb-622e-4931-a618-8e465448aa80-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-8l59v\" (UID: \"010dfdbb-622e-4931-a618-8e465448aa80\") " pod="openshift-multus/multus-additional-cni-plugins-8l59v" Jul 06 13:39:45.122932 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:45.122476 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vhrtn\" (UniqueName: \"kubernetes.io/projected/1aeba52d-6db7-4cb7-bdc8-eb9eda49b30f-kube-api-access-vhrtn\") pod \"network-check-target-dr8q7\" (UID: \"1aeba52d-6db7-4cb7-bdc8-eb9eda49b30f\") " pod="openshift-network-diagnostics/network-check-target-dr8q7" Jul 06 13:39:45.122932 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:45.122500 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ebea8265-9021-4744-82b9-f2b904b7e3b1-host-slash\") pod \"ovnkube-node-6zfjs\" (UID: \"ebea8265-9021-4744-82b9-f2b904b7e3b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-6zfjs" Jul 06 13:39:45.122932 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:45.122514 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/99283577-cbc0-4406-a369-c958a1b6d1dc-host-var-lib-cni-multus\") pod \"multus-r49sw\" (UID: \"99283577-cbc0-4406-a369-c958a1b6d1dc\") " pod="openshift-multus/multus-r49sw" Jul 06 13:39:45.122932 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:45.122524 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ebea8265-9021-4744-82b9-f2b904b7e3b1-host-cni-bin\") pod \"ovnkube-node-6zfjs\" (UID: \"ebea8265-9021-4744-82b9-f2b904b7e3b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-6zfjs" Jul 06 13:39:45.122932 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:45.122597 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/c3396eac-840e-41a5-9639-a78c864904af-hosts-file\") pod \"node-resolver-5qvhz\" (UID: \"c3396eac-840e-41a5-9639-a78c864904af\") " pod="openshift-dns/node-resolver-5qvhz" Jul 06 13:39:45.123921 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:45.122603 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/99283577-cbc0-4406-a369-c958a1b6d1dc-system-cni-dir\") pod \"multus-r49sw\" (UID: \"99283577-cbc0-4406-a369-c958a1b6d1dc\") " pod="openshift-multus/multus-r49sw" Jul 06 13:39:45.123921 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:45.122667 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/010dfdbb-622e-4931-a618-8e465448aa80-tuning-conf-dir\") pod \"multus-additional-cni-plugins-8l59v\" (UID: \"010dfdbb-622e-4931-a618-8e465448aa80\") " pod="openshift-multus/multus-additional-cni-plugins-8l59v" Jul 06 13:39:45.123921 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:45.122759 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/c3396eac-840e-41a5-9639-a78c864904af-hosts-file\") pod \"node-resolver-5qvhz\" (UID: \"c3396eac-840e-41a5-9639-a78c864904af\") " pod="openshift-dns/node-resolver-5qvhz" Jul 06 13:39:45.123921 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:45.122821 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/99283577-cbc0-4406-a369-c958a1b6d1dc-os-release\") pod \"multus-r49sw\" (UID: \"99283577-cbc0-4406-a369-c958a1b6d1dc\") " pod="openshift-multus/multus-r49sw" Jul 06 13:39:45.123921 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:45.122841 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/ea708850-a059-4fb9-973f-5460acad0659-etc-sysctl-conf\") pod \"tuned-v9c8w\" (UID: \"ea708850-a059-4fb9-973f-5460acad0659\") " pod="openshift-cluster-node-tuning-operator/tuned-v9c8w" Jul 06 13:39:45.123921 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:45.122836 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c3396eac-840e-41a5-9639-a78c864904af-tmp-dir\") pod \"node-resolver-5qvhz\" (UID: \"c3396eac-840e-41a5-9639-a78c864904af\") " pod="openshift-dns/node-resolver-5qvhz" Jul 06 13:39:45.123921 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:45.122907 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/038d9ebd-ecce-4e27-bc8b-e661a606932e-original-pull-secret\") pod \"global-pull-secret-syncer-hsn8z\" (UID: \"038d9ebd-ecce-4e27-bc8b-e661a606932e\") " pod="kube-system/global-pull-secret-syncer-hsn8z" Jul 06 13:39:45.123921 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:45.122961 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/cb39fc40-fab7-4adf-ab7a-25d1f3994549-device-dir\") pod \"aws-ebs-csi-driver-node-gmp8k\" (UID: \"cb39fc40-fab7-4adf-ab7a-25d1f3994549\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gmp8k" Jul 06 13:39:45.123921 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:45.122986 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/ebea8265-9021-4744-82b9-f2b904b7e3b1-host-kubelet\") pod \"ovnkube-node-6zfjs\" (UID: \"ebea8265-9021-4744-82b9-f2b904b7e3b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-6zfjs" Jul 06 13:39:45.123921 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:45.123007 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/ebea8265-9021-4744-82b9-f2b904b7e3b1-ovnkube-config\") pod \"ovnkube-node-6zfjs\" (UID: \"ebea8265-9021-4744-82b9-f2b904b7e3b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-6zfjs" Jul 06 13:39:45.123921 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:45.123030 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/ebea8265-9021-4744-82b9-f2b904b7e3b1-ovn-node-metrics-cert\") pod \"ovnkube-node-6zfjs\" (UID: \"ebea8265-9021-4744-82b9-f2b904b7e3b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-6zfjs" Jul 06 13:39:45.123921 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:45.123081 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/99283577-cbc0-4406-a369-c958a1b6d1dc-cni-binary-copy\") pod \"multus-r49sw\" (UID: \"99283577-cbc0-4406-a369-c958a1b6d1dc\") " pod="openshift-multus/multus-r49sw" Jul 06 13:39:45.123921 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:45.123107 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/99283577-cbc0-4406-a369-c958a1b6d1dc-multus-socket-dir-parent\") pod \"multus-r49sw\" (UID: \"99283577-cbc0-4406-a369-c958a1b6d1dc\") " pod="openshift-multus/multus-r49sw" Jul 06 13:39:45.123921 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:45.123134 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ea708850-a059-4fb9-973f-5460acad0659-lib-modules\") pod \"tuned-v9c8w\" (UID: \"ea708850-a059-4fb9-973f-5460acad0659\") " pod="openshift-cluster-node-tuning-operator/tuned-v9c8w" Jul 06 13:39:45.123921 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:45.123166 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c3396eac-840e-41a5-9639-a78c864904af-tmp-dir\") pod \"node-resolver-5qvhz\" (UID: \"c3396eac-840e-41a5-9639-a78c864904af\") " pod="openshift-dns/node-resolver-5qvhz" Jul 06 13:39:45.123921 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:45.123188 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/e4db2c9b-0534-4fda-a860-1457816e7a88-konnectivity-ca\") pod \"konnectivity-agent-9r5x9\" (UID: \"e4db2c9b-0534-4fda-a860-1457816e7a88\") " pod="kube-system/konnectivity-agent-9r5x9" Jul 06 13:39:45.123921 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:45.123188 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/010dfdbb-622e-4931-a618-8e465448aa80-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-8l59v\" (UID: \"010dfdbb-622e-4931-a618-8e465448aa80\") " pod="openshift-multus/multus-additional-cni-plugins-8l59v" Jul 06 13:39:45.124802 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:45.123215 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ebea8265-9021-4744-82b9-f2b904b7e3b1-var-lib-openvswitch\") pod \"ovnkube-node-6zfjs\" (UID: \"ebea8265-9021-4744-82b9-f2b904b7e3b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-6zfjs" Jul 06 13:39:45.124802 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:45.123257 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/ebea8265-9021-4744-82b9-f2b904b7e3b1-host-cni-netd\") pod \"ovnkube-node-6zfjs\" (UID: \"ebea8265-9021-4744-82b9-f2b904b7e3b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-6zfjs" Jul 06 13:39:45.124802 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:45.123274 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/99283577-cbc0-4406-a369-c958a1b6d1dc-multus-socket-dir-parent\") pod \"multus-r49sw\" (UID: \"99283577-cbc0-4406-a369-c958a1b6d1dc\") " pod="openshift-multus/multus-r49sw" Jul 06 13:39:45.124802 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:45.123285 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4gtz6\" (UniqueName: \"kubernetes.io/projected/ebea8265-9021-4744-82b9-f2b904b7e3b1-kube-api-access-4gtz6\") pod \"ovnkube-node-6zfjs\" (UID: \"ebea8265-9021-4744-82b9-f2b904b7e3b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-6zfjs" Jul 06 13:39:45.124802 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:45.123306 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ea708850-a059-4fb9-973f-5460acad0659-lib-modules\") pod \"tuned-v9c8w\" (UID: \"ea708850-a059-4fb9-973f-5460acad0659\") " pod="openshift-cluster-node-tuning-operator/tuned-v9c8w" Jul 06 13:39:45.124802 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:45.123314 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1e9a1360-d243-4b99-9dbe-b37d77b43a78-host\") pod \"node-ca-8flhb\" (UID: \"1e9a1360-d243-4b99-9dbe-b37d77b43a78\") " pod="openshift-image-registry/node-ca-8flhb" Jul 06 13:39:45.124802 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:45.123346 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1e9a1360-d243-4b99-9dbe-b37d77b43a78-host\") pod \"node-ca-8flhb\" (UID: \"1e9a1360-d243-4b99-9dbe-b37d77b43a78\") " pod="openshift-image-registry/node-ca-8flhb" Jul 06 13:39:45.124802 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:45.123377 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j2kgc\" (UniqueName: \"kubernetes.io/projected/1e9a1360-d243-4b99-9dbe-b37d77b43a78-kube-api-access-j2kgc\") pod \"node-ca-8flhb\" (UID: \"1e9a1360-d243-4b99-9dbe-b37d77b43a78\") " pod="openshift-image-registry/node-ca-8flhb" Jul 06 13:39:45.124802 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:45.123414 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/99283577-cbc0-4406-a369-c958a1b6d1dc-cnibin\") pod \"multus-r49sw\" (UID: \"99283577-cbc0-4406-a369-c958a1b6d1dc\") " pod="openshift-multus/multus-r49sw" Jul 06 13:39:45.124802 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:45.123432 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/ebea8265-9021-4744-82b9-f2b904b7e3b1-ovnkube-script-lib\") pod \"ovnkube-node-6zfjs\" (UID: \"ebea8265-9021-4744-82b9-f2b904b7e3b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-6zfjs" Jul 06 13:39:45.124802 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:45.123484 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-56758\" (UniqueName: \"kubernetes.io/projected/99283577-cbc0-4406-a369-c958a1b6d1dc-kube-api-access-56758\") pod \"multus-r49sw\" (UID: \"99283577-cbc0-4406-a369-c958a1b6d1dc\") " pod="openshift-multus/multus-r49sw" Jul 06 13:39:45.124802 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:45.123517 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ea708850-a059-4fb9-973f-5460acad0659-etc-kubernetes\") pod \"tuned-v9c8w\" (UID: \"ea708850-a059-4fb9-973f-5460acad0659\") " pod="openshift-cluster-node-tuning-operator/tuned-v9c8w" Jul 06 13:39:45.124802 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:45.123544 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ea708850-a059-4fb9-973f-5460acad0659-tmp\") pod \"tuned-v9c8w\" (UID: \"ea708850-a059-4fb9-973f-5460acad0659\") " pod="openshift-cluster-node-tuning-operator/tuned-v9c8w" Jul 06 13:39:45.124802 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:45.123569 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6zr7t\" (UniqueName: \"kubernetes.io/projected/ea708850-a059-4fb9-973f-5460acad0659-kube-api-access-6zr7t\") pod \"tuned-v9c8w\" (UID: \"ea708850-a059-4fb9-973f-5460acad0659\") " pod="openshift-cluster-node-tuning-operator/tuned-v9c8w" Jul 06 13:39:45.124802 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:45.123612 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/99283577-cbc0-4406-a369-c958a1b6d1dc-etc-kubernetes\") pod \"multus-r49sw\" (UID: \"99283577-cbc0-4406-a369-c958a1b6d1dc\") " pod="openshift-multus/multus-r49sw" Jul 06 13:39:45.124802 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:45.123622 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ea708850-a059-4fb9-973f-5460acad0659-etc-kubernetes\") pod \"tuned-v9c8w\" (UID: \"ea708850-a059-4fb9-973f-5460acad0659\") " pod="openshift-cluster-node-tuning-operator/tuned-v9c8w" Jul 06 13:39:45.124802 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:45.123484 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/99283577-cbc0-4406-a369-c958a1b6d1dc-cnibin\") pod \"multus-r49sw\" (UID: \"99283577-cbc0-4406-a369-c958a1b6d1dc\") " pod="openshift-multus/multus-r49sw" Jul 06 13:39:45.124802 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:45.123653 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/99283577-cbc0-4406-a369-c958a1b6d1dc-cni-binary-copy\") pod \"multus-r49sw\" (UID: \"99283577-cbc0-4406-a369-c958a1b6d1dc\") " pod="openshift-multus/multus-r49sw" Jul 06 13:39:45.125931 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:45.123684 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/ea708850-a059-4fb9-973f-5460acad0659-etc-sysconfig\") pod \"tuned-v9c8w\" (UID: \"ea708850-a059-4fb9-973f-5460acad0659\") " pod="openshift-cluster-node-tuning-operator/tuned-v9c8w" Jul 06 13:39:45.125931 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:45.123637 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/ea708850-a059-4fb9-973f-5460acad0659-etc-sysconfig\") pod \"tuned-v9c8w\" (UID: \"ea708850-a059-4fb9-973f-5460acad0659\") " pod="openshift-cluster-node-tuning-operator/tuned-v9c8w" Jul 06 13:39:45.125931 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:45.123725 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/ea708850-a059-4fb9-973f-5460acad0659-etc-systemd\") pod \"tuned-v9c8w\" (UID: \"ea708850-a059-4fb9-973f-5460acad0659\") " pod="openshift-cluster-node-tuning-operator/tuned-v9c8w" Jul 06 13:39:45.125931 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:45.123737 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/99283577-cbc0-4406-a369-c958a1b6d1dc-etc-kubernetes\") pod \"multus-r49sw\" (UID: \"99283577-cbc0-4406-a369-c958a1b6d1dc\") " pod="openshift-multus/multus-r49sw" Jul 06 13:39:45.125931 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:45.123752 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/cb39fc40-fab7-4adf-ab7a-25d1f3994549-sys-fs\") pod \"aws-ebs-csi-driver-node-gmp8k\" (UID: \"cb39fc40-fab7-4adf-ab7a-25d1f3994549\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gmp8k" Jul 06 13:39:45.125931 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:45.123780 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/ebea8265-9021-4744-82b9-f2b904b7e3b1-systemd-units\") pod \"ovnkube-node-6zfjs\" (UID: \"ebea8265-9021-4744-82b9-f2b904b7e3b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-6zfjs" Jul 06 13:39:45.125931 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:45.123807 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ebea8265-9021-4744-82b9-f2b904b7e3b1-host-run-netns\") pod \"ovnkube-node-6zfjs\" (UID: \"ebea8265-9021-4744-82b9-f2b904b7e3b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-6zfjs" Jul 06 13:39:45.125931 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:45.123811 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/ea708850-a059-4fb9-973f-5460acad0659-etc-systemd\") pod \"tuned-v9c8w\" (UID: \"ea708850-a059-4fb9-973f-5460acad0659\") " pod="openshift-cluster-node-tuning-operator/tuned-v9c8w" Jul 06 13:39:45.125931 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:45.123831 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/ebea8265-9021-4744-82b9-f2b904b7e3b1-node-log\") pod \"ovnkube-node-6zfjs\" (UID: \"ebea8265-9021-4744-82b9-f2b904b7e3b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-6zfjs" Jul 06 13:39:45.125931 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:45.123856 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/99283577-cbc0-4406-a369-c958a1b6d1dc-host-var-lib-cni-bin\") pod \"multus-r49sw\" (UID: \"99283577-cbc0-4406-a369-c958a1b6d1dc\") " pod="openshift-multus/multus-r49sw" Jul 06 13:39:45.125931 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:45.123876 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b8922936-e2e6-4a3a-84f9-d6b82fc20195-host-slash\") pod \"iptables-alerter-dhts8\" (UID: \"b8922936-e2e6-4a3a-84f9-d6b82fc20195\") " pod="openshift-network-operator/iptables-alerter-dhts8" Jul 06 13:39:45.125931 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:45.123898 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2pmm8\" (UniqueName: \"kubernetes.io/projected/cb39fc40-fab7-4adf-ab7a-25d1f3994549-kube-api-access-2pmm8\") pod \"aws-ebs-csi-driver-node-gmp8k\" (UID: \"cb39fc40-fab7-4adf-ab7a-25d1f3994549\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gmp8k" Jul 06 13:39:45.125931 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:45.123922 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/ebea8265-9021-4744-82b9-f2b904b7e3b1-log-socket\") pod \"ovnkube-node-6zfjs\" (UID: \"ebea8265-9021-4744-82b9-f2b904b7e3b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-6zfjs" Jul 06 13:39:45.125931 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:45.123937 2573 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 06 13:39:45.125931 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:45.123955 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/99283577-cbc0-4406-a369-c958a1b6d1dc-host-var-lib-cni-bin\") pod \"multus-r49sw\" (UID: \"99283577-cbc0-4406-a369-c958a1b6d1dc\") " pod="openshift-multus/multus-r49sw" Jul 06 13:39:45.125931 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:45.123972 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/ebea8265-9021-4744-82b9-f2b904b7e3b1-env-overrides\") pod \"ovnkube-node-6zfjs\" (UID: \"ebea8265-9021-4744-82b9-f2b904b7e3b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-6zfjs" Jul 06 13:39:45.125931 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:45.124017 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/99283577-cbc0-4406-a369-c958a1b6d1dc-host-run-k8s-cni-cncf-io\") pod \"multus-r49sw\" (UID: \"99283577-cbc0-4406-a369-c958a1b6d1dc\") " pod="openshift-multus/multus-r49sw" Jul 06 13:39:45.126727 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:45.124042 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/99283577-cbc0-4406-a369-c958a1b6d1dc-multus-conf-dir\") pod \"multus-r49sw\" (UID: \"99283577-cbc0-4406-a369-c958a1b6d1dc\") " pod="openshift-multus/multus-r49sw" Jul 06 13:39:45.126727 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:45.124069 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/010dfdbb-622e-4931-a618-8e465448aa80-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-8l59v\" (UID: \"010dfdbb-622e-4931-a618-8e465448aa80\") " pod="openshift-multus/multus-additional-cni-plugins-8l59v" Jul 06 13:39:45.126727 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:45.124080 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/99283577-cbc0-4406-a369-c958a1b6d1dc-host-run-k8s-cni-cncf-io\") pod \"multus-r49sw\" (UID: \"99283577-cbc0-4406-a369-c958a1b6d1dc\") " pod="openshift-multus/multus-r49sw" Jul 06 13:39:45.126727 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:45.124097 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/cb39fc40-fab7-4adf-ab7a-25d1f3994549-socket-dir\") pod \"aws-ebs-csi-driver-node-gmp8k\" (UID: \"cb39fc40-fab7-4adf-ab7a-25d1f3994549\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gmp8k" Jul 06 13:39:45.126727 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:45.124114 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/99283577-cbc0-4406-a369-c958a1b6d1dc-multus-conf-dir\") pod \"multus-r49sw\" (UID: \"99283577-cbc0-4406-a369-c958a1b6d1dc\") " pod="openshift-multus/multus-r49sw" Jul 06 13:39:45.126727 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:45.124139 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/cb39fc40-fab7-4adf-ab7a-25d1f3994549-etc-selinux\") pod \"aws-ebs-csi-driver-node-gmp8k\" (UID: \"cb39fc40-fab7-4adf-ab7a-25d1f3994549\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gmp8k" Jul 06 13:39:45.126727 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:45.124164 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/ebea8265-9021-4744-82b9-f2b904b7e3b1-run-systemd\") pod \"ovnkube-node-6zfjs\" (UID: \"ebea8265-9021-4744-82b9-f2b904b7e3b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-6zfjs" Jul 06 13:39:45.126727 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:45.124187 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ea708850-a059-4fb9-973f-5460acad0659-sys\") pod \"tuned-v9c8w\" (UID: \"ea708850-a059-4fb9-973f-5460acad0659\") " pod="openshift-cluster-node-tuning-operator/tuned-v9c8w" Jul 06 13:39:45.126727 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:45.124211 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/010dfdbb-622e-4931-a618-8e465448aa80-cni-binary-copy\") pod \"multus-additional-cni-plugins-8l59v\" (UID: \"010dfdbb-622e-4931-a618-8e465448aa80\") " pod="openshift-multus/multus-additional-cni-plugins-8l59v" Jul 06 13:39:45.126727 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:45.124237 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ea708850-a059-4fb9-973f-5460acad0659-host\") pod \"tuned-v9c8w\" (UID: \"ea708850-a059-4fb9-973f-5460acad0659\") " pod="openshift-cluster-node-tuning-operator/tuned-v9c8w" Jul 06 13:39:45.126727 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:45.124261 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/010dfdbb-622e-4931-a618-8e465448aa80-cnibin\") pod \"multus-additional-cni-plugins-8l59v\" (UID: \"010dfdbb-622e-4931-a618-8e465448aa80\") " pod="openshift-multus/multus-additional-cni-plugins-8l59v" Jul 06 13:39:45.126727 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:45.124276 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ea708850-a059-4fb9-973f-5460acad0659-sys\") pod \"tuned-v9c8w\" (UID: \"ea708850-a059-4fb9-973f-5460acad0659\") " pod="openshift-cluster-node-tuning-operator/tuned-v9c8w" Jul 06 13:39:45.126727 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:45.124287 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/b8922936-e2e6-4a3a-84f9-d6b82fc20195-iptables-alerter-script\") pod \"iptables-alerter-dhts8\" (UID: \"b8922936-e2e6-4a3a-84f9-d6b82fc20195\") " pod="openshift-network-operator/iptables-alerter-dhts8" Jul 06 13:39:45.126727 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:45.124322 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sxszw\" (UniqueName: \"kubernetes.io/projected/b8922936-e2e6-4a3a-84f9-d6b82fc20195-kube-api-access-sxszw\") pod \"iptables-alerter-dhts8\" (UID: \"b8922936-e2e6-4a3a-84f9-d6b82fc20195\") " pod="openshift-network-operator/iptables-alerter-dhts8" Jul 06 13:39:45.126727 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:45.124347 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ea708850-a059-4fb9-973f-5460acad0659-host\") pod \"tuned-v9c8w\" (UID: \"ea708850-a059-4fb9-973f-5460acad0659\") " pod="openshift-cluster-node-tuning-operator/tuned-v9c8w" Jul 06 13:39:45.126727 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:45.124347 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ebea8265-9021-4744-82b9-f2b904b7e3b1-etc-openvswitch\") pod \"ovnkube-node-6zfjs\" (UID: \"ebea8265-9021-4744-82b9-f2b904b7e3b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-6zfjs" Jul 06 13:39:45.126727 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:45.124403 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ebea8265-9021-4744-82b9-f2b904b7e3b1-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-6zfjs\" (UID: \"ebea8265-9021-4744-82b9-f2b904b7e3b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-6zfjs" Jul 06 13:39:45.127591 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:45.124416 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/010dfdbb-622e-4931-a618-8e465448aa80-cnibin\") pod \"multus-additional-cni-plugins-8l59v\" (UID: \"010dfdbb-622e-4931-a618-8e465448aa80\") " pod="openshift-multus/multus-additional-cni-plugins-8l59v" Jul 06 13:39:45.127591 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:45.124433 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/ea708850-a059-4fb9-973f-5460acad0659-etc-modprobe-d\") pod \"tuned-v9c8w\" (UID: \"ea708850-a059-4fb9-973f-5460acad0659\") " pod="openshift-cluster-node-tuning-operator/tuned-v9c8w" Jul 06 13:39:45.127591 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:45.124459 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/1e9a1360-d243-4b99-9dbe-b37d77b43a78-serviceca\") pod \"node-ca-8flhb\" (UID: \"1e9a1360-d243-4b99-9dbe-b37d77b43a78\") " pod="openshift-image-registry/node-ca-8flhb" Jul 06 13:39:45.127591 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:45.124483 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/99283577-cbc0-4406-a369-c958a1b6d1dc-multus-cni-dir\") pod \"multus-r49sw\" (UID: \"99283577-cbc0-4406-a369-c958a1b6d1dc\") " pod="openshift-multus/multus-r49sw" Jul 06 13:39:45.127591 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:45.124507 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/ea708850-a059-4fb9-973f-5460acad0659-run\") pod \"tuned-v9c8w\" (UID: \"ea708850-a059-4fb9-973f-5460acad0659\") " pod="openshift-cluster-node-tuning-operator/tuned-v9c8w" Jul 06 13:39:45.127591 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:45.124533 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8250b72b-73e5-442c-9e18-11a3cbceee8e-metrics-certs\") pod \"network-metrics-daemon-jj6vh\" (UID: \"8250b72b-73e5-442c-9e18-11a3cbceee8e\") " pod="openshift-multus/network-metrics-daemon-jj6vh" Jul 06 13:39:45.127591 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:45.124559 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/ebea8265-9021-4744-82b9-f2b904b7e3b1-run-ovn\") pod \"ovnkube-node-6zfjs\" (UID: \"ebea8265-9021-4744-82b9-f2b904b7e3b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-6zfjs" Jul 06 13:39:45.127591 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:45.124565 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/ea708850-a059-4fb9-973f-5460acad0659-etc-modprobe-d\") pod \"tuned-v9c8w\" (UID: \"ea708850-a059-4fb9-973f-5460acad0659\") " pod="openshift-cluster-node-tuning-operator/tuned-v9c8w" Jul 06 13:39:45.127591 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:45.124583 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/99283577-cbc0-4406-a369-c958a1b6d1dc-hostroot\") pod \"multus-r49sw\" (UID: \"99283577-cbc0-4406-a369-c958a1b6d1dc\") " pod="openshift-multus/multus-r49sw" Jul 06 13:39:45.127591 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:45.124609 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ea708850-a059-4fb9-973f-5460acad0659-var-lib-kubelet\") pod \"tuned-v9c8w\" (UID: \"ea708850-a059-4fb9-973f-5460acad0659\") " pod="openshift-cluster-node-tuning-operator/tuned-v9c8w" Jul 06 13:39:45.127591 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:45.124618 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/ea708850-a059-4fb9-973f-5460acad0659-run\") pod \"tuned-v9c8w\" (UID: \"ea708850-a059-4fb9-973f-5460acad0659\") " pod="openshift-cluster-node-tuning-operator/tuned-v9c8w" Jul 06 13:39:45.127591 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:45.124638 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/ea708850-a059-4fb9-973f-5460acad0659-etc-tuned\") pod \"tuned-v9c8w\" (UID: \"ea708850-a059-4fb9-973f-5460acad0659\") " pod="openshift-cluster-node-tuning-operator/tuned-v9c8w" Jul 06 13:39:45.127591 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:45.124665 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-92gcz\" (UniqueName: \"kubernetes.io/projected/8250b72b-73e5-442c-9e18-11a3cbceee8e-kube-api-access-92gcz\") pod \"network-metrics-daemon-jj6vh\" (UID: \"8250b72b-73e5-442c-9e18-11a3cbceee8e\") " pod="openshift-multus/network-metrics-daemon-jj6vh" Jul 06 13:39:45.127591 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:45.124671 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/010dfdbb-622e-4931-a618-8e465448aa80-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-8l59v\" (UID: \"010dfdbb-622e-4931-a618-8e465448aa80\") " pod="openshift-multus/multus-additional-cni-plugins-8l59v" Jul 06 13:39:45.127591 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:45.124693 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/99283577-cbc0-4406-a369-c958a1b6d1dc-multus-cni-dir\") pod \"multus-r49sw\" (UID: \"99283577-cbc0-4406-a369-c958a1b6d1dc\") " pod="openshift-multus/multus-r49sw" Jul 06 13:39:45.127591 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:45.124723 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/99283577-cbc0-4406-a369-c958a1b6d1dc-hostroot\") pod \"multus-r49sw\" (UID: \"99283577-cbc0-4406-a369-c958a1b6d1dc\") " pod="openshift-multus/multus-r49sw" Jul 06 13:39:45.127591 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:45.124737 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ea708850-a059-4fb9-973f-5460acad0659-var-lib-kubelet\") pod \"tuned-v9c8w\" (UID: \"ea708850-a059-4fb9-973f-5460acad0659\") " pod="openshift-cluster-node-tuning-operator/tuned-v9c8w" Jul 06 13:39:45.127591 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:45.124781 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/ea708850-a059-4fb9-973f-5460acad0659-etc-sysctl-d\") pod \"tuned-v9c8w\" (UID: \"ea708850-a059-4fb9-973f-5460acad0659\") " pod="openshift-cluster-node-tuning-operator/tuned-v9c8w" Jul 06 13:39:45.128605 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:45.124810 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/010dfdbb-622e-4931-a618-8e465448aa80-os-release\") pod \"multus-additional-cni-plugins-8l59v\" (UID: \"010dfdbb-622e-4931-a618-8e465448aa80\") " pod="openshift-multus/multus-additional-cni-plugins-8l59v" Jul 06 13:39:45.128605 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:45.124836 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/cb39fc40-fab7-4adf-ab7a-25d1f3994549-registration-dir\") pod \"aws-ebs-csi-driver-node-gmp8k\" (UID: \"cb39fc40-fab7-4adf-ab7a-25d1f3994549\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gmp8k" Jul 06 13:39:45.128605 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:45.124865 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/010dfdbb-622e-4931-a618-8e465448aa80-system-cni-dir\") pod \"multus-additional-cni-plugins-8l59v\" (UID: \"010dfdbb-622e-4931-a618-8e465448aa80\") " pod="openshift-multus/multus-additional-cni-plugins-8l59v" Jul 06 13:39:45.128605 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:45.124866 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/010dfdbb-622e-4931-a618-8e465448aa80-cni-binary-copy\") pod \"multus-additional-cni-plugins-8l59v\" (UID: \"010dfdbb-622e-4931-a618-8e465448aa80\") " pod="openshift-multus/multus-additional-cni-plugins-8l59v" Jul 06 13:39:45.128605 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:45.124910 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ebea8265-9021-4744-82b9-f2b904b7e3b1-host-run-ovn-kubernetes\") pod \"ovnkube-node-6zfjs\" (UID: \"ebea8265-9021-4744-82b9-f2b904b7e3b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-6zfjs" Jul 06 13:39:45.128605 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:45.124917 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/1e9a1360-d243-4b99-9dbe-b37d77b43a78-serviceca\") pod \"node-ca-8flhb\" (UID: \"1e9a1360-d243-4b99-9dbe-b37d77b43a78\") " pod="openshift-image-registry/node-ca-8flhb" Jul 06 13:39:45.128605 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:45.124939 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/99283577-cbc0-4406-a369-c958a1b6d1dc-multus-daemon-config\") pod \"multus-r49sw\" (UID: \"99283577-cbc0-4406-a369-c958a1b6d1dc\") " pod="openshift-multus/multus-r49sw" Jul 06 13:39:45.128605 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:45.125004 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/010dfdbb-622e-4931-a618-8e465448aa80-system-cni-dir\") pod \"multus-additional-cni-plugins-8l59v\" (UID: \"010dfdbb-622e-4931-a618-8e465448aa80\") " pod="openshift-multus/multus-additional-cni-plugins-8l59v" Jul 06 13:39:45.128605 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:45.125013 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/ea708850-a059-4fb9-973f-5460acad0659-etc-sysctl-d\") pod \"tuned-v9c8w\" (UID: \"ea708850-a059-4fb9-973f-5460acad0659\") " pod="openshift-cluster-node-tuning-operator/tuned-v9c8w" Jul 06 13:39:45.128605 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:45.125021 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/010dfdbb-622e-4931-a618-8e465448aa80-os-release\") pod \"multus-additional-cni-plugins-8l59v\" (UID: \"010dfdbb-622e-4931-a618-8e465448aa80\") " pod="openshift-multus/multus-additional-cni-plugins-8l59v" Jul 06 13:39:45.128605 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:45.125050 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/99283577-cbc0-4406-a369-c958a1b6d1dc-host-run-multus-certs\") pod \"multus-r49sw\" (UID: \"99283577-cbc0-4406-a369-c958a1b6d1dc\") " pod="openshift-multus/multus-r49sw" Jul 06 13:39:45.128605 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:45.125081 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5hlzz\" (UniqueName: \"kubernetes.io/projected/c3396eac-840e-41a5-9639-a78c864904af-kube-api-access-5hlzz\") pod \"node-resolver-5qvhz\" (UID: \"c3396eac-840e-41a5-9639-a78c864904af\") " pod="openshift-dns/node-resolver-5qvhz" Jul 06 13:39:45.128605 ip-10-0-138-163 kubenswrapper[2573]: E0706 13:39:45.125111 2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 13:39:45.128605 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:45.125150 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/99283577-cbc0-4406-a369-c958a1b6d1dc-host-run-multus-certs\") pod \"multus-r49sw\" (UID: \"99283577-cbc0-4406-a369-c958a1b6d1dc\") " pod="openshift-multus/multus-r49sw" Jul 06 13:39:45.128605 ip-10-0-138-163 kubenswrapper[2573]: E0706 13:39:45.125197 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8250b72b-73e5-442c-9e18-11a3cbceee8e-metrics-certs podName:8250b72b-73e5-442c-9e18-11a3cbceee8e nodeName:}" failed. No retries permitted until 2026-07-06 13:39:45.625177355 +0000 UTC m=+3.001776315 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8250b72b-73e5-442c-9e18-11a3cbceee8e-metrics-certs") pod "network-metrics-daemon-jj6vh" (UID: "8250b72b-73e5-442c-9e18-11a3cbceee8e") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 13:39:45.128605 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:45.125218 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/99283577-cbc0-4406-a369-c958a1b6d1dc-host-run-netns\") pod \"multus-r49sw\" (UID: \"99283577-cbc0-4406-a369-c958a1b6d1dc\") " pod="openshift-multus/multus-r49sw" Jul 06 13:39:45.128605 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:45.125321 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/99283577-cbc0-4406-a369-c958a1b6d1dc-host-var-lib-kubelet\") pod \"multus-r49sw\" (UID: \"99283577-cbc0-4406-a369-c958a1b6d1dc\") " pod="openshift-multus/multus-r49sw" Jul 06 13:39:45.129489 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:45.125341 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/99283577-cbc0-4406-a369-c958a1b6d1dc-host-run-netns\") pod \"multus-r49sw\" (UID: \"99283577-cbc0-4406-a369-c958a1b6d1dc\") " pod="openshift-multus/multus-r49sw" Jul 06 13:39:45.129489 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:45.125435 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/99283577-cbc0-4406-a369-c958a1b6d1dc-host-var-lib-kubelet\") pod \"multus-r49sw\" (UID: \"99283577-cbc0-4406-a369-c958a1b6d1dc\") " pod="openshift-multus/multus-r49sw" Jul 06 13:39:45.129489 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:45.125617 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/99283577-cbc0-4406-a369-c958a1b6d1dc-multus-daemon-config\") pod \"multus-r49sw\" (UID: \"99283577-cbc0-4406-a369-c958a1b6d1dc\") " pod="openshift-multus/multus-r49sw" Jul 06 13:39:45.129489 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:45.128068 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/ea708850-a059-4fb9-973f-5460acad0659-etc-tuned\") pod \"tuned-v9c8w\" (UID: \"ea708850-a059-4fb9-973f-5460acad0659\") " pod="openshift-cluster-node-tuning-operator/tuned-v9c8w" Jul 06 13:39:45.129489 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:45.128091 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ea708850-a059-4fb9-973f-5460acad0659-tmp\") pod \"tuned-v9c8w\" (UID: \"ea708850-a059-4fb9-973f-5460acad0659\") " pod="openshift-cluster-node-tuning-operator/tuned-v9c8w" Jul 06 13:39:45.132494 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:45.132435 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vg8nv\" (UniqueName: \"kubernetes.io/projected/010dfdbb-622e-4931-a618-8e465448aa80-kube-api-access-vg8nv\") pod \"multus-additional-cni-plugins-8l59v\" (UID: \"010dfdbb-622e-4931-a618-8e465448aa80\") " pod="openshift-multus/multus-additional-cni-plugins-8l59v" Jul 06 13:39:45.134556 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:45.134501 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-56758\" (UniqueName: \"kubernetes.io/projected/99283577-cbc0-4406-a369-c958a1b6d1dc-kube-api-access-56758\") pod \"multus-r49sw\" (UID: \"99283577-cbc0-4406-a369-c958a1b6d1dc\") " pod="openshift-multus/multus-r49sw" Jul 06 13:39:45.135616 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:45.135035 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5hlzz\" (UniqueName: \"kubernetes.io/projected/c3396eac-840e-41a5-9639-a78c864904af-kube-api-access-5hlzz\") pod \"node-resolver-5qvhz\" (UID: \"c3396eac-840e-41a5-9639-a78c864904af\") " pod="openshift-dns/node-resolver-5qvhz" Jul 06 13:39:45.135958 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:45.135938 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j2kgc\" (UniqueName: \"kubernetes.io/projected/1e9a1360-d243-4b99-9dbe-b37d77b43a78-kube-api-access-j2kgc\") pod \"node-ca-8flhb\" (UID: \"1e9a1360-d243-4b99-9dbe-b37d77b43a78\") " pod="openshift-image-registry/node-ca-8flhb" Jul 06 13:39:45.136029 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:45.136001 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6zr7t\" (UniqueName: \"kubernetes.io/projected/ea708850-a059-4fb9-973f-5460acad0659-kube-api-access-6zr7t\") pod \"tuned-v9c8w\" (UID: \"ea708850-a059-4fb9-973f-5460acad0659\") " pod="openshift-cluster-node-tuning-operator/tuned-v9c8w" Jul 06 13:39:45.137328 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:45.137303 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-92gcz\" (UniqueName: \"kubernetes.io/projected/8250b72b-73e5-442c-9e18-11a3cbceee8e-kube-api-access-92gcz\") pod \"network-metrics-daemon-jj6vh\" (UID: \"8250b72b-73e5-442c-9e18-11a3cbceee8e\") " pod="openshift-multus/network-metrics-daemon-jj6vh" Jul 06 13:39:45.161862 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:45.161802 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-163.ec2.internal" event={"ID":"ad032e325f69035c6ca1e0e6476b91fe","Type":"ContainerStarted","Data":"f7df46728e28a787c68c77df498a622c9f8e3950f5101f6f01693d020624fe3c"} Jul 06 13:39:45.163203 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:45.163178 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-163.ec2.internal" event={"ID":"e455a0f97ea051574dbd820a3603ff90","Type":"ContainerStarted","Data":"a181a633e46e28c02f3e528da3f66f27cdcd0bf23aa1197a26120ec56f6ac6e2"} Jul 06 13:39:45.226034 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:45.225995 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b8922936-e2e6-4a3a-84f9-d6b82fc20195-host-slash\") pod \"iptables-alerter-dhts8\" (UID: \"b8922936-e2e6-4a3a-84f9-d6b82fc20195\") " pod="openshift-network-operator/iptables-alerter-dhts8" Jul 06 13:39:45.226221 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:45.226046 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2pmm8\" (UniqueName: \"kubernetes.io/projected/cb39fc40-fab7-4adf-ab7a-25d1f3994549-kube-api-access-2pmm8\") pod \"aws-ebs-csi-driver-node-gmp8k\" (UID: \"cb39fc40-fab7-4adf-ab7a-25d1f3994549\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gmp8k" Jul 06 13:39:45.226221 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:45.226090 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/ebea8265-9021-4744-82b9-f2b904b7e3b1-log-socket\") pod \"ovnkube-node-6zfjs\" (UID: \"ebea8265-9021-4744-82b9-f2b904b7e3b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-6zfjs" Jul 06 13:39:45.226221 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:45.226114 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/ebea8265-9021-4744-82b9-f2b904b7e3b1-env-overrides\") pod \"ovnkube-node-6zfjs\" (UID: \"ebea8265-9021-4744-82b9-f2b904b7e3b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-6zfjs" Jul 06 13:39:45.226221 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:45.226140 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/cb39fc40-fab7-4adf-ab7a-25d1f3994549-socket-dir\") pod \"aws-ebs-csi-driver-node-gmp8k\" (UID: \"cb39fc40-fab7-4adf-ab7a-25d1f3994549\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gmp8k" Jul 06 13:39:45.226221 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:45.226167 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/cb39fc40-fab7-4adf-ab7a-25d1f3994549-etc-selinux\") pod \"aws-ebs-csi-driver-node-gmp8k\" (UID: \"cb39fc40-fab7-4adf-ab7a-25d1f3994549\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gmp8k" Jul 06 13:39:45.226221 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:45.226190 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/ebea8265-9021-4744-82b9-f2b904b7e3b1-run-systemd\") pod \"ovnkube-node-6zfjs\" (UID: \"ebea8265-9021-4744-82b9-f2b904b7e3b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-6zfjs" Jul 06 13:39:45.226221 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:45.226216 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/b8922936-e2e6-4a3a-84f9-d6b82fc20195-iptables-alerter-script\") pod \"iptables-alerter-dhts8\" (UID: \"b8922936-e2e6-4a3a-84f9-d6b82fc20195\") " pod="openshift-network-operator/iptables-alerter-dhts8" Jul 06 13:39:45.226591 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:45.226240 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sxszw\" (UniqueName: \"kubernetes.io/projected/b8922936-e2e6-4a3a-84f9-d6b82fc20195-kube-api-access-sxszw\") pod \"iptables-alerter-dhts8\" (UID: \"b8922936-e2e6-4a3a-84f9-d6b82fc20195\") " pod="openshift-network-operator/iptables-alerter-dhts8" Jul 06 13:39:45.226591 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:45.226264 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ebea8265-9021-4744-82b9-f2b904b7e3b1-etc-openvswitch\") pod \"ovnkube-node-6zfjs\" (UID: \"ebea8265-9021-4744-82b9-f2b904b7e3b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-6zfjs" Jul 06 13:39:45.226591 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:45.226292 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ebea8265-9021-4744-82b9-f2b904b7e3b1-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-6zfjs\" (UID: \"ebea8265-9021-4744-82b9-f2b904b7e3b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-6zfjs" Jul 06 13:39:45.226591 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:45.226338 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/ebea8265-9021-4744-82b9-f2b904b7e3b1-run-ovn\") pod \"ovnkube-node-6zfjs\" (UID: \"ebea8265-9021-4744-82b9-f2b904b7e3b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-6zfjs" Jul 06 13:39:45.226591 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:45.226372 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/cb39fc40-fab7-4adf-ab7a-25d1f3994549-registration-dir\") pod \"aws-ebs-csi-driver-node-gmp8k\" (UID: \"cb39fc40-fab7-4adf-ab7a-25d1f3994549\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gmp8k" Jul 06 13:39:45.226591 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:45.226400 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ebea8265-9021-4744-82b9-f2b904b7e3b1-host-run-ovn-kubernetes\") pod \"ovnkube-node-6zfjs\" (UID: \"ebea8265-9021-4744-82b9-f2b904b7e3b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-6zfjs" Jul 06 13:39:45.226591 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:45.226436 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/038d9ebd-ecce-4e27-bc8b-e661a606932e-dbus\") pod \"global-pull-secret-syncer-hsn8z\" (UID: \"038d9ebd-ecce-4e27-bc8b-e661a606932e\") " pod="kube-system/global-pull-secret-syncer-hsn8z" Jul 06 13:39:45.226591 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:45.226460 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ebea8265-9021-4744-82b9-f2b904b7e3b1-run-openvswitch\") pod \"ovnkube-node-6zfjs\" (UID: \"ebea8265-9021-4744-82b9-f2b904b7e3b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-6zfjs" Jul 06 13:39:45.226591 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:45.226489 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/038d9ebd-ecce-4e27-bc8b-e661a606932e-kubelet-config\") pod \"global-pull-secret-syncer-hsn8z\" (UID: \"038d9ebd-ecce-4e27-bc8b-e661a606932e\") " pod="kube-system/global-pull-secret-syncer-hsn8z" Jul 06 13:39:45.226591 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:45.226514 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/e4db2c9b-0534-4fda-a860-1457816e7a88-agent-certs\") pod \"konnectivity-agent-9r5x9\" (UID: \"e4db2c9b-0534-4fda-a860-1457816e7a88\") " pod="kube-system/konnectivity-agent-9r5x9" Jul 06 13:39:45.226591 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:45.226539 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/cb39fc40-fab7-4adf-ab7a-25d1f3994549-kubelet-dir\") pod \"aws-ebs-csi-driver-node-gmp8k\" (UID: \"cb39fc40-fab7-4adf-ab7a-25d1f3994549\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gmp8k" Jul 06 13:39:45.226591 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:45.226569 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vhrtn\" (UniqueName: \"kubernetes.io/projected/1aeba52d-6db7-4cb7-bdc8-eb9eda49b30f-kube-api-access-vhrtn\") pod \"network-check-target-dr8q7\" (UID: \"1aeba52d-6db7-4cb7-bdc8-eb9eda49b30f\") " pod="openshift-network-diagnostics/network-check-target-dr8q7" Jul 06 13:39:45.227264 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:45.226596 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ebea8265-9021-4744-82b9-f2b904b7e3b1-host-slash\") pod \"ovnkube-node-6zfjs\" (UID: \"ebea8265-9021-4744-82b9-f2b904b7e3b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-6zfjs" Jul 06 13:39:45.227264 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:45.226628 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ebea8265-9021-4744-82b9-f2b904b7e3b1-host-cni-bin\") pod \"ovnkube-node-6zfjs\" (UID: \"ebea8265-9021-4744-82b9-f2b904b7e3b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-6zfjs" Jul 06 13:39:45.227264 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:45.226657 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/038d9ebd-ecce-4e27-bc8b-e661a606932e-original-pull-secret\") pod \"global-pull-secret-syncer-hsn8z\" (UID: \"038d9ebd-ecce-4e27-bc8b-e661a606932e\") " pod="kube-system/global-pull-secret-syncer-hsn8z" Jul 06 13:39:45.227264 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:45.226683 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/cb39fc40-fab7-4adf-ab7a-25d1f3994549-device-dir\") pod \"aws-ebs-csi-driver-node-gmp8k\" (UID: \"cb39fc40-fab7-4adf-ab7a-25d1f3994549\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gmp8k" Jul 06 13:39:45.227264 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:45.226697 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ebea8265-9021-4744-82b9-f2b904b7e3b1-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-6zfjs\" (UID: \"ebea8265-9021-4744-82b9-f2b904b7e3b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-6zfjs" Jul 06 13:39:45.227264 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:45.226767 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b8922936-e2e6-4a3a-84f9-d6b82fc20195-host-slash\") pod \"iptables-alerter-dhts8\" (UID: \"b8922936-e2e6-4a3a-84f9-d6b82fc20195\") " pod="openshift-network-operator/iptables-alerter-dhts8" Jul 06 13:39:45.227264 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:45.226771 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/ebea8265-9021-4744-82b9-f2b904b7e3b1-run-ovn\") pod \"ovnkube-node-6zfjs\" (UID: \"ebea8265-9021-4744-82b9-f2b904b7e3b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-6zfjs" Jul 06 13:39:45.227264 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:45.226803 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/ebea8265-9021-4744-82b9-f2b904b7e3b1-host-kubelet\") pod \"ovnkube-node-6zfjs\" (UID: \"ebea8265-9021-4744-82b9-f2b904b7e3b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-6zfjs" Jul 06 13:39:45.227264 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:45.226879 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/cb39fc40-fab7-4adf-ab7a-25d1f3994549-registration-dir\") pod \"aws-ebs-csi-driver-node-gmp8k\" (UID: \"cb39fc40-fab7-4adf-ab7a-25d1f3994549\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gmp8k" Jul 06 13:39:45.227264 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:45.226925 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ebea8265-9021-4744-82b9-f2b904b7e3b1-host-run-ovn-kubernetes\") pod \"ovnkube-node-6zfjs\" (UID: \"ebea8265-9021-4744-82b9-f2b904b7e3b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-6zfjs" Jul 06 13:39:45.227264 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:45.227035 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/ebea8265-9021-4744-82b9-f2b904b7e3b1-log-socket\") pod \"ovnkube-node-6zfjs\" (UID: \"ebea8265-9021-4744-82b9-f2b904b7e3b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-6zfjs" Jul 06 13:39:45.227264 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:45.227109 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/038d9ebd-ecce-4e27-bc8b-e661a606932e-dbus\") pod \"global-pull-secret-syncer-hsn8z\" (UID: \"038d9ebd-ecce-4e27-bc8b-e661a606932e\") " pod="kube-system/global-pull-secret-syncer-hsn8z" Jul 06 13:39:45.227264 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:45.227176 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ebea8265-9021-4744-82b9-f2b904b7e3b1-run-openvswitch\") pod \"ovnkube-node-6zfjs\" (UID: \"ebea8265-9021-4744-82b9-f2b904b7e3b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-6zfjs" Jul 06 13:39:45.227264 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:45.227231 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/038d9ebd-ecce-4e27-bc8b-e661a606932e-kubelet-config\") pod \"global-pull-secret-syncer-hsn8z\" (UID: \"038d9ebd-ecce-4e27-bc8b-e661a606932e\") " pod="kube-system/global-pull-secret-syncer-hsn8z" Jul 06 13:39:45.227946 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:45.227567 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/ebea8265-9021-4744-82b9-f2b904b7e3b1-env-overrides\") pod \"ovnkube-node-6zfjs\" (UID: \"ebea8265-9021-4744-82b9-f2b904b7e3b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-6zfjs" Jul 06 13:39:45.227946 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:45.227674 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/cb39fc40-fab7-4adf-ab7a-25d1f3994549-socket-dir\") pod \"aws-ebs-csi-driver-node-gmp8k\" (UID: \"cb39fc40-fab7-4adf-ab7a-25d1f3994549\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gmp8k" Jul 06 13:39:45.227946 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:45.227929 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ebea8265-9021-4744-82b9-f2b904b7e3b1-etc-openvswitch\") pod \"ovnkube-node-6zfjs\" (UID: \"ebea8265-9021-4744-82b9-f2b904b7e3b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-6zfjs" Jul 06 13:39:45.228135 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:45.226709 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/ebea8265-9021-4744-82b9-f2b904b7e3b1-host-kubelet\") pod \"ovnkube-node-6zfjs\" (UID: \"ebea8265-9021-4744-82b9-f2b904b7e3b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-6zfjs" Jul 06 13:39:45.228135 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:45.227979 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/ebea8265-9021-4744-82b9-f2b904b7e3b1-ovnkube-config\") pod \"ovnkube-node-6zfjs\" (UID: \"ebea8265-9021-4744-82b9-f2b904b7e3b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-6zfjs" Jul 06 13:39:45.228135 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:45.228005 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/ebea8265-9021-4744-82b9-f2b904b7e3b1-ovn-node-metrics-cert\") pod \"ovnkube-node-6zfjs\" (UID: \"ebea8265-9021-4744-82b9-f2b904b7e3b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-6zfjs" Jul 06 13:39:45.228135 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:45.228034 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/e4db2c9b-0534-4fda-a860-1457816e7a88-konnectivity-ca\") pod \"konnectivity-agent-9r5x9\" (UID: \"e4db2c9b-0534-4fda-a860-1457816e7a88\") " pod="kube-system/konnectivity-agent-9r5x9" Jul 06 13:39:45.228135 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:45.228056 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ebea8265-9021-4744-82b9-f2b904b7e3b1-var-lib-openvswitch\") pod \"ovnkube-node-6zfjs\" (UID: \"ebea8265-9021-4744-82b9-f2b904b7e3b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-6zfjs" Jul 06 13:39:45.228135 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:45.228098 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/ebea8265-9021-4744-82b9-f2b904b7e3b1-host-cni-netd\") pod \"ovnkube-node-6zfjs\" (UID: \"ebea8265-9021-4744-82b9-f2b904b7e3b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-6zfjs" Jul 06 13:39:45.228434 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:45.228141 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4gtz6\" (UniqueName: \"kubernetes.io/projected/ebea8265-9021-4744-82b9-f2b904b7e3b1-kube-api-access-4gtz6\") pod \"ovnkube-node-6zfjs\" (UID: \"ebea8265-9021-4744-82b9-f2b904b7e3b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-6zfjs" Jul 06 13:39:45.228434 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:45.228163 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/b8922936-e2e6-4a3a-84f9-d6b82fc20195-iptables-alerter-script\") pod \"iptables-alerter-dhts8\" (UID: \"b8922936-e2e6-4a3a-84f9-d6b82fc20195\") " pod="openshift-network-operator/iptables-alerter-dhts8" Jul 06 13:39:45.228434 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:45.228168 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/ebea8265-9021-4744-82b9-f2b904b7e3b1-ovnkube-script-lib\") pod \"ovnkube-node-6zfjs\" (UID: \"ebea8265-9021-4744-82b9-f2b904b7e3b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-6zfjs" Jul 06 13:39:45.228434 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:45.228235 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/cb39fc40-fab7-4adf-ab7a-25d1f3994549-sys-fs\") pod \"aws-ebs-csi-driver-node-gmp8k\" (UID: \"cb39fc40-fab7-4adf-ab7a-25d1f3994549\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gmp8k" Jul 06 13:39:45.228434 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:45.228263 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/ebea8265-9021-4744-82b9-f2b904b7e3b1-systemd-units\") pod \"ovnkube-node-6zfjs\" (UID: \"ebea8265-9021-4744-82b9-f2b904b7e3b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-6zfjs" Jul 06 13:39:45.228434 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:45.228289 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ebea8265-9021-4744-82b9-f2b904b7e3b1-host-run-netns\") pod \"ovnkube-node-6zfjs\" (UID: \"ebea8265-9021-4744-82b9-f2b904b7e3b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-6zfjs" Jul 06 13:39:45.228434 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:45.228313 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/ebea8265-9021-4744-82b9-f2b904b7e3b1-node-log\") pod \"ovnkube-node-6zfjs\" (UID: \"ebea8265-9021-4744-82b9-f2b904b7e3b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-6zfjs" Jul 06 13:39:45.228434 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:45.228387 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/ebea8265-9021-4744-82b9-f2b904b7e3b1-node-log\") pod \"ovnkube-node-6zfjs\" (UID: \"ebea8265-9021-4744-82b9-f2b904b7e3b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-6zfjs" Jul 06 13:39:45.228838 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:45.228497 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/cb39fc40-fab7-4adf-ab7a-25d1f3994549-etc-selinux\") pod \"aws-ebs-csi-driver-node-gmp8k\" (UID: \"cb39fc40-fab7-4adf-ab7a-25d1f3994549\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gmp8k" Jul 06 13:39:45.228838 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:45.228545 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/ebea8265-9021-4744-82b9-f2b904b7e3b1-run-systemd\") pod \"ovnkube-node-6zfjs\" (UID: \"ebea8265-9021-4744-82b9-f2b904b7e3b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-6zfjs" Jul 06 13:39:45.228838 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:45.228594 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/cb39fc40-fab7-4adf-ab7a-25d1f3994549-sys-fs\") pod \"aws-ebs-csi-driver-node-gmp8k\" (UID: \"cb39fc40-fab7-4adf-ab7a-25d1f3994549\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gmp8k" Jul 06 13:39:45.228838 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:45.228611 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/ebea8265-9021-4744-82b9-f2b904b7e3b1-ovnkube-script-lib\") pod \"ovnkube-node-6zfjs\" (UID: \"ebea8265-9021-4744-82b9-f2b904b7e3b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-6zfjs" Jul 06 13:39:45.228838 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:45.228633 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/ebea8265-9021-4744-82b9-f2b904b7e3b1-systemd-units\") pod \"ovnkube-node-6zfjs\" (UID: \"ebea8265-9021-4744-82b9-f2b904b7e3b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-6zfjs" Jul 06 13:39:45.228838 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:45.228669 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ebea8265-9021-4744-82b9-f2b904b7e3b1-host-run-netns\") pod \"ovnkube-node-6zfjs\" (UID: \"ebea8265-9021-4744-82b9-f2b904b7e3b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-6zfjs" Jul 06 13:39:45.228838 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:45.228709 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ebea8265-9021-4744-82b9-f2b904b7e3b1-var-lib-openvswitch\") pod \"ovnkube-node-6zfjs\" (UID: \"ebea8265-9021-4744-82b9-f2b904b7e3b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-6zfjs" Jul 06 13:39:45.229228 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:45.229134 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/ebea8265-9021-4744-82b9-f2b904b7e3b1-ovnkube-config\") pod \"ovnkube-node-6zfjs\" (UID: \"ebea8265-9021-4744-82b9-f2b904b7e3b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-6zfjs" Jul 06 13:39:45.229228 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:45.229163 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ebea8265-9021-4744-82b9-f2b904b7e3b1-host-slash\") pod \"ovnkube-node-6zfjs\" (UID: \"ebea8265-9021-4744-82b9-f2b904b7e3b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-6zfjs" Jul 06 13:39:45.229228 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:45.229188 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/ebea8265-9021-4744-82b9-f2b904b7e3b1-host-cni-netd\") pod \"ovnkube-node-6zfjs\" (UID: \"ebea8265-9021-4744-82b9-f2b904b7e3b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-6zfjs" Jul 06 13:39:45.229483 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:45.229227 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/cb39fc40-fab7-4adf-ab7a-25d1f3994549-kubelet-dir\") pod \"aws-ebs-csi-driver-node-gmp8k\" (UID: \"cb39fc40-fab7-4adf-ab7a-25d1f3994549\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gmp8k" Jul 06 13:39:45.229483 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:45.229257 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/e4db2c9b-0534-4fda-a860-1457816e7a88-konnectivity-ca\") pod \"konnectivity-agent-9r5x9\" (UID: \"e4db2c9b-0534-4fda-a860-1457816e7a88\") " pod="kube-system/konnectivity-agent-9r5x9" Jul 06 13:39:45.229483 ip-10-0-138-163 kubenswrapper[2573]: E0706 13:39:45.229358 2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 13:39:45.229483 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:45.229385 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ebea8265-9021-4744-82b9-f2b904b7e3b1-host-cni-bin\") pod \"ovnkube-node-6zfjs\" (UID: \"ebea8265-9021-4744-82b9-f2b904b7e3b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-6zfjs" Jul 06 13:39:45.229483 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:45.229449 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/cb39fc40-fab7-4adf-ab7a-25d1f3994549-device-dir\") pod \"aws-ebs-csi-driver-node-gmp8k\" (UID: \"cb39fc40-fab7-4adf-ab7a-25d1f3994549\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gmp8k" Jul 06 13:39:45.229483 ip-10-0-138-163 kubenswrapper[2573]: E0706 13:39:45.229473 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/038d9ebd-ecce-4e27-bc8b-e661a606932e-original-pull-secret podName:038d9ebd-ecce-4e27-bc8b-e661a606932e nodeName:}" failed. No retries permitted until 2026-07-06 13:39:45.72945158 +0000 UTC m=+3.106050527 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/038d9ebd-ecce-4e27-bc8b-e661a606932e-original-pull-secret") pod "global-pull-secret-syncer-hsn8z" (UID: "038d9ebd-ecce-4e27-bc8b-e661a606932e") : object "kube-system"/"original-pull-secret" not registered Jul 06 13:39:45.231759 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:45.231731 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/ebea8265-9021-4744-82b9-f2b904b7e3b1-ovn-node-metrics-cert\") pod \"ovnkube-node-6zfjs\" (UID: \"ebea8265-9021-4744-82b9-f2b904b7e3b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-6zfjs" Jul 06 13:39:45.231870 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:45.231835 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/e4db2c9b-0534-4fda-a860-1457816e7a88-agent-certs\") pod \"konnectivity-agent-9r5x9\" (UID: \"e4db2c9b-0534-4fda-a860-1457816e7a88\") " pod="kube-system/konnectivity-agent-9r5x9" Jul 06 13:39:45.235469 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:45.235443 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sxszw\" (UniqueName: \"kubernetes.io/projected/b8922936-e2e6-4a3a-84f9-d6b82fc20195-kube-api-access-sxszw\") pod \"iptables-alerter-dhts8\" (UID: \"b8922936-e2e6-4a3a-84f9-d6b82fc20195\") " pod="openshift-network-operator/iptables-alerter-dhts8" Jul 06 13:39:45.236439 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:45.236413 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2pmm8\" (UniqueName: \"kubernetes.io/projected/cb39fc40-fab7-4adf-ab7a-25d1f3994549-kube-api-access-2pmm8\") pod \"aws-ebs-csi-driver-node-gmp8k\" (UID: \"cb39fc40-fab7-4adf-ab7a-25d1f3994549\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gmp8k" Jul 06 13:39:45.240020 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:45.239973 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4gtz6\" (UniqueName: \"kubernetes.io/projected/ebea8265-9021-4744-82b9-f2b904b7e3b1-kube-api-access-4gtz6\") pod \"ovnkube-node-6zfjs\" (UID: \"ebea8265-9021-4744-82b9-f2b904b7e3b1\") " pod="openshift-ovn-kubernetes/ovnkube-node-6zfjs" Jul 06 13:39:45.240894 ip-10-0-138-163 kubenswrapper[2573]: E0706 13:39:45.240874 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 13:39:45.240894 ip-10-0-138-163 kubenswrapper[2573]: E0706 13:39:45.240897 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 13:39:45.241029 ip-10-0-138-163 kubenswrapper[2573]: E0706 13:39:45.240907 2573 projected.go:196] Error preparing data for projected volume kube-api-access-vhrtn for pod openshift-network-diagnostics/network-check-target-dr8q7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 13:39:45.241029 ip-10-0-138-163 kubenswrapper[2573]: E0706 13:39:45.240978 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1aeba52d-6db7-4cb7-bdc8-eb9eda49b30f-kube-api-access-vhrtn podName:1aeba52d-6db7-4cb7-bdc8-eb9eda49b30f nodeName:}" failed. No retries permitted until 2026-07-06 13:39:45.740965381 +0000 UTC m=+3.117564324 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-vhrtn" (UniqueName: "kubernetes.io/projected/1aeba52d-6db7-4cb7-bdc8-eb9eda49b30f-kube-api-access-vhrtn") pod "network-check-target-dr8q7" (UID: "1aeba52d-6db7-4cb7-bdc8-eb9eda49b30f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 13:39:45.262332 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:45.262305 2573 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 06 13:39:45.315533 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:45.315501 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-5qvhz" Jul 06 13:39:45.323287 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:45.323263 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-8flhb" Jul 06 13:39:45.335656 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:45.335627 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-r49sw" Jul 06 13:39:45.340605 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:45.340576 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-v9c8w" Jul 06 13:39:45.349465 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:45.349443 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-8l59v" Jul 06 13:39:45.357422 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:45.357404 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-dhts8" Jul 06 13:39:45.366241 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:45.366218 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-6zfjs" Jul 06 13:39:45.372324 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:45.372289 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-9r5x9" Jul 06 13:39:45.379218 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:45.379192 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gmp8k" Jul 06 13:39:45.632348 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:45.632260 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8250b72b-73e5-442c-9e18-11a3cbceee8e-metrics-certs\") pod \"network-metrics-daemon-jj6vh\" (UID: \"8250b72b-73e5-442c-9e18-11a3cbceee8e\") " pod="openshift-multus/network-metrics-daemon-jj6vh" Jul 06 13:39:45.632500 ip-10-0-138-163 kubenswrapper[2573]: E0706 13:39:45.632441 2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 13:39:45.632500 ip-10-0-138-163 kubenswrapper[2573]: E0706 13:39:45.632497 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8250b72b-73e5-442c-9e18-11a3cbceee8e-metrics-certs podName:8250b72b-73e5-442c-9e18-11a3cbceee8e nodeName:}" failed. No retries permitted until 2026-07-06 13:39:46.632482566 +0000 UTC m=+4.009081507 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8250b72b-73e5-442c-9e18-11a3cbceee8e-metrics-certs") pod "network-metrics-daemon-jj6vh" (UID: "8250b72b-73e5-442c-9e18-11a3cbceee8e") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 13:39:45.733623 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:45.733590 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/038d9ebd-ecce-4e27-bc8b-e661a606932e-original-pull-secret\") pod \"global-pull-secret-syncer-hsn8z\" (UID: \"038d9ebd-ecce-4e27-bc8b-e661a606932e\") " pod="kube-system/global-pull-secret-syncer-hsn8z" Jul 06 13:39:45.733801 ip-10-0-138-163 kubenswrapper[2573]: E0706 13:39:45.733712 2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 13:39:45.733801 ip-10-0-138-163 kubenswrapper[2573]: E0706 13:39:45.733779 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/038d9ebd-ecce-4e27-bc8b-e661a606932e-original-pull-secret podName:038d9ebd-ecce-4e27-bc8b-e661a606932e nodeName:}" failed. No retries permitted until 2026-07-06 13:39:46.733759213 +0000 UTC m=+4.110358154 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/038d9ebd-ecce-4e27-bc8b-e661a606932e-original-pull-secret") pod "global-pull-secret-syncer-hsn8z" (UID: "038d9ebd-ecce-4e27-bc8b-e661a606932e") : object "kube-system"/"original-pull-secret" not registered Jul 06 13:39:45.833923 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:45.833877 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vhrtn\" (UniqueName: \"kubernetes.io/projected/1aeba52d-6db7-4cb7-bdc8-eb9eda49b30f-kube-api-access-vhrtn\") pod \"network-check-target-dr8q7\" (UID: \"1aeba52d-6db7-4cb7-bdc8-eb9eda49b30f\") " pod="openshift-network-diagnostics/network-check-target-dr8q7" Jul 06 13:39:45.834094 ip-10-0-138-163 kubenswrapper[2573]: E0706 13:39:45.834064 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 13:39:45.834094 ip-10-0-138-163 kubenswrapper[2573]: E0706 13:39:45.834091 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 13:39:45.834182 ip-10-0-138-163 kubenswrapper[2573]: E0706 13:39:45.834103 2573 projected.go:196] Error preparing data for projected volume kube-api-access-vhrtn for pod openshift-network-diagnostics/network-check-target-dr8q7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 13:39:45.834182 ip-10-0-138-163 kubenswrapper[2573]: E0706 13:39:45.834164 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1aeba52d-6db7-4cb7-bdc8-eb9eda49b30f-kube-api-access-vhrtn podName:1aeba52d-6db7-4cb7-bdc8-eb9eda49b30f nodeName:}" failed. No retries permitted until 2026-07-06 13:39:46.83414503 +0000 UTC m=+4.210743970 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-vhrtn" (UniqueName: "kubernetes.io/projected/1aeba52d-6db7-4cb7-bdc8-eb9eda49b30f-kube-api-access-vhrtn") pod "network-check-target-dr8q7" (UID: "1aeba52d-6db7-4cb7-bdc8-eb9eda49b30f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 13:39:46.058589 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:46.058464 2573 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-05 13:34:44 +0000 UTC" deadline="2028-02-19 13:34:48.078297778 +0000 UTC" Jul 06 13:39:46.058589 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:46.058527 2573 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14231h55m2.019775978s" Jul 06 13:39:46.346936 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:46.346891 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode4db2c9b_0534_4fda_a860_1457816e7a88.slice/crio-7f48f3a3b60201c76cd6c5dd4ccfae92e1080c89d37ba24bd616e02d3e4d9c58 WatchSource:0}: Error finding container 7f48f3a3b60201c76cd6c5dd4ccfae92e1080c89d37ba24bd616e02d3e4d9c58: Status 404 returned error can't find the container with id 7f48f3a3b60201c76cd6c5dd4ccfae92e1080c89d37ba24bd616e02d3e4d9c58 Jul 06 13:39:46.348599 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:46.348511 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podea708850_a059_4fb9_973f_5460acad0659.slice/crio-1c4e9a50d9674ffb0be23d30a5235cf12164febc7440c7a8e69a3f62586c5c3b WatchSource:0}: Error finding container 1c4e9a50d9674ffb0be23d30a5235cf12164febc7440c7a8e69a3f62586c5c3b: Status 404 returned error can't find the container with id 1c4e9a50d9674ffb0be23d30a5235cf12164febc7440c7a8e69a3f62586c5c3b Jul 06 13:39:46.352738 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:46.352613 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcb39fc40_fab7_4adf_ab7a_25d1f3994549.slice/crio-592c6b6e50379dcd81016a726314e04f75647dcf00a44533b98bef645dc72b0c WatchSource:0}: Error finding container 592c6b6e50379dcd81016a726314e04f75647dcf00a44533b98bef645dc72b0c: Status 404 returned error can't find the container with id 592c6b6e50379dcd81016a726314e04f75647dcf00a44533b98bef645dc72b0c Jul 06 13:39:46.355434 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:46.355413 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podebea8265_9021_4744_82b9_f2b904b7e3b1.slice/crio-7e8ad7a4c0382a0d1306c7979233e8893b88b58cd07bacf2c46dadeed36aba53 WatchSource:0}: Error finding container 7e8ad7a4c0382a0d1306c7979233e8893b88b58cd07bacf2c46dadeed36aba53: Status 404 returned error can't find the container with id 7e8ad7a4c0382a0d1306c7979233e8893b88b58cd07bacf2c46dadeed36aba53 Jul 06 13:39:46.356158 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:46.356135 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod010dfdbb_622e_4931_a618_8e465448aa80.slice/crio-1db5c77bc95a7141607f6eb5b3b6a5013c43073972225c5abd9ae40beca93456 WatchSource:0}: Error finding container 1db5c77bc95a7141607f6eb5b3b6a5013c43073972225c5abd9ae40beca93456: Status 404 returned error can't find the container with id 1db5c77bc95a7141607f6eb5b3b6a5013c43073972225c5abd9ae40beca93456 Jul 06 13:39:46.357976 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:46.357902 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod99283577_cbc0_4406_a369_c958a1b6d1dc.slice/crio-280617361cefcac2f20fcbc6c655aa5d64191276a5cec304907f3bf9558947d3 WatchSource:0}: Error finding container 280617361cefcac2f20fcbc6c655aa5d64191276a5cec304907f3bf9558947d3: Status 404 returned error can't find the container with id 280617361cefcac2f20fcbc6c655aa5d64191276a5cec304907f3bf9558947d3 Jul 06 13:39:46.359421 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:46.359315 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc3396eac_840e_41a5_9639_a78c864904af.slice/crio-df9d5f9fef12d0b7b9fa27f4864ac5c3ae54ab2cc0d7379aae4b33c9192f0328 WatchSource:0}: Error finding container df9d5f9fef12d0b7b9fa27f4864ac5c3ae54ab2cc0d7379aae4b33c9192f0328: Status 404 returned error can't find the container with id df9d5f9fef12d0b7b9fa27f4864ac5c3ae54ab2cc0d7379aae4b33c9192f0328 Jul 06 13:39:46.360650 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:46.360622 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1e9a1360_d243_4b99_9dbe_b37d77b43a78.slice/crio-1ea37e1d8a322ded1ab24e6842504487d30f50cab50bf7292c4ed18b6560e626 WatchSource:0}: Error finding container 1ea37e1d8a322ded1ab24e6842504487d30f50cab50bf7292c4ed18b6560e626: Status 404 returned error can't find the container with id 1ea37e1d8a322ded1ab24e6842504487d30f50cab50bf7292c4ed18b6560e626 Jul 06 13:39:46.361305 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:39:46.361194 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb8922936_e2e6_4a3a_84f9_d6b82fc20195.slice/crio-b7bc2d114fb82acb2d5ecce05eb117a11445b168a7b44a6cdf6ad08b1e2b8209 WatchSource:0}: Error finding container b7bc2d114fb82acb2d5ecce05eb117a11445b168a7b44a6cdf6ad08b1e2b8209: Status 404 returned error can't find the container with id b7bc2d114fb82acb2d5ecce05eb117a11445b168a7b44a6cdf6ad08b1e2b8209 Jul 06 13:39:46.640169 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:46.639988 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8250b72b-73e5-442c-9e18-11a3cbceee8e-metrics-certs\") pod \"network-metrics-daemon-jj6vh\" (UID: \"8250b72b-73e5-442c-9e18-11a3cbceee8e\") " pod="openshift-multus/network-metrics-daemon-jj6vh" Jul 06 13:39:46.640251 ip-10-0-138-163 kubenswrapper[2573]: E0706 13:39:46.640169 2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 13:39:46.640321 ip-10-0-138-163 kubenswrapper[2573]: E0706 13:39:46.640310 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8250b72b-73e5-442c-9e18-11a3cbceee8e-metrics-certs podName:8250b72b-73e5-442c-9e18-11a3cbceee8e nodeName:}" failed. No retries permitted until 2026-07-06 13:39:48.64028866 +0000 UTC m=+6.016887605 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8250b72b-73e5-442c-9e18-11a3cbceee8e-metrics-certs") pod "network-metrics-daemon-jj6vh" (UID: "8250b72b-73e5-442c-9e18-11a3cbceee8e") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 13:39:46.740703 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:46.740671 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/038d9ebd-ecce-4e27-bc8b-e661a606932e-original-pull-secret\") pod \"global-pull-secret-syncer-hsn8z\" (UID: \"038d9ebd-ecce-4e27-bc8b-e661a606932e\") " pod="kube-system/global-pull-secret-syncer-hsn8z" Jul 06 13:39:46.740840 ip-10-0-138-163 kubenswrapper[2573]: E0706 13:39:46.740785 2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 13:39:46.740882 ip-10-0-138-163 kubenswrapper[2573]: E0706 13:39:46.740841 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/038d9ebd-ecce-4e27-bc8b-e661a606932e-original-pull-secret podName:038d9ebd-ecce-4e27-bc8b-e661a606932e nodeName:}" failed. No retries permitted until 2026-07-06 13:39:48.74082835 +0000 UTC m=+6.117427290 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/038d9ebd-ecce-4e27-bc8b-e661a606932e-original-pull-secret") pod "global-pull-secret-syncer-hsn8z" (UID: "038d9ebd-ecce-4e27-bc8b-e661a606932e") : object "kube-system"/"original-pull-secret" not registered Jul 06 13:39:46.841966 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:46.841933 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vhrtn\" (UniqueName: \"kubernetes.io/projected/1aeba52d-6db7-4cb7-bdc8-eb9eda49b30f-kube-api-access-vhrtn\") pod \"network-check-target-dr8q7\" (UID: \"1aeba52d-6db7-4cb7-bdc8-eb9eda49b30f\") " pod="openshift-network-diagnostics/network-check-target-dr8q7" Jul 06 13:39:46.842206 ip-10-0-138-163 kubenswrapper[2573]: E0706 13:39:46.842130 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 13:39:46.842206 ip-10-0-138-163 kubenswrapper[2573]: E0706 13:39:46.842159 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 13:39:46.842206 ip-10-0-138-163 kubenswrapper[2573]: E0706 13:39:46.842176 2573 projected.go:196] Error preparing data for projected volume kube-api-access-vhrtn for pod openshift-network-diagnostics/network-check-target-dr8q7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 13:39:46.842454 ip-10-0-138-163 kubenswrapper[2573]: E0706 13:39:46.842248 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1aeba52d-6db7-4cb7-bdc8-eb9eda49b30f-kube-api-access-vhrtn podName:1aeba52d-6db7-4cb7-bdc8-eb9eda49b30f nodeName:}" failed. No retries permitted until 2026-07-06 13:39:48.84222729 +0000 UTC m=+6.218826234 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-vhrtn" (UniqueName: "kubernetes.io/projected/1aeba52d-6db7-4cb7-bdc8-eb9eda49b30f-kube-api-access-vhrtn") pod "network-check-target-dr8q7" (UID: "1aeba52d-6db7-4cb7-bdc8-eb9eda49b30f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 13:39:47.162214 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:47.158898 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dr8q7" Jul 06 13:39:47.162214 ip-10-0-138-163 kubenswrapper[2573]: E0706 13:39:47.159034 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dr8q7" podUID="1aeba52d-6db7-4cb7-bdc8-eb9eda49b30f" Jul 06 13:39:47.162214 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:47.159509 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jj6vh" Jul 06 13:39:47.162214 ip-10-0-138-163 kubenswrapper[2573]: E0706 13:39:47.159621 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jj6vh" podUID="8250b72b-73e5-442c-9e18-11a3cbceee8e" Jul 06 13:39:47.162214 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:47.159686 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hsn8z" Jul 06 13:39:47.162214 ip-10-0-138-163 kubenswrapper[2573]: E0706 13:39:47.159759 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hsn8z" podUID="038d9ebd-ecce-4e27-bc8b-e661a606932e" Jul 06 13:39:47.170884 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:47.170717 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gmp8k" event={"ID":"cb39fc40-fab7-4adf-ab7a-25d1f3994549","Type":"ContainerStarted","Data":"592c6b6e50379dcd81016a726314e04f75647dcf00a44533b98bef645dc72b0c"} Jul 06 13:39:47.176878 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:47.176803 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-9r5x9" event={"ID":"e4db2c9b-0534-4fda-a860-1457816e7a88","Type":"ContainerStarted","Data":"7f48f3a3b60201c76cd6c5dd4ccfae92e1080c89d37ba24bd616e02d3e4d9c58"} Jul 06 13:39:47.183294 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:47.182859 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-163.ec2.internal" event={"ID":"e455a0f97ea051574dbd820a3603ff90","Type":"ContainerStarted","Data":"a36dba29a3f53c13a48a55694c7710e0c19276cd3e88a7c1e17c39b1d2ddce0a"} Jul 06 13:39:47.184936 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:47.184872 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-r49sw" event={"ID":"99283577-cbc0-4406-a369-c958a1b6d1dc","Type":"ContainerStarted","Data":"280617361cefcac2f20fcbc6c655aa5d64191276a5cec304907f3bf9558947d3"} Jul 06 13:39:47.188488 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:47.188145 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6zfjs" event={"ID":"ebea8265-9021-4744-82b9-f2b904b7e3b1","Type":"ContainerStarted","Data":"7e8ad7a4c0382a0d1306c7979233e8893b88b58cd07bacf2c46dadeed36aba53"} Jul 06 13:39:47.193626 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:47.193567 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-v9c8w" event={"ID":"ea708850-a059-4fb9-973f-5460acad0659","Type":"ContainerStarted","Data":"1c4e9a50d9674ffb0be23d30a5235cf12164febc7440c7a8e69a3f62586c5c3b"} Jul 06 13:39:47.201932 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:47.201641 2573 generic.go:356] "Generic (PLEG): container finished" podID="ad032e325f69035c6ca1e0e6476b91fe" containerID="b443ccd219b393891c62176c0845e83a02173085954d29012d3559e7492a9823" exitCode=0 Jul 06 13:39:47.201932 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:47.201722 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-163.ec2.internal" event={"ID":"ad032e325f69035c6ca1e0e6476b91fe","Type":"ContainerDied","Data":"b443ccd219b393891c62176c0845e83a02173085954d29012d3559e7492a9823"} Jul 06 13:39:47.206128 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:47.206085 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8l59v" event={"ID":"010dfdbb-622e-4931-a618-8e465448aa80","Type":"ContainerStarted","Data":"1db5c77bc95a7141607f6eb5b3b6a5013c43073972225c5abd9ae40beca93456"} Jul 06 13:39:47.211380 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:47.211354 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-dhts8" event={"ID":"b8922936-e2e6-4a3a-84f9-d6b82fc20195","Type":"ContainerStarted","Data":"b7bc2d114fb82acb2d5ecce05eb117a11445b168a7b44a6cdf6ad08b1e2b8209"} Jul 06 13:39:47.218615 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:47.218498 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-8flhb" event={"ID":"1e9a1360-d243-4b99-9dbe-b37d77b43a78","Type":"ContainerStarted","Data":"1ea37e1d8a322ded1ab24e6842504487d30f50cab50bf7292c4ed18b6560e626"} Jul 06 13:39:47.219495 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:47.219451 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-163.ec2.internal" podStartSLOduration=3.219434573 podStartE2EDuration="3.219434573s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 13:39:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 13:39:47.200441621 +0000 UTC m=+4.577040583" watchObservedRunningTime="2026-07-06 13:39:47.219434573 +0000 UTC m=+4.596033535" Jul 06 13:39:47.227072 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:47.227044 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-5qvhz" event={"ID":"c3396eac-840e-41a5-9639-a78c864904af","Type":"ContainerStarted","Data":"df9d5f9fef12d0b7b9fa27f4864ac5c3ae54ab2cc0d7379aae4b33c9192f0328"} Jul 06 13:39:48.248232 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:48.248190 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-163.ec2.internal" event={"ID":"ad032e325f69035c6ca1e0e6476b91fe","Type":"ContainerStarted","Data":"037d5a7b16e469231bf8d8014517211a31e2196c8e02a261b45f0f1fb50b1e6b"} Jul 06 13:39:48.658757 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:48.658667 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8250b72b-73e5-442c-9e18-11a3cbceee8e-metrics-certs\") pod \"network-metrics-daemon-jj6vh\" (UID: \"8250b72b-73e5-442c-9e18-11a3cbceee8e\") " pod="openshift-multus/network-metrics-daemon-jj6vh" Jul 06 13:39:48.658938 ip-10-0-138-163 kubenswrapper[2573]: E0706 13:39:48.658890 2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 13:39:48.659009 ip-10-0-138-163 kubenswrapper[2573]: E0706 13:39:48.658962 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8250b72b-73e5-442c-9e18-11a3cbceee8e-metrics-certs podName:8250b72b-73e5-442c-9e18-11a3cbceee8e nodeName:}" failed. No retries permitted until 2026-07-06 13:39:52.658944045 +0000 UTC m=+10.035542991 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8250b72b-73e5-442c-9e18-11a3cbceee8e-metrics-certs") pod "network-metrics-daemon-jj6vh" (UID: "8250b72b-73e5-442c-9e18-11a3cbceee8e") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 13:39:48.759822 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:48.759784 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/038d9ebd-ecce-4e27-bc8b-e661a606932e-original-pull-secret\") pod \"global-pull-secret-syncer-hsn8z\" (UID: \"038d9ebd-ecce-4e27-bc8b-e661a606932e\") " pod="kube-system/global-pull-secret-syncer-hsn8z" Jul 06 13:39:48.760007 ip-10-0-138-163 kubenswrapper[2573]: E0706 13:39:48.759974 2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 13:39:48.760089 ip-10-0-138-163 kubenswrapper[2573]: E0706 13:39:48.760041 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/038d9ebd-ecce-4e27-bc8b-e661a606932e-original-pull-secret podName:038d9ebd-ecce-4e27-bc8b-e661a606932e nodeName:}" failed. No retries permitted until 2026-07-06 13:39:52.760021124 +0000 UTC m=+10.136620072 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/038d9ebd-ecce-4e27-bc8b-e661a606932e-original-pull-secret") pod "global-pull-secret-syncer-hsn8z" (UID: "038d9ebd-ecce-4e27-bc8b-e661a606932e") : object "kube-system"/"original-pull-secret" not registered Jul 06 13:39:48.860903 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:48.860834 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vhrtn\" (UniqueName: \"kubernetes.io/projected/1aeba52d-6db7-4cb7-bdc8-eb9eda49b30f-kube-api-access-vhrtn\") pod \"network-check-target-dr8q7\" (UID: \"1aeba52d-6db7-4cb7-bdc8-eb9eda49b30f\") " pod="openshift-network-diagnostics/network-check-target-dr8q7" Jul 06 13:39:48.861090 ip-10-0-138-163 kubenswrapper[2573]: E0706 13:39:48.861052 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 13:39:48.861090 ip-10-0-138-163 kubenswrapper[2573]: E0706 13:39:48.861072 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 13:39:48.861244 ip-10-0-138-163 kubenswrapper[2573]: E0706 13:39:48.861103 2573 projected.go:196] Error preparing data for projected volume kube-api-access-vhrtn for pod openshift-network-diagnostics/network-check-target-dr8q7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 13:39:48.861244 ip-10-0-138-163 kubenswrapper[2573]: E0706 13:39:48.861163 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1aeba52d-6db7-4cb7-bdc8-eb9eda49b30f-kube-api-access-vhrtn podName:1aeba52d-6db7-4cb7-bdc8-eb9eda49b30f nodeName:}" failed. No retries permitted until 2026-07-06 13:39:52.861143459 +0000 UTC m=+10.237742417 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-vhrtn" (UniqueName: "kubernetes.io/projected/1aeba52d-6db7-4cb7-bdc8-eb9eda49b30f-kube-api-access-vhrtn") pod "network-check-target-dr8q7" (UID: "1aeba52d-6db7-4cb7-bdc8-eb9eda49b30f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 13:39:49.158884 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:49.158795 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jj6vh" Jul 06 13:39:49.159065 ip-10-0-138-163 kubenswrapper[2573]: E0706 13:39:49.158940 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jj6vh" podUID="8250b72b-73e5-442c-9e18-11a3cbceee8e" Jul 06 13:39:49.159373 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:49.159352 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hsn8z" Jul 06 13:39:49.159479 ip-10-0-138-163 kubenswrapper[2573]: E0706 13:39:49.159457 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hsn8z" podUID="038d9ebd-ecce-4e27-bc8b-e661a606932e" Jul 06 13:39:49.159547 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:49.159501 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dr8q7" Jul 06 13:39:49.159598 ip-10-0-138-163 kubenswrapper[2573]: E0706 13:39:49.159565 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dr8q7" podUID="1aeba52d-6db7-4cb7-bdc8-eb9eda49b30f" Jul 06 13:39:51.157970 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:51.156962 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jj6vh" Jul 06 13:39:51.157970 ip-10-0-138-163 kubenswrapper[2573]: E0706 13:39:51.157138 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jj6vh" podUID="8250b72b-73e5-442c-9e18-11a3cbceee8e" Jul 06 13:39:51.157970 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:51.157570 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hsn8z" Jul 06 13:39:51.157970 ip-10-0-138-163 kubenswrapper[2573]: E0706 13:39:51.157670 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hsn8z" podUID="038d9ebd-ecce-4e27-bc8b-e661a606932e" Jul 06 13:39:51.157970 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:51.157771 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dr8q7" Jul 06 13:39:51.157970 ip-10-0-138-163 kubenswrapper[2573]: E0706 13:39:51.157851 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dr8q7" podUID="1aeba52d-6db7-4cb7-bdc8-eb9eda49b30f" Jul 06 13:39:52.696936 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:52.696815 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8250b72b-73e5-442c-9e18-11a3cbceee8e-metrics-certs\") pod \"network-metrics-daemon-jj6vh\" (UID: \"8250b72b-73e5-442c-9e18-11a3cbceee8e\") " pod="openshift-multus/network-metrics-daemon-jj6vh" Jul 06 13:39:52.697394 ip-10-0-138-163 kubenswrapper[2573]: E0706 13:39:52.697013 2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 13:39:52.697394 ip-10-0-138-163 kubenswrapper[2573]: E0706 13:39:52.697108 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8250b72b-73e5-442c-9e18-11a3cbceee8e-metrics-certs podName:8250b72b-73e5-442c-9e18-11a3cbceee8e nodeName:}" failed. No retries permitted until 2026-07-06 13:40:00.697085611 +0000 UTC m=+18.073684575 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8250b72b-73e5-442c-9e18-11a3cbceee8e-metrics-certs") pod "network-metrics-daemon-jj6vh" (UID: "8250b72b-73e5-442c-9e18-11a3cbceee8e") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 13:39:52.798180 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:52.798103 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/038d9ebd-ecce-4e27-bc8b-e661a606932e-original-pull-secret\") pod \"global-pull-secret-syncer-hsn8z\" (UID: \"038d9ebd-ecce-4e27-bc8b-e661a606932e\") " pod="kube-system/global-pull-secret-syncer-hsn8z" Jul 06 13:39:52.798452 ip-10-0-138-163 kubenswrapper[2573]: E0706 13:39:52.798289 2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 13:39:52.798452 ip-10-0-138-163 kubenswrapper[2573]: E0706 13:39:52.798362 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/038d9ebd-ecce-4e27-bc8b-e661a606932e-original-pull-secret podName:038d9ebd-ecce-4e27-bc8b-e661a606932e nodeName:}" failed. No retries permitted until 2026-07-06 13:40:00.798343353 +0000 UTC m=+18.174942308 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/038d9ebd-ecce-4e27-bc8b-e661a606932e-original-pull-secret") pod "global-pull-secret-syncer-hsn8z" (UID: "038d9ebd-ecce-4e27-bc8b-e661a606932e") : object "kube-system"/"original-pull-secret" not registered Jul 06 13:39:52.899327 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:52.899207 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vhrtn\" (UniqueName: \"kubernetes.io/projected/1aeba52d-6db7-4cb7-bdc8-eb9eda49b30f-kube-api-access-vhrtn\") pod \"network-check-target-dr8q7\" (UID: \"1aeba52d-6db7-4cb7-bdc8-eb9eda49b30f\") " pod="openshift-network-diagnostics/network-check-target-dr8q7" Jul 06 13:39:52.899494 ip-10-0-138-163 kubenswrapper[2573]: E0706 13:39:52.899397 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 13:39:52.899494 ip-10-0-138-163 kubenswrapper[2573]: E0706 13:39:52.899422 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 13:39:52.899494 ip-10-0-138-163 kubenswrapper[2573]: E0706 13:39:52.899434 2573 projected.go:196] Error preparing data for projected volume kube-api-access-vhrtn for pod openshift-network-diagnostics/network-check-target-dr8q7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 13:39:52.899675 ip-10-0-138-163 kubenswrapper[2573]: E0706 13:39:52.899494 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1aeba52d-6db7-4cb7-bdc8-eb9eda49b30f-kube-api-access-vhrtn podName:1aeba52d-6db7-4cb7-bdc8-eb9eda49b30f nodeName:}" failed. No retries permitted until 2026-07-06 13:40:00.899476113 +0000 UTC m=+18.276075069 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-vhrtn" (UniqueName: "kubernetes.io/projected/1aeba52d-6db7-4cb7-bdc8-eb9eda49b30f-kube-api-access-vhrtn") pod "network-check-target-dr8q7" (UID: "1aeba52d-6db7-4cb7-bdc8-eb9eda49b30f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 13:39:53.158068 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:53.157406 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jj6vh" Jul 06 13:39:53.158068 ip-10-0-138-163 kubenswrapper[2573]: E0706 13:39:53.157541 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jj6vh" podUID="8250b72b-73e5-442c-9e18-11a3cbceee8e" Jul 06 13:39:53.158068 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:53.157598 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hsn8z" Jul 06 13:39:53.158068 ip-10-0-138-163 kubenswrapper[2573]: E0706 13:39:53.157670 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hsn8z" podUID="038d9ebd-ecce-4e27-bc8b-e661a606932e" Jul 06 13:39:53.158068 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:53.157914 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dr8q7" Jul 06 13:39:53.158068 ip-10-0-138-163 kubenswrapper[2573]: E0706 13:39:53.158038 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dr8q7" podUID="1aeba52d-6db7-4cb7-bdc8-eb9eda49b30f" Jul 06 13:39:55.156206 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:55.156125 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dr8q7" Jul 06 13:39:55.156642 ip-10-0-138-163 kubenswrapper[2573]: E0706 13:39:55.156260 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dr8q7" podUID="1aeba52d-6db7-4cb7-bdc8-eb9eda49b30f" Jul 06 13:39:55.156708 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:55.156648 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jj6vh" Jul 06 13:39:55.156762 ip-10-0-138-163 kubenswrapper[2573]: E0706 13:39:55.156740 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jj6vh" podUID="8250b72b-73e5-442c-9e18-11a3cbceee8e" Jul 06 13:39:55.157006 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:55.156877 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hsn8z" Jul 06 13:39:55.157006 ip-10-0-138-163 kubenswrapper[2573]: E0706 13:39:55.156969 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hsn8z" podUID="038d9ebd-ecce-4e27-bc8b-e661a606932e" Jul 06 13:39:57.155874 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:57.155836 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hsn8z" Jul 06 13:39:57.155874 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:57.155860 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jj6vh" Jul 06 13:39:57.156286 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:57.155852 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dr8q7" Jul 06 13:39:57.156286 ip-10-0-138-163 kubenswrapper[2573]: E0706 13:39:57.155947 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hsn8z" podUID="038d9ebd-ecce-4e27-bc8b-e661a606932e" Jul 06 13:39:57.156286 ip-10-0-138-163 kubenswrapper[2573]: E0706 13:39:57.156029 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jj6vh" podUID="8250b72b-73e5-442c-9e18-11a3cbceee8e" Jul 06 13:39:57.156286 ip-10-0-138-163 kubenswrapper[2573]: E0706 13:39:57.156103 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dr8q7" podUID="1aeba52d-6db7-4cb7-bdc8-eb9eda49b30f" Jul 06 13:39:58.273853 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:58.273814 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-9r5x9" event={"ID":"e4db2c9b-0534-4fda-a860-1457816e7a88","Type":"ContainerStarted","Data":"e1c6f91812c461d3098d7e4ae53e76f9474ce42c81e71cd467682ab96ceefca5"} Jul 06 13:39:58.289511 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:58.289458 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-9r5x9" podStartSLOduration=3.27886986 podStartE2EDuration="14.289444481s" totalImagesPullingTime="11.010574621s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 13:39:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 13:39:58.289317201 +0000 UTC m=+15.665916162" watchObservedRunningTime="2026-07-06 13:39:58.289444481 +0000 UTC m=+15.666043441" Jul 06 13:39:58.289732 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:58.289706 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-163.ec2.internal" podStartSLOduration=14.28970171 podStartE2EDuration="14.28970171s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 13:39:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 13:39:48.267168632 +0000 UTC m=+5.643767597" watchObservedRunningTime="2026-07-06 13:39:58.28970171 +0000 UTC m=+15.666300670" Jul 06 13:39:59.156735 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:59.156693 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dr8q7" Jul 06 13:39:59.156922 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:59.156704 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jj6vh" Jul 06 13:39:59.156922 ip-10-0-138-163 kubenswrapper[2573]: E0706 13:39:59.156831 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dr8q7" podUID="1aeba52d-6db7-4cb7-bdc8-eb9eda49b30f" Jul 06 13:39:59.156922 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:39:59.156843 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hsn8z" Jul 06 13:39:59.157105 ip-10-0-138-163 kubenswrapper[2573]: E0706 13:39:59.156955 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jj6vh" podUID="8250b72b-73e5-442c-9e18-11a3cbceee8e" Jul 06 13:39:59.157105 ip-10-0-138-163 kubenswrapper[2573]: E0706 13:39:59.157058 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hsn8z" podUID="038d9ebd-ecce-4e27-bc8b-e661a606932e" Jul 06 13:40:00.763951 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:00.763916 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8250b72b-73e5-442c-9e18-11a3cbceee8e-metrics-certs\") pod \"network-metrics-daemon-jj6vh\" (UID: \"8250b72b-73e5-442c-9e18-11a3cbceee8e\") " pod="openshift-multus/network-metrics-daemon-jj6vh" Jul 06 13:40:00.764472 ip-10-0-138-163 kubenswrapper[2573]: E0706 13:40:00.764099 2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 13:40:00.764472 ip-10-0-138-163 kubenswrapper[2573]: E0706 13:40:00.764169 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8250b72b-73e5-442c-9e18-11a3cbceee8e-metrics-certs podName:8250b72b-73e5-442c-9e18-11a3cbceee8e nodeName:}" failed. No retries permitted until 2026-07-06 13:40:16.764145585 +0000 UTC m=+34.140744524 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8250b72b-73e5-442c-9e18-11a3cbceee8e-metrics-certs") pod "network-metrics-daemon-jj6vh" (UID: "8250b72b-73e5-442c-9e18-11a3cbceee8e") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 13:40:00.865201 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:00.865171 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/038d9ebd-ecce-4e27-bc8b-e661a606932e-original-pull-secret\") pod \"global-pull-secret-syncer-hsn8z\" (UID: \"038d9ebd-ecce-4e27-bc8b-e661a606932e\") " pod="kube-system/global-pull-secret-syncer-hsn8z" Jul 06 13:40:00.865380 ip-10-0-138-163 kubenswrapper[2573]: E0706 13:40:00.865329 2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 13:40:00.865429 ip-10-0-138-163 kubenswrapper[2573]: E0706 13:40:00.865403 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/038d9ebd-ecce-4e27-bc8b-e661a606932e-original-pull-secret podName:038d9ebd-ecce-4e27-bc8b-e661a606932e nodeName:}" failed. No retries permitted until 2026-07-06 13:40:16.865384652 +0000 UTC m=+34.241983610 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/038d9ebd-ecce-4e27-bc8b-e661a606932e-original-pull-secret") pod "global-pull-secret-syncer-hsn8z" (UID: "038d9ebd-ecce-4e27-bc8b-e661a606932e") : object "kube-system"/"original-pull-secret" not registered Jul 06 13:40:00.965755 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:00.965724 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vhrtn\" (UniqueName: \"kubernetes.io/projected/1aeba52d-6db7-4cb7-bdc8-eb9eda49b30f-kube-api-access-vhrtn\") pod \"network-check-target-dr8q7\" (UID: \"1aeba52d-6db7-4cb7-bdc8-eb9eda49b30f\") " pod="openshift-network-diagnostics/network-check-target-dr8q7" Jul 06 13:40:00.965930 ip-10-0-138-163 kubenswrapper[2573]: E0706 13:40:00.965913 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 13:40:00.965993 ip-10-0-138-163 kubenswrapper[2573]: E0706 13:40:00.965939 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 13:40:00.965993 ip-10-0-138-163 kubenswrapper[2573]: E0706 13:40:00.965954 2573 projected.go:196] Error preparing data for projected volume kube-api-access-vhrtn for pod openshift-network-diagnostics/network-check-target-dr8q7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 13:40:00.966122 ip-10-0-138-163 kubenswrapper[2573]: E0706 13:40:00.966018 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1aeba52d-6db7-4cb7-bdc8-eb9eda49b30f-kube-api-access-vhrtn podName:1aeba52d-6db7-4cb7-bdc8-eb9eda49b30f nodeName:}" failed. No retries permitted until 2026-07-06 13:40:16.965999422 +0000 UTC m=+34.342598374 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-vhrtn" (UniqueName: "kubernetes.io/projected/1aeba52d-6db7-4cb7-bdc8-eb9eda49b30f-kube-api-access-vhrtn") pod "network-check-target-dr8q7" (UID: "1aeba52d-6db7-4cb7-bdc8-eb9eda49b30f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 13:40:01.156897 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:01.156814 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jj6vh" Jul 06 13:40:01.156897 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:01.156849 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dr8q7" Jul 06 13:40:01.156897 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:01.156814 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hsn8z" Jul 06 13:40:01.157181 ip-10-0-138-163 kubenswrapper[2573]: E0706 13:40:01.156952 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jj6vh" podUID="8250b72b-73e5-442c-9e18-11a3cbceee8e" Jul 06 13:40:01.157181 ip-10-0-138-163 kubenswrapper[2573]: E0706 13:40:01.157099 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hsn8z" podUID="038d9ebd-ecce-4e27-bc8b-e661a606932e" Jul 06 13:40:01.157307 ip-10-0-138-163 kubenswrapper[2573]: E0706 13:40:01.157182 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dr8q7" podUID="1aeba52d-6db7-4cb7-bdc8-eb9eda49b30f" Jul 06 13:40:02.141108 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:02.141072 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-9r5x9" Jul 06 13:40:02.141668 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:02.141650 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-9r5x9" Jul 06 13:40:03.157289 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:03.157049 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dr8q7" Jul 06 13:40:03.157748 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:03.157110 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hsn8z" Jul 06 13:40:03.157748 ip-10-0-138-163 kubenswrapper[2573]: E0706 13:40:03.157374 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dr8q7" podUID="1aeba52d-6db7-4cb7-bdc8-eb9eda49b30f" Jul 06 13:40:03.157748 ip-10-0-138-163 kubenswrapper[2573]: E0706 13:40:03.157472 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hsn8z" podUID="038d9ebd-ecce-4e27-bc8b-e661a606932e" Jul 06 13:40:03.157748 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:03.157141 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jj6vh" Jul 06 13:40:03.157748 ip-10-0-138-163 kubenswrapper[2573]: E0706 13:40:03.157647 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jj6vh" podUID="8250b72b-73e5-442c-9e18-11a3cbceee8e" Jul 06 13:40:05.156723 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:05.156679 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dr8q7" Jul 06 13:40:05.156723 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:05.156714 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hsn8z" Jul 06 13:40:05.157264 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:05.156679 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jj6vh" Jul 06 13:40:05.157264 ip-10-0-138-163 kubenswrapper[2573]: E0706 13:40:05.156794 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dr8q7" podUID="1aeba52d-6db7-4cb7-bdc8-eb9eda49b30f" Jul 06 13:40:05.157264 ip-10-0-138-163 kubenswrapper[2573]: E0706 13:40:05.156892 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jj6vh" podUID="8250b72b-73e5-442c-9e18-11a3cbceee8e" Jul 06 13:40:05.157264 ip-10-0-138-163 kubenswrapper[2573]: E0706 13:40:05.156977 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hsn8z" podUID="038d9ebd-ecce-4e27-bc8b-e661a606932e" Jul 06 13:40:06.291151 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:06.290823 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-r49sw" event={"ID":"99283577-cbc0-4406-a369-c958a1b6d1dc","Type":"ContainerStarted","Data":"3994ad8899b62d620559250ac32feb6e25a9248fef8ec10e749ffd1180023eef"} Jul 06 13:40:06.294087 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:06.294065 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6zfjs" event={"ID":"ebea8265-9021-4744-82b9-f2b904b7e3b1","Type":"ContainerStarted","Data":"24f046dc29dc76083e28293f0708b2388aff59ac02721a9fe2b22669257e04e3"} Jul 06 13:40:06.294190 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:06.294154 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6zfjs" event={"ID":"ebea8265-9021-4744-82b9-f2b904b7e3b1","Type":"ContainerStarted","Data":"5bab505bd39ff0dca7de7f50ad91b1c8f225796acf1ecda9a5ab3e8804048747"} Jul 06 13:40:06.294231 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:06.294209 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6zfjs" event={"ID":"ebea8265-9021-4744-82b9-f2b904b7e3b1","Type":"ContainerStarted","Data":"c779775cc33246f131fff13a9d6c02f9b81893786e8524724cebd26ea55597b5"} Jul 06 13:40:06.294281 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:06.294265 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6zfjs" event={"ID":"ebea8265-9021-4744-82b9-f2b904b7e3b1","Type":"ContainerStarted","Data":"e8d7a0a21398e167ad95003d73601453b8e66a0c508fe72265478ab7fd3bc6dc"} Jul 06 13:40:06.294333 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:06.294300 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6zfjs" event={"ID":"ebea8265-9021-4744-82b9-f2b904b7e3b1","Type":"ContainerStarted","Data":"deb359e8dcec1aca78edcc2ab4db354c4567d154a9a8a9859e5dd226f9514749"} Jul 06 13:40:06.294375 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:06.294342 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6zfjs" event={"ID":"ebea8265-9021-4744-82b9-f2b904b7e3b1","Type":"ContainerStarted","Data":"0d9161a86c17ba7e63cf47ec4a1cdf92ed317f72aa72aac6c9f1beb7dbe9d582"} Jul 06 13:40:06.295497 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:06.295478 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-v9c8w" event={"ID":"ea708850-a059-4fb9-973f-5460acad0659","Type":"ContainerStarted","Data":"134205d2d8d3223bc30cf2886173d041eda93f49753b982665c1676dd1a46d3b"} Jul 06 13:40:06.296994 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:06.296969 2573 generic.go:356] "Generic (PLEG): container finished" podID="010dfdbb-622e-4931-a618-8e465448aa80" containerID="71bb5ef93dfb33c37ae3c72e02ae23e93cefae175a4dd1bedd82b613765e069b" exitCode=0 Jul 06 13:40:06.297102 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:06.297062 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8l59v" event={"ID":"010dfdbb-622e-4931-a618-8e465448aa80","Type":"ContainerDied","Data":"71bb5ef93dfb33c37ae3c72e02ae23e93cefae175a4dd1bedd82b613765e069b"} Jul 06 13:40:06.298485 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:06.298465 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-8flhb" event={"ID":"1e9a1360-d243-4b99-9dbe-b37d77b43a78","Type":"ContainerStarted","Data":"e3a838c268b1469ad1535ec0905f1d3ac502862f6ab7806296df309516831b59"} Jul 06 13:40:06.300004 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:06.299971 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-5qvhz" event={"ID":"c3396eac-840e-41a5-9639-a78c864904af","Type":"ContainerStarted","Data":"a4ff0ca58f5d2708b8aa3e3070ffda4ee798e88212113c517f332cf6c472dbcc"} Jul 06 13:40:06.301368 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:06.301349 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gmp8k" event={"ID":"cb39fc40-fab7-4adf-ab7a-25d1f3994549","Type":"ContainerStarted","Data":"ccfbeadbf50c8800b858b4cba02802d2435948673e3d21a3bb5a909fd4f8e4a7"} Jul 06 13:40:06.309739 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:06.309705 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-r49sw" podStartSLOduration=3.10669541 podStartE2EDuration="22.309694511s" totalImagesPullingTime="19.202999101s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 13:39:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 13:40:06.309344039 +0000 UTC m=+23.685943000" watchObservedRunningTime="2026-07-06 13:40:06.309694511 +0000 UTC m=+23.686293471" Jul 06 13:40:06.324711 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:06.324675 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-5qvhz" podStartSLOduration=11.262603967 podStartE2EDuration="22.32466367s" totalImagesPullingTime="11.062059703s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 13:39:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 13:40:06.32463617 +0000 UTC m=+23.701235127" watchObservedRunningTime="2026-07-06 13:40:06.32466367 +0000 UTC m=+23.701262629" Jul 06 13:40:06.343525 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:06.343482 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-v9c8w" podStartSLOduration=3.181679448 podStartE2EDuration="22.343467894s" totalImagesPullingTime="19.161788446s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 13:39:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 13:40:06.343195394 +0000 UTC m=+23.719794365" watchObservedRunningTime="2026-07-06 13:40:06.343467894 +0000 UTC m=+23.720066853" Jul 06 13:40:06.386319 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:06.386252 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-8flhb" podStartSLOduration=11.325376564 podStartE2EDuration="22.386231733s" totalImagesPullingTime="11.060855169s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 13:39:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 13:40:06.385930178 +0000 UTC m=+23.762529139" watchObservedRunningTime="2026-07-06 13:40:06.386231733 +0000 UTC m=+23.762830741" Jul 06 13:40:07.156895 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:07.156802 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hsn8z" Jul 06 13:40:07.156895 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:07.156821 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dr8q7" Jul 06 13:40:07.156895 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:07.156848 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jj6vh" Jul 06 13:40:07.157286 ip-10-0-138-163 kubenswrapper[2573]: E0706 13:40:07.156942 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hsn8z" podUID="038d9ebd-ecce-4e27-bc8b-e661a606932e" Jul 06 13:40:07.157286 ip-10-0-138-163 kubenswrapper[2573]: E0706 13:40:07.157027 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dr8q7" podUID="1aeba52d-6db7-4cb7-bdc8-eb9eda49b30f" Jul 06 13:40:07.157286 ip-10-0-138-163 kubenswrapper[2573]: E0706 13:40:07.157172 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jj6vh" podUID="8250b72b-73e5-442c-9e18-11a3cbceee8e" Jul 06 13:40:07.304632 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:07.304575 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-dhts8" event={"ID":"b8922936-e2e6-4a3a-84f9-d6b82fc20195","Type":"ContainerStarted","Data":"988b0e627cc58e8cef0f65cd9b8472f8ee7309a68fe99e1869f756925811db9a"} Jul 06 13:40:07.318587 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:07.318545 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-dhts8" podStartSLOduration=12.258211142 podStartE2EDuration="23.31852903s" totalImagesPullingTime="11.060317888s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 13:39:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 13:40:07.31841033 +0000 UTC m=+24.695009293" watchObservedRunningTime="2026-07-06 13:40:07.31852903 +0000 UTC m=+24.695127992" Jul 06 13:40:07.441949 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:07.441922 2573 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 06 13:40:08.089362 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:08.089267 2573 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-06T13:40:07.441945932Z","UUID":"97c1102a-9bc4-4eaf-9934-471e1a5022b3","Handler":null,"Name":"","Endpoint":""} Jul 06 13:40:08.090895 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:08.090874 2573 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 06 13:40:08.091009 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:08.090917 2573 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 06 13:40:08.308724 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:08.308559 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gmp8k" event={"ID":"cb39fc40-fab7-4adf-ab7a-25d1f3994549","Type":"ContainerStarted","Data":"36f348d6bd810ce87aa863cdd50ae9e69a2a47b9ca76792694dcdbab0fe02f80"} Jul 06 13:40:09.156731 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:09.156645 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hsn8z" Jul 06 13:40:09.156891 ip-10-0-138-163 kubenswrapper[2573]: E0706 13:40:09.156760 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hsn8z" podUID="038d9ebd-ecce-4e27-bc8b-e661a606932e" Jul 06 13:40:09.156891 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:09.156645 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jj6vh" Jul 06 13:40:09.157010 ip-10-0-138-163 kubenswrapper[2573]: E0706 13:40:09.156907 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jj6vh" podUID="8250b72b-73e5-442c-9e18-11a3cbceee8e" Jul 06 13:40:09.157010 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:09.156916 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dr8q7" Jul 06 13:40:09.157134 ip-10-0-138-163 kubenswrapper[2573]: E0706 13:40:09.157054 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dr8q7" podUID="1aeba52d-6db7-4cb7-bdc8-eb9eda49b30f" Jul 06 13:40:09.313235 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:09.313198 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6zfjs" event={"ID":"ebea8265-9021-4744-82b9-f2b904b7e3b1","Type":"ContainerStarted","Data":"bec00aee8c8589043d6c4edc75546cbdee7618f51658832e8de31c9bfa9155dd"} Jul 06 13:40:09.314950 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:09.314927 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gmp8k" event={"ID":"cb39fc40-fab7-4adf-ab7a-25d1f3994549","Type":"ContainerStarted","Data":"d326d8953501730c20817d9993a7494d4bc05b719d10c1b25dd628c40765c508"} Jul 06 13:40:09.337895 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:09.337856 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gmp8k" podStartSLOduration=3.190555723 podStartE2EDuration="25.337843468s" totalImagesPullingTime="22.147287745s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 13:39:44 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 13:40:09.337744441 +0000 UTC m=+26.714343403" watchObservedRunningTime="2026-07-06 13:40:09.337843468 +0000 UTC m=+26.714442427" Jul 06 13:40:11.156529 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:11.156440 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jj6vh" Jul 06 13:40:11.156529 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:11.156480 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hsn8z" Jul 06 13:40:11.157230 ip-10-0-138-163 kubenswrapper[2573]: E0706 13:40:11.156596 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jj6vh" podUID="8250b72b-73e5-442c-9e18-11a3cbceee8e" Jul 06 13:40:11.157230 ip-10-0-138-163 kubenswrapper[2573]: E0706 13:40:11.156667 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hsn8z" podUID="038d9ebd-ecce-4e27-bc8b-e661a606932e" Jul 06 13:40:11.157230 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:11.156693 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dr8q7" Jul 06 13:40:11.157230 ip-10-0-138-163 kubenswrapper[2573]: E0706 13:40:11.156777 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dr8q7" podUID="1aeba52d-6db7-4cb7-bdc8-eb9eda49b30f" Jul 06 13:40:12.325255 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:12.324973 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8l59v" event={"ID":"010dfdbb-622e-4931-a618-8e465448aa80","Type":"ContainerStarted","Data":"e450e8d6be8ca1df9a88f4416de9042584b5e13b33158f3beb4b152dc6b53fe6"} Jul 06 13:40:12.328265 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:12.328244 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6zfjs" event={"ID":"ebea8265-9021-4744-82b9-f2b904b7e3b1","Type":"ContainerStarted","Data":"f8adb6a51f647ffe265209dd5b928faacb877adbefb63e938c6aaf837e9574c0"} Jul 06 13:40:12.328459 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:12.328442 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-6zfjs" Jul 06 13:40:12.328573 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:12.328500 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-6zfjs" Jul 06 13:40:12.342538 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:12.342514 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-6zfjs" Jul 06 13:40:12.381942 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:12.381860 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-6zfjs" podStartSLOduration=9.156635661 podStartE2EDuration="28.381846706s" totalImagesPullingTime="19.225211045s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 13:39:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 13:40:12.380698186 +0000 UTC m=+29.757297145" watchObservedRunningTime="2026-07-06 13:40:12.381846706 +0000 UTC m=+29.758445666" Jul 06 13:40:13.111827 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:13.111794 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-9r5x9" Jul 06 13:40:13.112131 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:13.111962 2573 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jul 06 13:40:13.112476 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:13.112451 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-9r5x9" Jul 06 13:40:13.157172 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:13.157111 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jj6vh" Jul 06 13:40:13.157172 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:13.157131 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hsn8z" Jul 06 13:40:13.157398 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:13.157225 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dr8q7" Jul 06 13:40:13.157398 ip-10-0-138-163 kubenswrapper[2573]: E0706 13:40:13.157242 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jj6vh" podUID="8250b72b-73e5-442c-9e18-11a3cbceee8e" Jul 06 13:40:13.157398 ip-10-0-138-163 kubenswrapper[2573]: E0706 13:40:13.157313 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dr8q7" podUID="1aeba52d-6db7-4cb7-bdc8-eb9eda49b30f" Jul 06 13:40:13.157554 ip-10-0-138-163 kubenswrapper[2573]: E0706 13:40:13.157410 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hsn8z" podUID="038d9ebd-ecce-4e27-bc8b-e661a606932e" Jul 06 13:40:13.332683 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:13.332654 2573 generic.go:356] "Generic (PLEG): container finished" podID="010dfdbb-622e-4931-a618-8e465448aa80" containerID="e450e8d6be8ca1df9a88f4416de9042584b5e13b33158f3beb4b152dc6b53fe6" exitCode=0 Jul 06 13:40:13.333127 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:13.332742 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8l59v" event={"ID":"010dfdbb-622e-4931-a618-8e465448aa80","Type":"ContainerDied","Data":"e450e8d6be8ca1df9a88f4416de9042584b5e13b33158f3beb4b152dc6b53fe6"} Jul 06 13:40:13.333392 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:13.333373 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-6zfjs" Jul 06 13:40:13.348439 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:13.348421 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-6zfjs" Jul 06 13:40:14.125716 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:14.125687 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-jj6vh"] Jul 06 13:40:14.125897 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:14.125816 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jj6vh" Jul 06 13:40:14.125945 ip-10-0-138-163 kubenswrapper[2573]: E0706 13:40:14.125915 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jj6vh" podUID="8250b72b-73e5-442c-9e18-11a3cbceee8e" Jul 06 13:40:14.129230 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:14.129211 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-dr8q7"] Jul 06 13:40:14.129330 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:14.129292 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dr8q7" Jul 06 13:40:14.129376 ip-10-0-138-163 kubenswrapper[2573]: E0706 13:40:14.129361 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dr8q7" podUID="1aeba52d-6db7-4cb7-bdc8-eb9eda49b30f" Jul 06 13:40:14.134090 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:14.134066 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-hsn8z"] Jul 06 13:40:14.134193 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:14.134140 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hsn8z" Jul 06 13:40:14.134233 ip-10-0-138-163 kubenswrapper[2573]: E0706 13:40:14.134204 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hsn8z" podUID="038d9ebd-ecce-4e27-bc8b-e661a606932e" Jul 06 13:40:15.338933 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:15.338727 2573 generic.go:356] "Generic (PLEG): container finished" podID="010dfdbb-622e-4931-a618-8e465448aa80" containerID="4d35e9175e965a389c01ff091b6495b82bb54c586fc54cf07d38d39b5ab73a73" exitCode=0 Jul 06 13:40:15.339400 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:15.338801 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8l59v" event={"ID":"010dfdbb-622e-4931-a618-8e465448aa80","Type":"ContainerDied","Data":"4d35e9175e965a389c01ff091b6495b82bb54c586fc54cf07d38d39b5ab73a73"} Jul 06 13:40:16.156124 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:16.156089 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dr8q7" Jul 06 13:40:16.156124 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:16.156111 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jj6vh" Jul 06 13:40:16.156303 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:16.156112 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hsn8z" Jul 06 13:40:16.156303 ip-10-0-138-163 kubenswrapper[2573]: E0706 13:40:16.156175 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dr8q7" podUID="1aeba52d-6db7-4cb7-bdc8-eb9eda49b30f" Jul 06 13:40:16.156303 ip-10-0-138-163 kubenswrapper[2573]: E0706 13:40:16.156292 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jj6vh" podUID="8250b72b-73e5-442c-9e18-11a3cbceee8e" Jul 06 13:40:16.156440 ip-10-0-138-163 kubenswrapper[2573]: E0706 13:40:16.156384 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hsn8z" podUID="038d9ebd-ecce-4e27-bc8b-e661a606932e" Jul 06 13:40:16.343493 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:16.343464 2573 generic.go:356] "Generic (PLEG): container finished" podID="010dfdbb-622e-4931-a618-8e465448aa80" containerID="2332292f4698610a0ace912cd9e9fade96fcf75a750e49d583d745d9c14c3a96" exitCode=0 Jul 06 13:40:16.344125 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:16.343530 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8l59v" event={"ID":"010dfdbb-622e-4931-a618-8e465448aa80","Type":"ContainerDied","Data":"2332292f4698610a0ace912cd9e9fade96fcf75a750e49d583d745d9c14c3a96"} Jul 06 13:40:16.785672 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:16.785646 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8250b72b-73e5-442c-9e18-11a3cbceee8e-metrics-certs\") pod \"network-metrics-daemon-jj6vh\" (UID: \"8250b72b-73e5-442c-9e18-11a3cbceee8e\") " pod="openshift-multus/network-metrics-daemon-jj6vh" Jul 06 13:40:16.785831 ip-10-0-138-163 kubenswrapper[2573]: E0706 13:40:16.785770 2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 13:40:16.785831 ip-10-0-138-163 kubenswrapper[2573]: E0706 13:40:16.785824 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8250b72b-73e5-442c-9e18-11a3cbceee8e-metrics-certs podName:8250b72b-73e5-442c-9e18-11a3cbceee8e nodeName:}" failed. No retries permitted until 2026-07-06 13:40:48.785808127 +0000 UTC m=+66.162407081 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8250b72b-73e5-442c-9e18-11a3cbceee8e-metrics-certs") pod "network-metrics-daemon-jj6vh" (UID: "8250b72b-73e5-442c-9e18-11a3cbceee8e") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 13:40:16.886662 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:16.886594 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/038d9ebd-ecce-4e27-bc8b-e661a606932e-original-pull-secret\") pod \"global-pull-secret-syncer-hsn8z\" (UID: \"038d9ebd-ecce-4e27-bc8b-e661a606932e\") " pod="kube-system/global-pull-secret-syncer-hsn8z" Jul 06 13:40:16.886784 ip-10-0-138-163 kubenswrapper[2573]: E0706 13:40:16.886712 2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 13:40:16.886784 ip-10-0-138-163 kubenswrapper[2573]: E0706 13:40:16.886758 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/038d9ebd-ecce-4e27-bc8b-e661a606932e-original-pull-secret podName:038d9ebd-ecce-4e27-bc8b-e661a606932e nodeName:}" failed. No retries permitted until 2026-07-06 13:40:48.886745731 +0000 UTC m=+66.263344673 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/038d9ebd-ecce-4e27-bc8b-e661a606932e-original-pull-secret") pod "global-pull-secret-syncer-hsn8z" (UID: "038d9ebd-ecce-4e27-bc8b-e661a606932e") : object "kube-system"/"original-pull-secret" not registered Jul 06 13:40:16.987278 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:16.987244 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vhrtn\" (UniqueName: \"kubernetes.io/projected/1aeba52d-6db7-4cb7-bdc8-eb9eda49b30f-kube-api-access-vhrtn\") pod \"network-check-target-dr8q7\" (UID: \"1aeba52d-6db7-4cb7-bdc8-eb9eda49b30f\") " pod="openshift-network-diagnostics/network-check-target-dr8q7" Jul 06 13:40:16.987454 ip-10-0-138-163 kubenswrapper[2573]: E0706 13:40:16.987381 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 13:40:16.987454 ip-10-0-138-163 kubenswrapper[2573]: E0706 13:40:16.987400 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 13:40:16.987454 ip-10-0-138-163 kubenswrapper[2573]: E0706 13:40:16.987414 2573 projected.go:196] Error preparing data for projected volume kube-api-access-vhrtn for pod openshift-network-diagnostics/network-check-target-dr8q7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 13:40:16.987612 ip-10-0-138-163 kubenswrapper[2573]: E0706 13:40:16.987467 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1aeba52d-6db7-4cb7-bdc8-eb9eda49b30f-kube-api-access-vhrtn podName:1aeba52d-6db7-4cb7-bdc8-eb9eda49b30f nodeName:}" failed. No retries permitted until 2026-07-06 13:40:48.987455135 +0000 UTC m=+66.364054077 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-vhrtn" (UniqueName: "kubernetes.io/projected/1aeba52d-6db7-4cb7-bdc8-eb9eda49b30f-kube-api-access-vhrtn") pod "network-check-target-dr8q7" (UID: "1aeba52d-6db7-4cb7-bdc8-eb9eda49b30f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 13:40:18.156572 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:18.156539 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jj6vh" Jul 06 13:40:18.157059 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:18.156558 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hsn8z" Jul 06 13:40:18.157059 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:18.156668 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dr8q7" Jul 06 13:40:18.157059 ip-10-0-138-163 kubenswrapper[2573]: E0706 13:40:18.156669 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jj6vh" podUID="8250b72b-73e5-442c-9e18-11a3cbceee8e" Jul 06 13:40:18.157059 ip-10-0-138-163 kubenswrapper[2573]: E0706 13:40:18.156757 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hsn8z" podUID="038d9ebd-ecce-4e27-bc8b-e661a606932e" Jul 06 13:40:18.157059 ip-10-0-138-163 kubenswrapper[2573]: E0706 13:40:18.156825 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dr8q7" podUID="1aeba52d-6db7-4cb7-bdc8-eb9eda49b30f" Jul 06 13:40:18.387895 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:18.387813 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-163.ec2.internal" event="NodeReady" Jul 06 13:40:18.388061 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:18.387965 2573 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 06 13:40:18.423344 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:18.423312 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-65fd8c9c68-9mp5n"] Jul 06 13:40:18.425419 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:18.425395 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-65fd8c9c68-9mp5n" Jul 06 13:40:18.428111 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:18.428087 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-c858x\"" Jul 06 13:40:18.428471 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:18.428319 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 06 13:40:18.428471 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:18.428392 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 06 13:40:18.428471 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:18.428400 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 06 13:40:18.434413 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:18.433951 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 06 13:40:18.440454 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:18.440410 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-65fd8c9c68-9mp5n"] Jul 06 13:40:18.443492 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:18.443473 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-cm7lv"] Jul 06 13:40:18.445256 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:18.445240 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-6j4hj"] Jul 06 13:40:18.445356 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:18.445324 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-cm7lv" Jul 06 13:40:18.447250 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:18.447233 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-6j4hj" Jul 06 13:40:18.448098 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:18.448081 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 06 13:40:18.448310 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:18.448297 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-lqkq5\"" Jul 06 13:40:18.448558 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:18.448544 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 06 13:40:18.449361 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:18.449344 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 06 13:40:18.449435 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:18.449364 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 06 13:40:18.449435 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:18.449427 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-fhbx9\"" Jul 06 13:40:18.449669 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:18.449656 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 06 13:40:18.456207 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:18.456185 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-6j4hj"] Jul 06 13:40:18.460152 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:18.460123 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-cm7lv"] Jul 06 13:40:18.598459 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:18.598424 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/87c92d36-2646-4a77-a03a-27190066fbfe-metrics-tls\") pod \"dns-default-cm7lv\" (UID: \"87c92d36-2646-4a77-a03a-27190066fbfe\") " pod="openshift-dns/dns-default-cm7lv" Jul 06 13:40:18.598459 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:18.598463 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/9fc1c970-76a7-4617-a6f4-0046e9c4f967-installation-pull-secrets\") pod \"image-registry-65fd8c9c68-9mp5n\" (UID: \"9fc1c970-76a7-4617-a6f4-0046e9c4f967\") " pod="openshift-image-registry/image-registry-65fd8c9c68-9mp5n" Jul 06 13:40:18.598658 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:18.598506 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/9fc1c970-76a7-4617-a6f4-0046e9c4f967-ca-trust-extracted\") pod \"image-registry-65fd8c9c68-9mp5n\" (UID: \"9fc1c970-76a7-4617-a6f4-0046e9c4f967\") " pod="openshift-image-registry/image-registry-65fd8c9c68-9mp5n" Jul 06 13:40:18.598658 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:18.598554 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9fc1c970-76a7-4617-a6f4-0046e9c4f967-bound-sa-token\") pod \"image-registry-65fd8c9c68-9mp5n\" (UID: \"9fc1c970-76a7-4617-a6f4-0046e9c4f967\") " pod="openshift-image-registry/image-registry-65fd8c9c68-9mp5n" Jul 06 13:40:18.598658 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:18.598592 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/9fc1c970-76a7-4617-a6f4-0046e9c4f967-registry-certificates\") pod \"image-registry-65fd8c9c68-9mp5n\" (UID: \"9fc1c970-76a7-4617-a6f4-0046e9c4f967\") " pod="openshift-image-registry/image-registry-65fd8c9c68-9mp5n" Jul 06 13:40:18.598658 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:18.598611 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9fc1c970-76a7-4617-a6f4-0046e9c4f967-trusted-ca\") pod \"image-registry-65fd8c9c68-9mp5n\" (UID: \"9fc1c970-76a7-4617-a6f4-0046e9c4f967\") " pod="openshift-image-registry/image-registry-65fd8c9c68-9mp5n" Jul 06 13:40:18.598658 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:18.598630 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gxbv5\" (UniqueName: \"kubernetes.io/projected/523ff6ed-d67a-4ac2-8b8c-985f3fe16845-kube-api-access-gxbv5\") pod \"ingress-canary-6j4hj\" (UID: \"523ff6ed-d67a-4ac2-8b8c-985f3fe16845\") " pod="openshift-ingress-canary/ingress-canary-6j4hj" Jul 06 13:40:18.598817 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:18.598673 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-62vbc\" (UniqueName: \"kubernetes.io/projected/87c92d36-2646-4a77-a03a-27190066fbfe-kube-api-access-62vbc\") pod \"dns-default-cm7lv\" (UID: \"87c92d36-2646-4a77-a03a-27190066fbfe\") " pod="openshift-dns/dns-default-cm7lv" Jul 06 13:40:18.598817 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:18.598691 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/87c92d36-2646-4a77-a03a-27190066fbfe-config-volume\") pod \"dns-default-cm7lv\" (UID: \"87c92d36-2646-4a77-a03a-27190066fbfe\") " pod="openshift-dns/dns-default-cm7lv" Jul 06 13:40:18.598817 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:18.598731 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/87c92d36-2646-4a77-a03a-27190066fbfe-tmp-dir\") pod \"dns-default-cm7lv\" (UID: \"87c92d36-2646-4a77-a03a-27190066fbfe\") " pod="openshift-dns/dns-default-cm7lv" Jul 06 13:40:18.598817 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:18.598749 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/523ff6ed-d67a-4ac2-8b8c-985f3fe16845-cert\") pod \"ingress-canary-6j4hj\" (UID: \"523ff6ed-d67a-4ac2-8b8c-985f3fe16845\") " pod="openshift-ingress-canary/ingress-canary-6j4hj" Jul 06 13:40:18.598817 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:18.598767 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/9fc1c970-76a7-4617-a6f4-0046e9c4f967-image-registry-private-configuration\") pod \"image-registry-65fd8c9c68-9mp5n\" (UID: \"9fc1c970-76a7-4617-a6f4-0046e9c4f967\") " pod="openshift-image-registry/image-registry-65fd8c9c68-9mp5n" Jul 06 13:40:18.598817 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:18.598783 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9fc1c970-76a7-4617-a6f4-0046e9c4f967-registry-tls\") pod \"image-registry-65fd8c9c68-9mp5n\" (UID: \"9fc1c970-76a7-4617-a6f4-0046e9c4f967\") " pod="openshift-image-registry/image-registry-65fd8c9c68-9mp5n" Jul 06 13:40:18.598817 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:18.598806 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2n67v\" (UniqueName: \"kubernetes.io/projected/9fc1c970-76a7-4617-a6f4-0046e9c4f967-kube-api-access-2n67v\") pod \"image-registry-65fd8c9c68-9mp5n\" (UID: \"9fc1c970-76a7-4617-a6f4-0046e9c4f967\") " pod="openshift-image-registry/image-registry-65fd8c9c68-9mp5n" Jul 06 13:40:18.699831 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:18.699757 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/87c92d36-2646-4a77-a03a-27190066fbfe-metrics-tls\") pod \"dns-default-cm7lv\" (UID: \"87c92d36-2646-4a77-a03a-27190066fbfe\") " pod="openshift-dns/dns-default-cm7lv" Jul 06 13:40:18.699831 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:18.699793 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/9fc1c970-76a7-4617-a6f4-0046e9c4f967-installation-pull-secrets\") pod \"image-registry-65fd8c9c68-9mp5n\" (UID: \"9fc1c970-76a7-4617-a6f4-0046e9c4f967\") " pod="openshift-image-registry/image-registry-65fd8c9c68-9mp5n" Jul 06 13:40:18.700029 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:18.699833 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/9fc1c970-76a7-4617-a6f4-0046e9c4f967-ca-trust-extracted\") pod \"image-registry-65fd8c9c68-9mp5n\" (UID: \"9fc1c970-76a7-4617-a6f4-0046e9c4f967\") " pod="openshift-image-registry/image-registry-65fd8c9c68-9mp5n" Jul 06 13:40:18.700029 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:18.699877 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9fc1c970-76a7-4617-a6f4-0046e9c4f967-bound-sa-token\") pod \"image-registry-65fd8c9c68-9mp5n\" (UID: \"9fc1c970-76a7-4617-a6f4-0046e9c4f967\") " pod="openshift-image-registry/image-registry-65fd8c9c68-9mp5n" Jul 06 13:40:18.700029 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:18.699899 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/9fc1c970-76a7-4617-a6f4-0046e9c4f967-registry-certificates\") pod \"image-registry-65fd8c9c68-9mp5n\" (UID: \"9fc1c970-76a7-4617-a6f4-0046e9c4f967\") " pod="openshift-image-registry/image-registry-65fd8c9c68-9mp5n" Jul 06 13:40:18.700029 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:18.699916 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9fc1c970-76a7-4617-a6f4-0046e9c4f967-trusted-ca\") pod \"image-registry-65fd8c9c68-9mp5n\" (UID: \"9fc1c970-76a7-4617-a6f4-0046e9c4f967\") " pod="openshift-image-registry/image-registry-65fd8c9c68-9mp5n" Jul 06 13:40:18.700029 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:18.699938 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gxbv5\" (UniqueName: \"kubernetes.io/projected/523ff6ed-d67a-4ac2-8b8c-985f3fe16845-kube-api-access-gxbv5\") pod \"ingress-canary-6j4hj\" (UID: \"523ff6ed-d67a-4ac2-8b8c-985f3fe16845\") " pod="openshift-ingress-canary/ingress-canary-6j4hj" Jul 06 13:40:18.700029 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:18.699972 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-62vbc\" (UniqueName: \"kubernetes.io/projected/87c92d36-2646-4a77-a03a-27190066fbfe-kube-api-access-62vbc\") pod \"dns-default-cm7lv\" (UID: \"87c92d36-2646-4a77-a03a-27190066fbfe\") " pod="openshift-dns/dns-default-cm7lv" Jul 06 13:40:18.700029 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:18.700001 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/87c92d36-2646-4a77-a03a-27190066fbfe-config-volume\") pod \"dns-default-cm7lv\" (UID: \"87c92d36-2646-4a77-a03a-27190066fbfe\") " pod="openshift-dns/dns-default-cm7lv" Jul 06 13:40:18.700432 ip-10-0-138-163 kubenswrapper[2573]: E0706 13:40:18.700021 2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 06 13:40:18.700432 ip-10-0-138-163 kubenswrapper[2573]: E0706 13:40:18.700128 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/87c92d36-2646-4a77-a03a-27190066fbfe-metrics-tls podName:87c92d36-2646-4a77-a03a-27190066fbfe nodeName:}" failed. No retries permitted until 2026-07-06 13:40:19.200106199 +0000 UTC m=+36.576705137 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/87c92d36-2646-4a77-a03a-27190066fbfe-metrics-tls") pod "dns-default-cm7lv" (UID: "87c92d36-2646-4a77-a03a-27190066fbfe") : secret "dns-default-metrics-tls" not found Jul 06 13:40:18.700432 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:18.700057 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/87c92d36-2646-4a77-a03a-27190066fbfe-tmp-dir\") pod \"dns-default-cm7lv\" (UID: \"87c92d36-2646-4a77-a03a-27190066fbfe\") " pod="openshift-dns/dns-default-cm7lv" Jul 06 13:40:18.700432 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:18.700224 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/523ff6ed-d67a-4ac2-8b8c-985f3fe16845-cert\") pod \"ingress-canary-6j4hj\" (UID: \"523ff6ed-d67a-4ac2-8b8c-985f3fe16845\") " pod="openshift-ingress-canary/ingress-canary-6j4hj" Jul 06 13:40:18.700432 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:18.700282 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/9fc1c970-76a7-4617-a6f4-0046e9c4f967-ca-trust-extracted\") pod \"image-registry-65fd8c9c68-9mp5n\" (UID: \"9fc1c970-76a7-4617-a6f4-0046e9c4f967\") " pod="openshift-image-registry/image-registry-65fd8c9c68-9mp5n" Jul 06 13:40:18.700432 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:18.700357 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/87c92d36-2646-4a77-a03a-27190066fbfe-tmp-dir\") pod \"dns-default-cm7lv\" (UID: \"87c92d36-2646-4a77-a03a-27190066fbfe\") " pod="openshift-dns/dns-default-cm7lv" Jul 06 13:40:18.700432 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:18.700391 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/9fc1c970-76a7-4617-a6f4-0046e9c4f967-image-registry-private-configuration\") pod \"image-registry-65fd8c9c68-9mp5n\" (UID: \"9fc1c970-76a7-4617-a6f4-0046e9c4f967\") " pod="openshift-image-registry/image-registry-65fd8c9c68-9mp5n" Jul 06 13:40:18.700782 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:18.700571 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9fc1c970-76a7-4617-a6f4-0046e9c4f967-registry-tls\") pod \"image-registry-65fd8c9c68-9mp5n\" (UID: \"9fc1c970-76a7-4617-a6f4-0046e9c4f967\") " pod="openshift-image-registry/image-registry-65fd8c9c68-9mp5n" Jul 06 13:40:18.700782 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:18.700610 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2n67v\" (UniqueName: \"kubernetes.io/projected/9fc1c970-76a7-4617-a6f4-0046e9c4f967-kube-api-access-2n67v\") pod \"image-registry-65fd8c9c68-9mp5n\" (UID: \"9fc1c970-76a7-4617-a6f4-0046e9c4f967\") " pod="openshift-image-registry/image-registry-65fd8c9c68-9mp5n" Jul 06 13:40:18.700885 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:18.700844 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/87c92d36-2646-4a77-a03a-27190066fbfe-config-volume\") pod \"dns-default-cm7lv\" (UID: \"87c92d36-2646-4a77-a03a-27190066fbfe\") " pod="openshift-dns/dns-default-cm7lv" Jul 06 13:40:18.700934 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:18.700914 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/9fc1c970-76a7-4617-a6f4-0046e9c4f967-registry-certificates\") pod \"image-registry-65fd8c9c68-9mp5n\" (UID: \"9fc1c970-76a7-4617-a6f4-0046e9c4f967\") " pod="openshift-image-registry/image-registry-65fd8c9c68-9mp5n" Jul 06 13:40:18.700934 ip-10-0-138-163 kubenswrapper[2573]: E0706 13:40:18.700926 2573 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 06 13:40:18.701010 ip-10-0-138-163 kubenswrapper[2573]: E0706 13:40:18.700940 2573 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-65fd8c9c68-9mp5n: secret "image-registry-tls" not found Jul 06 13:40:18.701010 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:18.700940 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9fc1c970-76a7-4617-a6f4-0046e9c4f967-trusted-ca\") pod \"image-registry-65fd8c9c68-9mp5n\" (UID: \"9fc1c970-76a7-4617-a6f4-0046e9c4f967\") " pod="openshift-image-registry/image-registry-65fd8c9c68-9mp5n" Jul 06 13:40:18.701010 ip-10-0-138-163 kubenswrapper[2573]: E0706 13:40:18.700998 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9fc1c970-76a7-4617-a6f4-0046e9c4f967-registry-tls podName:9fc1c970-76a7-4617-a6f4-0046e9c4f967 nodeName:}" failed. No retries permitted until 2026-07-06 13:40:19.200986817 +0000 UTC m=+36.577585755 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9fc1c970-76a7-4617-a6f4-0046e9c4f967-registry-tls") pod "image-registry-65fd8c9c68-9mp5n" (UID: "9fc1c970-76a7-4617-a6f4-0046e9c4f967") : secret "image-registry-tls" not found Jul 06 13:40:18.703992 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:18.703970 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/9fc1c970-76a7-4617-a6f4-0046e9c4f967-image-registry-private-configuration\") pod \"image-registry-65fd8c9c68-9mp5n\" (UID: \"9fc1c970-76a7-4617-a6f4-0046e9c4f967\") " pod="openshift-image-registry/image-registry-65fd8c9c68-9mp5n" Jul 06 13:40:18.704120 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:18.704017 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/9fc1c970-76a7-4617-a6f4-0046e9c4f967-installation-pull-secrets\") pod \"image-registry-65fd8c9c68-9mp5n\" (UID: \"9fc1c970-76a7-4617-a6f4-0046e9c4f967\") " pod="openshift-image-registry/image-registry-65fd8c9c68-9mp5n" Jul 06 13:40:18.704120 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:18.704067 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/523ff6ed-d67a-4ac2-8b8c-985f3fe16845-cert\") pod \"ingress-canary-6j4hj\" (UID: \"523ff6ed-d67a-4ac2-8b8c-985f3fe16845\") " pod="openshift-ingress-canary/ingress-canary-6j4hj" Jul 06 13:40:18.711497 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:18.711466 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-62vbc\" (UniqueName: \"kubernetes.io/projected/87c92d36-2646-4a77-a03a-27190066fbfe-kube-api-access-62vbc\") pod \"dns-default-cm7lv\" (UID: \"87c92d36-2646-4a77-a03a-27190066fbfe\") " pod="openshift-dns/dns-default-cm7lv" Jul 06 13:40:18.711624 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:18.711607 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gxbv5\" (UniqueName: \"kubernetes.io/projected/523ff6ed-d67a-4ac2-8b8c-985f3fe16845-kube-api-access-gxbv5\") pod \"ingress-canary-6j4hj\" (UID: \"523ff6ed-d67a-4ac2-8b8c-985f3fe16845\") " pod="openshift-ingress-canary/ingress-canary-6j4hj" Jul 06 13:40:18.711917 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:18.711884 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9fc1c970-76a7-4617-a6f4-0046e9c4f967-bound-sa-token\") pod \"image-registry-65fd8c9c68-9mp5n\" (UID: \"9fc1c970-76a7-4617-a6f4-0046e9c4f967\") " pod="openshift-image-registry/image-registry-65fd8c9c68-9mp5n" Jul 06 13:40:18.712048 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:18.712017 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2n67v\" (UniqueName: \"kubernetes.io/projected/9fc1c970-76a7-4617-a6f4-0046e9c4f967-kube-api-access-2n67v\") pod \"image-registry-65fd8c9c68-9mp5n\" (UID: \"9fc1c970-76a7-4617-a6f4-0046e9c4f967\") " pod="openshift-image-registry/image-registry-65fd8c9c68-9mp5n" Jul 06 13:40:18.762265 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:18.762247 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-6j4hj" Jul 06 13:40:18.913498 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:18.913267 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-6j4hj"] Jul 06 13:40:18.917341 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:40:18.917316 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod523ff6ed_d67a_4ac2_8b8c_985f3fe16845.slice/crio-972ff0947f7bf2fe4edd40392de6ad065dbec582390fa8f05e5a9dc85d05c48e WatchSource:0}: Error finding container 972ff0947f7bf2fe4edd40392de6ad065dbec582390fa8f05e5a9dc85d05c48e: Status 404 returned error can't find the container with id 972ff0947f7bf2fe4edd40392de6ad065dbec582390fa8f05e5a9dc85d05c48e Jul 06 13:40:19.204557 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:19.204527 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9fc1c970-76a7-4617-a6f4-0046e9c4f967-registry-tls\") pod \"image-registry-65fd8c9c68-9mp5n\" (UID: \"9fc1c970-76a7-4617-a6f4-0046e9c4f967\") " pod="openshift-image-registry/image-registry-65fd8c9c68-9mp5n" Jul 06 13:40:19.205004 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:19.204565 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/87c92d36-2646-4a77-a03a-27190066fbfe-metrics-tls\") pod \"dns-default-cm7lv\" (UID: \"87c92d36-2646-4a77-a03a-27190066fbfe\") " pod="openshift-dns/dns-default-cm7lv" Jul 06 13:40:19.205004 ip-10-0-138-163 kubenswrapper[2573]: E0706 13:40:19.204674 2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 06 13:40:19.205004 ip-10-0-138-163 kubenswrapper[2573]: E0706 13:40:19.204678 2573 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 06 13:40:19.205004 ip-10-0-138-163 kubenswrapper[2573]: E0706 13:40:19.204694 2573 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-65fd8c9c68-9mp5n: secret "image-registry-tls" not found Jul 06 13:40:19.205004 ip-10-0-138-163 kubenswrapper[2573]: E0706 13:40:19.204731 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/87c92d36-2646-4a77-a03a-27190066fbfe-metrics-tls podName:87c92d36-2646-4a77-a03a-27190066fbfe nodeName:}" failed. No retries permitted until 2026-07-06 13:40:20.204719171 +0000 UTC m=+37.581318109 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/87c92d36-2646-4a77-a03a-27190066fbfe-metrics-tls") pod "dns-default-cm7lv" (UID: "87c92d36-2646-4a77-a03a-27190066fbfe") : secret "dns-default-metrics-tls" not found Jul 06 13:40:19.205004 ip-10-0-138-163 kubenswrapper[2573]: E0706 13:40:19.204744 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9fc1c970-76a7-4617-a6f4-0046e9c4f967-registry-tls podName:9fc1c970-76a7-4617-a6f4-0046e9c4f967 nodeName:}" failed. No retries permitted until 2026-07-06 13:40:20.204738564 +0000 UTC m=+37.581337501 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9fc1c970-76a7-4617-a6f4-0046e9c4f967-registry-tls") pod "image-registry-65fd8c9c68-9mp5n" (UID: "9fc1c970-76a7-4617-a6f4-0046e9c4f967") : secret "image-registry-tls" not found Jul 06 13:40:19.351582 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:19.351542 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-6j4hj" event={"ID":"523ff6ed-d67a-4ac2-8b8c-985f3fe16845","Type":"ContainerStarted","Data":"972ff0947f7bf2fe4edd40392de6ad065dbec582390fa8f05e5a9dc85d05c48e"} Jul 06 13:40:20.156193 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:20.156082 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hsn8z" Jul 06 13:40:20.156193 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:20.156113 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jj6vh" Jul 06 13:40:20.156193 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:20.156129 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dr8q7" Jul 06 13:40:20.163426 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:20.163400 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-jzrjm\"" Jul 06 13:40:20.163554 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:20.163425 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 06 13:40:20.163554 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:20.163456 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-rf6qs\"" Jul 06 13:40:20.163554 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:20.163400 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 06 13:40:20.164021 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:20.163844 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 06 13:40:20.164021 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:20.163915 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 06 13:40:20.211360 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:20.211328 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9fc1c970-76a7-4617-a6f4-0046e9c4f967-registry-tls\") pod \"image-registry-65fd8c9c68-9mp5n\" (UID: \"9fc1c970-76a7-4617-a6f4-0046e9c4f967\") " pod="openshift-image-registry/image-registry-65fd8c9c68-9mp5n" Jul 06 13:40:20.211762 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:20.211386 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/87c92d36-2646-4a77-a03a-27190066fbfe-metrics-tls\") pod \"dns-default-cm7lv\" (UID: \"87c92d36-2646-4a77-a03a-27190066fbfe\") " pod="openshift-dns/dns-default-cm7lv" Jul 06 13:40:20.211762 ip-10-0-138-163 kubenswrapper[2573]: E0706 13:40:20.211495 2573 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 06 13:40:20.211762 ip-10-0-138-163 kubenswrapper[2573]: E0706 13:40:20.211513 2573 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-65fd8c9c68-9mp5n: secret "image-registry-tls" not found Jul 06 13:40:20.211762 ip-10-0-138-163 kubenswrapper[2573]: E0706 13:40:20.211532 2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 06 13:40:20.211762 ip-10-0-138-163 kubenswrapper[2573]: E0706 13:40:20.211582 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9fc1c970-76a7-4617-a6f4-0046e9c4f967-registry-tls podName:9fc1c970-76a7-4617-a6f4-0046e9c4f967 nodeName:}" failed. No retries permitted until 2026-07-06 13:40:22.211558355 +0000 UTC m=+39.588157294 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9fc1c970-76a7-4617-a6f4-0046e9c4f967-registry-tls") pod "image-registry-65fd8c9c68-9mp5n" (UID: "9fc1c970-76a7-4617-a6f4-0046e9c4f967") : secret "image-registry-tls" not found Jul 06 13:40:20.211762 ip-10-0-138-163 kubenswrapper[2573]: E0706 13:40:20.211604 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/87c92d36-2646-4a77-a03a-27190066fbfe-metrics-tls podName:87c92d36-2646-4a77-a03a-27190066fbfe nodeName:}" failed. No retries permitted until 2026-07-06 13:40:22.211593733 +0000 UTC m=+39.588192674 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/87c92d36-2646-4a77-a03a-27190066fbfe-metrics-tls") pod "dns-default-cm7lv" (UID: "87c92d36-2646-4a77-a03a-27190066fbfe") : secret "dns-default-metrics-tls" not found Jul 06 13:40:22.228926 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:22.228893 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/87c92d36-2646-4a77-a03a-27190066fbfe-metrics-tls\") pod \"dns-default-cm7lv\" (UID: \"87c92d36-2646-4a77-a03a-27190066fbfe\") " pod="openshift-dns/dns-default-cm7lv" Jul 06 13:40:22.229347 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:22.228979 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9fc1c970-76a7-4617-a6f4-0046e9c4f967-registry-tls\") pod \"image-registry-65fd8c9c68-9mp5n\" (UID: \"9fc1c970-76a7-4617-a6f4-0046e9c4f967\") " pod="openshift-image-registry/image-registry-65fd8c9c68-9mp5n" Jul 06 13:40:22.229347 ip-10-0-138-163 kubenswrapper[2573]: E0706 13:40:22.229064 2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 06 13:40:22.229347 ip-10-0-138-163 kubenswrapper[2573]: E0706 13:40:22.229080 2573 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 06 13:40:22.229347 ip-10-0-138-163 kubenswrapper[2573]: E0706 13:40:22.229091 2573 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-65fd8c9c68-9mp5n: secret "image-registry-tls" not found Jul 06 13:40:22.229347 ip-10-0-138-163 kubenswrapper[2573]: E0706 13:40:22.229127 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/87c92d36-2646-4a77-a03a-27190066fbfe-metrics-tls podName:87c92d36-2646-4a77-a03a-27190066fbfe nodeName:}" failed. No retries permitted until 2026-07-06 13:40:26.229110953 +0000 UTC m=+43.605709891 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/87c92d36-2646-4a77-a03a-27190066fbfe-metrics-tls") pod "dns-default-cm7lv" (UID: "87c92d36-2646-4a77-a03a-27190066fbfe") : secret "dns-default-metrics-tls" not found Jul 06 13:40:22.229347 ip-10-0-138-163 kubenswrapper[2573]: E0706 13:40:22.229142 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9fc1c970-76a7-4617-a6f4-0046e9c4f967-registry-tls podName:9fc1c970-76a7-4617-a6f4-0046e9c4f967 nodeName:}" failed. No retries permitted until 2026-07-06 13:40:26.229135837 +0000 UTC m=+43.605734774 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9fc1c970-76a7-4617-a6f4-0046e9c4f967-registry-tls") pod "image-registry-65fd8c9c68-9mp5n" (UID: "9fc1c970-76a7-4617-a6f4-0046e9c4f967") : secret "image-registry-tls" not found Jul 06 13:40:23.363213 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:23.362959 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-6j4hj" event={"ID":"523ff6ed-d67a-4ac2-8b8c-985f3fe16845","Type":"ContainerStarted","Data":"ea8bb727000262f83a70a8055241aa543542304e89ff7ec9d6f785ed75a5a5cb"} Jul 06 13:40:23.365566 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:23.365539 2573 generic.go:356] "Generic (PLEG): container finished" podID="010dfdbb-622e-4931-a618-8e465448aa80" containerID="1a28e0675b2e4c9f9637ac2870b26c86f1ab63c197c4248742901243d238765c" exitCode=0 Jul 06 13:40:23.365652 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:23.365591 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8l59v" event={"ID":"010dfdbb-622e-4931-a618-8e465448aa80","Type":"ContainerDied","Data":"1a28e0675b2e4c9f9637ac2870b26c86f1ab63c197c4248742901243d238765c"} Jul 06 13:40:23.379970 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:23.379930 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-6j4hj" podStartSLOduration=1.95744267 podStartE2EDuration="5.379916581s" totalImagesPullingTime="3.422473911s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 13:40:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 13:40:23.379379307 +0000 UTC m=+40.755978266" watchObservedRunningTime="2026-07-06 13:40:23.379916581 +0000 UTC m=+40.756515519" Jul 06 13:40:24.269486 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:24.269455 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-7d9ck"] Jul 06 13:40:24.289850 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:24.289827 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-7d9ck" Jul 06 13:40:24.294214 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:24.294188 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-mwkj4\"" Jul 06 13:40:24.294572 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:24.294552 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-7d9ck"] Jul 06 13:40:24.294816 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:24.294801 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jul 06 13:40:24.295164 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:24.295145 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jul 06 13:40:24.295260 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:24.295214 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jul 06 13:40:24.368470 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:24.368444 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-64786d9cbb-lgttx"] Jul 06 13:40:24.370896 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:24.370874 2573 generic.go:356] "Generic (PLEG): container finished" podID="010dfdbb-622e-4931-a618-8e465448aa80" containerID="589d49eb9c9270825a7cd21d75d038305ddcdbd7159b81a20420fb4c712d42fb" exitCode=0 Jul 06 13:40:24.384065 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:24.384022 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8l59v" event={"ID":"010dfdbb-622e-4931-a618-8e465448aa80","Type":"ContainerDied","Data":"589d49eb9c9270825a7cd21d75d038305ddcdbd7159b81a20420fb4c712d42fb"} Jul 06 13:40:24.384159 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:24.384078 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-68b757fb67-z2f98"] Jul 06 13:40:24.384159 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:24.384147 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-lgttx" Jul 06 13:40:24.386274 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:24.386258 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jul 06 13:40:24.386355 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:24.386336 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 06 13:40:24.386546 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:24.386528 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-mc46c\"" Jul 06 13:40:24.387506 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:24.387488 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 06 13:40:24.387564 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:24.387531 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jul 06 13:40:24.408190 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:24.408145 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-64786d9cbb-lgttx"] Jul 06 13:40:24.408303 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:24.408265 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-68b757fb67-z2f98" Jul 06 13:40:24.408422 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:24.408393 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-68b757fb67-z2f98"] Jul 06 13:40:24.412018 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:24.412000 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jul 06 13:40:24.412398 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:24.412378 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jul 06 13:40:24.412688 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:24.412668 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jul 06 13:40:24.412965 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:24.412937 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-d7wjr\"" Jul 06 13:40:24.418769 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:24.418743 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jul 06 13:40:24.422005 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:24.421986 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jul 06 13:40:24.444692 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:24.444673 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d095657b-0d82-44c9-920d-3ac8a3b344f0-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-7d9ck\" (UID: \"d095657b-0d82-44c9-920d-3ac8a3b344f0\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-7d9ck" Jul 06 13:40:24.444755 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:24.444702 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qxt7d\" (UniqueName: \"kubernetes.io/projected/d095657b-0d82-44c9-920d-3ac8a3b344f0-kube-api-access-qxt7d\") pod \"cluster-samples-operator-56fcf86bf-7d9ck\" (UID: \"d095657b-0d82-44c9-920d-3ac8a3b344f0\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-7d9ck" Jul 06 13:40:24.545996 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:24.545936 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/628d0eab-eceb-4062-a2bc-8072b21babd1-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-lgttx\" (UID: \"628d0eab-eceb-4062-a2bc-8072b21babd1\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-lgttx" Jul 06 13:40:24.546141 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:24.546005 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/66e76252-8877-403e-9c30-e56ec0013c24-trusted-ca\") pod \"console-operator-68b757fb67-z2f98\" (UID: \"66e76252-8877-403e-9c30-e56ec0013c24\") " pod="openshift-console-operator/console-operator-68b757fb67-z2f98" Jul 06 13:40:24.546141 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:24.546058 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/628d0eab-eceb-4062-a2bc-8072b21babd1-telemetry-config\") pod \"cluster-monitoring-operator-64786d9cbb-lgttx\" (UID: \"628d0eab-eceb-4062-a2bc-8072b21babd1\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-lgttx" Jul 06 13:40:24.546243 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:24.546144 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d095657b-0d82-44c9-920d-3ac8a3b344f0-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-7d9ck\" (UID: \"d095657b-0d82-44c9-920d-3ac8a3b344f0\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-7d9ck" Jul 06 13:40:24.546243 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:24.546192 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qxt7d\" (UniqueName: \"kubernetes.io/projected/d095657b-0d82-44c9-920d-3ac8a3b344f0-kube-api-access-qxt7d\") pod \"cluster-samples-operator-56fcf86bf-7d9ck\" (UID: \"d095657b-0d82-44c9-920d-3ac8a3b344f0\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-7d9ck" Jul 06 13:40:24.546243 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:24.546224 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-74gj6\" (UniqueName: \"kubernetes.io/projected/66e76252-8877-403e-9c30-e56ec0013c24-kube-api-access-74gj6\") pod \"console-operator-68b757fb67-z2f98\" (UID: \"66e76252-8877-403e-9c30-e56ec0013c24\") " pod="openshift-console-operator/console-operator-68b757fb67-z2f98" Jul 06 13:40:24.546243 ip-10-0-138-163 kubenswrapper[2573]: E0706 13:40:24.546233 2573 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 06 13:40:24.546421 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:24.546288 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/66e76252-8877-403e-9c30-e56ec0013c24-config\") pod \"console-operator-68b757fb67-z2f98\" (UID: \"66e76252-8877-403e-9c30-e56ec0013c24\") " pod="openshift-console-operator/console-operator-68b757fb67-z2f98" Jul 06 13:40:24.546421 ip-10-0-138-163 kubenswrapper[2573]: E0706 13:40:24.546316 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d095657b-0d82-44c9-920d-3ac8a3b344f0-samples-operator-tls podName:d095657b-0d82-44c9-920d-3ac8a3b344f0 nodeName:}" failed. No retries permitted until 2026-07-06 13:40:25.046293904 +0000 UTC m=+42.422892855 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/d095657b-0d82-44c9-920d-3ac8a3b344f0-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-7d9ck" (UID: "d095657b-0d82-44c9-920d-3ac8a3b344f0") : secret "samples-operator-tls" not found Jul 06 13:40:24.546524 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:24.546438 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/66e76252-8877-403e-9c30-e56ec0013c24-serving-cert\") pod \"console-operator-68b757fb67-z2f98\" (UID: \"66e76252-8877-403e-9c30-e56ec0013c24\") " pod="openshift-console-operator/console-operator-68b757fb67-z2f98" Jul 06 13:40:24.546524 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:24.546469 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rnvqc\" (UniqueName: \"kubernetes.io/projected/628d0eab-eceb-4062-a2bc-8072b21babd1-kube-api-access-rnvqc\") pod \"cluster-monitoring-operator-64786d9cbb-lgttx\" (UID: \"628d0eab-eceb-4062-a2bc-8072b21babd1\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-lgttx" Jul 06 13:40:24.556217 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:24.556193 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qxt7d\" (UniqueName: \"kubernetes.io/projected/d095657b-0d82-44c9-920d-3ac8a3b344f0-kube-api-access-qxt7d\") pod \"cluster-samples-operator-56fcf86bf-7d9ck\" (UID: \"d095657b-0d82-44c9-920d-3ac8a3b344f0\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-7d9ck" Jul 06 13:40:24.647618 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:24.647578 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/628d0eab-eceb-4062-a2bc-8072b21babd1-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-lgttx\" (UID: \"628d0eab-eceb-4062-a2bc-8072b21babd1\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-lgttx" Jul 06 13:40:24.647618 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:24.647625 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/66e76252-8877-403e-9c30-e56ec0013c24-trusted-ca\") pod \"console-operator-68b757fb67-z2f98\" (UID: \"66e76252-8877-403e-9c30-e56ec0013c24\") " pod="openshift-console-operator/console-operator-68b757fb67-z2f98" Jul 06 13:40:24.647847 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:24.647645 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/628d0eab-eceb-4062-a2bc-8072b21babd1-telemetry-config\") pod \"cluster-monitoring-operator-64786d9cbb-lgttx\" (UID: \"628d0eab-eceb-4062-a2bc-8072b21babd1\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-lgttx" Jul 06 13:40:24.647847 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:24.647679 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-74gj6\" (UniqueName: \"kubernetes.io/projected/66e76252-8877-403e-9c30-e56ec0013c24-kube-api-access-74gj6\") pod \"console-operator-68b757fb67-z2f98\" (UID: \"66e76252-8877-403e-9c30-e56ec0013c24\") " pod="openshift-console-operator/console-operator-68b757fb67-z2f98" Jul 06 13:40:24.647847 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:24.647718 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/66e76252-8877-403e-9c30-e56ec0013c24-config\") pod \"console-operator-68b757fb67-z2f98\" (UID: \"66e76252-8877-403e-9c30-e56ec0013c24\") " pod="openshift-console-operator/console-operator-68b757fb67-z2f98" Jul 06 13:40:24.647847 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:24.647732 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/66e76252-8877-403e-9c30-e56ec0013c24-serving-cert\") pod \"console-operator-68b757fb67-z2f98\" (UID: \"66e76252-8877-403e-9c30-e56ec0013c24\") " pod="openshift-console-operator/console-operator-68b757fb67-z2f98" Jul 06 13:40:24.647847 ip-10-0-138-163 kubenswrapper[2573]: E0706 13:40:24.647732 2573 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 06 13:40:24.647847 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:24.647746 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rnvqc\" (UniqueName: \"kubernetes.io/projected/628d0eab-eceb-4062-a2bc-8072b21babd1-kube-api-access-rnvqc\") pod \"cluster-monitoring-operator-64786d9cbb-lgttx\" (UID: \"628d0eab-eceb-4062-a2bc-8072b21babd1\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-lgttx" Jul 06 13:40:24.647847 ip-10-0-138-163 kubenswrapper[2573]: E0706 13:40:24.647802 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/628d0eab-eceb-4062-a2bc-8072b21babd1-cluster-monitoring-operator-tls podName:628d0eab-eceb-4062-a2bc-8072b21babd1 nodeName:}" failed. No retries permitted until 2026-07-06 13:40:25.147783394 +0000 UTC m=+42.524382355 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/628d0eab-eceb-4062-a2bc-8072b21babd1-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-lgttx" (UID: "628d0eab-eceb-4062-a2bc-8072b21babd1") : secret "cluster-monitoring-operator-tls" not found Jul 06 13:40:24.648530 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:24.648509 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/66e76252-8877-403e-9c30-e56ec0013c24-trusted-ca\") pod \"console-operator-68b757fb67-z2f98\" (UID: \"66e76252-8877-403e-9c30-e56ec0013c24\") " pod="openshift-console-operator/console-operator-68b757fb67-z2f98" Jul 06 13:40:24.648569 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:24.648531 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/66e76252-8877-403e-9c30-e56ec0013c24-config\") pod \"console-operator-68b757fb67-z2f98\" (UID: \"66e76252-8877-403e-9c30-e56ec0013c24\") " pod="openshift-console-operator/console-operator-68b757fb67-z2f98" Jul 06 13:40:24.648609 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:24.648531 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/628d0eab-eceb-4062-a2bc-8072b21babd1-telemetry-config\") pod \"cluster-monitoring-operator-64786d9cbb-lgttx\" (UID: \"628d0eab-eceb-4062-a2bc-8072b21babd1\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-lgttx" Jul 06 13:40:24.649952 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:24.649926 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/66e76252-8877-403e-9c30-e56ec0013c24-serving-cert\") pod \"console-operator-68b757fb67-z2f98\" (UID: \"66e76252-8877-403e-9c30-e56ec0013c24\") " pod="openshift-console-operator/console-operator-68b757fb67-z2f98" Jul 06 13:40:24.661477 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:24.661451 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rnvqc\" (UniqueName: \"kubernetes.io/projected/628d0eab-eceb-4062-a2bc-8072b21babd1-kube-api-access-rnvqc\") pod \"cluster-monitoring-operator-64786d9cbb-lgttx\" (UID: \"628d0eab-eceb-4062-a2bc-8072b21babd1\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-lgttx" Jul 06 13:40:24.666942 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:24.666922 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-74gj6\" (UniqueName: \"kubernetes.io/projected/66e76252-8877-403e-9c30-e56ec0013c24-kube-api-access-74gj6\") pod \"console-operator-68b757fb67-z2f98\" (UID: \"66e76252-8877-403e-9c30-e56ec0013c24\") " pod="openshift-console-operator/console-operator-68b757fb67-z2f98" Jul 06 13:40:24.722343 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:24.722296 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-68b757fb67-z2f98" Jul 06 13:40:24.919577 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:24.919547 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-68b757fb67-z2f98"] Jul 06 13:40:24.922303 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:40:24.922281 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod66e76252_8877_403e_9c30_e56ec0013c24.slice/crio-9c76e8285323e7f7be8299f371f063405a070c63b514c91d0f350f92395758d4 WatchSource:0}: Error finding container 9c76e8285323e7f7be8299f371f063405a070c63b514c91d0f350f92395758d4: Status 404 returned error can't find the container with id 9c76e8285323e7f7be8299f371f063405a070c63b514c91d0f350f92395758d4 Jul 06 13:40:25.051249 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:25.051217 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d095657b-0d82-44c9-920d-3ac8a3b344f0-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-7d9ck\" (UID: \"d095657b-0d82-44c9-920d-3ac8a3b344f0\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-7d9ck" Jul 06 13:40:25.051376 ip-10-0-138-163 kubenswrapper[2573]: E0706 13:40:25.051324 2573 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 06 13:40:25.051411 ip-10-0-138-163 kubenswrapper[2573]: E0706 13:40:25.051382 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d095657b-0d82-44c9-920d-3ac8a3b344f0-samples-operator-tls podName:d095657b-0d82-44c9-920d-3ac8a3b344f0 nodeName:}" failed. No retries permitted until 2026-07-06 13:40:26.051369716 +0000 UTC m=+43.427968654 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/d095657b-0d82-44c9-920d-3ac8a3b344f0-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-7d9ck" (UID: "d095657b-0d82-44c9-920d-3ac8a3b344f0") : secret "samples-operator-tls" not found Jul 06 13:40:25.152346 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:25.152270 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/628d0eab-eceb-4062-a2bc-8072b21babd1-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-lgttx\" (UID: \"628d0eab-eceb-4062-a2bc-8072b21babd1\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-lgttx" Jul 06 13:40:25.152471 ip-10-0-138-163 kubenswrapper[2573]: E0706 13:40:25.152410 2573 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 06 13:40:25.152471 ip-10-0-138-163 kubenswrapper[2573]: E0706 13:40:25.152468 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/628d0eab-eceb-4062-a2bc-8072b21babd1-cluster-monitoring-operator-tls podName:628d0eab-eceb-4062-a2bc-8072b21babd1 nodeName:}" failed. No retries permitted until 2026-07-06 13:40:26.152454116 +0000 UTC m=+43.529053058 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/628d0eab-eceb-4062-a2bc-8072b21babd1-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-lgttx" (UID: "628d0eab-eceb-4062-a2bc-8072b21babd1") : secret "cluster-monitoring-operator-tls" not found Jul 06 13:40:25.376676 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:25.376639 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8l59v" event={"ID":"010dfdbb-622e-4931-a618-8e465448aa80","Type":"ContainerStarted","Data":"3ba4cba9d606cfa43a9f431cf14200f6f126650680c24ff9a182954322beb51c"} Jul 06 13:40:25.377745 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:25.377713 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-z2f98" event={"ID":"66e76252-8877-403e-9c30-e56ec0013c24","Type":"ContainerStarted","Data":"9c76e8285323e7f7be8299f371f063405a070c63b514c91d0f350f92395758d4"} Jul 06 13:40:25.406127 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:25.406018 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-8l59v" podStartSLOduration=16.721533639 podStartE2EDuration="41.406005342s" totalImagesPullingTime="24.684471703s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 13:39:44 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 13:40:25.404521404 +0000 UTC m=+42.781120364" watchObservedRunningTime="2026-07-06 13:40:25.406005342 +0000 UTC m=+42.782604303" Jul 06 13:40:26.058467 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:26.058432 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d095657b-0d82-44c9-920d-3ac8a3b344f0-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-7d9ck\" (UID: \"d095657b-0d82-44c9-920d-3ac8a3b344f0\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-7d9ck" Jul 06 13:40:26.058639 ip-10-0-138-163 kubenswrapper[2573]: E0706 13:40:26.058615 2573 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 06 13:40:26.058709 ip-10-0-138-163 kubenswrapper[2573]: E0706 13:40:26.058696 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d095657b-0d82-44c9-920d-3ac8a3b344f0-samples-operator-tls podName:d095657b-0d82-44c9-920d-3ac8a3b344f0 nodeName:}" failed. No retries permitted until 2026-07-06 13:40:28.058675185 +0000 UTC m=+45.435274138 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/d095657b-0d82-44c9-920d-3ac8a3b344f0-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-7d9ck" (UID: "d095657b-0d82-44c9-920d-3ac8a3b344f0") : secret "samples-operator-tls" not found Jul 06 13:40:26.159160 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:26.159126 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/628d0eab-eceb-4062-a2bc-8072b21babd1-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-lgttx\" (UID: \"628d0eab-eceb-4062-a2bc-8072b21babd1\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-lgttx" Jul 06 13:40:26.159294 ip-10-0-138-163 kubenswrapper[2573]: E0706 13:40:26.159246 2573 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 06 13:40:26.159328 ip-10-0-138-163 kubenswrapper[2573]: E0706 13:40:26.159300 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/628d0eab-eceb-4062-a2bc-8072b21babd1-cluster-monitoring-operator-tls podName:628d0eab-eceb-4062-a2bc-8072b21babd1 nodeName:}" failed. No retries permitted until 2026-07-06 13:40:28.159288724 +0000 UTC m=+45.535887662 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/628d0eab-eceb-4062-a2bc-8072b21babd1-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-lgttx" (UID: "628d0eab-eceb-4062-a2bc-8072b21babd1") : secret "cluster-monitoring-operator-tls" not found Jul 06 13:40:26.260419 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:26.260388 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9fc1c970-76a7-4617-a6f4-0046e9c4f967-registry-tls\") pod \"image-registry-65fd8c9c68-9mp5n\" (UID: \"9fc1c970-76a7-4617-a6f4-0046e9c4f967\") " pod="openshift-image-registry/image-registry-65fd8c9c68-9mp5n" Jul 06 13:40:26.260561 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:26.260431 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/87c92d36-2646-4a77-a03a-27190066fbfe-metrics-tls\") pod \"dns-default-cm7lv\" (UID: \"87c92d36-2646-4a77-a03a-27190066fbfe\") " pod="openshift-dns/dns-default-cm7lv" Jul 06 13:40:26.260561 ip-10-0-138-163 kubenswrapper[2573]: E0706 13:40:26.260544 2573 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 06 13:40:26.260621 ip-10-0-138-163 kubenswrapper[2573]: E0706 13:40:26.260565 2573 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-65fd8c9c68-9mp5n: secret "image-registry-tls" not found Jul 06 13:40:26.260621 ip-10-0-138-163 kubenswrapper[2573]: E0706 13:40:26.260565 2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 06 13:40:26.260621 ip-10-0-138-163 kubenswrapper[2573]: E0706 13:40:26.260614 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/87c92d36-2646-4a77-a03a-27190066fbfe-metrics-tls podName:87c92d36-2646-4a77-a03a-27190066fbfe nodeName:}" failed. No retries permitted until 2026-07-06 13:40:34.260601793 +0000 UTC m=+51.637200731 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/87c92d36-2646-4a77-a03a-27190066fbfe-metrics-tls") pod "dns-default-cm7lv" (UID: "87c92d36-2646-4a77-a03a-27190066fbfe") : secret "dns-default-metrics-tls" not found Jul 06 13:40:26.260722 ip-10-0-138-163 kubenswrapper[2573]: E0706 13:40:26.260628 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9fc1c970-76a7-4617-a6f4-0046e9c4f967-registry-tls podName:9fc1c970-76a7-4617-a6f4-0046e9c4f967 nodeName:}" failed. No retries permitted until 2026-07-06 13:40:34.260621933 +0000 UTC m=+51.637220871 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9fc1c970-76a7-4617-a6f4-0046e9c4f967-registry-tls") pod "image-registry-65fd8c9c68-9mp5n" (UID: "9fc1c970-76a7-4617-a6f4-0046e9c4f967") : secret "image-registry-tls" not found Jul 06 13:40:28.073931 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:28.073891 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d095657b-0d82-44c9-920d-3ac8a3b344f0-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-7d9ck\" (UID: \"d095657b-0d82-44c9-920d-3ac8a3b344f0\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-7d9ck" Jul 06 13:40:28.074371 ip-10-0-138-163 kubenswrapper[2573]: E0706 13:40:28.074018 2573 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 06 13:40:28.074371 ip-10-0-138-163 kubenswrapper[2573]: E0706 13:40:28.074112 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d095657b-0d82-44c9-920d-3ac8a3b344f0-samples-operator-tls podName:d095657b-0d82-44c9-920d-3ac8a3b344f0 nodeName:}" failed. No retries permitted until 2026-07-06 13:40:32.074092873 +0000 UTC m=+49.450691815 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/d095657b-0d82-44c9-920d-3ac8a3b344f0-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-7d9ck" (UID: "d095657b-0d82-44c9-920d-3ac8a3b344f0") : secret "samples-operator-tls" not found Jul 06 13:40:28.175020 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:28.174987 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/628d0eab-eceb-4062-a2bc-8072b21babd1-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-lgttx\" (UID: \"628d0eab-eceb-4062-a2bc-8072b21babd1\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-lgttx" Jul 06 13:40:28.175201 ip-10-0-138-163 kubenswrapper[2573]: E0706 13:40:28.175151 2573 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 06 13:40:28.175256 ip-10-0-138-163 kubenswrapper[2573]: E0706 13:40:28.175223 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/628d0eab-eceb-4062-a2bc-8072b21babd1-cluster-monitoring-operator-tls podName:628d0eab-eceb-4062-a2bc-8072b21babd1 nodeName:}" failed. No retries permitted until 2026-07-06 13:40:32.17520327 +0000 UTC m=+49.551802210 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/628d0eab-eceb-4062-a2bc-8072b21babd1-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-lgttx" (UID: "628d0eab-eceb-4062-a2bc-8072b21babd1") : secret "cluster-monitoring-operator-tls" not found Jul 06 13:40:28.387184 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:28.387112 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-z2f98_66e76252-8877-403e-9c30-e56ec0013c24/console-operator/0.log" Jul 06 13:40:28.387184 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:28.387149 2573 generic.go:356] "Generic (PLEG): container finished" podID="66e76252-8877-403e-9c30-e56ec0013c24" containerID="440c2dd529d20f16aeabc97e69c9595c05ee0aaef222da5ca53e104d3c12b62f" exitCode=255 Jul 06 13:40:28.387360 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:28.387184 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-z2f98" event={"ID":"66e76252-8877-403e-9c30-e56ec0013c24","Type":"ContainerDied","Data":"440c2dd529d20f16aeabc97e69c9595c05ee0aaef222da5ca53e104d3c12b62f"} Jul 06 13:40:28.387409 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:28.387398 2573 scope.go:117] "RemoveContainer" containerID="440c2dd529d20f16aeabc97e69c9595c05ee0aaef222da5ca53e104d3c12b62f" Jul 06 13:40:29.391297 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:29.391269 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-z2f98_66e76252-8877-403e-9c30-e56ec0013c24/console-operator/1.log" Jul 06 13:40:29.391736 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:29.391678 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-z2f98_66e76252-8877-403e-9c30-e56ec0013c24/console-operator/0.log" Jul 06 13:40:29.391736 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:29.391710 2573 generic.go:356] "Generic (PLEG): container finished" podID="66e76252-8877-403e-9c30-e56ec0013c24" containerID="f678ea87dadaebb73f4eae5dc20d6fe076e74c975bf0d18446e2737b59a17e2d" exitCode=255 Jul 06 13:40:29.391806 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:29.391744 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-z2f98" event={"ID":"66e76252-8877-403e-9c30-e56ec0013c24","Type":"ContainerDied","Data":"f678ea87dadaebb73f4eae5dc20d6fe076e74c975bf0d18446e2737b59a17e2d"} Jul 06 13:40:29.391806 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:29.391800 2573 scope.go:117] "RemoveContainer" containerID="440c2dd529d20f16aeabc97e69c9595c05ee0aaef222da5ca53e104d3c12b62f" Jul 06 13:40:29.391971 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:29.391953 2573 scope.go:117] "RemoveContainer" containerID="f678ea87dadaebb73f4eae5dc20d6fe076e74c975bf0d18446e2737b59a17e2d" Jul 06 13:40:29.392140 ip-10-0-138-163 kubenswrapper[2573]: E0706 13:40:29.392113 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-z2f98_openshift-console-operator(66e76252-8877-403e-9c30-e56ec0013c24)\"" pod="openshift-console-operator/console-operator-68b757fb67-z2f98" podUID="66e76252-8877-403e-9c30-e56ec0013c24" Jul 06 13:40:30.268566 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:30.268536 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-22trx"] Jul 06 13:40:30.298725 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:30.298697 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-22trx" Jul 06 13:40:30.304142 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:30.304110 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-22trx"] Jul 06 13:40:30.311016 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:30.310992 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 06 13:40:30.311142 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:30.311014 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 06 13:40:30.311142 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:30.311021 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 06 13:40:30.311142 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:30.311079 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-nbfr8\"" Jul 06 13:40:30.311142 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:30.311021 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 06 13:40:30.390641 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:30.390608 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/369661c8-e355-4b66-a939-dcf92753f0e6-crio-socket\") pod \"insights-runtime-extractor-22trx\" (UID: \"369661c8-e355-4b66-a939-dcf92753f0e6\") " pod="openshift-insights/insights-runtime-extractor-22trx" Jul 06 13:40:30.390641 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:30.390643 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/369661c8-e355-4b66-a939-dcf92753f0e6-data-volume\") pod \"insights-runtime-extractor-22trx\" (UID: \"369661c8-e355-4b66-a939-dcf92753f0e6\") " pod="openshift-insights/insights-runtime-extractor-22trx" Jul 06 13:40:30.390808 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:30.390662 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/369661c8-e355-4b66-a939-dcf92753f0e6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-22trx\" (UID: \"369661c8-e355-4b66-a939-dcf92753f0e6\") " pod="openshift-insights/insights-runtime-extractor-22trx" Jul 06 13:40:30.390844 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:30.390806 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gs66z\" (UniqueName: \"kubernetes.io/projected/369661c8-e355-4b66-a939-dcf92753f0e6-kube-api-access-gs66z\") pod \"insights-runtime-extractor-22trx\" (UID: \"369661c8-e355-4b66-a939-dcf92753f0e6\") " pod="openshift-insights/insights-runtime-extractor-22trx" Jul 06 13:40:30.390886 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:30.390844 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/369661c8-e355-4b66-a939-dcf92753f0e6-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-22trx\" (UID: \"369661c8-e355-4b66-a939-dcf92753f0e6\") " pod="openshift-insights/insights-runtime-extractor-22trx" Jul 06 13:40:30.395777 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:30.395754 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-z2f98_66e76252-8877-403e-9c30-e56ec0013c24/console-operator/1.log" Jul 06 13:40:30.396126 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:30.396053 2573 scope.go:117] "RemoveContainer" containerID="f678ea87dadaebb73f4eae5dc20d6fe076e74c975bf0d18446e2737b59a17e2d" Jul 06 13:40:30.396198 ip-10-0-138-163 kubenswrapper[2573]: E0706 13:40:30.396181 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-z2f98_openshift-console-operator(66e76252-8877-403e-9c30-e56ec0013c24)\"" pod="openshift-console-operator/console-operator-68b757fb67-z2f98" podUID="66e76252-8877-403e-9c30-e56ec0013c24" Jul 06 13:40:30.491761 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:30.491733 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gs66z\" (UniqueName: \"kubernetes.io/projected/369661c8-e355-4b66-a939-dcf92753f0e6-kube-api-access-gs66z\") pod \"insights-runtime-extractor-22trx\" (UID: \"369661c8-e355-4b66-a939-dcf92753f0e6\") " pod="openshift-insights/insights-runtime-extractor-22trx" Jul 06 13:40:30.491885 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:30.491790 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/369661c8-e355-4b66-a939-dcf92753f0e6-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-22trx\" (UID: \"369661c8-e355-4b66-a939-dcf92753f0e6\") " pod="openshift-insights/insights-runtime-extractor-22trx" Jul 06 13:40:30.491885 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:30.491819 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/369661c8-e355-4b66-a939-dcf92753f0e6-crio-socket\") pod \"insights-runtime-extractor-22trx\" (UID: \"369661c8-e355-4b66-a939-dcf92753f0e6\") " pod="openshift-insights/insights-runtime-extractor-22trx" Jul 06 13:40:30.491885 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:30.491846 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/369661c8-e355-4b66-a939-dcf92753f0e6-data-volume\") pod \"insights-runtime-extractor-22trx\" (UID: \"369661c8-e355-4b66-a939-dcf92753f0e6\") " pod="openshift-insights/insights-runtime-extractor-22trx" Jul 06 13:40:30.491885 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:30.491871 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/369661c8-e355-4b66-a939-dcf92753f0e6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-22trx\" (UID: \"369661c8-e355-4b66-a939-dcf92753f0e6\") " pod="openshift-insights/insights-runtime-extractor-22trx" Jul 06 13:40:30.492295 ip-10-0-138-163 kubenswrapper[2573]: E0706 13:40:30.491899 2573 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 06 13:40:30.492295 ip-10-0-138-163 kubenswrapper[2573]: E0706 13:40:30.491950 2573 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 06 13:40:30.492295 ip-10-0-138-163 kubenswrapper[2573]: E0706 13:40:30.491972 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/369661c8-e355-4b66-a939-dcf92753f0e6-kube-rbac-proxy-cm podName:369661c8-e355-4b66-a939-dcf92753f0e6 nodeName:}" failed. No retries permitted until 2026-07-06 13:40:30.991954779 +0000 UTC m=+48.368553717 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/369661c8-e355-4b66-a939-dcf92753f0e6-kube-rbac-proxy-cm") pod "insights-runtime-extractor-22trx" (UID: "369661c8-e355-4b66-a939-dcf92753f0e6") : configmap "kube-rbac-proxy" not found Jul 06 13:40:30.492295 ip-10-0-138-163 kubenswrapper[2573]: E0706 13:40:30.491996 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/369661c8-e355-4b66-a939-dcf92753f0e6-insights-runtime-extractor-tls podName:369661c8-e355-4b66-a939-dcf92753f0e6 nodeName:}" failed. No retries permitted until 2026-07-06 13:40:30.991980816 +0000 UTC m=+48.368579760 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/369661c8-e355-4b66-a939-dcf92753f0e6-insights-runtime-extractor-tls") pod "insights-runtime-extractor-22trx" (UID: "369661c8-e355-4b66-a939-dcf92753f0e6") : secret "insights-runtime-extractor-tls" not found Jul 06 13:40:30.492295 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:30.492195 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/369661c8-e355-4b66-a939-dcf92753f0e6-crio-socket\") pod \"insights-runtime-extractor-22trx\" (UID: \"369661c8-e355-4b66-a939-dcf92753f0e6\") " pod="openshift-insights/insights-runtime-extractor-22trx" Jul 06 13:40:30.492295 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:30.492281 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/369661c8-e355-4b66-a939-dcf92753f0e6-data-volume\") pod \"insights-runtime-extractor-22trx\" (UID: \"369661c8-e355-4b66-a939-dcf92753f0e6\") " pod="openshift-insights/insights-runtime-extractor-22trx" Jul 06 13:40:30.514471 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:30.514449 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gs66z\" (UniqueName: \"kubernetes.io/projected/369661c8-e355-4b66-a939-dcf92753f0e6-kube-api-access-gs66z\") pod \"insights-runtime-extractor-22trx\" (UID: \"369661c8-e355-4b66-a939-dcf92753f0e6\") " pod="openshift-insights/insights-runtime-extractor-22trx" Jul 06 13:40:30.995582 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:30.995547 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/369661c8-e355-4b66-a939-dcf92753f0e6-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-22trx\" (UID: \"369661c8-e355-4b66-a939-dcf92753f0e6\") " pod="openshift-insights/insights-runtime-extractor-22trx" Jul 06 13:40:30.995582 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:30.995585 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/369661c8-e355-4b66-a939-dcf92753f0e6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-22trx\" (UID: \"369661c8-e355-4b66-a939-dcf92753f0e6\") " pod="openshift-insights/insights-runtime-extractor-22trx" Jul 06 13:40:30.995768 ip-10-0-138-163 kubenswrapper[2573]: E0706 13:40:30.995667 2573 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 06 13:40:30.995768 ip-10-0-138-163 kubenswrapper[2573]: E0706 13:40:30.995683 2573 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 06 13:40:30.995768 ip-10-0-138-163 kubenswrapper[2573]: E0706 13:40:30.995728 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/369661c8-e355-4b66-a939-dcf92753f0e6-insights-runtime-extractor-tls podName:369661c8-e355-4b66-a939-dcf92753f0e6 nodeName:}" failed. No retries permitted until 2026-07-06 13:40:31.995716768 +0000 UTC m=+49.372315706 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/369661c8-e355-4b66-a939-dcf92753f0e6-insights-runtime-extractor-tls") pod "insights-runtime-extractor-22trx" (UID: "369661c8-e355-4b66-a939-dcf92753f0e6") : secret "insights-runtime-extractor-tls" not found Jul 06 13:40:30.998784 ip-10-0-138-163 kubenswrapper[2573]: E0706 13:40:30.996080 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/369661c8-e355-4b66-a939-dcf92753f0e6-kube-rbac-proxy-cm podName:369661c8-e355-4b66-a939-dcf92753f0e6 nodeName:}" failed. No retries permitted until 2026-07-06 13:40:31.995734723 +0000 UTC m=+49.372333661 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/369661c8-e355-4b66-a939-dcf92753f0e6-kube-rbac-proxy-cm") pod "insights-runtime-extractor-22trx" (UID: "369661c8-e355-4b66-a939-dcf92753f0e6") : configmap "kube-rbac-proxy" not found Jul 06 13:40:32.002408 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:32.002369 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/369661c8-e355-4b66-a939-dcf92753f0e6-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-22trx\" (UID: \"369661c8-e355-4b66-a939-dcf92753f0e6\") " pod="openshift-insights/insights-runtime-extractor-22trx" Jul 06 13:40:32.002408 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:32.002411 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/369661c8-e355-4b66-a939-dcf92753f0e6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-22trx\" (UID: \"369661c8-e355-4b66-a939-dcf92753f0e6\") " pod="openshift-insights/insights-runtime-extractor-22trx" Jul 06 13:40:32.002814 ip-10-0-138-163 kubenswrapper[2573]: E0706 13:40:32.002495 2573 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 06 13:40:32.002814 ip-10-0-138-163 kubenswrapper[2573]: E0706 13:40:32.002561 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/369661c8-e355-4b66-a939-dcf92753f0e6-kube-rbac-proxy-cm podName:369661c8-e355-4b66-a939-dcf92753f0e6 nodeName:}" failed. No retries permitted until 2026-07-06 13:40:34.002545485 +0000 UTC m=+51.379144423 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/369661c8-e355-4b66-a939-dcf92753f0e6-kube-rbac-proxy-cm") pod "insights-runtime-extractor-22trx" (UID: "369661c8-e355-4b66-a939-dcf92753f0e6") : configmap "kube-rbac-proxy" not found Jul 06 13:40:32.002814 ip-10-0-138-163 kubenswrapper[2573]: E0706 13:40:32.002582 2573 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 06 13:40:32.002814 ip-10-0-138-163 kubenswrapper[2573]: E0706 13:40:32.002627 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/369661c8-e355-4b66-a939-dcf92753f0e6-insights-runtime-extractor-tls podName:369661c8-e355-4b66-a939-dcf92753f0e6 nodeName:}" failed. No retries permitted until 2026-07-06 13:40:34.002612327 +0000 UTC m=+51.379211274 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/369661c8-e355-4b66-a939-dcf92753f0e6-insights-runtime-extractor-tls") pod "insights-runtime-extractor-22trx" (UID: "369661c8-e355-4b66-a939-dcf92753f0e6") : secret "insights-runtime-extractor-tls" not found Jul 06 13:40:32.102794 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:32.102764 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d095657b-0d82-44c9-920d-3ac8a3b344f0-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-7d9ck\" (UID: \"d095657b-0d82-44c9-920d-3ac8a3b344f0\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-7d9ck" Jul 06 13:40:32.102929 ip-10-0-138-163 kubenswrapper[2573]: E0706 13:40:32.102904 2573 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 06 13:40:32.102981 ip-10-0-138-163 kubenswrapper[2573]: E0706 13:40:32.102963 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d095657b-0d82-44c9-920d-3ac8a3b344f0-samples-operator-tls podName:d095657b-0d82-44c9-920d-3ac8a3b344f0 nodeName:}" failed. No retries permitted until 2026-07-06 13:40:40.102948238 +0000 UTC m=+57.479547175 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/d095657b-0d82-44c9-920d-3ac8a3b344f0-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-7d9ck" (UID: "d095657b-0d82-44c9-920d-3ac8a3b344f0") : secret "samples-operator-tls" not found Jul 06 13:40:32.204128 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:32.204102 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/628d0eab-eceb-4062-a2bc-8072b21babd1-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-lgttx\" (UID: \"628d0eab-eceb-4062-a2bc-8072b21babd1\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-lgttx" Jul 06 13:40:32.204260 ip-10-0-138-163 kubenswrapper[2573]: E0706 13:40:32.204242 2573 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 06 13:40:32.204312 ip-10-0-138-163 kubenswrapper[2573]: E0706 13:40:32.204302 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/628d0eab-eceb-4062-a2bc-8072b21babd1-cluster-monitoring-operator-tls podName:628d0eab-eceb-4062-a2bc-8072b21babd1 nodeName:}" failed. No retries permitted until 2026-07-06 13:40:40.204288174 +0000 UTC m=+57.580887113 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/628d0eab-eceb-4062-a2bc-8072b21babd1-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-lgttx" (UID: "628d0eab-eceb-4062-a2bc-8072b21babd1") : secret "cluster-monitoring-operator-tls" not found Jul 06 13:40:32.241878 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:32.241855 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-5qvhz_c3396eac-840e-41a5-9639-a78c864904af/dns-node-resolver/0.log" Jul 06 13:40:33.248607 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:33.248584 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-8flhb_1e9a1360-d243-4b99-9dbe-b37d77b43a78/node-ca/0.log" Jul 06 13:40:33.842346 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:33.842317 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-6j4hj_523ff6ed-d67a-4ac2-8b8c-985f3fe16845/serve-healthcheck-canary/0.log" Jul 06 13:40:34.018545 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:34.018511 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/369661c8-e355-4b66-a939-dcf92753f0e6-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-22trx\" (UID: \"369661c8-e355-4b66-a939-dcf92753f0e6\") " pod="openshift-insights/insights-runtime-extractor-22trx" Jul 06 13:40:34.018704 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:34.018555 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/369661c8-e355-4b66-a939-dcf92753f0e6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-22trx\" (UID: \"369661c8-e355-4b66-a939-dcf92753f0e6\") " pod="openshift-insights/insights-runtime-extractor-22trx" Jul 06 13:40:34.018704 ip-10-0-138-163 kubenswrapper[2573]: E0706 13:40:34.018627 2573 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 06 13:40:34.018704 ip-10-0-138-163 kubenswrapper[2573]: E0706 13:40:34.018666 2573 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 06 13:40:34.018704 ip-10-0-138-163 kubenswrapper[2573]: E0706 13:40:34.018683 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/369661c8-e355-4b66-a939-dcf92753f0e6-kube-rbac-proxy-cm podName:369661c8-e355-4b66-a939-dcf92753f0e6 nodeName:}" failed. No retries permitted until 2026-07-06 13:40:38.018669118 +0000 UTC m=+55.395268056 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/369661c8-e355-4b66-a939-dcf92753f0e6-kube-rbac-proxy-cm") pod "insights-runtime-extractor-22trx" (UID: "369661c8-e355-4b66-a939-dcf92753f0e6") : configmap "kube-rbac-proxy" not found Jul 06 13:40:34.018905 ip-10-0-138-163 kubenswrapper[2573]: E0706 13:40:34.018714 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/369661c8-e355-4b66-a939-dcf92753f0e6-insights-runtime-extractor-tls podName:369661c8-e355-4b66-a939-dcf92753f0e6 nodeName:}" failed. No retries permitted until 2026-07-06 13:40:38.018699518 +0000 UTC m=+55.395298470 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/369661c8-e355-4b66-a939-dcf92753f0e6-insights-runtime-extractor-tls") pod "insights-runtime-extractor-22trx" (UID: "369661c8-e355-4b66-a939-dcf92753f0e6") : secret "insights-runtime-extractor-tls" not found Jul 06 13:40:34.320672 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:34.320640 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9fc1c970-76a7-4617-a6f4-0046e9c4f967-registry-tls\") pod \"image-registry-65fd8c9c68-9mp5n\" (UID: \"9fc1c970-76a7-4617-a6f4-0046e9c4f967\") " pod="openshift-image-registry/image-registry-65fd8c9c68-9mp5n" Jul 06 13:40:34.321098 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:34.320684 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/87c92d36-2646-4a77-a03a-27190066fbfe-metrics-tls\") pod \"dns-default-cm7lv\" (UID: \"87c92d36-2646-4a77-a03a-27190066fbfe\") " pod="openshift-dns/dns-default-cm7lv" Jul 06 13:40:34.321098 ip-10-0-138-163 kubenswrapper[2573]: E0706 13:40:34.320801 2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 06 13:40:34.321098 ip-10-0-138-163 kubenswrapper[2573]: E0706 13:40:34.320815 2573 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 06 13:40:34.321098 ip-10-0-138-163 kubenswrapper[2573]: E0706 13:40:34.320834 2573 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-65fd8c9c68-9mp5n: secret "image-registry-tls" not found Jul 06 13:40:34.321098 ip-10-0-138-163 kubenswrapper[2573]: E0706 13:40:34.320851 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/87c92d36-2646-4a77-a03a-27190066fbfe-metrics-tls podName:87c92d36-2646-4a77-a03a-27190066fbfe nodeName:}" failed. No retries permitted until 2026-07-06 13:40:50.320838479 +0000 UTC m=+67.697437417 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/87c92d36-2646-4a77-a03a-27190066fbfe-metrics-tls") pod "dns-default-cm7lv" (UID: "87c92d36-2646-4a77-a03a-27190066fbfe") : secret "dns-default-metrics-tls" not found Jul 06 13:40:34.321098 ip-10-0-138-163 kubenswrapper[2573]: E0706 13:40:34.320883 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9fc1c970-76a7-4617-a6f4-0046e9c4f967-registry-tls podName:9fc1c970-76a7-4617-a6f4-0046e9c4f967 nodeName:}" failed. No retries permitted until 2026-07-06 13:40:50.320866639 +0000 UTC m=+67.697465594 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9fc1c970-76a7-4617-a6f4-0046e9c4f967-registry-tls") pod "image-registry-65fd8c9c68-9mp5n" (UID: "9fc1c970-76a7-4617-a6f4-0046e9c4f967") : secret "image-registry-tls" not found Jul 06 13:40:34.722804 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:34.722777 2573 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-68b757fb67-z2f98" Jul 06 13:40:34.722944 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:34.722830 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-68b757fb67-z2f98" Jul 06 13:40:34.723168 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:34.723157 2573 scope.go:117] "RemoveContainer" containerID="f678ea87dadaebb73f4eae5dc20d6fe076e74c975bf0d18446e2737b59a17e2d" Jul 06 13:40:34.723313 ip-10-0-138-163 kubenswrapper[2573]: E0706 13:40:34.723296 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-z2f98_openshift-console-operator(66e76252-8877-403e-9c30-e56ec0013c24)\"" pod="openshift-console-operator/console-operator-68b757fb67-z2f98" podUID="66e76252-8877-403e-9c30-e56ec0013c24" Jul 06 13:40:38.051805 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:38.051766 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/369661c8-e355-4b66-a939-dcf92753f0e6-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-22trx\" (UID: \"369661c8-e355-4b66-a939-dcf92753f0e6\") " pod="openshift-insights/insights-runtime-extractor-22trx" Jul 06 13:40:38.051805 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:38.051808 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/369661c8-e355-4b66-a939-dcf92753f0e6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-22trx\" (UID: \"369661c8-e355-4b66-a939-dcf92753f0e6\") " pod="openshift-insights/insights-runtime-extractor-22trx" Jul 06 13:40:38.052458 ip-10-0-138-163 kubenswrapper[2573]: E0706 13:40:38.051991 2573 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 06 13:40:38.052458 ip-10-0-138-163 kubenswrapper[2573]: E0706 13:40:38.052071 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/369661c8-e355-4b66-a939-dcf92753f0e6-insights-runtime-extractor-tls podName:369661c8-e355-4b66-a939-dcf92753f0e6 nodeName:}" failed. No retries permitted until 2026-07-06 13:40:46.052054739 +0000 UTC m=+63.428653691 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/369661c8-e355-4b66-a939-dcf92753f0e6-insights-runtime-extractor-tls") pod "insights-runtime-extractor-22trx" (UID: "369661c8-e355-4b66-a939-dcf92753f0e6") : secret "insights-runtime-extractor-tls" not found Jul 06 13:40:38.052560 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:38.052466 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/369661c8-e355-4b66-a939-dcf92753f0e6-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-22trx\" (UID: \"369661c8-e355-4b66-a939-dcf92753f0e6\") " pod="openshift-insights/insights-runtime-extractor-22trx" Jul 06 13:40:40.167446 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:40.167394 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d095657b-0d82-44c9-920d-3ac8a3b344f0-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-7d9ck\" (UID: \"d095657b-0d82-44c9-920d-3ac8a3b344f0\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-7d9ck" Jul 06 13:40:40.169729 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:40.169712 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d095657b-0d82-44c9-920d-3ac8a3b344f0-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-7d9ck\" (UID: \"d095657b-0d82-44c9-920d-3ac8a3b344f0\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-7d9ck" Jul 06 13:40:40.199614 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:40.199578 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-7d9ck" Jul 06 13:40:40.268803 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:40.268774 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/628d0eab-eceb-4062-a2bc-8072b21babd1-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-lgttx\" (UID: \"628d0eab-eceb-4062-a2bc-8072b21babd1\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-lgttx" Jul 06 13:40:40.268939 ip-10-0-138-163 kubenswrapper[2573]: E0706 13:40:40.268899 2573 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 06 13:40:40.268981 ip-10-0-138-163 kubenswrapper[2573]: E0706 13:40:40.268950 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/628d0eab-eceb-4062-a2bc-8072b21babd1-cluster-monitoring-operator-tls podName:628d0eab-eceb-4062-a2bc-8072b21babd1 nodeName:}" failed. No retries permitted until 2026-07-06 13:40:56.26893667 +0000 UTC m=+73.645535608 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/628d0eab-eceb-4062-a2bc-8072b21babd1-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-lgttx" (UID: "628d0eab-eceb-4062-a2bc-8072b21babd1") : secret "cluster-monitoring-operator-tls" not found Jul 06 13:40:40.317055 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:40.317010 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-7d9ck"] Jul 06 13:40:40.419690 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:40.419630 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-7d9ck" event={"ID":"d095657b-0d82-44c9-920d-3ac8a3b344f0","Type":"ContainerStarted","Data":"d60d6fd97bdb4066be83ffe9db22ed6e45d6a451b8d5e4f85b7889c3632b907e"} Jul 06 13:40:42.426761 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:42.426720 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-7d9ck" event={"ID":"d095657b-0d82-44c9-920d-3ac8a3b344f0","Type":"ContainerStarted","Data":"2c3349dff48bdcbd12c021324661bff74caf1d2e217436c2d5eb39d08fbac549"} Jul 06 13:40:42.427204 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:42.426802 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-7d9ck" event={"ID":"d095657b-0d82-44c9-920d-3ac8a3b344f0","Type":"ContainerStarted","Data":"621f1666ca798d3e438be7269b53d28c4f8de337d39df5a8d5085afc0a7ab7c4"} Jul 06 13:40:42.445300 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:42.445161 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-7d9ck" podStartSLOduration=16.56031856 podStartE2EDuration="18.445144758s" totalImagesPullingTime="1.884826198s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 13:40:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 13:40:42.444073094 +0000 UTC m=+59.820672054" watchObservedRunningTime="2026-07-06 13:40:42.445144758 +0000 UTC m=+59.821743720" Jul 06 13:40:45.156836 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:45.156800 2573 scope.go:117] "RemoveContainer" containerID="f678ea87dadaebb73f4eae5dc20d6fe076e74c975bf0d18446e2737b59a17e2d" Jul 06 13:40:45.349523 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:45.349499 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-6zfjs" Jul 06 13:40:45.435586 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:45.435513 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-z2f98_66e76252-8877-403e-9c30-e56ec0013c24/console-operator/1.log" Jul 06 13:40:45.435586 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:45.435566 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-z2f98" event={"ID":"66e76252-8877-403e-9c30-e56ec0013c24","Type":"ContainerStarted","Data":"b0bc8660acc69cd2b93b558ef8fa0785b58a6172d6c1fe379c11203c818d0701"} Jul 06 13:40:45.435858 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:45.435842 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-68b757fb67-z2f98" Jul 06 13:40:45.453894 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:45.453842 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-68b757fb67-z2f98" podStartSLOduration=19.042438274 podStartE2EDuration="21.453827738s" totalImagesPullingTime="2.411389464s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 13:40:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 13:40:45.452659092 +0000 UTC m=+62.829258055" watchObservedRunningTime="2026-07-06 13:40:45.453827738 +0000 UTC m=+62.830426742" Jul 06 13:40:45.961646 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:45.961616 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-68b757fb67-z2f98" Jul 06 13:40:46.114240 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:46.114198 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/369661c8-e355-4b66-a939-dcf92753f0e6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-22trx\" (UID: \"369661c8-e355-4b66-a939-dcf92753f0e6\") " pod="openshift-insights/insights-runtime-extractor-22trx" Jul 06 13:40:46.116796 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:46.116772 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/369661c8-e355-4b66-a939-dcf92753f0e6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-22trx\" (UID: \"369661c8-e355-4b66-a939-dcf92753f0e6\") " pod="openshift-insights/insights-runtime-extractor-22trx" Jul 06 13:40:46.209454 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:46.209423 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-nbfr8\"" Jul 06 13:40:46.217702 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:46.217643 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-22trx" Jul 06 13:40:46.339590 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:46.339563 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-22trx"] Jul 06 13:40:46.342922 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:40:46.342895 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod369661c8_e355_4b66_a939_dcf92753f0e6.slice/crio-a4c87b400cad8ba33310b49b85e556639a6dda5b9069e2b51210cc9841f22d51 WatchSource:0}: Error finding container a4c87b400cad8ba33310b49b85e556639a6dda5b9069e2b51210cc9841f22d51: Status 404 returned error can't find the container with id a4c87b400cad8ba33310b49b85e556639a6dda5b9069e2b51210cc9841f22d51 Jul 06 13:40:46.442562 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:46.442527 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-22trx" event={"ID":"369661c8-e355-4b66-a939-dcf92753f0e6","Type":"ContainerStarted","Data":"a4c87b400cad8ba33310b49b85e556639a6dda5b9069e2b51210cc9841f22d51"} Jul 06 13:40:48.836885 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:48.836848 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8250b72b-73e5-442c-9e18-11a3cbceee8e-metrics-certs\") pod \"network-metrics-daemon-jj6vh\" (UID: \"8250b72b-73e5-442c-9e18-11a3cbceee8e\") " pod="openshift-multus/network-metrics-daemon-jj6vh" Jul 06 13:40:48.840003 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:48.839982 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 06 13:40:48.849582 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:48.849548 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8250b72b-73e5-442c-9e18-11a3cbceee8e-metrics-certs\") pod \"network-metrics-daemon-jj6vh\" (UID: \"8250b72b-73e5-442c-9e18-11a3cbceee8e\") " pod="openshift-multus/network-metrics-daemon-jj6vh" Jul 06 13:40:48.938001 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:48.937963 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/038d9ebd-ecce-4e27-bc8b-e661a606932e-original-pull-secret\") pod \"global-pull-secret-syncer-hsn8z\" (UID: \"038d9ebd-ecce-4e27-bc8b-e661a606932e\") " pod="kube-system/global-pull-secret-syncer-hsn8z" Jul 06 13:40:48.940870 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:48.940838 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 06 13:40:48.950937 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:48.950913 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/038d9ebd-ecce-4e27-bc8b-e661a606932e-original-pull-secret\") pod \"global-pull-secret-syncer-hsn8z\" (UID: \"038d9ebd-ecce-4e27-bc8b-e661a606932e\") " pod="kube-system/global-pull-secret-syncer-hsn8z" Jul 06 13:40:48.969112 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:48.969086 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hsn8z" Jul 06 13:40:48.978608 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:48.978588 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-jzrjm\"" Jul 06 13:40:48.986737 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:48.986723 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jj6vh" Jul 06 13:40:49.039004 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:49.038972 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vhrtn\" (UniqueName: \"kubernetes.io/projected/1aeba52d-6db7-4cb7-bdc8-eb9eda49b30f-kube-api-access-vhrtn\") pod \"network-check-target-dr8q7\" (UID: \"1aeba52d-6db7-4cb7-bdc8-eb9eda49b30f\") " pod="openshift-network-diagnostics/network-check-target-dr8q7" Jul 06 13:40:49.041311 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:49.041294 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 06 13:40:49.051939 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:49.051919 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 06 13:40:49.062339 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:49.062314 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vhrtn\" (UniqueName: \"kubernetes.io/projected/1aeba52d-6db7-4cb7-bdc8-eb9eda49b30f-kube-api-access-vhrtn\") pod \"network-check-target-dr8q7\" (UID: \"1aeba52d-6db7-4cb7-bdc8-eb9eda49b30f\") " pod="openshift-network-diagnostics/network-check-target-dr8q7" Jul 06 13:40:49.285217 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:49.285187 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-rf6qs\"" Jul 06 13:40:49.293211 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:49.293181 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dr8q7" Jul 06 13:40:50.032013 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:50.031980 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-jj6vh"] Jul 06 13:40:50.035417 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:40:50.035350 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8250b72b_73e5_442c_9e18_11a3cbceee8e.slice/crio-3d548b74073f64078a63cdb3956a7baa37b469b499b52dd08d65d09067a5d221 WatchSource:0}: Error finding container 3d548b74073f64078a63cdb3956a7baa37b469b499b52dd08d65d09067a5d221: Status 404 returned error can't find the container with id 3d548b74073f64078a63cdb3956a7baa37b469b499b52dd08d65d09067a5d221 Jul 06 13:40:50.046634 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:50.046599 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-hsn8z"] Jul 06 13:40:50.050844 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:40:50.050815 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod038d9ebd_ecce_4e27_bc8b_e661a606932e.slice/crio-dbcc6a1a41f90071730ed8274c6fdd7f77cd7d40d32d3747be785576714263b8 WatchSource:0}: Error finding container dbcc6a1a41f90071730ed8274c6fdd7f77cd7d40d32d3747be785576714263b8: Status 404 returned error can't find the container with id dbcc6a1a41f90071730ed8274c6fdd7f77cd7d40d32d3747be785576714263b8 Jul 06 13:40:50.065342 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:50.065322 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-dr8q7"] Jul 06 13:40:50.067483 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:40:50.067460 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1aeba52d_6db7_4cb7_bdc8_eb9eda49b30f.slice/crio-02304ed975d3e65b329c7d7408b613fff40b490e1f871147c8abf8ebd9e08a7b WatchSource:0}: Error finding container 02304ed975d3e65b329c7d7408b613fff40b490e1f871147c8abf8ebd9e08a7b: Status 404 returned error can't find the container with id 02304ed975d3e65b329c7d7408b613fff40b490e1f871147c8abf8ebd9e08a7b Jul 06 13:40:50.348533 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:50.348499 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9fc1c970-76a7-4617-a6f4-0046e9c4f967-registry-tls\") pod \"image-registry-65fd8c9c68-9mp5n\" (UID: \"9fc1c970-76a7-4617-a6f4-0046e9c4f967\") " pod="openshift-image-registry/image-registry-65fd8c9c68-9mp5n" Jul 06 13:40:50.348533 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:50.348536 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/87c92d36-2646-4a77-a03a-27190066fbfe-metrics-tls\") pod \"dns-default-cm7lv\" (UID: \"87c92d36-2646-4a77-a03a-27190066fbfe\") " pod="openshift-dns/dns-default-cm7lv" Jul 06 13:40:50.350769 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:50.350752 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/87c92d36-2646-4a77-a03a-27190066fbfe-metrics-tls\") pod \"dns-default-cm7lv\" (UID: \"87c92d36-2646-4a77-a03a-27190066fbfe\") " pod="openshift-dns/dns-default-cm7lv" Jul 06 13:40:50.350854 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:50.350837 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9fc1c970-76a7-4617-a6f4-0046e9c4f967-registry-tls\") pod \"image-registry-65fd8c9c68-9mp5n\" (UID: \"9fc1c970-76a7-4617-a6f4-0046e9c4f967\") " pod="openshift-image-registry/image-registry-65fd8c9c68-9mp5n" Jul 06 13:40:50.455895 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:50.455855 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-dr8q7" event={"ID":"1aeba52d-6db7-4cb7-bdc8-eb9eda49b30f","Type":"ContainerStarted","Data":"02304ed975d3e65b329c7d7408b613fff40b490e1f871147c8abf8ebd9e08a7b"} Jul 06 13:40:50.457545 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:50.457516 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-22trx" event={"ID":"369661c8-e355-4b66-a939-dcf92753f0e6","Type":"ContainerStarted","Data":"5ab0de9d2c6572f5918035bb0e6d617bdc6a36e13ea7d1006c31768a23d781ed"} Jul 06 13:40:50.458753 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:50.458724 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-jj6vh" event={"ID":"8250b72b-73e5-442c-9e18-11a3cbceee8e","Type":"ContainerStarted","Data":"3d548b74073f64078a63cdb3956a7baa37b469b499b52dd08d65d09067a5d221"} Jul 06 13:40:50.460079 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:50.460057 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-hsn8z" event={"ID":"038d9ebd-ecce-4e27-bc8b-e661a606932e","Type":"ContainerStarted","Data":"dbcc6a1a41f90071730ed8274c6fdd7f77cd7d40d32d3747be785576714263b8"} Jul 06 13:40:50.540381 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:50.540353 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-c858x\"" Jul 06 13:40:50.548690 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:50.548660 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-65fd8c9c68-9mp5n" Jul 06 13:40:50.558708 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:50.558690 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-lqkq5\"" Jul 06 13:40:50.566594 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:50.566574 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-cm7lv" Jul 06 13:40:50.723162 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:50.723129 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-65fd8c9c68-9mp5n"] Jul 06 13:40:50.739475 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:50.739393 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-cm7lv"] Jul 06 13:40:50.799631 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:40:50.799595 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9fc1c970_76a7_4617_a6f4_0046e9c4f967.slice/crio-1451105295a02b8d6216b14b991774fb97328c81fc5a37dfb84f3fa3dc20d076 WatchSource:0}: Error finding container 1451105295a02b8d6216b14b991774fb97328c81fc5a37dfb84f3fa3dc20d076: Status 404 returned error can't find the container with id 1451105295a02b8d6216b14b991774fb97328c81fc5a37dfb84f3fa3dc20d076 Jul 06 13:40:50.800216 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:40:50.800181 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod87c92d36_2646_4a77_a03a_27190066fbfe.slice/crio-58e7365561d47a7afecf075519f4a333e0bf33cec447812f4827dba35a6ef018 WatchSource:0}: Error finding container 58e7365561d47a7afecf075519f4a333e0bf33cec447812f4827dba35a6ef018: Status 404 returned error can't find the container with id 58e7365561d47a7afecf075519f4a333e0bf33cec447812f4827dba35a6ef018 Jul 06 13:40:51.465474 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:51.465439 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-cm7lv" event={"ID":"87c92d36-2646-4a77-a03a-27190066fbfe","Type":"ContainerStarted","Data":"58e7365561d47a7afecf075519f4a333e0bf33cec447812f4827dba35a6ef018"} Jul 06 13:40:51.467103 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:51.467070 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-22trx" event={"ID":"369661c8-e355-4b66-a939-dcf92753f0e6","Type":"ContainerStarted","Data":"74afe72d93b08f1a2359834638098ffdf506b2de7eaa9e27c625ae08384569ea"} Jul 06 13:40:51.468449 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:51.468425 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-65fd8c9c68-9mp5n" event={"ID":"9fc1c970-76a7-4617-a6f4-0046e9c4f967","Type":"ContainerStarted","Data":"5b43426a5d933e124ffd50e66db84b192b0032b49ad72eb368b3f956bb285ee5"} Jul 06 13:40:51.468549 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:51.468462 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-65fd8c9c68-9mp5n" event={"ID":"9fc1c970-76a7-4617-a6f4-0046e9c4f967","Type":"ContainerStarted","Data":"1451105295a02b8d6216b14b991774fb97328c81fc5a37dfb84f3fa3dc20d076"} Jul 06 13:40:51.468599 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:51.468565 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-65fd8c9c68-9mp5n" Jul 06 13:40:51.492611 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:51.492569 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-65fd8c9c68-9mp5n" podStartSLOduration=67.49255721 podStartE2EDuration="1m7.49255721s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 13:39:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 13:40:51.49097079 +0000 UTC m=+68.867569750" watchObservedRunningTime="2026-07-06 13:40:51.49255721 +0000 UTC m=+68.869156170" Jul 06 13:40:52.478124 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:52.478091 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-jj6vh" event={"ID":"8250b72b-73e5-442c-9e18-11a3cbceee8e","Type":"ContainerStarted","Data":"80333da470b878efa67039fa0e92ed134a0a51bf22f8307a6fe1c871c8e79c6b"} Jul 06 13:40:52.478601 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:52.478144 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-jj6vh" event={"ID":"8250b72b-73e5-442c-9e18-11a3cbceee8e","Type":"ContainerStarted","Data":"8021037d07fba102b36f547b270e96f54239e6b203530614de02786143525422"} Jul 06 13:40:52.496320 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:52.496265 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-jj6vh" podStartSLOduration=66.847516776 podStartE2EDuration="1m8.49624294s" totalImagesPullingTime="1.648726164s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 13:39:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 13:40:52.495315788 +0000 UTC m=+69.871914750" watchObservedRunningTime="2026-07-06 13:40:52.49624294 +0000 UTC m=+69.872841880" Jul 06 13:40:54.351294 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:54.351262 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6f5fc545cd-pwrkv"] Jul 06 13:40:54.353577 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:54.353554 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6f5fc545cd-pwrkv" Jul 06 13:40:54.356561 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:54.356326 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\"" Jul 06 13:40:54.356561 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:54.356378 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\"" Jul 06 13:40:54.356561 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:54.356394 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jul 06 13:40:54.356561 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:54.356378 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jul 06 13:40:54.357624 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:54.357370 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jul 06 13:40:54.357624 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:54.357478 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\"" Jul 06 13:40:54.357624 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:54.357515 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\"" Jul 06 13:40:54.367178 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:54.367154 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6f5fc545cd-pwrkv"] Jul 06 13:40:54.482937 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:54.482901 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/dec1a881-8967-4ca9-b4ff-275f3263af88-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-6f5fc545cd-pwrkv\" (UID: \"dec1a881-8967-4ca9-b4ff-275f3263af88\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6f5fc545cd-pwrkv" Jul 06 13:40:54.483119 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:54.482959 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/dec1a881-8967-4ca9-b4ff-275f3263af88-additional-service-ca\") pod \"cluster-proxy-proxy-agent-6f5fc545cd-pwrkv\" (UID: \"dec1a881-8967-4ca9-b4ff-275f3263af88\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6f5fc545cd-pwrkv" Jul 06 13:40:54.483119 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:54.483022 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/dec1a881-8967-4ca9-b4ff-275f3263af88-hub\") pod \"cluster-proxy-proxy-agent-6f5fc545cd-pwrkv\" (UID: \"dec1a881-8967-4ca9-b4ff-275f3263af88\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6f5fc545cd-pwrkv" Jul 06 13:40:54.483296 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:54.483270 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wdfzq\" (UniqueName: \"kubernetes.io/projected/dec1a881-8967-4ca9-b4ff-275f3263af88-kube-api-access-wdfzq\") pod \"cluster-proxy-proxy-agent-6f5fc545cd-pwrkv\" (UID: \"dec1a881-8967-4ca9-b4ff-275f3263af88\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6f5fc545cd-pwrkv" Jul 06 13:40:54.483377 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:54.483316 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/dec1a881-8967-4ca9-b4ff-275f3263af88-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-6f5fc545cd-pwrkv\" (UID: \"dec1a881-8967-4ca9-b4ff-275f3263af88\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6f5fc545cd-pwrkv" Jul 06 13:40:54.483377 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:54.483343 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/dec1a881-8967-4ca9-b4ff-275f3263af88-ca\") pod \"cluster-proxy-proxy-agent-6f5fc545cd-pwrkv\" (UID: \"dec1a881-8967-4ca9-b4ff-275f3263af88\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6f5fc545cd-pwrkv" Jul 06 13:40:54.584231 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:54.584193 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/dec1a881-8967-4ca9-b4ff-275f3263af88-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-6f5fc545cd-pwrkv\" (UID: \"dec1a881-8967-4ca9-b4ff-275f3263af88\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6f5fc545cd-pwrkv" Jul 06 13:40:54.584454 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:54.584238 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/dec1a881-8967-4ca9-b4ff-275f3263af88-additional-service-ca\") pod \"cluster-proxy-proxy-agent-6f5fc545cd-pwrkv\" (UID: \"dec1a881-8967-4ca9-b4ff-275f3263af88\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6f5fc545cd-pwrkv" Jul 06 13:40:54.584454 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:54.584336 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/dec1a881-8967-4ca9-b4ff-275f3263af88-hub\") pod \"cluster-proxy-proxy-agent-6f5fc545cd-pwrkv\" (UID: \"dec1a881-8967-4ca9-b4ff-275f3263af88\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6f5fc545cd-pwrkv" Jul 06 13:40:54.584454 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:54.584390 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wdfzq\" (UniqueName: \"kubernetes.io/projected/dec1a881-8967-4ca9-b4ff-275f3263af88-kube-api-access-wdfzq\") pod \"cluster-proxy-proxy-agent-6f5fc545cd-pwrkv\" (UID: \"dec1a881-8967-4ca9-b4ff-275f3263af88\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6f5fc545cd-pwrkv" Jul 06 13:40:54.584454 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:54.584428 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/dec1a881-8967-4ca9-b4ff-275f3263af88-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-6f5fc545cd-pwrkv\" (UID: \"dec1a881-8967-4ca9-b4ff-275f3263af88\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6f5fc545cd-pwrkv" Jul 06 13:40:54.584650 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:54.584457 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/dec1a881-8967-4ca9-b4ff-275f3263af88-ca\") pod \"cluster-proxy-proxy-agent-6f5fc545cd-pwrkv\" (UID: \"dec1a881-8967-4ca9-b4ff-275f3263af88\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6f5fc545cd-pwrkv" Jul 06 13:40:54.584990 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:54.584943 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/dec1a881-8967-4ca9-b4ff-275f3263af88-additional-service-ca\") pod \"cluster-proxy-proxy-agent-6f5fc545cd-pwrkv\" (UID: \"dec1a881-8967-4ca9-b4ff-275f3263af88\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6f5fc545cd-pwrkv" Jul 06 13:40:54.587626 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:54.587389 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/dec1a881-8967-4ca9-b4ff-275f3263af88-ca\") pod \"cluster-proxy-proxy-agent-6f5fc545cd-pwrkv\" (UID: \"dec1a881-8967-4ca9-b4ff-275f3263af88\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6f5fc545cd-pwrkv" Jul 06 13:40:54.587626 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:54.587530 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/dec1a881-8967-4ca9-b4ff-275f3263af88-hub\") pod \"cluster-proxy-proxy-agent-6f5fc545cd-pwrkv\" (UID: \"dec1a881-8967-4ca9-b4ff-275f3263af88\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6f5fc545cd-pwrkv" Jul 06 13:40:54.587626 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:54.587569 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/dec1a881-8967-4ca9-b4ff-275f3263af88-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-6f5fc545cd-pwrkv\" (UID: \"dec1a881-8967-4ca9-b4ff-275f3263af88\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6f5fc545cd-pwrkv" Jul 06 13:40:54.587790 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:54.587667 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/dec1a881-8967-4ca9-b4ff-275f3263af88-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-6f5fc545cd-pwrkv\" (UID: \"dec1a881-8967-4ca9-b4ff-275f3263af88\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6f5fc545cd-pwrkv" Jul 06 13:40:54.593564 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:54.593543 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wdfzq\" (UniqueName: \"kubernetes.io/projected/dec1a881-8967-4ca9-b4ff-275f3263af88-kube-api-access-wdfzq\") pod \"cluster-proxy-proxy-agent-6f5fc545cd-pwrkv\" (UID: \"dec1a881-8967-4ca9-b4ff-275f3263af88\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6f5fc545cd-pwrkv" Jul 06 13:40:54.671605 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:54.671534 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6f5fc545cd-pwrkv" Jul 06 13:40:56.298606 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:56.298569 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/628d0eab-eceb-4062-a2bc-8072b21babd1-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-lgttx\" (UID: \"628d0eab-eceb-4062-a2bc-8072b21babd1\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-lgttx" Jul 06 13:40:56.301191 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:56.301169 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/628d0eab-eceb-4062-a2bc-8072b21babd1-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-lgttx\" (UID: \"628d0eab-eceb-4062-a2bc-8072b21babd1\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-lgttx" Jul 06 13:40:56.495115 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:56.495089 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-mc46c\"" Jul 06 13:40:56.503308 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:56.503280 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-lgttx" Jul 06 13:40:57.038427 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:57.038404 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-64786d9cbb-lgttx"] Jul 06 13:40:57.043387 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:40:57.043359 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod628d0eab_eceb_4062_a2bc_8072b21babd1.slice/crio-e2c542ef0d256415746b1479a9485d0b7717fb79b1c5fc873dc0656a21b87735 WatchSource:0}: Error finding container e2c542ef0d256415746b1479a9485d0b7717fb79b1c5fc873dc0656a21b87735: Status 404 returned error can't find the container with id e2c542ef0d256415746b1479a9485d0b7717fb79b1c5fc873dc0656a21b87735 Jul 06 13:40:57.054563 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:57.054476 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6f5fc545cd-pwrkv"] Jul 06 13:40:57.064356 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:40:57.064330 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poddec1a881_8967_4ca9_b4ff_275f3263af88.slice/crio-815dec5c20a81f1ca659c07245aa7ad9471071a333c62ed9b1e3d1e96b5d1537 WatchSource:0}: Error finding container 815dec5c20a81f1ca659c07245aa7ad9471071a333c62ed9b1e3d1e96b5d1537: Status 404 returned error can't find the container with id 815dec5c20a81f1ca659c07245aa7ad9471071a333c62ed9b1e3d1e96b5d1537 Jul 06 13:40:57.497793 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:57.497754 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-22trx" event={"ID":"369661c8-e355-4b66-a939-dcf92753f0e6","Type":"ContainerStarted","Data":"68b749bd9d729b89714cecf586c81e89531c73b0e7b5aa98ae2824b761a0b5b1"} Jul 06 13:40:57.499132 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:57.499112 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-hsn8z" event={"ID":"038d9ebd-ecce-4e27-bc8b-e661a606932e","Type":"ContainerStarted","Data":"8eba68860c2903dcc1e0805df6bbae622810c60587a41ed6baf6f6720adf79cf"} Jul 06 13:40:57.500389 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:57.500370 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-dr8q7" event={"ID":"1aeba52d-6db7-4cb7-bdc8-eb9eda49b30f","Type":"ContainerStarted","Data":"01d4691aad3f9b2232b24f561d3d169c04686cf2dbd28a865cec9584d335a411"} Jul 06 13:40:57.500477 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:57.500418 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-dr8q7" Jul 06 13:40:57.501961 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:57.501941 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-cm7lv" event={"ID":"87c92d36-2646-4a77-a03a-27190066fbfe","Type":"ContainerStarted","Data":"8ff3dbb9365a4898f6db7f598c06e3b1b059d6b38c8c23803bfa8d33d23b1735"} Jul 06 13:40:57.502067 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:57.501981 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-cm7lv" event={"ID":"87c92d36-2646-4a77-a03a-27190066fbfe","Type":"ContainerStarted","Data":"32505c8eb61b517781a8b5b85315912740a6c32d043500c4d7c5ce2b1c260ab2"} Jul 06 13:40:57.502124 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:57.502060 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-cm7lv" Jul 06 13:40:57.503010 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:57.502994 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-lgttx" event={"ID":"628d0eab-eceb-4062-a2bc-8072b21babd1","Type":"ContainerStarted","Data":"e2c542ef0d256415746b1479a9485d0b7717fb79b1c5fc873dc0656a21b87735"} Jul 06 13:40:57.504203 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:57.504181 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6f5fc545cd-pwrkv" event={"ID":"dec1a881-8967-4ca9-b4ff-275f3263af88","Type":"ContainerStarted","Data":"815dec5c20a81f1ca659c07245aa7ad9471071a333c62ed9b1e3d1e96b5d1537"} Jul 06 13:40:57.518668 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:57.518629 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-22trx" podStartSLOduration=17.221740835 podStartE2EDuration="27.518617125s" totalImagesPullingTime="10.29687629s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 13:40:30 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 13:40:57.517534272 +0000 UTC m=+74.894133233" watchObservedRunningTime="2026-07-06 13:40:57.518617125 +0000 UTC m=+74.895216086" Jul 06 13:40:57.533908 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:57.533871 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-dr8q7" podStartSLOduration=66.733609732 podStartE2EDuration="1m13.533859469s" totalImagesPullingTime="6.800249737s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 13:39:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 13:40:57.533146089 +0000 UTC m=+74.909745050" watchObservedRunningTime="2026-07-06 13:40:57.533859469 +0000 UTC m=+74.910458427" Jul 06 13:40:57.552231 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:57.552189 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-hsn8z" podStartSLOduration=66.726373417 podStartE2EDuration="1m13.552176296s" totalImagesPullingTime="6.825802879s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 13:39:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 13:40:57.551539582 +0000 UTC m=+74.928138542" watchObservedRunningTime="2026-07-06 13:40:57.552176296 +0000 UTC m=+74.928775255" Jul 06 13:40:57.570735 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:57.570695 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-cm7lv" podStartSLOduration=33.530530302 podStartE2EDuration="39.570683286s" totalImagesPullingTime="6.040152984s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 13:40:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 13:40:57.570342699 +0000 UTC m=+74.946941660" watchObservedRunningTime="2026-07-06 13:40:57.570683286 +0000 UTC m=+74.947282246" Jul 06 13:40:59.512942 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:59.512908 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-lgttx" event={"ID":"628d0eab-eceb-4062-a2bc-8072b21babd1","Type":"ContainerStarted","Data":"3ef862f35254fd608c575afeb590b651f51d79c19b33ef485c17796b833124ca"} Jul 06 13:40:59.532086 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:40:59.532010 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-lgttx" podStartSLOduration=33.468246332 podStartE2EDuration="35.531990539s" totalImagesPullingTime="2.063744207s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 13:40:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 13:40:59.530764995 +0000 UTC m=+76.907363954" watchObservedRunningTime="2026-07-06 13:40:59.531990539 +0000 UTC m=+76.908589504" Jul 06 13:41:07.509675 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:41:07.509561 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-cm7lv" Jul 06 13:41:10.101189 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:41:10.101144 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-nnrkt"] Jul 06 13:41:10.104607 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:41:10.104577 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-nnrkt" Jul 06 13:41:10.107380 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:41:10.107027 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 06 13:41:10.107380 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:41:10.107086 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-h5lp7\"" Jul 06 13:41:10.107380 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:41:10.107365 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 06 13:41:10.107620 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:41:10.107527 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 06 13:41:10.108003 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:41:10.107980 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 06 13:41:10.196203 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:41:10.196175 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mld2d\" (UniqueName: \"kubernetes.io/projected/c5ec9ee7-8508-41c8-9889-cb371ba85bee-kube-api-access-mld2d\") pod \"node-exporter-nnrkt\" (UID: \"c5ec9ee7-8508-41c8-9889-cb371ba85bee\") " pod="openshift-monitoring/node-exporter-nnrkt" Jul 06 13:41:10.196203 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:41:10.196210 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c5ec9ee7-8508-41c8-9889-cb371ba85bee-sys\") pod \"node-exporter-nnrkt\" (UID: \"c5ec9ee7-8508-41c8-9889-cb371ba85bee\") " pod="openshift-monitoring/node-exporter-nnrkt" Jul 06 13:41:10.196447 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:41:10.196233 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/c5ec9ee7-8508-41c8-9889-cb371ba85bee-node-exporter-wtmp\") pod \"node-exporter-nnrkt\" (UID: \"c5ec9ee7-8508-41c8-9889-cb371ba85bee\") " pod="openshift-monitoring/node-exporter-nnrkt" Jul 06 13:41:10.196447 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:41:10.196253 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/c5ec9ee7-8508-41c8-9889-cb371ba85bee-node-exporter-accelerators-collector-config\") pod \"node-exporter-nnrkt\" (UID: \"c5ec9ee7-8508-41c8-9889-cb371ba85bee\") " pod="openshift-monitoring/node-exporter-nnrkt" Jul 06 13:41:10.196447 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:41:10.196313 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c5ec9ee7-8508-41c8-9889-cb371ba85bee-metrics-client-ca\") pod \"node-exporter-nnrkt\" (UID: \"c5ec9ee7-8508-41c8-9889-cb371ba85bee\") " pod="openshift-monitoring/node-exporter-nnrkt" Jul 06 13:41:10.196447 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:41:10.196335 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/c5ec9ee7-8508-41c8-9889-cb371ba85bee-root\") pod \"node-exporter-nnrkt\" (UID: \"c5ec9ee7-8508-41c8-9889-cb371ba85bee\") " pod="openshift-monitoring/node-exporter-nnrkt" Jul 06 13:41:10.196447 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:41:10.196348 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/c5ec9ee7-8508-41c8-9889-cb371ba85bee-node-exporter-tls\") pod \"node-exporter-nnrkt\" (UID: \"c5ec9ee7-8508-41c8-9889-cb371ba85bee\") " pod="openshift-monitoring/node-exporter-nnrkt" Jul 06 13:41:10.196447 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:41:10.196369 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c5ec9ee7-8508-41c8-9889-cb371ba85bee-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-nnrkt\" (UID: \"c5ec9ee7-8508-41c8-9889-cb371ba85bee\") " pod="openshift-monitoring/node-exporter-nnrkt" Jul 06 13:41:10.196447 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:41:10.196400 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/c5ec9ee7-8508-41c8-9889-cb371ba85bee-node-exporter-textfile\") pod \"node-exporter-nnrkt\" (UID: \"c5ec9ee7-8508-41c8-9889-cb371ba85bee\") " pod="openshift-monitoring/node-exporter-nnrkt" Jul 06 13:41:10.297556 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:41:10.297521 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c5ec9ee7-8508-41c8-9889-cb371ba85bee-metrics-client-ca\") pod \"node-exporter-nnrkt\" (UID: \"c5ec9ee7-8508-41c8-9889-cb371ba85bee\") " pod="openshift-monitoring/node-exporter-nnrkt" Jul 06 13:41:10.297723 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:41:10.297572 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/c5ec9ee7-8508-41c8-9889-cb371ba85bee-root\") pod \"node-exporter-nnrkt\" (UID: \"c5ec9ee7-8508-41c8-9889-cb371ba85bee\") " pod="openshift-monitoring/node-exporter-nnrkt" Jul 06 13:41:10.297723 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:41:10.297600 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/c5ec9ee7-8508-41c8-9889-cb371ba85bee-node-exporter-tls\") pod \"node-exporter-nnrkt\" (UID: \"c5ec9ee7-8508-41c8-9889-cb371ba85bee\") " pod="openshift-monitoring/node-exporter-nnrkt" Jul 06 13:41:10.297723 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:41:10.297632 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c5ec9ee7-8508-41c8-9889-cb371ba85bee-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-nnrkt\" (UID: \"c5ec9ee7-8508-41c8-9889-cb371ba85bee\") " pod="openshift-monitoring/node-exporter-nnrkt" Jul 06 13:41:10.297723 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:41:10.297647 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/c5ec9ee7-8508-41c8-9889-cb371ba85bee-root\") pod \"node-exporter-nnrkt\" (UID: \"c5ec9ee7-8508-41c8-9889-cb371ba85bee\") " pod="openshift-monitoring/node-exporter-nnrkt" Jul 06 13:41:10.297723 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:41:10.297676 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/c5ec9ee7-8508-41c8-9889-cb371ba85bee-node-exporter-textfile\") pod \"node-exporter-nnrkt\" (UID: \"c5ec9ee7-8508-41c8-9889-cb371ba85bee\") " pod="openshift-monitoring/node-exporter-nnrkt" Jul 06 13:41:10.297723 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:41:10.297716 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mld2d\" (UniqueName: \"kubernetes.io/projected/c5ec9ee7-8508-41c8-9889-cb371ba85bee-kube-api-access-mld2d\") pod \"node-exporter-nnrkt\" (UID: \"c5ec9ee7-8508-41c8-9889-cb371ba85bee\") " pod="openshift-monitoring/node-exporter-nnrkt" Jul 06 13:41:10.298106 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:41:10.297740 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c5ec9ee7-8508-41c8-9889-cb371ba85bee-sys\") pod \"node-exporter-nnrkt\" (UID: \"c5ec9ee7-8508-41c8-9889-cb371ba85bee\") " pod="openshift-monitoring/node-exporter-nnrkt" Jul 06 13:41:10.298106 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:41:10.297766 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/c5ec9ee7-8508-41c8-9889-cb371ba85bee-node-exporter-wtmp\") pod \"node-exporter-nnrkt\" (UID: \"c5ec9ee7-8508-41c8-9889-cb371ba85bee\") " pod="openshift-monitoring/node-exporter-nnrkt" Jul 06 13:41:10.298106 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:41:10.297789 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/c5ec9ee7-8508-41c8-9889-cb371ba85bee-node-exporter-accelerators-collector-config\") pod \"node-exporter-nnrkt\" (UID: \"c5ec9ee7-8508-41c8-9889-cb371ba85bee\") " pod="openshift-monitoring/node-exporter-nnrkt" Jul 06 13:41:10.298312 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:41:10.298122 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c5ec9ee7-8508-41c8-9889-cb371ba85bee-sys\") pod \"node-exporter-nnrkt\" (UID: \"c5ec9ee7-8508-41c8-9889-cb371ba85bee\") " pod="openshift-monitoring/node-exporter-nnrkt" Jul 06 13:41:10.298312 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:41:10.298223 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c5ec9ee7-8508-41c8-9889-cb371ba85bee-metrics-client-ca\") pod \"node-exporter-nnrkt\" (UID: \"c5ec9ee7-8508-41c8-9889-cb371ba85bee\") " pod="openshift-monitoring/node-exporter-nnrkt" Jul 06 13:41:10.298312 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:41:10.298286 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/c5ec9ee7-8508-41c8-9889-cb371ba85bee-node-exporter-wtmp\") pod \"node-exporter-nnrkt\" (UID: \"c5ec9ee7-8508-41c8-9889-cb371ba85bee\") " pod="openshift-monitoring/node-exporter-nnrkt" Jul 06 13:41:10.298487 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:41:10.298331 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/c5ec9ee7-8508-41c8-9889-cb371ba85bee-node-exporter-accelerators-collector-config\") pod \"node-exporter-nnrkt\" (UID: \"c5ec9ee7-8508-41c8-9889-cb371ba85bee\") " pod="openshift-monitoring/node-exporter-nnrkt" Jul 06 13:41:10.298487 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:41:10.298395 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/c5ec9ee7-8508-41c8-9889-cb371ba85bee-node-exporter-textfile\") pod \"node-exporter-nnrkt\" (UID: \"c5ec9ee7-8508-41c8-9889-cb371ba85bee\") " pod="openshift-monitoring/node-exporter-nnrkt" Jul 06 13:41:10.300808 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:41:10.300778 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c5ec9ee7-8508-41c8-9889-cb371ba85bee-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-nnrkt\" (UID: \"c5ec9ee7-8508-41c8-9889-cb371ba85bee\") " pod="openshift-monitoring/node-exporter-nnrkt" Jul 06 13:41:10.301569 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:41:10.301544 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/c5ec9ee7-8508-41c8-9889-cb371ba85bee-node-exporter-tls\") pod \"node-exporter-nnrkt\" (UID: \"c5ec9ee7-8508-41c8-9889-cb371ba85bee\") " pod="openshift-monitoring/node-exporter-nnrkt" Jul 06 13:41:10.310989 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:41:10.310969 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mld2d\" (UniqueName: \"kubernetes.io/projected/c5ec9ee7-8508-41c8-9889-cb371ba85bee-kube-api-access-mld2d\") pod \"node-exporter-nnrkt\" (UID: \"c5ec9ee7-8508-41c8-9889-cb371ba85bee\") " pod="openshift-monitoring/node-exporter-nnrkt" Jul 06 13:41:10.416372 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:41:10.416270 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-nnrkt" Jul 06 13:41:10.429884 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:41:10.429814 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc5ec9ee7_8508_41c8_9889_cb371ba85bee.slice/crio-f1c51177c2296f2a4dc5318275ebdbe21109f6de6669bf4db6895b7c0e6a8807 WatchSource:0}: Error finding container f1c51177c2296f2a4dc5318275ebdbe21109f6de6669bf4db6895b7c0e6a8807: Status 404 returned error can't find the container with id f1c51177c2296f2a4dc5318275ebdbe21109f6de6669bf4db6895b7c0e6a8807 Jul 06 13:41:10.551824 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:41:10.551786 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-nnrkt" event={"ID":"c5ec9ee7-8508-41c8-9889-cb371ba85bee","Type":"ContainerStarted","Data":"f1c51177c2296f2a4dc5318275ebdbe21109f6de6669bf4db6895b7c0e6a8807"} Jul 06 13:41:10.554677 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:41:10.554646 2573 patch_prober.go:28] interesting pod/image-registry-65fd8c9c68-9mp5n container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 06 13:41:10.554813 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:41:10.554702 2573 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-65fd8c9c68-9mp5n" podUID="9fc1c970-76a7-4617-a6f4-0046e9c4f967" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 06 13:41:12.483547 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:41:12.483506 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-65fd8c9c68-9mp5n" Jul 06 13:41:13.564768 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:41:13.564733 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6f5fc545cd-pwrkv" event={"ID":"dec1a881-8967-4ca9-b4ff-275f3263af88","Type":"ContainerStarted","Data":"88c723e8c21d3a7e0eb1f38bf5af40c5d6036e974de4860289a41f24d1c04200"} Jul 06 13:41:13.565209 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:41:13.564784 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6f5fc545cd-pwrkv" event={"ID":"dec1a881-8967-4ca9-b4ff-275f3263af88","Type":"ContainerStarted","Data":"5b52f524a9397ef3916bb336dfb7db03fc672b90f933f2c0c7ddb5b2f4394c21"} Jul 06 13:41:13.565209 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:41:13.564803 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6f5fc545cd-pwrkv" event={"ID":"dec1a881-8967-4ca9-b4ff-275f3263af88","Type":"ContainerStarted","Data":"62b53a219ca5cb65a4b7d5ab1865b5dd4ebf53173e3150838c4488b256044f0c"} Jul 06 13:41:13.566295 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:41:13.566267 2573 generic.go:356] "Generic (PLEG): container finished" podID="c5ec9ee7-8508-41c8-9889-cb371ba85bee" containerID="c2c25e5bf83aa1e4b9bfdcdaaf23e864a26b342531df5f5f0d3d65018468b909" exitCode=0 Jul 06 13:41:13.566389 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:41:13.566306 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-nnrkt" event={"ID":"c5ec9ee7-8508-41c8-9889-cb371ba85bee","Type":"ContainerDied","Data":"c2c25e5bf83aa1e4b9bfdcdaaf23e864a26b342531df5f5f0d3d65018468b909"} Jul 06 13:41:13.591765 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:41:13.591640 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6f5fc545cd-pwrkv" podStartSLOduration=3.438647496 podStartE2EDuration="19.591623442s" totalImagesPullingTime="16.152975946s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 13:40:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 13:41:13.590513731 +0000 UTC m=+90.967112692" watchObservedRunningTime="2026-07-06 13:41:13.591623442 +0000 UTC m=+90.968222404" Jul 06 13:41:14.520913 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:41:14.520879 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-dd759cc5c-l856l"] Jul 06 13:41:14.523953 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:41:14.523934 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-dd759cc5c-l856l" Jul 06 13:41:14.527237 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:41:14.527198 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Jul 06 13:41:14.527237 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:41:14.527211 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-d4kp510cku5lj\"" Jul 06 13:41:14.527432 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:41:14.527277 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 06 13:41:14.527432 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:41:14.527198 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Jul 06 13:41:14.527432 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:41:14.527215 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Jul 06 13:41:14.527432 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:41:14.527349 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-lnrgc\"" Jul 06 13:41:14.535846 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:41:14.535823 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-dd759cc5c-l856l"] Jul 06 13:41:14.571751 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:41:14.571720 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-nnrkt" event={"ID":"c5ec9ee7-8508-41c8-9889-cb371ba85bee","Type":"ContainerStarted","Data":"6399bd0834f91aa46cab1d05c9e004f7d104b1902a15b9005e2a272082f3525b"} Jul 06 13:41:14.572080 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:41:14.571774 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-nnrkt" event={"ID":"c5ec9ee7-8508-41c8-9889-cb371ba85bee","Type":"ContainerStarted","Data":"39d7e499190bffba8ce554590254c01a19bf6e33d33aedd687afa4105ef97140"} Jul 06 13:41:14.637042 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:41:14.637019 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/cc75af9b-11c1-49b4-b911-68bb3d314a48-secret-metrics-server-tls\") pod \"metrics-server-dd759cc5c-l856l\" (UID: \"cc75af9b-11c1-49b4-b911-68bb3d314a48\") " pod="openshift-monitoring/metrics-server-dd759cc5c-l856l" Jul 06 13:41:14.637159 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:41:14.637073 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/cc75af9b-11c1-49b4-b911-68bb3d314a48-secret-metrics-server-client-certs\") pod \"metrics-server-dd759cc5c-l856l\" (UID: \"cc75af9b-11c1-49b4-b911-68bb3d314a48\") " pod="openshift-monitoring/metrics-server-dd759cc5c-l856l" Jul 06 13:41:14.637159 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:41:14.637119 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/cc75af9b-11c1-49b4-b911-68bb3d314a48-client-ca-bundle\") pod \"metrics-server-dd759cc5c-l856l\" (UID: \"cc75af9b-11c1-49b4-b911-68bb3d314a48\") " pod="openshift-monitoring/metrics-server-dd759cc5c-l856l" Jul 06 13:41:14.637159 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:41:14.637148 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/cc75af9b-11c1-49b4-b911-68bb3d314a48-audit-log\") pod \"metrics-server-dd759cc5c-l856l\" (UID: \"cc75af9b-11c1-49b4-b911-68bb3d314a48\") " pod="openshift-monitoring/metrics-server-dd759cc5c-l856l" Jul 06 13:41:14.637271 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:41:14.637197 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cc75af9b-11c1-49b4-b911-68bb3d314a48-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-dd759cc5c-l856l\" (UID: \"cc75af9b-11c1-49b4-b911-68bb3d314a48\") " pod="openshift-monitoring/metrics-server-dd759cc5c-l856l" Jul 06 13:41:14.637271 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:41:14.637230 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4r44w\" (UniqueName: \"kubernetes.io/projected/cc75af9b-11c1-49b4-b911-68bb3d314a48-kube-api-access-4r44w\") pod \"metrics-server-dd759cc5c-l856l\" (UID: \"cc75af9b-11c1-49b4-b911-68bb3d314a48\") " pod="openshift-monitoring/metrics-server-dd759cc5c-l856l" Jul 06 13:41:14.637271 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:41:14.637250 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/cc75af9b-11c1-49b4-b911-68bb3d314a48-metrics-server-audit-profiles\") pod \"metrics-server-dd759cc5c-l856l\" (UID: \"cc75af9b-11c1-49b4-b911-68bb3d314a48\") " pod="openshift-monitoring/metrics-server-dd759cc5c-l856l" Jul 06 13:41:14.738049 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:41:14.738014 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/cc75af9b-11c1-49b4-b911-68bb3d314a48-secret-metrics-server-client-certs\") pod \"metrics-server-dd759cc5c-l856l\" (UID: \"cc75af9b-11c1-49b4-b911-68bb3d314a48\") " pod="openshift-monitoring/metrics-server-dd759cc5c-l856l" Jul 06 13:41:14.738189 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:41:14.738079 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/cc75af9b-11c1-49b4-b911-68bb3d314a48-client-ca-bundle\") pod \"metrics-server-dd759cc5c-l856l\" (UID: \"cc75af9b-11c1-49b4-b911-68bb3d314a48\") " pod="openshift-monitoring/metrics-server-dd759cc5c-l856l" Jul 06 13:41:14.738189 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:41:14.738120 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/cc75af9b-11c1-49b4-b911-68bb3d314a48-audit-log\") pod \"metrics-server-dd759cc5c-l856l\" (UID: \"cc75af9b-11c1-49b4-b911-68bb3d314a48\") " pod="openshift-monitoring/metrics-server-dd759cc5c-l856l" Jul 06 13:41:14.738189 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:41:14.738152 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cc75af9b-11c1-49b4-b911-68bb3d314a48-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-dd759cc5c-l856l\" (UID: \"cc75af9b-11c1-49b4-b911-68bb3d314a48\") " pod="openshift-monitoring/metrics-server-dd759cc5c-l856l" Jul 06 13:41:14.738628 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:41:14.738197 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4r44w\" (UniqueName: \"kubernetes.io/projected/cc75af9b-11c1-49b4-b911-68bb3d314a48-kube-api-access-4r44w\") pod \"metrics-server-dd759cc5c-l856l\" (UID: \"cc75af9b-11c1-49b4-b911-68bb3d314a48\") " pod="openshift-monitoring/metrics-server-dd759cc5c-l856l" Jul 06 13:41:14.738822 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:41:14.738796 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/cc75af9b-11c1-49b4-b911-68bb3d314a48-metrics-server-audit-profiles\") pod \"metrics-server-dd759cc5c-l856l\" (UID: \"cc75af9b-11c1-49b4-b911-68bb3d314a48\") " pod="openshift-monitoring/metrics-server-dd759cc5c-l856l" Jul 06 13:41:14.738945 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:41:14.738681 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/cc75af9b-11c1-49b4-b911-68bb3d314a48-audit-log\") pod \"metrics-server-dd759cc5c-l856l\" (UID: \"cc75af9b-11c1-49b4-b911-68bb3d314a48\") " pod="openshift-monitoring/metrics-server-dd759cc5c-l856l" Jul 06 13:41:14.738945 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:41:14.738890 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cc75af9b-11c1-49b4-b911-68bb3d314a48-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-dd759cc5c-l856l\" (UID: \"cc75af9b-11c1-49b4-b911-68bb3d314a48\") " pod="openshift-monitoring/metrics-server-dd759cc5c-l856l" Jul 06 13:41:14.739080 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:41:14.738993 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/cc75af9b-11c1-49b4-b911-68bb3d314a48-secret-metrics-server-tls\") pod \"metrics-server-dd759cc5c-l856l\" (UID: \"cc75af9b-11c1-49b4-b911-68bb3d314a48\") " pod="openshift-monitoring/metrics-server-dd759cc5c-l856l" Jul 06 13:41:14.739648 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:41:14.739627 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/cc75af9b-11c1-49b4-b911-68bb3d314a48-metrics-server-audit-profiles\") pod \"metrics-server-dd759cc5c-l856l\" (UID: \"cc75af9b-11c1-49b4-b911-68bb3d314a48\") " pod="openshift-monitoring/metrics-server-dd759cc5c-l856l" Jul 06 13:41:14.741192 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:41:14.741170 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/cc75af9b-11c1-49b4-b911-68bb3d314a48-secret-metrics-server-client-certs\") pod \"metrics-server-dd759cc5c-l856l\" (UID: \"cc75af9b-11c1-49b4-b911-68bb3d314a48\") " pod="openshift-monitoring/metrics-server-dd759cc5c-l856l" Jul 06 13:41:14.741192 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:41:14.741183 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/cc75af9b-11c1-49b4-b911-68bb3d314a48-client-ca-bundle\") pod \"metrics-server-dd759cc5c-l856l\" (UID: \"cc75af9b-11c1-49b4-b911-68bb3d314a48\") " pod="openshift-monitoring/metrics-server-dd759cc5c-l856l" Jul 06 13:41:14.741329 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:41:14.741296 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/cc75af9b-11c1-49b4-b911-68bb3d314a48-secret-metrics-server-tls\") pod \"metrics-server-dd759cc5c-l856l\" (UID: \"cc75af9b-11c1-49b4-b911-68bb3d314a48\") " pod="openshift-monitoring/metrics-server-dd759cc5c-l856l" Jul 06 13:41:14.746405 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:41:14.746379 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4r44w\" (UniqueName: \"kubernetes.io/projected/cc75af9b-11c1-49b4-b911-68bb3d314a48-kube-api-access-4r44w\") pod \"metrics-server-dd759cc5c-l856l\" (UID: \"cc75af9b-11c1-49b4-b911-68bb3d314a48\") " pod="openshift-monitoring/metrics-server-dd759cc5c-l856l" Jul 06 13:41:14.832452 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:41:14.832372 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-dd759cc5c-l856l" Jul 06 13:41:14.970823 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:41:14.970485 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-nnrkt" podStartSLOduration=2.126081906 podStartE2EDuration="4.970462799s" totalImagesPullingTime="2.772822221s" totalInitContainerRuntime="71.558672ms" isStatefulPod=true podCreationTimestamp="2026-07-06 13:41:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 13:41:14.592846321 +0000 UTC m=+91.969445300" watchObservedRunningTime="2026-07-06 13:41:14.970462799 +0000 UTC m=+92.347061762" Jul 06 13:41:14.971842 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:41:14.971817 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-dd759cc5c-l856l"] Jul 06 13:41:14.974741 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:41:14.974715 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcc75af9b_11c1_49b4_b911_68bb3d314a48.slice/crio-39637f06563ec1fe3b283d469cfdb0ec45e45b0a66599f500dfe9d1447957b3d WatchSource:0}: Error finding container 39637f06563ec1fe3b283d469cfdb0ec45e45b0a66599f500dfe9d1447957b3d: Status 404 returned error can't find the container with id 39637f06563ec1fe3b283d469cfdb0ec45e45b0a66599f500dfe9d1447957b3d Jul 06 13:41:15.577567 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:41:15.577519 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-dd759cc5c-l856l" event={"ID":"cc75af9b-11c1-49b4-b911-68bb3d314a48","Type":"ContainerStarted","Data":"39637f06563ec1fe3b283d469cfdb0ec45e45b0a66599f500dfe9d1447957b3d"} Jul 06 13:41:16.483616 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:41:16.483589 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 06 13:41:16.487250 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:41:16.487234 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 06 13:41:16.490142 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:41:16.490117 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 06 13:41:16.490268 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:41:16.490248 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 06 13:41:16.490331 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:41:16.490249 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-6ts8c\"" Jul 06 13:41:16.490483 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:41:16.490471 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 06 13:41:16.490689 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:41:16.490674 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 06 13:41:16.490689 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:41:16.490686 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 06 13:41:16.491079 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:41:16.491063 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 06 13:41:16.491483 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:41:16.491452 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 06 13:41:16.491557 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:41:16.491456 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 06 13:41:16.492742 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:41:16.492599 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 06 13:41:16.492742 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:41:16.492618 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-9fdf6fdop7k49\"" Jul 06 13:41:16.492742 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:41:16.492624 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 06 13:41:16.492742 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:41:16.492676 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 06 13:41:16.493136 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:41:16.493070 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 06 13:41:16.495009 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:41:16.494989 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 06 13:41:16.497449 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:41:16.497434 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 06 13:41:16.517479 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:41:16.517459 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 06 13:41:16.583145 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:41:16.583112 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-dd759cc5c-l856l" event={"ID":"cc75af9b-11c1-49b4-b911-68bb3d314a48","Type":"ContainerStarted","Data":"7863122c72203537a142256febe1e71b294ba26cf5b112d852ae66f31f388853"} Jul 06 13:41:16.606056 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:41:16.605152 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-dd759cc5c-l856l" podStartSLOduration=1.21475372 podStartE2EDuration="2.605134054s" totalImagesPullingTime="1.390380334s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 13:41:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 13:41:16.603183823 +0000 UTC m=+93.979782783" watchObservedRunningTime="2026-07-06 13:41:16.605134054 +0000 UTC m=+93.981733017" Jul 06 13:41:16.654856 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:41:16.654774 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5214fbb1-153b-4e09-9af9-4543cee383fd-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5214fbb1-153b-4e09-9af9-4543cee383fd\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 13:41:16.654856 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:41:16.654805 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5214fbb1-153b-4e09-9af9-4543cee383fd-web-config\") pod \"prometheus-k8s-0\" (UID: \"5214fbb1-153b-4e09-9af9-4543cee383fd\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 13:41:16.654856 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:41:16.654828 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5214fbb1-153b-4e09-9af9-4543cee383fd-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"5214fbb1-153b-4e09-9af9-4543cee383fd\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 13:41:16.655082 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:41:16.654878 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5214fbb1-153b-4e09-9af9-4543cee383fd-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5214fbb1-153b-4e09-9af9-4543cee383fd\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 13:41:16.655082 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:41:16.654915 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/5214fbb1-153b-4e09-9af9-4543cee383fd-config\") pod \"prometheus-k8s-0\" (UID: \"5214fbb1-153b-4e09-9af9-4543cee383fd\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 13:41:16.655082 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:41:16.654939 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/5214fbb1-153b-4e09-9af9-4543cee383fd-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"5214fbb1-153b-4e09-9af9-4543cee383fd\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 13:41:16.655082 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:41:16.654955 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5214fbb1-153b-4e09-9af9-4543cee383fd-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"5214fbb1-153b-4e09-9af9-4543cee383fd\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 13:41:16.655082 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:41:16.654971 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5214fbb1-153b-4e09-9af9-4543cee383fd-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"5214fbb1-153b-4e09-9af9-4543cee383fd\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 13:41:16.655082 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:41:16.654990 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/5214fbb1-153b-4e09-9af9-4543cee383fd-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"5214fbb1-153b-4e09-9af9-4543cee383fd\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 13:41:16.655082 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:41:16.655005 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/5214fbb1-153b-4e09-9af9-4543cee383fd-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"5214fbb1-153b-4e09-9af9-4543cee383fd\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 13:41:16.655082 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:41:16.655070 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5214fbb1-153b-4e09-9af9-4543cee383fd-config-out\") pod \"prometheus-k8s-0\" (UID: \"5214fbb1-153b-4e09-9af9-4543cee383fd\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 13:41:16.655082 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:41:16.655087 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/5214fbb1-153b-4e09-9af9-4543cee383fd-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"5214fbb1-153b-4e09-9af9-4543cee383fd\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 13:41:16.655379 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:41:16.655116 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/5214fbb1-153b-4e09-9af9-4543cee383fd-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"5214fbb1-153b-4e09-9af9-4543cee383fd\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 13:41:16.655379 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:41:16.655132 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bf6vp\" (UniqueName: \"kubernetes.io/projected/5214fbb1-153b-4e09-9af9-4543cee383fd-kube-api-access-bf6vp\") pod \"prometheus-k8s-0\" (UID: \"5214fbb1-153b-4e09-9af9-4543cee383fd\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 13:41:16.655379 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:41:16.655148 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/5214fbb1-153b-4e09-9af9-4543cee383fd-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"5214fbb1-153b-4e09-9af9-4543cee383fd\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 13:41:16.655379 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:41:16.655163 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/5214fbb1-153b-4e09-9af9-4543cee383fd-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"5214fbb1-153b-4e09-9af9-4543cee383fd\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 13:41:16.655379 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:41:16.655195 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/5214fbb1-153b-4e09-9af9-4543cee383fd-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"5214fbb1-153b-4e09-9af9-4543cee383fd\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 13:41:16.655379 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:41:16.655224 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/5214fbb1-153b-4e09-9af9-4543cee383fd-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"5214fbb1-153b-4e09-9af9-4543cee383fd\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 13:41:16.655379 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:41:16.655242 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5214fbb1-153b-4e09-9af9-4543cee383fd-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"5214fbb1-153b-4e09-9af9-4543cee383fd\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 13:41:16.655379 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:41:16.655268 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5214fbb1-153b-4e09-9af9-4543cee383fd-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5214fbb1-153b-4e09-9af9-4543cee383fd\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 13:41:16.755723 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:41:16.755700 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5214fbb1-153b-4e09-9af9-4543cee383fd-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"5214fbb1-153b-4e09-9af9-4543cee383fd\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 13:41:16.755877 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:41:16.755733 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5214fbb1-153b-4e09-9af9-4543cee383fd-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5214fbb1-153b-4e09-9af9-4543cee383fd\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 13:41:16.755877 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:41:16.755754 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/5214fbb1-153b-4e09-9af9-4543cee383fd-config\") pod \"prometheus-k8s-0\" (UID: \"5214fbb1-153b-4e09-9af9-4543cee383fd\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 13:41:16.755877 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:41:16.755779 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/5214fbb1-153b-4e09-9af9-4543cee383fd-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"5214fbb1-153b-4e09-9af9-4543cee383fd\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 13:41:16.756022 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:41:16.755898 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5214fbb1-153b-4e09-9af9-4543cee383fd-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"5214fbb1-153b-4e09-9af9-4543cee383fd\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 13:41:16.756022 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:41:16.755936 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5214fbb1-153b-4e09-9af9-4543cee383fd-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"5214fbb1-153b-4e09-9af9-4543cee383fd\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 13:41:16.756661 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:41:16.756633 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5214fbb1-153b-4e09-9af9-4543cee383fd-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5214fbb1-153b-4e09-9af9-4543cee383fd\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 13:41:16.756768 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:41:16.756675 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5214fbb1-153b-4e09-9af9-4543cee383fd-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"5214fbb1-153b-4e09-9af9-4543cee383fd\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 13:41:16.756768 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:41:16.756744 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/5214fbb1-153b-4e09-9af9-4543cee383fd-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"5214fbb1-153b-4e09-9af9-4543cee383fd\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 13:41:16.756882 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:41:16.756776 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/5214fbb1-153b-4e09-9af9-4543cee383fd-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"5214fbb1-153b-4e09-9af9-4543cee383fd\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 13:41:16.756882 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:41:16.756827 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5214fbb1-153b-4e09-9af9-4543cee383fd-config-out\") pod \"prometheus-k8s-0\" (UID: \"5214fbb1-153b-4e09-9af9-4543cee383fd\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 13:41:16.756882 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:41:16.756858 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/5214fbb1-153b-4e09-9af9-4543cee383fd-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"5214fbb1-153b-4e09-9af9-4543cee383fd\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 13:41:16.758067 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:41:16.758029 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/5214fbb1-153b-4e09-9af9-4543cee383fd-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"5214fbb1-153b-4e09-9af9-4543cee383fd\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 13:41:16.758157 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:41:16.758081 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bf6vp\" (UniqueName: \"kubernetes.io/projected/5214fbb1-153b-4e09-9af9-4543cee383fd-kube-api-access-bf6vp\") pod \"prometheus-k8s-0\" (UID: \"5214fbb1-153b-4e09-9af9-4543cee383fd\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 13:41:16.758157 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:41:16.758105 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/5214fbb1-153b-4e09-9af9-4543cee383fd-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"5214fbb1-153b-4e09-9af9-4543cee383fd\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 13:41:16.758157 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:41:16.758128 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/5214fbb1-153b-4e09-9af9-4543cee383fd-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"5214fbb1-153b-4e09-9af9-4543cee383fd\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 13:41:16.758320 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:41:16.758158 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/5214fbb1-153b-4e09-9af9-4543cee383fd-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"5214fbb1-153b-4e09-9af9-4543cee383fd\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 13:41:16.758320 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:41:16.758213 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/5214fbb1-153b-4e09-9af9-4543cee383fd-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"5214fbb1-153b-4e09-9af9-4543cee383fd\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 13:41:16.758320 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:41:16.758249 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5214fbb1-153b-4e09-9af9-4543cee383fd-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"5214fbb1-153b-4e09-9af9-4543cee383fd\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 13:41:16.758320 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:41:16.758280 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5214fbb1-153b-4e09-9af9-4543cee383fd-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5214fbb1-153b-4e09-9af9-4543cee383fd\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 13:41:16.758504 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:41:16.758364 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5214fbb1-153b-4e09-9af9-4543cee383fd-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5214fbb1-153b-4e09-9af9-4543cee383fd\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 13:41:16.758504 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:41:16.758387 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5214fbb1-153b-4e09-9af9-4543cee383fd-web-config\") pod \"prometheus-k8s-0\" (UID: \"5214fbb1-153b-4e09-9af9-4543cee383fd\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 13:41:16.758710 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:41:16.758685 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/5214fbb1-153b-4e09-9af9-4543cee383fd-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"5214fbb1-153b-4e09-9af9-4543cee383fd\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 13:41:16.758775 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:41:16.757680 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/5214fbb1-153b-4e09-9af9-4543cee383fd-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"5214fbb1-153b-4e09-9af9-4543cee383fd\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 13:41:16.758894 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:41:16.758871 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5214fbb1-153b-4e09-9af9-4543cee383fd-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"5214fbb1-153b-4e09-9af9-4543cee383fd\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 13:41:16.760500 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:41:16.759938 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5214fbb1-153b-4e09-9af9-4543cee383fd-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5214fbb1-153b-4e09-9af9-4543cee383fd\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 13:41:16.760500 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:41:16.760461 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/5214fbb1-153b-4e09-9af9-4543cee383fd-config\") pod \"prometheus-k8s-0\" (UID: \"5214fbb1-153b-4e09-9af9-4543cee383fd\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 13:41:16.761746 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:41:16.760521 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/5214fbb1-153b-4e09-9af9-4543cee383fd-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"5214fbb1-153b-4e09-9af9-4543cee383fd\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 13:41:16.761746 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:41:16.760878 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5214fbb1-153b-4e09-9af9-4543cee383fd-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5214fbb1-153b-4e09-9af9-4543cee383fd\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 13:41:16.761746 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:41:16.760975 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/5214fbb1-153b-4e09-9af9-4543cee383fd-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"5214fbb1-153b-4e09-9af9-4543cee383fd\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 13:41:16.761746 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:41:16.760996 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5214fbb1-153b-4e09-9af9-4543cee383fd-config-out\") pod \"prometheus-k8s-0\" (UID: \"5214fbb1-153b-4e09-9af9-4543cee383fd\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 13:41:16.761746 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:41:16.761568 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/5214fbb1-153b-4e09-9af9-4543cee383fd-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"5214fbb1-153b-4e09-9af9-4543cee383fd\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 13:41:16.761746 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:41:16.761643 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/5214fbb1-153b-4e09-9af9-4543cee383fd-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"5214fbb1-153b-4e09-9af9-4543cee383fd\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 13:41:16.762211 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:41:16.762185 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/5214fbb1-153b-4e09-9af9-4543cee383fd-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"5214fbb1-153b-4e09-9af9-4543cee383fd\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 13:41:16.763368 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:41:16.763345 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5214fbb1-153b-4e09-9af9-4543cee383fd-web-config\") pod \"prometheus-k8s-0\" (UID: \"5214fbb1-153b-4e09-9af9-4543cee383fd\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 13:41:16.763851 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:41:16.763815 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5214fbb1-153b-4e09-9af9-4543cee383fd-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"5214fbb1-153b-4e09-9af9-4543cee383fd\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 13:41:16.763851 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:41:16.763821 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/5214fbb1-153b-4e09-9af9-4543cee383fd-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"5214fbb1-153b-4e09-9af9-4543cee383fd\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 13:41:16.763955 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:41:16.763824 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5214fbb1-153b-4e09-9af9-4543cee383fd-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"5214fbb1-153b-4e09-9af9-4543cee383fd\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 13:41:16.764073 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:41:16.764024 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/5214fbb1-153b-4e09-9af9-4543cee383fd-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"5214fbb1-153b-4e09-9af9-4543cee383fd\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 13:41:16.770618 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:41:16.770594 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bf6vp\" (UniqueName: \"kubernetes.io/projected/5214fbb1-153b-4e09-9af9-4543cee383fd-kube-api-access-bf6vp\") pod \"prometheus-k8s-0\" (UID: \"5214fbb1-153b-4e09-9af9-4543cee383fd\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 13:41:16.798363 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:41:16.798337 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 06 13:41:16.942556 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:41:16.942525 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 06 13:41:16.944552 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:41:16.944528 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5214fbb1_153b_4e09_9af9_4543cee383fd.slice/crio-174844e4193afa8b14dba470727a2264279b2f81e59aca9523e49932393598f1 WatchSource:0}: Error finding container 174844e4193afa8b14dba470727a2264279b2f81e59aca9523e49932393598f1: Status 404 returned error can't find the container with id 174844e4193afa8b14dba470727a2264279b2f81e59aca9523e49932393598f1 Jul 06 13:41:17.588352 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:41:17.588311 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5214fbb1-153b-4e09-9af9-4543cee383fd","Type":"ContainerStarted","Data":"174844e4193afa8b14dba470727a2264279b2f81e59aca9523e49932393598f1"} Jul 06 13:41:17.833224 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:41:17.833192 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-65fd8c9c68-9mp5n"] Jul 06 13:41:18.593363 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:41:18.593329 2573 generic.go:356] "Generic (PLEG): container finished" podID="5214fbb1-153b-4e09-9af9-4543cee383fd" containerID="680ad06458dc3059481f87f244e6e5e57ffae9c5046735b79ce133d44931c773" exitCode=0 Jul 06 13:41:18.593747 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:41:18.593413 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5214fbb1-153b-4e09-9af9-4543cee383fd","Type":"ContainerDied","Data":"680ad06458dc3059481f87f244e6e5e57ffae9c5046735b79ce133d44931c773"} Jul 06 13:41:22.613373 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:41:22.613331 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5214fbb1-153b-4e09-9af9-4543cee383fd","Type":"ContainerStarted","Data":"f135eb31bfec67e212b458ca456389eef91f92fb9f57f316e836f0c4e8bc0537"} Jul 06 13:41:22.613853 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:41:22.613420 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5214fbb1-153b-4e09-9af9-4543cee383fd","Type":"ContainerStarted","Data":"2c97b277d1dea915334d7491f58736720581c981db9087d27f5e51d2f26e52d5"} Jul 06 13:41:25.628643 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:41:25.628606 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5214fbb1-153b-4e09-9af9-4543cee383fd","Type":"ContainerStarted","Data":"dc15da7fe79b814b18c126d2cd8e4d49697bfec2979c98e45ed56fcd4913eb5c"} Jul 06 13:41:25.628988 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:41:25.628670 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5214fbb1-153b-4e09-9af9-4543cee383fd","Type":"ContainerStarted","Data":"67c352d058853181ab7e956ab80bebfc20c38355c2d01942d38a4abe29ae98ad"} Jul 06 13:41:25.628988 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:41:25.628696 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5214fbb1-153b-4e09-9af9-4543cee383fd","Type":"ContainerStarted","Data":"3ae0c0295a73067a85c743c8c1b10a72d9ec01e986ab7d318c531bc23e213388"} Jul 06 13:41:25.628988 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:41:25.628724 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5214fbb1-153b-4e09-9af9-4543cee383fd","Type":"ContainerStarted","Data":"d247cce40e4a4f9fa4ff5426c5a5a78641928a04ab8c4df1cb3f01c2d5621db8"} Jul 06 13:41:25.660751 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:41:25.660698 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.6047519059999997 podStartE2EDuration="9.660680961s" totalImagesPullingTime="7.036954112s" totalInitContainerRuntime="18.974943ms" isStatefulPod=false podCreationTimestamp="2026-07-06 13:41:16 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 13:41:25.658151785 +0000 UTC m=+103.034750745" watchObservedRunningTime="2026-07-06 13:41:25.660680961 +0000 UTC m=+103.037279921" Jul 06 13:41:26.798951 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:41:26.798917 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 06 13:41:28.510715 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:41:28.510687 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-dr8q7" Jul 06 13:41:34.832991 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:41:34.832952 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-dd759cc5c-l856l" Jul 06 13:41:34.833453 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:41:34.833025 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-dd759cc5c-l856l" Jul 06 13:41:42.858206 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:41:42.858142 2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-65fd8c9c68-9mp5n" podUID="9fc1c970-76a7-4617-a6f4-0046e9c4f967" containerName="registry" containerID="cri-o://5b43426a5d933e124ffd50e66db84b192b0032b49ad72eb368b3f956bb285ee5" gracePeriod=30 Jul 06 13:41:43.099579 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:41:43.099554 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-65fd8c9c68-9mp5n" Jul 06 13:41:43.177184 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:41:43.177124 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/9fc1c970-76a7-4617-a6f4-0046e9c4f967-installation-pull-secrets\") pod \"9fc1c970-76a7-4617-a6f4-0046e9c4f967\" (UID: \"9fc1c970-76a7-4617-a6f4-0046e9c4f967\") " Jul 06 13:41:43.177184 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:41:43.177149 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2n67v\" (UniqueName: \"kubernetes.io/projected/9fc1c970-76a7-4617-a6f4-0046e9c4f967-kube-api-access-2n67v\") pod \"9fc1c970-76a7-4617-a6f4-0046e9c4f967\" (UID: \"9fc1c970-76a7-4617-a6f4-0046e9c4f967\") " Jul 06 13:41:43.177184 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:41:43.177170 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9fc1c970-76a7-4617-a6f4-0046e9c4f967-bound-sa-token\") pod \"9fc1c970-76a7-4617-a6f4-0046e9c4f967\" (UID: \"9fc1c970-76a7-4617-a6f4-0046e9c4f967\") " Jul 06 13:41:43.177416 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:41:43.177218 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/9fc1c970-76a7-4617-a6f4-0046e9c4f967-image-registry-private-configuration\") pod \"9fc1c970-76a7-4617-a6f4-0046e9c4f967\" (UID: \"9fc1c970-76a7-4617-a6f4-0046e9c4f967\") " Jul 06 13:41:43.177416 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:41:43.177252 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/9fc1c970-76a7-4617-a6f4-0046e9c4f967-registry-certificates\") pod \"9fc1c970-76a7-4617-a6f4-0046e9c4f967\" (UID: \"9fc1c970-76a7-4617-a6f4-0046e9c4f967\") " Jul 06 13:41:43.177416 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:41:43.177293 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/9fc1c970-76a7-4617-a6f4-0046e9c4f967-ca-trust-extracted\") pod \"9fc1c970-76a7-4617-a6f4-0046e9c4f967\" (UID: \"9fc1c970-76a7-4617-a6f4-0046e9c4f967\") " Jul 06 13:41:43.177416 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:41:43.177330 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9fc1c970-76a7-4617-a6f4-0046e9c4f967-registry-tls\") pod \"9fc1c970-76a7-4617-a6f4-0046e9c4f967\" (UID: \"9fc1c970-76a7-4617-a6f4-0046e9c4f967\") " Jul 06 13:41:43.177416 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:41:43.177388 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9fc1c970-76a7-4617-a6f4-0046e9c4f967-trusted-ca\") pod \"9fc1c970-76a7-4617-a6f4-0046e9c4f967\" (UID: \"9fc1c970-76a7-4617-a6f4-0046e9c4f967\") " Jul 06 13:41:43.177839 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:41:43.177700 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9fc1c970-76a7-4617-a6f4-0046e9c4f967-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "9fc1c970-76a7-4617-a6f4-0046e9c4f967" (UID: "9fc1c970-76a7-4617-a6f4-0046e9c4f967"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 13:41:43.177958 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:41:43.177928 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9fc1c970-76a7-4617-a6f4-0046e9c4f967-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "9fc1c970-76a7-4617-a6f4-0046e9c4f967" (UID: "9fc1c970-76a7-4617-a6f4-0046e9c4f967"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 13:41:43.179607 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:41:43.179581 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9fc1c970-76a7-4617-a6f4-0046e9c4f967-kube-api-access-2n67v" (OuterVolumeSpecName: "kube-api-access-2n67v") pod "9fc1c970-76a7-4617-a6f4-0046e9c4f967" (UID: "9fc1c970-76a7-4617-a6f4-0046e9c4f967"). InnerVolumeSpecName "kube-api-access-2n67v". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 13:41:43.179776 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:41:43.179752 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9fc1c970-76a7-4617-a6f4-0046e9c4f967-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "9fc1c970-76a7-4617-a6f4-0046e9c4f967" (UID: "9fc1c970-76a7-4617-a6f4-0046e9c4f967"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 13:41:43.180000 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:41:43.179975 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9fc1c970-76a7-4617-a6f4-0046e9c4f967-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "9fc1c970-76a7-4617-a6f4-0046e9c4f967" (UID: "9fc1c970-76a7-4617-a6f4-0046e9c4f967"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 13:41:43.180119 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:41:43.180025 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9fc1c970-76a7-4617-a6f4-0046e9c4f967-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "9fc1c970-76a7-4617-a6f4-0046e9c4f967" (UID: "9fc1c970-76a7-4617-a6f4-0046e9c4f967"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 13:41:43.180119 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:41:43.180094 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9fc1c970-76a7-4617-a6f4-0046e9c4f967-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "9fc1c970-76a7-4617-a6f4-0046e9c4f967" (UID: "9fc1c970-76a7-4617-a6f4-0046e9c4f967"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 13:41:43.186020 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:41:43.185997 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9fc1c970-76a7-4617-a6f4-0046e9c4f967-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "9fc1c970-76a7-4617-a6f4-0046e9c4f967" (UID: "9fc1c970-76a7-4617-a6f4-0046e9c4f967"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 13:41:43.278700 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:41:43.278673 2573 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9fc1c970-76a7-4617-a6f4-0046e9c4f967-trusted-ca\") on node \"ip-10-0-138-163.ec2.internal\" DevicePath \"\"" Jul 06 13:41:43.278700 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:41:43.278698 2573 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/9fc1c970-76a7-4617-a6f4-0046e9c4f967-installation-pull-secrets\") on node \"ip-10-0-138-163.ec2.internal\" DevicePath \"\"" Jul 06 13:41:43.278851 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:41:43.278709 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2n67v\" (UniqueName: \"kubernetes.io/projected/9fc1c970-76a7-4617-a6f4-0046e9c4f967-kube-api-access-2n67v\") on node \"ip-10-0-138-163.ec2.internal\" DevicePath \"\"" Jul 06 13:41:43.278851 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:41:43.278717 2573 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9fc1c970-76a7-4617-a6f4-0046e9c4f967-bound-sa-token\") on node \"ip-10-0-138-163.ec2.internal\" DevicePath \"\"" Jul 06 13:41:43.278851 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:41:43.278727 2573 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/9fc1c970-76a7-4617-a6f4-0046e9c4f967-image-registry-private-configuration\") on node \"ip-10-0-138-163.ec2.internal\" DevicePath \"\"" Jul 06 13:41:43.278851 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:41:43.278736 2573 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/9fc1c970-76a7-4617-a6f4-0046e9c4f967-registry-certificates\") on node \"ip-10-0-138-163.ec2.internal\" DevicePath \"\"" Jul 06 13:41:43.278851 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:41:43.278744 2573 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/9fc1c970-76a7-4617-a6f4-0046e9c4f967-ca-trust-extracted\") on node \"ip-10-0-138-163.ec2.internal\" DevicePath \"\"" Jul 06 13:41:43.278851 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:41:43.278753 2573 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9fc1c970-76a7-4617-a6f4-0046e9c4f967-registry-tls\") on node \"ip-10-0-138-163.ec2.internal\" DevicePath \"\"" Jul 06 13:41:43.690525 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:41:43.690489 2573 generic.go:356] "Generic (PLEG): container finished" podID="9fc1c970-76a7-4617-a6f4-0046e9c4f967" containerID="5b43426a5d933e124ffd50e66db84b192b0032b49ad72eb368b3f956bb285ee5" exitCode=0 Jul 06 13:41:43.690689 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:41:43.690543 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-65fd8c9c68-9mp5n" Jul 06 13:41:43.690689 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:41:43.690574 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-65fd8c9c68-9mp5n" event={"ID":"9fc1c970-76a7-4617-a6f4-0046e9c4f967","Type":"ContainerDied","Data":"5b43426a5d933e124ffd50e66db84b192b0032b49ad72eb368b3f956bb285ee5"} Jul 06 13:41:43.690689 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:41:43.690645 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-65fd8c9c68-9mp5n" event={"ID":"9fc1c970-76a7-4617-a6f4-0046e9c4f967","Type":"ContainerDied","Data":"1451105295a02b8d6216b14b991774fb97328c81fc5a37dfb84f3fa3dc20d076"} Jul 06 13:41:43.690689 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:41:43.690665 2573 scope.go:117] "RemoveContainer" containerID="5b43426a5d933e124ffd50e66db84b192b0032b49ad72eb368b3f956bb285ee5" Jul 06 13:41:43.699857 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:41:43.699834 2573 scope.go:117] "RemoveContainer" containerID="5b43426a5d933e124ffd50e66db84b192b0032b49ad72eb368b3f956bb285ee5" Jul 06 13:41:43.700257 ip-10-0-138-163 kubenswrapper[2573]: E0706 13:41:43.700237 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5b43426a5d933e124ffd50e66db84b192b0032b49ad72eb368b3f956bb285ee5\": container with ID starting with 5b43426a5d933e124ffd50e66db84b192b0032b49ad72eb368b3f956bb285ee5 not found: ID does not exist" containerID="5b43426a5d933e124ffd50e66db84b192b0032b49ad72eb368b3f956bb285ee5" Jul 06 13:41:43.700334 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:41:43.700264 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5b43426a5d933e124ffd50e66db84b192b0032b49ad72eb368b3f956bb285ee5"} err="failed to get container status \"5b43426a5d933e124ffd50e66db84b192b0032b49ad72eb368b3f956bb285ee5\": rpc error: code = NotFound desc = could not find container \"5b43426a5d933e124ffd50e66db84b192b0032b49ad72eb368b3f956bb285ee5\": container with ID starting with 5b43426a5d933e124ffd50e66db84b192b0032b49ad72eb368b3f956bb285ee5 not found: ID does not exist" Jul 06 13:41:43.713596 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:41:43.713564 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-65fd8c9c68-9mp5n"] Jul 06 13:41:43.718048 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:41:43.718015 2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-65fd8c9c68-9mp5n"] Jul 06 13:41:45.160452 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:41:45.160412 2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9fc1c970-76a7-4617-a6f4-0046e9c4f967" path="/var/lib/kubelet/pods/9fc1c970-76a7-4617-a6f4-0046e9c4f967/volumes" Jul 06 13:41:54.838640 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:41:54.838601 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-dd759cc5c-l856l" Jul 06 13:41:54.842961 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:41:54.842935 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-dd759cc5c-l856l" Jul 06 13:42:16.799314 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:42:16.799278 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 06 13:42:16.818136 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:42:16.818106 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 06 13:42:16.832143 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:42:16.832116 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 06 13:44:26.559025 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:44:26.558962 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6b559b5dcd-2dcwx"] Jul 06 13:44:26.559493 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:44:26.559376 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9fc1c970-76a7-4617-a6f4-0046e9c4f967" containerName="registry" Jul 06 13:44:26.559493 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:44:26.559392 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="9fc1c970-76a7-4617-a6f4-0046e9c4f967" containerName="registry" Jul 06 13:44:26.559493 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:44:26.559461 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="9fc1c970-76a7-4617-a6f4-0046e9c4f967" containerName="registry" Jul 06 13:44:26.562732 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:44:26.562715 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6b559b5dcd-2dcwx" Jul 06 13:44:26.566689 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:44:26.565796 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 06 13:44:26.566689 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:44:26.565854 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 06 13:44:26.566689 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:44:26.566281 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-2q29q\"" Jul 06 13:44:26.566904 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:44:26.566752 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 06 13:44:26.566904 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:44:26.566770 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 06 13:44:26.675970 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:44:26.675937 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6b559b5dcd-2dcwx"] Jul 06 13:44:26.703436 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:44:26.703409 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/217f821e-464b-4836-bfa5-dedc084766aa-tmp\") pod \"opendatahub-operator-controller-manager-6b559b5dcd-2dcwx\" (UID: \"217f821e-464b-4836-bfa5-dedc084766aa\") " pod="opendatahub/opendatahub-operator-controller-manager-6b559b5dcd-2dcwx" Jul 06 13:44:26.703595 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:44:26.703464 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/217f821e-464b-4836-bfa5-dedc084766aa-webhook-cert\") pod \"opendatahub-operator-controller-manager-6b559b5dcd-2dcwx\" (UID: \"217f821e-464b-4836-bfa5-dedc084766aa\") " pod="opendatahub/opendatahub-operator-controller-manager-6b559b5dcd-2dcwx" Jul 06 13:44:26.703595 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:44:26.703535 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l78zq\" (UniqueName: \"kubernetes.io/projected/217f821e-464b-4836-bfa5-dedc084766aa-kube-api-access-l78zq\") pod \"opendatahub-operator-controller-manager-6b559b5dcd-2dcwx\" (UID: \"217f821e-464b-4836-bfa5-dedc084766aa\") " pod="opendatahub/opendatahub-operator-controller-manager-6b559b5dcd-2dcwx" Jul 06 13:44:26.703595 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:44:26.703563 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/217f821e-464b-4836-bfa5-dedc084766aa-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6b559b5dcd-2dcwx\" (UID: \"217f821e-464b-4836-bfa5-dedc084766aa\") " pod="opendatahub/opendatahub-operator-controller-manager-6b559b5dcd-2dcwx" Jul 06 13:44:26.703595 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:44:26.703589 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/217f821e-464b-4836-bfa5-dedc084766aa-manifests\") pod \"opendatahub-operator-controller-manager-6b559b5dcd-2dcwx\" (UID: \"217f821e-464b-4836-bfa5-dedc084766aa\") " pod="opendatahub/opendatahub-operator-controller-manager-6b559b5dcd-2dcwx" Jul 06 13:44:26.804947 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:44:26.804918 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/217f821e-464b-4836-bfa5-dedc084766aa-tmp\") pod \"opendatahub-operator-controller-manager-6b559b5dcd-2dcwx\" (UID: \"217f821e-464b-4836-bfa5-dedc084766aa\") " pod="opendatahub/opendatahub-operator-controller-manager-6b559b5dcd-2dcwx" Jul 06 13:44:26.805114 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:44:26.804970 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/217f821e-464b-4836-bfa5-dedc084766aa-webhook-cert\") pod \"opendatahub-operator-controller-manager-6b559b5dcd-2dcwx\" (UID: \"217f821e-464b-4836-bfa5-dedc084766aa\") " pod="opendatahub/opendatahub-operator-controller-manager-6b559b5dcd-2dcwx" Jul 06 13:44:26.805114 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:44:26.804996 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l78zq\" (UniqueName: \"kubernetes.io/projected/217f821e-464b-4836-bfa5-dedc084766aa-kube-api-access-l78zq\") pod \"opendatahub-operator-controller-manager-6b559b5dcd-2dcwx\" (UID: \"217f821e-464b-4836-bfa5-dedc084766aa\") " pod="opendatahub/opendatahub-operator-controller-manager-6b559b5dcd-2dcwx" Jul 06 13:44:26.805114 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:44:26.805021 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/217f821e-464b-4836-bfa5-dedc084766aa-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6b559b5dcd-2dcwx\" (UID: \"217f821e-464b-4836-bfa5-dedc084766aa\") " pod="opendatahub/opendatahub-operator-controller-manager-6b559b5dcd-2dcwx" Jul 06 13:44:26.805114 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:44:26.805057 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/217f821e-464b-4836-bfa5-dedc084766aa-manifests\") pod \"opendatahub-operator-controller-manager-6b559b5dcd-2dcwx\" (UID: \"217f821e-464b-4836-bfa5-dedc084766aa\") " pod="opendatahub/opendatahub-operator-controller-manager-6b559b5dcd-2dcwx" Jul 06 13:44:26.805520 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:44:26.805489 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/217f821e-464b-4836-bfa5-dedc084766aa-manifests\") pod \"opendatahub-operator-controller-manager-6b559b5dcd-2dcwx\" (UID: \"217f821e-464b-4836-bfa5-dedc084766aa\") " pod="opendatahub/opendatahub-operator-controller-manager-6b559b5dcd-2dcwx" Jul 06 13:44:26.807460 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:44:26.807432 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/217f821e-464b-4836-bfa5-dedc084766aa-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6b559b5dcd-2dcwx\" (UID: \"217f821e-464b-4836-bfa5-dedc084766aa\") " pod="opendatahub/opendatahub-operator-controller-manager-6b559b5dcd-2dcwx" Jul 06 13:44:26.807693 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:44:26.807674 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/217f821e-464b-4836-bfa5-dedc084766aa-tmp\") pod \"opendatahub-operator-controller-manager-6b559b5dcd-2dcwx\" (UID: \"217f821e-464b-4836-bfa5-dedc084766aa\") " pod="opendatahub/opendatahub-operator-controller-manager-6b559b5dcd-2dcwx" Jul 06 13:44:26.807811 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:44:26.807794 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/217f821e-464b-4836-bfa5-dedc084766aa-webhook-cert\") pod \"opendatahub-operator-controller-manager-6b559b5dcd-2dcwx\" (UID: \"217f821e-464b-4836-bfa5-dedc084766aa\") " pod="opendatahub/opendatahub-operator-controller-manager-6b559b5dcd-2dcwx" Jul 06 13:44:26.837934 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:44:26.837874 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l78zq\" (UniqueName: \"kubernetes.io/projected/217f821e-464b-4836-bfa5-dedc084766aa-kube-api-access-l78zq\") pod \"opendatahub-operator-controller-manager-6b559b5dcd-2dcwx\" (UID: \"217f821e-464b-4836-bfa5-dedc084766aa\") " pod="opendatahub/opendatahub-operator-controller-manager-6b559b5dcd-2dcwx" Jul 06 13:44:26.876799 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:44:26.876766 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6b559b5dcd-2dcwx" Jul 06 13:44:27.028765 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:44:27.028732 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6b559b5dcd-2dcwx"] Jul 06 13:44:27.032251 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:44:27.032224 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod217f821e_464b_4836_bfa5_dedc084766aa.slice/crio-55f29f7f7f82027ee091bce95f82669564f85542935ec777f9f0c9ea39828acd WatchSource:0}: Error finding container 55f29f7f7f82027ee091bce95f82669564f85542935ec777f9f0c9ea39828acd: Status 404 returned error can't find the container with id 55f29f7f7f82027ee091bce95f82669564f85542935ec777f9f0c9ea39828acd Jul 06 13:44:27.242775 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:44:27.242746 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6b559b5dcd-2dcwx" event={"ID":"217f821e-464b-4836-bfa5-dedc084766aa","Type":"ContainerStarted","Data":"55f29f7f7f82027ee091bce95f82669564f85542935ec777f9f0c9ea39828acd"} Jul 06 13:44:30.256252 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:44:30.256209 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6b559b5dcd-2dcwx" event={"ID":"217f821e-464b-4836-bfa5-dedc084766aa","Type":"ContainerStarted","Data":"5477562806f9f69a8e61fe92f88ab8edb213c27a00f57f899ea1bae6c0fb9a6b"} Jul 06 13:44:31.261597 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:44:31.261564 2573 generic.go:356] "Generic (PLEG): container finished" podID="217f821e-464b-4836-bfa5-dedc084766aa" containerID="5477562806f9f69a8e61fe92f88ab8edb213c27a00f57f899ea1bae6c0fb9a6b" exitCode=0 Jul 06 13:44:31.261969 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:44:31.261629 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6b559b5dcd-2dcwx" event={"ID":"217f821e-464b-4836-bfa5-dedc084766aa","Type":"ContainerDied","Data":"5477562806f9f69a8e61fe92f88ab8edb213c27a00f57f899ea1bae6c0fb9a6b"} Jul 06 13:44:32.267186 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:44:32.267147 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6b559b5dcd-2dcwx" event={"ID":"217f821e-464b-4836-bfa5-dedc084766aa","Type":"ContainerStarted","Data":"17d95a410fc2a75664cd3422bacac196ce1833048dfcd84052c6aa68455cdb56"} Jul 06 13:44:32.267574 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:44:32.267296 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-6b559b5dcd-2dcwx" Jul 06 13:44:43.018477 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:44:43.018444 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-z2f98_66e76252-8877-403e-9c30-e56ec0013c24/console-operator/1.log" Jul 06 13:44:43.022226 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:44:43.022198 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-z2f98_66e76252-8877-403e-9c30-e56ec0013c24/console-operator/1.log" Jul 06 13:44:43.032657 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:44:43.032630 2573 kubelet.go:1648] "Image garbage collection succeeded" Jul 06 13:44:43.272687 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:44:43.272619 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-6b559b5dcd-2dcwx" Jul 06 13:44:43.413896 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:44:43.314870 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-6b559b5dcd-2dcwx" podStartSLOduration=12.997171669 podStartE2EDuration="17.3148545s" totalImagesPullingTime="3.285044503s" totalInitContainerRuntime="1.032638328s" isStatefulPod=false podCreationTimestamp="2026-07-06 13:44:26 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 13:44:32.326565632 +0000 UTC m=+289.703164593" watchObservedRunningTime="2026-07-06 13:44:43.3148545 +0000 UTC m=+300.691453460" Jul 06 13:44:44.018589 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:44:44.018556 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-6ff5df8b5c-j8vsf"] Jul 06 13:44:44.021584 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:44:44.021566 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-6ff5df8b5c-j8vsf" Jul 06 13:44:44.024292 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:44:44.024269 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jul 06 13:44:44.025200 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:44:44.025174 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-xzq6q\"" Jul 06 13:44:44.025200 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:44:44.025196 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jul 06 13:44:44.025350 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:44:44.025237 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jul 06 13:44:44.025482 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:44:44.025466 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jul 06 13:44:44.025545 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:44:44.025504 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jul 06 13:44:44.037513 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:44:44.037495 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/8e0788aa-0444-4aee-90ef-cd6fca201177-metrics-cert\") pod \"lws-controller-manager-6ff5df8b5c-j8vsf\" (UID: \"8e0788aa-0444-4aee-90ef-cd6fca201177\") " pod="openshift-lws-operator/lws-controller-manager-6ff5df8b5c-j8vsf" Jul 06 13:44:44.037598 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:44:44.037521 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/8e0788aa-0444-4aee-90ef-cd6fca201177-manager-config\") pod \"lws-controller-manager-6ff5df8b5c-j8vsf\" (UID: \"8e0788aa-0444-4aee-90ef-cd6fca201177\") " pod="openshift-lws-operator/lws-controller-manager-6ff5df8b5c-j8vsf" Jul 06 13:44:44.037598 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:44:44.037546 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s5pf2\" (UniqueName: \"kubernetes.io/projected/8e0788aa-0444-4aee-90ef-cd6fca201177-kube-api-access-s5pf2\") pod \"lws-controller-manager-6ff5df8b5c-j8vsf\" (UID: \"8e0788aa-0444-4aee-90ef-cd6fca201177\") " pod="openshift-lws-operator/lws-controller-manager-6ff5df8b5c-j8vsf" Jul 06 13:44:44.037668 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:44:44.037601 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8e0788aa-0444-4aee-90ef-cd6fca201177-cert\") pod \"lws-controller-manager-6ff5df8b5c-j8vsf\" (UID: \"8e0788aa-0444-4aee-90ef-cd6fca201177\") " pod="openshift-lws-operator/lws-controller-manager-6ff5df8b5c-j8vsf" Jul 06 13:44:44.045911 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:44:44.045890 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-6ff5df8b5c-j8vsf"] Jul 06 13:44:44.138527 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:44:44.138499 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s5pf2\" (UniqueName: \"kubernetes.io/projected/8e0788aa-0444-4aee-90ef-cd6fca201177-kube-api-access-s5pf2\") pod \"lws-controller-manager-6ff5df8b5c-j8vsf\" (UID: \"8e0788aa-0444-4aee-90ef-cd6fca201177\") " pod="openshift-lws-operator/lws-controller-manager-6ff5df8b5c-j8vsf" Jul 06 13:44:44.138686 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:44:44.138541 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8e0788aa-0444-4aee-90ef-cd6fca201177-cert\") pod \"lws-controller-manager-6ff5df8b5c-j8vsf\" (UID: \"8e0788aa-0444-4aee-90ef-cd6fca201177\") " pod="openshift-lws-operator/lws-controller-manager-6ff5df8b5c-j8vsf" Jul 06 13:44:44.138686 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:44:44.138593 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/8e0788aa-0444-4aee-90ef-cd6fca201177-metrics-cert\") pod \"lws-controller-manager-6ff5df8b5c-j8vsf\" (UID: \"8e0788aa-0444-4aee-90ef-cd6fca201177\") " pod="openshift-lws-operator/lws-controller-manager-6ff5df8b5c-j8vsf" Jul 06 13:44:44.138686 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:44:44.138612 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/8e0788aa-0444-4aee-90ef-cd6fca201177-manager-config\") pod \"lws-controller-manager-6ff5df8b5c-j8vsf\" (UID: \"8e0788aa-0444-4aee-90ef-cd6fca201177\") " pod="openshift-lws-operator/lws-controller-manager-6ff5df8b5c-j8vsf" Jul 06 13:44:44.139342 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:44:44.139321 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/8e0788aa-0444-4aee-90ef-cd6fca201177-manager-config\") pod \"lws-controller-manager-6ff5df8b5c-j8vsf\" (UID: \"8e0788aa-0444-4aee-90ef-cd6fca201177\") " pod="openshift-lws-operator/lws-controller-manager-6ff5df8b5c-j8vsf" Jul 06 13:44:44.140997 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:44:44.140976 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8e0788aa-0444-4aee-90ef-cd6fca201177-cert\") pod \"lws-controller-manager-6ff5df8b5c-j8vsf\" (UID: \"8e0788aa-0444-4aee-90ef-cd6fca201177\") " pod="openshift-lws-operator/lws-controller-manager-6ff5df8b5c-j8vsf" Jul 06 13:44:44.141100 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:44:44.141025 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/8e0788aa-0444-4aee-90ef-cd6fca201177-metrics-cert\") pod \"lws-controller-manager-6ff5df8b5c-j8vsf\" (UID: \"8e0788aa-0444-4aee-90ef-cd6fca201177\") " pod="openshift-lws-operator/lws-controller-manager-6ff5df8b5c-j8vsf" Jul 06 13:44:44.151184 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:44:44.151157 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s5pf2\" (UniqueName: \"kubernetes.io/projected/8e0788aa-0444-4aee-90ef-cd6fca201177-kube-api-access-s5pf2\") pod \"lws-controller-manager-6ff5df8b5c-j8vsf\" (UID: \"8e0788aa-0444-4aee-90ef-cd6fca201177\") " pod="openshift-lws-operator/lws-controller-manager-6ff5df8b5c-j8vsf" Jul 06 13:44:44.331153 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:44:44.331077 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-6ff5df8b5c-j8vsf" Jul 06 13:44:44.470756 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:44:44.470725 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-6ff5df8b5c-j8vsf"] Jul 06 13:44:44.473491 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:44:44.473466 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8e0788aa_0444_4aee_90ef_cd6fca201177.slice/crio-6a3072d93a85495ef747b757f5dee2c49470e834ef3510b16ee7cda3f752b098 WatchSource:0}: Error finding container 6a3072d93a85495ef747b757f5dee2c49470e834ef3510b16ee7cda3f752b098: Status 404 returned error can't find the container with id 6a3072d93a85495ef747b757f5dee2c49470e834ef3510b16ee7cda3f752b098 Jul 06 13:44:44.475400 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:44:44.475386 2573 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 06 13:44:45.311711 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:44:45.311678 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-6ff5df8b5c-j8vsf" event={"ID":"8e0788aa-0444-4aee-90ef-cd6fca201177","Type":"ContainerStarted","Data":"6a3072d93a85495ef747b757f5dee2c49470e834ef3510b16ee7cda3f752b098"} Jul 06 13:44:52.338992 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:44:52.338959 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-6ff5df8b5c-j8vsf" event={"ID":"8e0788aa-0444-4aee-90ef-cd6fca201177","Type":"ContainerStarted","Data":"8b3b20ef7e38e8d7542c21ba5873e41bda7cab66d9948b18209e68c7e85ea66b"} Jul 06 13:44:52.339474 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:44:52.339073 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-6ff5df8b5c-j8vsf" Jul 06 13:44:52.359168 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:44:52.359067 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-6ff5df8b5c-j8vsf" podStartSLOduration=2.088931417 podStartE2EDuration="9.359049747s" totalImagesPullingTime="7.27011833s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 13:44:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 13:44:52.358541663 +0000 UTC m=+309.735140623" watchObservedRunningTime="2026-07-06 13:44:52.359049747 +0000 UTC m=+309.735648699" Jul 06 13:44:55.208739 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:44:55.208705 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-2jljx"] Jul 06 13:44:55.212133 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:44:55.212113 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-2jljx" Jul 06 13:44:55.216610 ip-10-0-138-163 kubenswrapper[2573]: E0706 13:44:55.216576 2573 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"cacerts\" is forbidden: User \"system:node:ip-10-0-138-163.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-138-163.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-ingress\"/\"cacerts\"" type="*v1.Secret" Jul 06 13:44:55.216731 ip-10-0-138-163 kubenswrapper[2573]: E0706 13:44:55.216638 2573 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"openshift-gw-ca-root-cert\" is forbidden: User \"system:node:ip-10-0-138-163.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-138-163.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" type="*v1.ConfigMap" Jul 06 13:44:55.216731 ip-10-0-138-163 kubenswrapper[2573]: E0706 13:44:55.216647 2573 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"istiod-openshift-gateway-dockercfg-564mz\" is forbidden: User \"system:node:ip-10-0-138-163.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-138-163.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-564mz\"" type="*v1.Secret" Jul 06 13:44:55.216731 ip-10-0-138-163 kubenswrapper[2573]: E0706 13:44:55.216647 2573 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"istiod-tls\" is forbidden: User \"system:node:ip-10-0-138-163.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-138-163.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" type="*v1.Secret" Jul 06 13:44:55.216949 ip-10-0-138-163 kubenswrapper[2573]: E0706 13:44:55.216913 2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"istiod-openshift-gateway-94bb8fbfd-2jljx\" is forbidden: User \"system:node:ip-10-0-138-163.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-138-163.ec2.internal' and this object" podUID="aad3bb1b-0bac-4b96-b020-2612138bf4af" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-2jljx" Jul 06 13:44:55.216949 ip-10-0-138-163 kubenswrapper[2573]: E0706 13:44:55.216929 2573 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"openshift-service-ca.crt\" is forbidden: User \"system:node:ip-10-0-138-163.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-138-163.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap" Jul 06 13:44:55.216949 ip-10-0-138-163 kubenswrapper[2573]: E0706 13:44:55.216937 2573 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"istio-kubeconfig\" is forbidden: User \"system:node:ip-10-0-138-163.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-138-163.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" type="*v1.Secret" Jul 06 13:44:55.216949 ip-10-0-138-163 kubenswrapper[2573]: E0706 13:44:55.216938 2573 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"kube-root-ca.crt\" is forbidden: User \"system:node:ip-10-0-138-163.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-138-163.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" Jul 06 13:44:55.220165 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:44:55.220145 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/aad3bb1b-0bac-4b96-b020-2612138bf4af-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-2jljx\" (UID: \"aad3bb1b-0bac-4b96-b020-2612138bf4af\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-2jljx" Jul 06 13:44:55.220252 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:44:55.220189 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/aad3bb1b-0bac-4b96-b020-2612138bf4af-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-2jljx\" (UID: \"aad3bb1b-0bac-4b96-b020-2612138bf4af\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-2jljx" Jul 06 13:44:55.220252 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:44:55.220208 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/aad3bb1b-0bac-4b96-b020-2612138bf4af-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-2jljx\" (UID: \"aad3bb1b-0bac-4b96-b020-2612138bf4af\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-2jljx" Jul 06 13:44:55.220332 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:44:55.220274 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/aad3bb1b-0bac-4b96-b020-2612138bf4af-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-2jljx\" (UID: \"aad3bb1b-0bac-4b96-b020-2612138bf4af\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-2jljx" Jul 06 13:44:55.220332 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:44:55.220296 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d6rfc\" (UniqueName: \"kubernetes.io/projected/aad3bb1b-0bac-4b96-b020-2612138bf4af-kube-api-access-d6rfc\") pod \"istiod-openshift-gateway-94bb8fbfd-2jljx\" (UID: \"aad3bb1b-0bac-4b96-b020-2612138bf4af\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-2jljx" Jul 06 13:44:55.220332 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:44:55.220316 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/aad3bb1b-0bac-4b96-b020-2612138bf4af-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-2jljx\" (UID: \"aad3bb1b-0bac-4b96-b020-2612138bf4af\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-2jljx" Jul 06 13:44:55.220440 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:44:55.220333 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/aad3bb1b-0bac-4b96-b020-2612138bf4af-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-2jljx\" (UID: \"aad3bb1b-0bac-4b96-b020-2612138bf4af\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-2jljx" Jul 06 13:44:55.242413 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:44:55.242380 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-2jljx"] Jul 06 13:44:55.321239 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:44:55.321193 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/aad3bb1b-0bac-4b96-b020-2612138bf4af-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-2jljx\" (UID: \"aad3bb1b-0bac-4b96-b020-2612138bf4af\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-2jljx" Jul 06 13:44:55.321239 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:44:55.321241 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/aad3bb1b-0bac-4b96-b020-2612138bf4af-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-2jljx\" (UID: \"aad3bb1b-0bac-4b96-b020-2612138bf4af\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-2jljx" Jul 06 13:44:55.321481 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:44:55.321269 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/aad3bb1b-0bac-4b96-b020-2612138bf4af-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-2jljx\" (UID: \"aad3bb1b-0bac-4b96-b020-2612138bf4af\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-2jljx" Jul 06 13:44:55.321481 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:44:55.321295 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d6rfc\" (UniqueName: \"kubernetes.io/projected/aad3bb1b-0bac-4b96-b020-2612138bf4af-kube-api-access-d6rfc\") pod \"istiod-openshift-gateway-94bb8fbfd-2jljx\" (UID: \"aad3bb1b-0bac-4b96-b020-2612138bf4af\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-2jljx" Jul 06 13:44:55.321481 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:44:55.321316 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/aad3bb1b-0bac-4b96-b020-2612138bf4af-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-2jljx\" (UID: \"aad3bb1b-0bac-4b96-b020-2612138bf4af\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-2jljx" Jul 06 13:44:55.321481 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:44:55.321340 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/aad3bb1b-0bac-4b96-b020-2612138bf4af-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-2jljx\" (UID: \"aad3bb1b-0bac-4b96-b020-2612138bf4af\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-2jljx" Jul 06 13:44:55.321481 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:44:55.321385 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/aad3bb1b-0bac-4b96-b020-2612138bf4af-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-2jljx\" (UID: \"aad3bb1b-0bac-4b96-b020-2612138bf4af\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-2jljx" Jul 06 13:44:55.323605 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:44:55.323584 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/aad3bb1b-0bac-4b96-b020-2612138bf4af-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-2jljx\" (UID: \"aad3bb1b-0bac-4b96-b020-2612138bf4af\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-2jljx" Jul 06 13:44:55.330975 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:44:55.330953 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/aad3bb1b-0bac-4b96-b020-2612138bf4af-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-2jljx\" (UID: \"aad3bb1b-0bac-4b96-b020-2612138bf4af\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-2jljx" Jul 06 13:44:56.102757 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:44:56.102728 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 06 13:44:56.262975 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:44:56.262945 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jul 06 13:44:56.274293 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:44:56.274260 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/aad3bb1b-0bac-4b96-b020-2612138bf4af-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-2jljx\" (UID: \"aad3bb1b-0bac-4b96-b020-2612138bf4af\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-2jljx" Jul 06 13:44:56.322336 ip-10-0-138-163 kubenswrapper[2573]: E0706 13:44:56.322303 2573 configmap.go:193] Couldn't get configMap openshift-ingress/openshift-gw-ca-root-cert: failed to sync configmap cache: timed out waiting for the condition Jul 06 13:44:56.322484 ip-10-0-138-163 kubenswrapper[2573]: E0706 13:44:56.322307 2573 secret.go:189] Couldn't get secret openshift-ingress/istio-kubeconfig: failed to sync secret cache: timed out waiting for the condition Jul 06 13:44:56.322484 ip-10-0-138-163 kubenswrapper[2573]: E0706 13:44:56.322422 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/aad3bb1b-0bac-4b96-b020-2612138bf4af-istio-csr-ca-configmap podName:aad3bb1b-0bac-4b96-b020-2612138bf4af nodeName:}" failed. No retries permitted until 2026-07-06 13:44:56.822401327 +0000 UTC m=+314.199000271 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "istio-csr-ca-configmap" (UniqueName: "kubernetes.io/configmap/aad3bb1b-0bac-4b96-b020-2612138bf4af-istio-csr-ca-configmap") pod "istiod-openshift-gateway-94bb8fbfd-2jljx" (UID: "aad3bb1b-0bac-4b96-b020-2612138bf4af") : failed to sync configmap cache: timed out waiting for the condition Jul 06 13:44:56.322484 ip-10-0-138-163 kubenswrapper[2573]: E0706 13:44:56.322447 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aad3bb1b-0bac-4b96-b020-2612138bf4af-istio-kubeconfig podName:aad3bb1b-0bac-4b96-b020-2612138bf4af nodeName:}" failed. No retries permitted until 2026-07-06 13:44:56.822435879 +0000 UTC m=+314.199034830 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "istio-kubeconfig" (UniqueName: "kubernetes.io/secret/aad3bb1b-0bac-4b96-b020-2612138bf4af-istio-kubeconfig") pod "istiod-openshift-gateway-94bb8fbfd-2jljx" (UID: "aad3bb1b-0bac-4b96-b020-2612138bf4af") : failed to sync secret cache: timed out waiting for the condition Jul 06 13:44:56.322484 ip-10-0-138-163 kubenswrapper[2573]: E0706 13:44:56.322311 2573 secret.go:189] Couldn't get secret openshift-ingress/cacerts: failed to sync secret cache: timed out waiting for the condition Jul 06 13:44:56.322484 ip-10-0-138-163 kubenswrapper[2573]: E0706 13:44:56.322480 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aad3bb1b-0bac-4b96-b020-2612138bf4af-cacerts podName:aad3bb1b-0bac-4b96-b020-2612138bf4af nodeName:}" failed. No retries permitted until 2026-07-06 13:44:56.822471624 +0000 UTC m=+314.199070566 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cacerts" (UniqueName: "kubernetes.io/secret/aad3bb1b-0bac-4b96-b020-2612138bf4af-cacerts") pod "istiod-openshift-gateway-94bb8fbfd-2jljx" (UID: "aad3bb1b-0bac-4b96-b020-2612138bf4af") : failed to sync secret cache: timed out waiting for the condition Jul 06 13:44:56.363182 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:44:56.363112 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-564mz\"" Jul 06 13:44:56.498257 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:44:56.498227 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 06 13:44:56.583929 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:44:56.583902 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jul 06 13:44:56.681900 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:44:56.681810 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 06 13:44:56.692718 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:44:56.692687 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d6rfc\" (UniqueName: \"kubernetes.io/projected/aad3bb1b-0bac-4b96-b020-2612138bf4af-kube-api-access-d6rfc\") pod \"istiod-openshift-gateway-94bb8fbfd-2jljx\" (UID: \"aad3bb1b-0bac-4b96-b020-2612138bf4af\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-2jljx" Jul 06 13:44:56.809646 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:44:56.809621 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jul 06 13:44:56.833958 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:44:56.833934 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/aad3bb1b-0bac-4b96-b020-2612138bf4af-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-2jljx\" (UID: \"aad3bb1b-0bac-4b96-b020-2612138bf4af\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-2jljx" Jul 06 13:44:56.834115 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:44:56.833975 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/aad3bb1b-0bac-4b96-b020-2612138bf4af-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-2jljx\" (UID: \"aad3bb1b-0bac-4b96-b020-2612138bf4af\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-2jljx" Jul 06 13:44:56.834115 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:44:56.834001 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/aad3bb1b-0bac-4b96-b020-2612138bf4af-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-2jljx\" (UID: \"aad3bb1b-0bac-4b96-b020-2612138bf4af\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-2jljx" Jul 06 13:44:56.834597 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:44:56.834572 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/aad3bb1b-0bac-4b96-b020-2612138bf4af-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-2jljx\" (UID: \"aad3bb1b-0bac-4b96-b020-2612138bf4af\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-2jljx" Jul 06 13:44:56.836140 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:44:56.836025 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/aad3bb1b-0bac-4b96-b020-2612138bf4af-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-2jljx\" (UID: \"aad3bb1b-0bac-4b96-b020-2612138bf4af\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-2jljx" Jul 06 13:44:56.836195 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:44:56.836113 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/aad3bb1b-0bac-4b96-b020-2612138bf4af-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-2jljx\" (UID: \"aad3bb1b-0bac-4b96-b020-2612138bf4af\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-2jljx" Jul 06 13:44:57.020777 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:44:57.020749 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-2jljx" Jul 06 13:44:57.173296 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:44:57.173230 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-2jljx"] Jul 06 13:44:57.175420 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:44:57.175397 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaad3bb1b_0bac_4b96_b020_2612138bf4af.slice/crio-664c2aed67d03ce2e47be5b32cd6e9a0721c40f51dbc2f36aad6c94a82c809ba WatchSource:0}: Error finding container 664c2aed67d03ce2e47be5b32cd6e9a0721c40f51dbc2f36aad6c94a82c809ba: Status 404 returned error can't find the container with id 664c2aed67d03ce2e47be5b32cd6e9a0721c40f51dbc2f36aad6c94a82c809ba Jul 06 13:44:57.357946 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:44:57.357870 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-2jljx" event={"ID":"aad3bb1b-0bac-4b96-b020-2612138bf4af","Type":"ContainerStarted","Data":"664c2aed67d03ce2e47be5b32cd6e9a0721c40f51dbc2f36aad6c94a82c809ba"} Jul 06 13:45:03.345731 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:45:03.345704 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-6ff5df8b5c-j8vsf" Jul 06 13:45:07.570488 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:45:07.570446 2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 06 13:45:07.570744 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:45:07.570512 2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 06 13:45:08.401593 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:45:08.401559 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-2jljx" event={"ID":"aad3bb1b-0bac-4b96-b020-2612138bf4af","Type":"ContainerStarted","Data":"bca3d99fe7cb26ba1ff8b302ebdc18fd2549e273f609a29ab73b1e4bbe7dd998"} Jul 06 13:45:08.401782 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:45:08.401765 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-2jljx" Jul 06 13:45:08.403165 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:45:08.403144 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-2jljx" Jul 06 13:45:08.425179 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:45:08.425134 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-2jljx" podStartSLOduration=3.0321996 podStartE2EDuration="13.425120575s" totalImagesPullingTime="10.392920975s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 13:44:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 13:45:08.423304557 +0000 UTC m=+325.799903508" watchObservedRunningTime="2026-07-06 13:45:08.425120575 +0000 UTC m=+325.801719534" Jul 06 13:46:38.893963 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:46:38.893930 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8s85j"] Jul 06 13:46:38.896105 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:46:38.896089 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8s85j" Jul 06 13:46:38.904551 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:46:38.904532 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 06 13:46:38.904833 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:46:38.904818 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-wjqtl\"" Jul 06 13:46:38.905560 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:46:38.905544 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 06 13:46:38.942222 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:46:38.942191 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8s85j"] Jul 06 13:46:39.067410 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:46:39.067378 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/41eaf1d5-3a71-4ce7-8f3b-27f985639c85-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-8s85j\" (UID: \"41eaf1d5-3a71-4ce7-8f3b-27f985639c85\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8s85j" Jul 06 13:46:39.067410 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:46:39.067412 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-th9kq\" (UniqueName: \"kubernetes.io/projected/41eaf1d5-3a71-4ce7-8f3b-27f985639c85-kube-api-access-th9kq\") pod \"kuadrant-operator-controller-manager-86878c769f-8s85j\" (UID: \"41eaf1d5-3a71-4ce7-8f3b-27f985639c85\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8s85j" Jul 06 13:46:39.168142 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:46:39.168071 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/41eaf1d5-3a71-4ce7-8f3b-27f985639c85-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-8s85j\" (UID: \"41eaf1d5-3a71-4ce7-8f3b-27f985639c85\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8s85j" Jul 06 13:46:39.168142 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:46:39.168105 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-th9kq\" (UniqueName: \"kubernetes.io/projected/41eaf1d5-3a71-4ce7-8f3b-27f985639c85-kube-api-access-th9kq\") pod \"kuadrant-operator-controller-manager-86878c769f-8s85j\" (UID: \"41eaf1d5-3a71-4ce7-8f3b-27f985639c85\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8s85j" Jul 06 13:46:39.168424 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:46:39.168406 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/41eaf1d5-3a71-4ce7-8f3b-27f985639c85-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-8s85j\" (UID: \"41eaf1d5-3a71-4ce7-8f3b-27f985639c85\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8s85j" Jul 06 13:46:39.185502 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:46:39.185475 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-th9kq\" (UniqueName: \"kubernetes.io/projected/41eaf1d5-3a71-4ce7-8f3b-27f985639c85-kube-api-access-th9kq\") pod \"kuadrant-operator-controller-manager-86878c769f-8s85j\" (UID: \"41eaf1d5-3a71-4ce7-8f3b-27f985639c85\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8s85j" Jul 06 13:46:39.204985 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:46:39.204964 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8s85j" Jul 06 13:46:39.419546 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:46:39.419470 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8s85j"] Jul 06 13:46:39.425250 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:46:39.425223 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod41eaf1d5_3a71_4ce7_8f3b_27f985639c85.slice/crio-a0fec4fb457221c04aed4e8a227dbc12662ce630c50b712bebc7ebd48220d8bf WatchSource:0}: Error finding container a0fec4fb457221c04aed4e8a227dbc12662ce630c50b712bebc7ebd48220d8bf: Status 404 returned error can't find the container with id a0fec4fb457221c04aed4e8a227dbc12662ce630c50b712bebc7ebd48220d8bf Jul 06 13:46:39.731625 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:46:39.731594 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8s85j" event={"ID":"41eaf1d5-3a71-4ce7-8f3b-27f985639c85","Type":"ContainerStarted","Data":"a0fec4fb457221c04aed4e8a227dbc12662ce630c50b712bebc7ebd48220d8bf"} Jul 06 13:46:44.756212 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:46:44.756177 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8s85j" event={"ID":"41eaf1d5-3a71-4ce7-8f3b-27f985639c85","Type":"ContainerStarted","Data":"a2c591a45d1c0c23b1ba81926f192bfaae1dee5e3e5ee5d230067a30f7d8821d"} Jul 06 13:46:44.756563 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:46:44.756305 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8s85j" Jul 06 13:46:55.762517 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:46:55.762485 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8s85j" Jul 06 13:46:55.802234 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:46:55.802185 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8s85j" podStartSLOduration=12.674954565 podStartE2EDuration="17.802172126s" totalImagesPullingTime="5.127217561s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 13:46:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 13:46:44.814562681 +0000 UTC m=+422.191161641" watchObservedRunningTime="2026-07-06 13:46:55.802172126 +0000 UTC m=+433.178771154" Jul 06 13:48:58.430746 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:48:58.430667 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-75drf"] Jul 06 13:48:58.433904 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:48:58.433889 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-75drf" Jul 06 13:48:58.436326 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:48:58.436305 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-xpd76\"" Jul 06 13:48:58.437326 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:48:58.437306 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\"" Jul 06 13:48:58.437464 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:48:58.437338 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 06 13:48:58.437464 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:48:58.437349 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 06 13:48:58.447821 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:48:58.447792 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-75drf"] Jul 06 13:48:58.494533 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:48:58.494504 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9122ec9e-ca2b-4219-bc77-a2a2a9ad216e-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-75drf\" (UID: \"9122ec9e-ca2b-4219-bc77-a2a2a9ad216e\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-75drf" Jul 06 13:48:58.494719 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:48:58.494548 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9122ec9e-ca2b-4219-bc77-a2a2a9ad216e-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-75drf\" (UID: \"9122ec9e-ca2b-4219-bc77-a2a2a9ad216e\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-75drf" Jul 06 13:48:58.494719 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:48:58.494627 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9122ec9e-ca2b-4219-bc77-a2a2a9ad216e-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-75drf\" (UID: \"9122ec9e-ca2b-4219-bc77-a2a2a9ad216e\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-75drf" Jul 06 13:48:58.494719 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:48:58.494642 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9122ec9e-ca2b-4219-bc77-a2a2a9ad216e-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-75drf\" (UID: \"9122ec9e-ca2b-4219-bc77-a2a2a9ad216e\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-75drf" Jul 06 13:48:58.494842 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:48:58.494762 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9122ec9e-ca2b-4219-bc77-a2a2a9ad216e-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-75drf\" (UID: \"9122ec9e-ca2b-4219-bc77-a2a2a9ad216e\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-75drf" Jul 06 13:48:58.494880 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:48:58.494837 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m8mbn\" (UniqueName: \"kubernetes.io/projected/9122ec9e-ca2b-4219-bc77-a2a2a9ad216e-kube-api-access-m8mbn\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-75drf\" (UID: \"9122ec9e-ca2b-4219-bc77-a2a2a9ad216e\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-75drf" Jul 06 13:48:58.596101 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:48:58.596062 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9122ec9e-ca2b-4219-bc77-a2a2a9ad216e-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-75drf\" (UID: \"9122ec9e-ca2b-4219-bc77-a2a2a9ad216e\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-75drf" Jul 06 13:48:58.596300 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:48:58.596109 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9122ec9e-ca2b-4219-bc77-a2a2a9ad216e-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-75drf\" (UID: \"9122ec9e-ca2b-4219-bc77-a2a2a9ad216e\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-75drf" Jul 06 13:48:58.596300 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:48:58.596138 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9122ec9e-ca2b-4219-bc77-a2a2a9ad216e-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-75drf\" (UID: \"9122ec9e-ca2b-4219-bc77-a2a2a9ad216e\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-75drf" Jul 06 13:48:58.596300 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:48:58.596187 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m8mbn\" (UniqueName: \"kubernetes.io/projected/9122ec9e-ca2b-4219-bc77-a2a2a9ad216e-kube-api-access-m8mbn\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-75drf\" (UID: \"9122ec9e-ca2b-4219-bc77-a2a2a9ad216e\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-75drf" Jul 06 13:48:58.596300 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:48:58.596245 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9122ec9e-ca2b-4219-bc77-a2a2a9ad216e-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-75drf\" (UID: \"9122ec9e-ca2b-4219-bc77-a2a2a9ad216e\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-75drf" Jul 06 13:48:58.596300 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:48:58.596272 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9122ec9e-ca2b-4219-bc77-a2a2a9ad216e-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-75drf\" (UID: \"9122ec9e-ca2b-4219-bc77-a2a2a9ad216e\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-75drf" Jul 06 13:48:58.596578 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:48:58.596516 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9122ec9e-ca2b-4219-bc77-a2a2a9ad216e-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-75drf\" (UID: \"9122ec9e-ca2b-4219-bc77-a2a2a9ad216e\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-75drf" Jul 06 13:48:58.596635 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:48:58.596582 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9122ec9e-ca2b-4219-bc77-a2a2a9ad216e-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-75drf\" (UID: \"9122ec9e-ca2b-4219-bc77-a2a2a9ad216e\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-75drf" Jul 06 13:48:58.596786 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:48:58.596763 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9122ec9e-ca2b-4219-bc77-a2a2a9ad216e-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-75drf\" (UID: \"9122ec9e-ca2b-4219-bc77-a2a2a9ad216e\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-75drf" Jul 06 13:48:58.598486 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:48:58.598466 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9122ec9e-ca2b-4219-bc77-a2a2a9ad216e-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-75drf\" (UID: \"9122ec9e-ca2b-4219-bc77-a2a2a9ad216e\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-75drf" Jul 06 13:48:58.598745 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:48:58.598728 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9122ec9e-ca2b-4219-bc77-a2a2a9ad216e-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-75drf\" (UID: \"9122ec9e-ca2b-4219-bc77-a2a2a9ad216e\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-75drf" Jul 06 13:48:58.605708 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:48:58.605682 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m8mbn\" (UniqueName: \"kubernetes.io/projected/9122ec9e-ca2b-4219-bc77-a2a2a9ad216e-kube-api-access-m8mbn\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-75drf\" (UID: \"9122ec9e-ca2b-4219-bc77-a2a2a9ad216e\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-75drf" Jul 06 13:48:58.743783 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:48:58.743753 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-75drf" Jul 06 13:48:58.872875 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:48:58.872840 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-75drf"] Jul 06 13:48:58.874963 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:48:58.874944 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9122ec9e_ca2b_4219_bc77_a2a2a9ad216e.slice/crio-2523a9a3e950a9cfb5e3d518bcab6d96f4daa75b1579461fea08066aa3c09e74 WatchSource:0}: Error finding container 2523a9a3e950a9cfb5e3d518bcab6d96f4daa75b1579461fea08066aa3c09e74: Status 404 returned error can't find the container with id 2523a9a3e950a9cfb5e3d518bcab6d96f4daa75b1579461fea08066aa3c09e74 Jul 06 13:48:59.278106 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:48:59.278012 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-75drf" event={"ID":"9122ec9e-ca2b-4219-bc77-a2a2a9ad216e","Type":"ContainerStarted","Data":"2523a9a3e950a9cfb5e3d518bcab6d96f4daa75b1579461fea08066aa3c09e74"} Jul 06 13:49:00.283583 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:49:00.283490 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-75drf" event={"ID":"9122ec9e-ca2b-4219-bc77-a2a2a9ad216e","Type":"ContainerStarted","Data":"86df9443891add23267f049e80b5b528c69b40fa999f6c9e0e6ce1587569a02d"} Jul 06 13:49:00.310830 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:49:00.310780 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-75drf" podStartSLOduration=1.18806042 podStartE2EDuration="2.310765274s" totalImagesPullingTime="1.122704854s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 13:48:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 13:49:00.309065358 +0000 UTC m=+557.685664310" watchObservedRunningTime="2026-07-06 13:49:00.310765274 +0000 UTC m=+557.687364233" Jul 06 13:49:08.744177 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:49:08.744145 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-75drf" Jul 06 13:49:08.744654 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:49:08.744239 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-75drf" Jul 06 13:49:08.756231 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:49:08.756213 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-75drf" Jul 06 13:49:09.330146 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:49:09.330122 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-75drf" Jul 06 13:49:23.516817 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:49:23.516790 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-nmlnd"] Jul 06 13:49:23.519799 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:49:23.519781 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-nmlnd" Jul 06 13:49:23.522235 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:49:23.522216 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\"" Jul 06 13:49:23.530829 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:49:23.530807 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-nmlnd"] Jul 06 13:49:23.614111 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:49:23.614073 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3866d780-1d99-4970-9037-703646c500c8-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-nmlnd\" (UID: \"3866d780-1d99-4970-9037-703646c500c8\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-nmlnd" Jul 06 13:49:23.614295 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:49:23.614187 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zg9rs\" (UniqueName: \"kubernetes.io/projected/3866d780-1d99-4970-9037-703646c500c8-kube-api-access-zg9rs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-nmlnd\" (UID: \"3866d780-1d99-4970-9037-703646c500c8\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-nmlnd" Jul 06 13:49:23.614295 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:49:23.614233 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3866d780-1d99-4970-9037-703646c500c8-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-nmlnd\" (UID: \"3866d780-1d99-4970-9037-703646c500c8\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-nmlnd" Jul 06 13:49:23.614295 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:49:23.614256 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3866d780-1d99-4970-9037-703646c500c8-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-nmlnd\" (UID: \"3866d780-1d99-4970-9037-703646c500c8\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-nmlnd" Jul 06 13:49:23.614295 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:49:23.614276 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3866d780-1d99-4970-9037-703646c500c8-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-nmlnd\" (UID: \"3866d780-1d99-4970-9037-703646c500c8\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-nmlnd" Jul 06 13:49:23.614453 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:49:23.614349 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3866d780-1d99-4970-9037-703646c500c8-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-nmlnd\" (UID: \"3866d780-1d99-4970-9037-703646c500c8\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-nmlnd" Jul 06 13:49:23.715383 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:49:23.715347 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zg9rs\" (UniqueName: \"kubernetes.io/projected/3866d780-1d99-4970-9037-703646c500c8-kube-api-access-zg9rs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-nmlnd\" (UID: \"3866d780-1d99-4970-9037-703646c500c8\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-nmlnd" Jul 06 13:49:23.715568 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:49:23.715390 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3866d780-1d99-4970-9037-703646c500c8-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-nmlnd\" (UID: \"3866d780-1d99-4970-9037-703646c500c8\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-nmlnd" Jul 06 13:49:23.715568 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:49:23.715406 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3866d780-1d99-4970-9037-703646c500c8-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-nmlnd\" (UID: \"3866d780-1d99-4970-9037-703646c500c8\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-nmlnd" Jul 06 13:49:23.715568 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:49:23.715421 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3866d780-1d99-4970-9037-703646c500c8-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-nmlnd\" (UID: \"3866d780-1d99-4970-9037-703646c500c8\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-nmlnd" Jul 06 13:49:23.715568 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:49:23.715438 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3866d780-1d99-4970-9037-703646c500c8-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-nmlnd\" (UID: \"3866d780-1d99-4970-9037-703646c500c8\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-nmlnd" Jul 06 13:49:23.715568 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:49:23.715466 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3866d780-1d99-4970-9037-703646c500c8-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-nmlnd\" (UID: \"3866d780-1d99-4970-9037-703646c500c8\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-nmlnd" Jul 06 13:49:23.715862 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:49:23.715834 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3866d780-1d99-4970-9037-703646c500c8-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-nmlnd\" (UID: \"3866d780-1d99-4970-9037-703646c500c8\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-nmlnd" Jul 06 13:49:23.715948 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:49:23.715878 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3866d780-1d99-4970-9037-703646c500c8-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-nmlnd\" (UID: \"3866d780-1d99-4970-9037-703646c500c8\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-nmlnd" Jul 06 13:49:23.715948 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:49:23.715913 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3866d780-1d99-4970-9037-703646c500c8-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-nmlnd\" (UID: \"3866d780-1d99-4970-9037-703646c500c8\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-nmlnd" Jul 06 13:49:23.717711 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:49:23.717689 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3866d780-1d99-4970-9037-703646c500c8-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-nmlnd\" (UID: \"3866d780-1d99-4970-9037-703646c500c8\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-nmlnd" Jul 06 13:49:23.717909 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:49:23.717889 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3866d780-1d99-4970-9037-703646c500c8-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-nmlnd\" (UID: \"3866d780-1d99-4970-9037-703646c500c8\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-nmlnd" Jul 06 13:49:23.724480 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:49:23.724457 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zg9rs\" (UniqueName: \"kubernetes.io/projected/3866d780-1d99-4970-9037-703646c500c8-kube-api-access-zg9rs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-nmlnd\" (UID: \"3866d780-1d99-4970-9037-703646c500c8\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-nmlnd" Jul 06 13:49:23.829295 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:49:23.829217 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-nmlnd" Jul 06 13:49:23.962474 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:49:23.962446 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-nmlnd"] Jul 06 13:49:23.964655 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:49:23.964635 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3866d780_1d99_4970_9037_703646c500c8.slice/crio-4698a3a7491bdfe5feec41eebe121d55b8e77ea5e9c4ce636169dae75bba287b WatchSource:0}: Error finding container 4698a3a7491bdfe5feec41eebe121d55b8e77ea5e9c4ce636169dae75bba287b: Status 404 returned error can't find the container with id 4698a3a7491bdfe5feec41eebe121d55b8e77ea5e9c4ce636169dae75bba287b Jul 06 13:49:24.381134 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:49:24.381101 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-nmlnd" event={"ID":"3866d780-1d99-4970-9037-703646c500c8","Type":"ContainerStarted","Data":"2234fe49ca05c2db8f37d3f28ae0318b0aa3f359ece7587b5382ed79f8fbe546"} Jul 06 13:49:24.381285 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:49:24.381175 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-nmlnd" event={"ID":"3866d780-1d99-4970-9037-703646c500c8","Type":"ContainerStarted","Data":"4698a3a7491bdfe5feec41eebe121d55b8e77ea5e9c4ce636169dae75bba287b"} Jul 06 13:49:24.400428 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:49:24.400387 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-nmlnd" podStartSLOduration=1.191738526 podStartE2EDuration="1.400375444s" totalImagesPullingTime="208.636918ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 13:49:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 13:49:24.398130255 +0000 UTC m=+581.774729217" watchObservedRunningTime="2026-07-06 13:49:24.400375444 +0000 UTC m=+581.776974404" Jul 06 13:49:33.830009 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:49:33.829967 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-nmlnd" Jul 06 13:49:33.830501 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:49:33.830060 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-nmlnd" Jul 06 13:49:33.842385 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:49:33.842362 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-nmlnd" Jul 06 13:49:34.431375 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:49:34.431348 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-nmlnd" Jul 06 13:49:41.215791 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:49:41.215761 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-4fmdp"] Jul 06 13:49:41.218829 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:49:41.218813 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4fmdp" Jul 06 13:49:41.222883 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:49:41.222860 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\"" Jul 06 13:49:41.232024 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:49:41.232003 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-4fmdp"] Jul 06 13:49:41.259716 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:49:41.259688 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b4da1c2b-12cf-4ffd-a0e3-2c46b23132a9-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-4fmdp\" (UID: \"b4da1c2b-12cf-4ffd-a0e3-2c46b23132a9\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4fmdp" Jul 06 13:49:41.259847 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:49:41.259732 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b4da1c2b-12cf-4ffd-a0e3-2c46b23132a9-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-4fmdp\" (UID: \"b4da1c2b-12cf-4ffd-a0e3-2c46b23132a9\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4fmdp" Jul 06 13:49:41.259847 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:49:41.259792 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b4da1c2b-12cf-4ffd-a0e3-2c46b23132a9-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-4fmdp\" (UID: \"b4da1c2b-12cf-4ffd-a0e3-2c46b23132a9\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4fmdp" Jul 06 13:49:41.259964 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:49:41.259889 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b4da1c2b-12cf-4ffd-a0e3-2c46b23132a9-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-4fmdp\" (UID: \"b4da1c2b-12cf-4ffd-a0e3-2c46b23132a9\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4fmdp" Jul 06 13:49:41.259964 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:49:41.259920 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b4da1c2b-12cf-4ffd-a0e3-2c46b23132a9-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-4fmdp\" (UID: \"b4da1c2b-12cf-4ffd-a0e3-2c46b23132a9\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4fmdp" Jul 06 13:49:41.259964 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:49:41.259945 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4vntn\" (UniqueName: \"kubernetes.io/projected/b4da1c2b-12cf-4ffd-a0e3-2c46b23132a9-kube-api-access-4vntn\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-4fmdp\" (UID: \"b4da1c2b-12cf-4ffd-a0e3-2c46b23132a9\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4fmdp" Jul 06 13:49:41.361227 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:49:41.361196 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b4da1c2b-12cf-4ffd-a0e3-2c46b23132a9-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-4fmdp\" (UID: \"b4da1c2b-12cf-4ffd-a0e3-2c46b23132a9\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4fmdp" Jul 06 13:49:41.361443 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:49:41.361269 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b4da1c2b-12cf-4ffd-a0e3-2c46b23132a9-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-4fmdp\" (UID: \"b4da1c2b-12cf-4ffd-a0e3-2c46b23132a9\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4fmdp" Jul 06 13:49:41.361443 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:49:41.361295 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b4da1c2b-12cf-4ffd-a0e3-2c46b23132a9-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-4fmdp\" (UID: \"b4da1c2b-12cf-4ffd-a0e3-2c46b23132a9\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4fmdp" Jul 06 13:49:41.361443 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:49:41.361318 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4vntn\" (UniqueName: \"kubernetes.io/projected/b4da1c2b-12cf-4ffd-a0e3-2c46b23132a9-kube-api-access-4vntn\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-4fmdp\" (UID: \"b4da1c2b-12cf-4ffd-a0e3-2c46b23132a9\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4fmdp" Jul 06 13:49:41.361443 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:49:41.361366 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b4da1c2b-12cf-4ffd-a0e3-2c46b23132a9-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-4fmdp\" (UID: \"b4da1c2b-12cf-4ffd-a0e3-2c46b23132a9\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4fmdp" Jul 06 13:49:41.361443 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:49:41.361419 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b4da1c2b-12cf-4ffd-a0e3-2c46b23132a9-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-4fmdp\" (UID: \"b4da1c2b-12cf-4ffd-a0e3-2c46b23132a9\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4fmdp" Jul 06 13:49:41.361781 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:49:41.361719 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b4da1c2b-12cf-4ffd-a0e3-2c46b23132a9-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-4fmdp\" (UID: \"b4da1c2b-12cf-4ffd-a0e3-2c46b23132a9\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4fmdp" Jul 06 13:49:41.361897 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:49:41.361868 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b4da1c2b-12cf-4ffd-a0e3-2c46b23132a9-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-4fmdp\" (UID: \"b4da1c2b-12cf-4ffd-a0e3-2c46b23132a9\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4fmdp" Jul 06 13:49:41.361961 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:49:41.361933 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b4da1c2b-12cf-4ffd-a0e3-2c46b23132a9-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-4fmdp\" (UID: \"b4da1c2b-12cf-4ffd-a0e3-2c46b23132a9\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4fmdp" Jul 06 13:49:41.363667 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:49:41.363636 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b4da1c2b-12cf-4ffd-a0e3-2c46b23132a9-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-4fmdp\" (UID: \"b4da1c2b-12cf-4ffd-a0e3-2c46b23132a9\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4fmdp" Jul 06 13:49:41.364154 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:49:41.364137 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b4da1c2b-12cf-4ffd-a0e3-2c46b23132a9-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-4fmdp\" (UID: \"b4da1c2b-12cf-4ffd-a0e3-2c46b23132a9\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4fmdp" Jul 06 13:49:41.373259 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:49:41.373238 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4vntn\" (UniqueName: \"kubernetes.io/projected/b4da1c2b-12cf-4ffd-a0e3-2c46b23132a9-kube-api-access-4vntn\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-4fmdp\" (UID: \"b4da1c2b-12cf-4ffd-a0e3-2c46b23132a9\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4fmdp" Jul 06 13:49:41.529099 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:49:41.529062 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4fmdp" Jul 06 13:49:41.658936 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:49:41.658910 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-4fmdp"] Jul 06 13:49:41.661483 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:49:41.661451 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb4da1c2b_12cf_4ffd_a0e3_2c46b23132a9.slice/crio-3f19f2eab2e32d5a2fce57dd03c7101e635802013ffc0f9dadaf8a6ff7389f41 WatchSource:0}: Error finding container 3f19f2eab2e32d5a2fce57dd03c7101e635802013ffc0f9dadaf8a6ff7389f41: Status 404 returned error can't find the container with id 3f19f2eab2e32d5a2fce57dd03c7101e635802013ffc0f9dadaf8a6ff7389f41 Jul 06 13:49:42.456502 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:49:42.456419 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4fmdp" event={"ID":"b4da1c2b-12cf-4ffd-a0e3-2c46b23132a9","Type":"ContainerStarted","Data":"d4737e9e8184d38004117cddf7f4b7e77ff0d81ffc74a145b1b474ab884c0a81"} Jul 06 13:49:42.456502 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:49:42.456465 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4fmdp" event={"ID":"b4da1c2b-12cf-4ffd-a0e3-2c46b23132a9","Type":"ContainerStarted","Data":"3f19f2eab2e32d5a2fce57dd03c7101e635802013ffc0f9dadaf8a6ff7389f41"} Jul 06 13:49:42.475252 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:49:42.475206 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4fmdp" podStartSLOduration=1.119829913 podStartE2EDuration="1.475186447s" totalImagesPullingTime="355.356534ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 13:49:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 13:49:42.473766488 +0000 UTC m=+599.850365448" watchObservedRunningTime="2026-07-06 13:49:42.475186447 +0000 UTC m=+599.851785408" Jul 06 13:49:43.049887 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:49:43.049861 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-z2f98_66e76252-8877-403e-9c30-e56ec0013c24/console-operator/1.log" Jul 06 13:49:43.051178 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:49:43.051156 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-z2f98_66e76252-8877-403e-9c30-e56ec0013c24/console-operator/1.log" Jul 06 13:49:51.529894 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:49:51.529860 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4fmdp" Jul 06 13:49:51.531914 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:49:51.529925 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4fmdp" Jul 06 13:49:51.542491 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:49:51.542467 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4fmdp" Jul 06 13:49:52.509709 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:49:52.509677 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-4fmdp" Jul 06 13:54:43.083622 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:54:43.083548 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-z2f98_66e76252-8877-403e-9c30-e56ec0013c24/console-operator/1.log" Jul 06 13:54:43.084324 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:54:43.083758 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-z2f98_66e76252-8877-403e-9c30-e56ec0013c24/console-operator/1.log" Jul 06 13:56:34.950926 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:56:34.950888 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8s85j"] Jul 06 13:56:34.953773 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:56:34.951108 2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8s85j" podUID="41eaf1d5-3a71-4ce7-8f3b-27f985639c85" containerName="manager" containerID="cri-o://a2c591a45d1c0c23b1ba81926f192bfaae1dee5e3e5ee5d230067a30f7d8821d" gracePeriod=10 Jul 06 13:56:37.095612 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:56:37.095589 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8s85j" Jul 06 13:56:37.172368 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:56:37.172335 2573 generic.go:356] "Generic (PLEG): container finished" podID="41eaf1d5-3a71-4ce7-8f3b-27f985639c85" containerID="a2c591a45d1c0c23b1ba81926f192bfaae1dee5e3e5ee5d230067a30f7d8821d" exitCode=0 Jul 06 13:56:37.172516 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:56:37.172379 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8s85j" event={"ID":"41eaf1d5-3a71-4ce7-8f3b-27f985639c85","Type":"ContainerDied","Data":"a2c591a45d1c0c23b1ba81926f192bfaae1dee5e3e5ee5d230067a30f7d8821d"} Jul 06 13:56:37.172516 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:56:37.172392 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8s85j" Jul 06 13:56:37.172516 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:56:37.172436 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8s85j" event={"ID":"41eaf1d5-3a71-4ce7-8f3b-27f985639c85","Type":"ContainerDied","Data":"a0fec4fb457221c04aed4e8a227dbc12662ce630c50b712bebc7ebd48220d8bf"} Jul 06 13:56:37.172516 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:56:37.172464 2573 scope.go:117] "RemoveContainer" containerID="a2c591a45d1c0c23b1ba81926f192bfaae1dee5e3e5ee5d230067a30f7d8821d" Jul 06 13:56:37.182384 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:56:37.182369 2573 scope.go:117] "RemoveContainer" containerID="a2c591a45d1c0c23b1ba81926f192bfaae1dee5e3e5ee5d230067a30f7d8821d" Jul 06 13:56:37.182655 ip-10-0-138-163 kubenswrapper[2573]: E0706 13:56:37.182637 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a2c591a45d1c0c23b1ba81926f192bfaae1dee5e3e5ee5d230067a30f7d8821d\": container with ID starting with a2c591a45d1c0c23b1ba81926f192bfaae1dee5e3e5ee5d230067a30f7d8821d not found: ID does not exist" containerID="a2c591a45d1c0c23b1ba81926f192bfaae1dee5e3e5ee5d230067a30f7d8821d" Jul 06 13:56:37.182712 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:56:37.182664 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a2c591a45d1c0c23b1ba81926f192bfaae1dee5e3e5ee5d230067a30f7d8821d"} err="failed to get container status \"a2c591a45d1c0c23b1ba81926f192bfaae1dee5e3e5ee5d230067a30f7d8821d\": rpc error: code = NotFound desc = could not find container \"a2c591a45d1c0c23b1ba81926f192bfaae1dee5e3e5ee5d230067a30f7d8821d\": container with ID starting with a2c591a45d1c0c23b1ba81926f192bfaae1dee5e3e5ee5d230067a30f7d8821d not found: ID does not exist" Jul 06 13:56:37.209983 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:56:37.209933 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/41eaf1d5-3a71-4ce7-8f3b-27f985639c85-extensions-socket-volume\") pod \"41eaf1d5-3a71-4ce7-8f3b-27f985639c85\" (UID: \"41eaf1d5-3a71-4ce7-8f3b-27f985639c85\") " Jul 06 13:56:37.210115 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:56:37.210004 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-th9kq\" (UniqueName: \"kubernetes.io/projected/41eaf1d5-3a71-4ce7-8f3b-27f985639c85-kube-api-access-th9kq\") pod \"41eaf1d5-3a71-4ce7-8f3b-27f985639c85\" (UID: \"41eaf1d5-3a71-4ce7-8f3b-27f985639c85\") " Jul 06 13:56:37.210339 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:56:37.210317 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/41eaf1d5-3a71-4ce7-8f3b-27f985639c85-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "41eaf1d5-3a71-4ce7-8f3b-27f985639c85" (UID: "41eaf1d5-3a71-4ce7-8f3b-27f985639c85"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 13:56:37.212003 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:56:37.211981 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/41eaf1d5-3a71-4ce7-8f3b-27f985639c85-kube-api-access-th9kq" (OuterVolumeSpecName: "kube-api-access-th9kq") pod "41eaf1d5-3a71-4ce7-8f3b-27f985639c85" (UID: "41eaf1d5-3a71-4ce7-8f3b-27f985639c85"). InnerVolumeSpecName "kube-api-access-th9kq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 13:56:37.311550 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:56:37.311520 2573 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/41eaf1d5-3a71-4ce7-8f3b-27f985639c85-extensions-socket-volume\") on node \"ip-10-0-138-163.ec2.internal\" DevicePath \"\"" Jul 06 13:56:37.311550 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:56:37.311546 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-th9kq\" (UniqueName: \"kubernetes.io/projected/41eaf1d5-3a71-4ce7-8f3b-27f985639c85-kube-api-access-th9kq\") on node \"ip-10-0-138-163.ec2.internal\" DevicePath \"\"" Jul 06 13:56:37.496597 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:56:37.496566 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8s85j"] Jul 06 13:56:37.500716 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:56:37.500696 2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8s85j"] Jul 06 13:56:39.165227 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:56:39.165194 2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="41eaf1d5-3a71-4ce7-8f3b-27f985639c85" path="/var/lib/kubelet/pods/41eaf1d5-3a71-4ce7-8f3b-27f985639c85/volumes" Jul 06 13:57:36.149358 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:57:36.149285 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8pcn8"] Jul 06 13:57:36.149796 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:57:36.149580 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="41eaf1d5-3a71-4ce7-8f3b-27f985639c85" containerName="manager" Jul 06 13:57:36.149796 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:57:36.149590 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="41eaf1d5-3a71-4ce7-8f3b-27f985639c85" containerName="manager" Jul 06 13:57:36.149796 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:57:36.149647 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="41eaf1d5-3a71-4ce7-8f3b-27f985639c85" containerName="manager" Jul 06 13:57:36.152609 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:57:36.152593 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8pcn8" Jul 06 13:57:36.155479 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:57:36.155456 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 06 13:57:36.155479 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:57:36.155475 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-wjqtl\"" Jul 06 13:57:36.155622 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:57:36.155461 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 06 13:57:36.166844 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:57:36.166823 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8pcn8"] Jul 06 13:57:36.290468 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:57:36.290439 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d132a906-a57c-47db-8177-6199c9504fdd-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-8pcn8\" (UID: \"d132a906-a57c-47db-8177-6199c9504fdd\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8pcn8" Jul 06 13:57:36.290639 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:57:36.290560 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4h6p6\" (UniqueName: \"kubernetes.io/projected/d132a906-a57c-47db-8177-6199c9504fdd-kube-api-access-4h6p6\") pod \"kuadrant-operator-controller-manager-86878c769f-8pcn8\" (UID: \"d132a906-a57c-47db-8177-6199c9504fdd\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8pcn8" Jul 06 13:57:36.391385 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:57:36.391349 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d132a906-a57c-47db-8177-6199c9504fdd-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-8pcn8\" (UID: \"d132a906-a57c-47db-8177-6199c9504fdd\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8pcn8" Jul 06 13:57:36.391552 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:57:36.391425 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4h6p6\" (UniqueName: \"kubernetes.io/projected/d132a906-a57c-47db-8177-6199c9504fdd-kube-api-access-4h6p6\") pod \"kuadrant-operator-controller-manager-86878c769f-8pcn8\" (UID: \"d132a906-a57c-47db-8177-6199c9504fdd\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8pcn8" Jul 06 13:57:36.391729 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:57:36.391708 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d132a906-a57c-47db-8177-6199c9504fdd-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-8pcn8\" (UID: \"d132a906-a57c-47db-8177-6199c9504fdd\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8pcn8" Jul 06 13:57:36.413207 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:57:36.413145 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4h6p6\" (UniqueName: \"kubernetes.io/projected/d132a906-a57c-47db-8177-6199c9504fdd-kube-api-access-4h6p6\") pod \"kuadrant-operator-controller-manager-86878c769f-8pcn8\" (UID: \"d132a906-a57c-47db-8177-6199c9504fdd\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8pcn8" Jul 06 13:57:36.462375 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:57:36.462350 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8pcn8" Jul 06 13:57:36.607292 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:57:36.607265 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8pcn8"] Jul 06 13:57:36.608747 ip-10-0-138-163 kubenswrapper[2573]: W0706 13:57:36.608723 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd132a906_a57c_47db_8177_6199c9504fdd.slice/crio-d8919ca32fe42ad8a6e525fbc6456e03b86d6c23d7e2677052e725ee1b8a3fe3 WatchSource:0}: Error finding container d8919ca32fe42ad8a6e525fbc6456e03b86d6c23d7e2677052e725ee1b8a3fe3: Status 404 returned error can't find the container with id d8919ca32fe42ad8a6e525fbc6456e03b86d6c23d7e2677052e725ee1b8a3fe3 Jul 06 13:57:37.415586 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:57:37.415550 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8pcn8" event={"ID":"d132a906-a57c-47db-8177-6199c9504fdd","Type":"ContainerStarted","Data":"ee3495024df0acc57ca034a195bcdc49f305416ba25056aeccbd4d90f0afaea3"} Jul 06 13:57:37.415974 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:57:37.415605 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8pcn8" event={"ID":"d132a906-a57c-47db-8177-6199c9504fdd","Type":"ContainerStarted","Data":"d8919ca32fe42ad8a6e525fbc6456e03b86d6c23d7e2677052e725ee1b8a3fe3"} Jul 06 13:57:37.415974 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:57:37.415742 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8pcn8" Jul 06 13:57:37.440364 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:57:37.440309 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8pcn8" podStartSLOduration=1.440289519 podStartE2EDuration="1.440289519s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 13:57:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 13:57:37.438304976 +0000 UTC m=+1074.814903936" watchObservedRunningTime="2026-07-06 13:57:37.440289519 +0000 UTC m=+1074.816888479" Jul 06 13:57:48.422054 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:57:48.422007 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8pcn8" Jul 06 13:59:43.108644 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:59:43.108620 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-z2f98_66e76252-8877-403e-9c30-e56ec0013c24/console-operator/1.log" Jul 06 13:59:43.109217 ip-10-0-138-163 kubenswrapper[2573]: I0706 13:59:43.109199 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-z2f98_66e76252-8877-403e-9c30-e56ec0013c24/console-operator/1.log" Jul 06 14:04:43.133309 ip-10-0-138-163 kubenswrapper[2573]: I0706 14:04:43.133270 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-z2f98_66e76252-8877-403e-9c30-e56ec0013c24/console-operator/1.log" Jul 06 14:04:43.137188 ip-10-0-138-163 kubenswrapper[2573]: I0706 14:04:43.137165 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-z2f98_66e76252-8877-403e-9c30-e56ec0013c24/console-operator/1.log" Jul 06 14:09:16.358134 ip-10-0-138-163 kubenswrapper[2573]: I0706 14:09:16.358100 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-inf-b-7e06f0-7dcf989869-g8d4g"] Jul 06 14:09:16.361621 ip-10-0-138-163 kubenswrapper[2573]: I0706 14:09:16.361602 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-b-7e06f0-7dcf989869-g8d4g" Jul 06 14:09:16.367275 ip-10-0-138-163 kubenswrapper[2573]: I0706 14:09:16.367255 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-inf-b-7e06f0-serving-cert\"" Jul 06 14:09:16.367384 ip-10-0-138-163 kubenswrapper[2573]: I0706 14:09:16.367274 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-hq6cd\"" Jul 06 14:09:16.378396 ip-10-0-138-163 kubenswrapper[2573]: I0706 14:09:16.378371 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-inf-b-7e06f0-7dcf989869-g8d4g"] Jul 06 14:09:16.488628 ip-10-0-138-163 kubenswrapper[2573]: I0706 14:09:16.488598 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d992b78c-842b-4207-bc1c-b9b29fbfd7c1-maas-api-tls\") pod \"maas-api-e2e-inf-b-7e06f0-7dcf989869-g8d4g\" (UID: \"d992b78c-842b-4207-bc1c-b9b29fbfd7c1\") " pod="opendatahub/maas-api-e2e-inf-b-7e06f0-7dcf989869-g8d4g" Jul 06 14:09:16.488628 ip-10-0-138-163 kubenswrapper[2573]: I0706 14:09:16.488631 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d992b78c-842b-4207-bc1c-b9b29fbfd7c1-openshift-service-ca\") pod \"maas-api-e2e-inf-b-7e06f0-7dcf989869-g8d4g\" (UID: \"d992b78c-842b-4207-bc1c-b9b29fbfd7c1\") " pod="opendatahub/maas-api-e2e-inf-b-7e06f0-7dcf989869-g8d4g" Jul 06 14:09:16.488830 ip-10-0-138-163 kubenswrapper[2573]: I0706 14:09:16.488662 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g67s9\" (UniqueName: \"kubernetes.io/projected/d992b78c-842b-4207-bc1c-b9b29fbfd7c1-kube-api-access-g67s9\") pod \"maas-api-e2e-inf-b-7e06f0-7dcf989869-g8d4g\" (UID: \"d992b78c-842b-4207-bc1c-b9b29fbfd7c1\") " pod="opendatahub/maas-api-e2e-inf-b-7e06f0-7dcf989869-g8d4g" Jul 06 14:09:16.589460 ip-10-0-138-163 kubenswrapper[2573]: I0706 14:09:16.589427 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d992b78c-842b-4207-bc1c-b9b29fbfd7c1-maas-api-tls\") pod \"maas-api-e2e-inf-b-7e06f0-7dcf989869-g8d4g\" (UID: \"d992b78c-842b-4207-bc1c-b9b29fbfd7c1\") " pod="opendatahub/maas-api-e2e-inf-b-7e06f0-7dcf989869-g8d4g" Jul 06 14:09:16.589460 ip-10-0-138-163 kubenswrapper[2573]: I0706 14:09:16.589462 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d992b78c-842b-4207-bc1c-b9b29fbfd7c1-openshift-service-ca\") pod \"maas-api-e2e-inf-b-7e06f0-7dcf989869-g8d4g\" (UID: \"d992b78c-842b-4207-bc1c-b9b29fbfd7c1\") " pod="opendatahub/maas-api-e2e-inf-b-7e06f0-7dcf989869-g8d4g" Jul 06 14:09:16.589694 ip-10-0-138-163 kubenswrapper[2573]: I0706 14:09:16.589492 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g67s9\" (UniqueName: \"kubernetes.io/projected/d992b78c-842b-4207-bc1c-b9b29fbfd7c1-kube-api-access-g67s9\") pod \"maas-api-e2e-inf-b-7e06f0-7dcf989869-g8d4g\" (UID: \"d992b78c-842b-4207-bc1c-b9b29fbfd7c1\") " pod="opendatahub/maas-api-e2e-inf-b-7e06f0-7dcf989869-g8d4g" Jul 06 14:09:16.589694 ip-10-0-138-163 kubenswrapper[2573]: E0706 14:09:16.589606 2573 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-inf-b-7e06f0-serving-cert: secret "maas-api-e2e-inf-b-7e06f0-serving-cert" not found Jul 06 14:09:16.589694 ip-10-0-138-163 kubenswrapper[2573]: E0706 14:09:16.589692 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d992b78c-842b-4207-bc1c-b9b29fbfd7c1-maas-api-tls podName:d992b78c-842b-4207-bc1c-b9b29fbfd7c1 nodeName:}" failed. No retries permitted until 2026-07-06 14:09:17.089671042 +0000 UTC m=+1774.466269999 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/d992b78c-842b-4207-bc1c-b9b29fbfd7c1-maas-api-tls") pod "maas-api-e2e-inf-b-7e06f0-7dcf989869-g8d4g" (UID: "d992b78c-842b-4207-bc1c-b9b29fbfd7c1") : secret "maas-api-e2e-inf-b-7e06f0-serving-cert" not found Jul 06 14:09:16.590103 ip-10-0-138-163 kubenswrapper[2573]: I0706 14:09:16.590086 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d992b78c-842b-4207-bc1c-b9b29fbfd7c1-openshift-service-ca\") pod \"maas-api-e2e-inf-b-7e06f0-7dcf989869-g8d4g\" (UID: \"d992b78c-842b-4207-bc1c-b9b29fbfd7c1\") " pod="opendatahub/maas-api-e2e-inf-b-7e06f0-7dcf989869-g8d4g" Jul 06 14:09:16.602263 ip-10-0-138-163 kubenswrapper[2573]: I0706 14:09:16.602239 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g67s9\" (UniqueName: \"kubernetes.io/projected/d992b78c-842b-4207-bc1c-b9b29fbfd7c1-kube-api-access-g67s9\") pod \"maas-api-e2e-inf-b-7e06f0-7dcf989869-g8d4g\" (UID: \"d992b78c-842b-4207-bc1c-b9b29fbfd7c1\") " pod="opendatahub/maas-api-e2e-inf-b-7e06f0-7dcf989869-g8d4g" Jul 06 14:09:17.093778 ip-10-0-138-163 kubenswrapper[2573]: I0706 14:09:17.093745 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d992b78c-842b-4207-bc1c-b9b29fbfd7c1-maas-api-tls\") pod \"maas-api-e2e-inf-b-7e06f0-7dcf989869-g8d4g\" (UID: \"d992b78c-842b-4207-bc1c-b9b29fbfd7c1\") " pod="opendatahub/maas-api-e2e-inf-b-7e06f0-7dcf989869-g8d4g" Jul 06 14:09:17.096149 ip-10-0-138-163 kubenswrapper[2573]: I0706 14:09:17.096133 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d992b78c-842b-4207-bc1c-b9b29fbfd7c1-maas-api-tls\") pod \"maas-api-e2e-inf-b-7e06f0-7dcf989869-g8d4g\" (UID: \"d992b78c-842b-4207-bc1c-b9b29fbfd7c1\") " pod="opendatahub/maas-api-e2e-inf-b-7e06f0-7dcf989869-g8d4g" Jul 06 14:09:17.270960 ip-10-0-138-163 kubenswrapper[2573]: I0706 14:09:17.270928 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-b-7e06f0-7dcf989869-g8d4g" Jul 06 14:09:17.411729 ip-10-0-138-163 kubenswrapper[2573]: I0706 14:09:17.411639 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-inf-b-7e06f0-7dcf989869-g8d4g"] Jul 06 14:09:17.416213 ip-10-0-138-163 kubenswrapper[2573]: W0706 14:09:17.416189 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd992b78c_842b_4207_bc1c_b9b29fbfd7c1.slice/crio-b8eb8f5d15de721bb4a589aa02abe03be1c5514406c98621269c6f920a1cc278 WatchSource:0}: Error finding container b8eb8f5d15de721bb4a589aa02abe03be1c5514406c98621269c6f920a1cc278: Status 404 returned error can't find the container with id b8eb8f5d15de721bb4a589aa02abe03be1c5514406c98621269c6f920a1cc278 Jul 06 14:09:17.418014 ip-10-0-138-163 kubenswrapper[2573]: I0706 14:09:17.417997 2573 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 06 14:09:18.290447 ip-10-0-138-163 kubenswrapper[2573]: I0706 14:09:18.290408 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-b-7e06f0-7dcf989869-g8d4g" event={"ID":"d992b78c-842b-4207-bc1c-b9b29fbfd7c1","Type":"ContainerStarted","Data":"b8eb8f5d15de721bb4a589aa02abe03be1c5514406c98621269c6f920a1cc278"} Jul 06 14:09:20.301923 ip-10-0-138-163 kubenswrapper[2573]: I0706 14:09:20.301888 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-b-7e06f0-7dcf989869-g8d4g" event={"ID":"d992b78c-842b-4207-bc1c-b9b29fbfd7c1","Type":"ContainerStarted","Data":"e049d3afe8d8875833516db8fa9338e594af7175476f0e7f5e0d89e6ce0c5be8"} Jul 06 14:09:20.302336 ip-10-0-138-163 kubenswrapper[2573]: I0706 14:09:20.301959 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-inf-b-7e06f0-7dcf989869-g8d4g" Jul 06 14:09:20.323290 ip-10-0-138-163 kubenswrapper[2573]: I0706 14:09:20.323245 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-inf-b-7e06f0-7dcf989869-g8d4g" podStartSLOduration=2.168475236 podStartE2EDuration="4.323228817s" totalImagesPullingTime="2.154753581s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:09:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:09:20.321516523 +0000 UTC m=+1777.698115483" watchObservedRunningTime="2026-07-06 14:09:20.323228817 +0000 UTC m=+1777.699827777" Jul 06 14:09:26.312170 ip-10-0-138-163 kubenswrapper[2573]: I0706 14:09:26.312135 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-inf-b-7e06f0-7dcf989869-g8d4g" Jul 06 14:09:43.161930 ip-10-0-138-163 kubenswrapper[2573]: I0706 14:09:43.161900 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-z2f98_66e76252-8877-403e-9c30-e56ec0013c24/console-operator/1.log" Jul 06 14:09:43.163191 ip-10-0-138-163 kubenswrapper[2573]: I0706 14:09:43.163170 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-z2f98_66e76252-8877-403e-9c30-e56ec0013c24/console-operator/1.log" Jul 06 14:11:02.505252 ip-10-0-138-163 kubenswrapper[2573]: I0706 14:11:02.505220 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-inf-b-7e06f0-7dcf989869-g8d4g"] Jul 06 14:11:02.505863 ip-10-0-138-163 kubenswrapper[2573]: I0706 14:11:02.505441 2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-inf-b-7e06f0-7dcf989869-g8d4g" podUID="d992b78c-842b-4207-bc1c-b9b29fbfd7c1" containerName="maas-api" containerID="cri-o://e049d3afe8d8875833516db8fa9338e594af7175476f0e7f5e0d89e6ce0c5be8" gracePeriod=30 Jul 06 14:11:03.749505 ip-10-0-138-163 kubenswrapper[2573]: I0706 14:11:03.749477 2573 generic.go:356] "Generic (PLEG): container finished" podID="d992b78c-842b-4207-bc1c-b9b29fbfd7c1" containerID="e049d3afe8d8875833516db8fa9338e594af7175476f0e7f5e0d89e6ce0c5be8" exitCode=0 Jul 06 14:11:03.749813 ip-10-0-138-163 kubenswrapper[2573]: I0706 14:11:03.749553 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-b-7e06f0-7dcf989869-g8d4g" event={"ID":"d992b78c-842b-4207-bc1c-b9b29fbfd7c1","Type":"ContainerDied","Data":"e049d3afe8d8875833516db8fa9338e594af7175476f0e7f5e0d89e6ce0c5be8"} Jul 06 14:11:03.749813 ip-10-0-138-163 kubenswrapper[2573]: I0706 14:11:03.749600 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-b-7e06f0-7dcf989869-g8d4g" event={"ID":"d992b78c-842b-4207-bc1c-b9b29fbfd7c1","Type":"ContainerDied","Data":"b8eb8f5d15de721bb4a589aa02abe03be1c5514406c98621269c6f920a1cc278"} Jul 06 14:11:03.749813 ip-10-0-138-163 kubenswrapper[2573]: I0706 14:11:03.749616 2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b8eb8f5d15de721bb4a589aa02abe03be1c5514406c98621269c6f920a1cc278" Jul 06 14:11:03.755499 ip-10-0-138-163 kubenswrapper[2573]: I0706 14:11:03.755478 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-b-7e06f0-7dcf989869-g8d4g" Jul 06 14:11:03.822327 ip-10-0-138-163 kubenswrapper[2573]: I0706 14:11:03.822254 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g67s9\" (UniqueName: \"kubernetes.io/projected/d992b78c-842b-4207-bc1c-b9b29fbfd7c1-kube-api-access-g67s9\") pod \"d992b78c-842b-4207-bc1c-b9b29fbfd7c1\" (UID: \"d992b78c-842b-4207-bc1c-b9b29fbfd7c1\") " Jul 06 14:11:03.822327 ip-10-0-138-163 kubenswrapper[2573]: I0706 14:11:03.822307 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d992b78c-842b-4207-bc1c-b9b29fbfd7c1-maas-api-tls\") pod \"d992b78c-842b-4207-bc1c-b9b29fbfd7c1\" (UID: \"d992b78c-842b-4207-bc1c-b9b29fbfd7c1\") " Jul 06 14:11:03.822500 ip-10-0-138-163 kubenswrapper[2573]: I0706 14:11:03.822346 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d992b78c-842b-4207-bc1c-b9b29fbfd7c1-openshift-service-ca\") pod \"d992b78c-842b-4207-bc1c-b9b29fbfd7c1\" (UID: \"d992b78c-842b-4207-bc1c-b9b29fbfd7c1\") " Jul 06 14:11:03.822718 ip-10-0-138-163 kubenswrapper[2573]: I0706 14:11:03.822688 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d992b78c-842b-4207-bc1c-b9b29fbfd7c1-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "d992b78c-842b-4207-bc1c-b9b29fbfd7c1" (UID: "d992b78c-842b-4207-bc1c-b9b29fbfd7c1"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 14:11:03.824507 ip-10-0-138-163 kubenswrapper[2573]: I0706 14:11:03.824482 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d992b78c-842b-4207-bc1c-b9b29fbfd7c1-kube-api-access-g67s9" (OuterVolumeSpecName: "kube-api-access-g67s9") pod "d992b78c-842b-4207-bc1c-b9b29fbfd7c1" (UID: "d992b78c-842b-4207-bc1c-b9b29fbfd7c1"). InnerVolumeSpecName "kube-api-access-g67s9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 14:11:03.824595 ip-10-0-138-163 kubenswrapper[2573]: I0706 14:11:03.824501 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d992b78c-842b-4207-bc1c-b9b29fbfd7c1-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "d992b78c-842b-4207-bc1c-b9b29fbfd7c1" (UID: "d992b78c-842b-4207-bc1c-b9b29fbfd7c1"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 14:11:03.923121 ip-10-0-138-163 kubenswrapper[2573]: I0706 14:11:03.923091 2573 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d992b78c-842b-4207-bc1c-b9b29fbfd7c1-openshift-service-ca\") on node \"ip-10-0-138-163.ec2.internal\" DevicePath \"\"" Jul 06 14:11:03.923121 ip-10-0-138-163 kubenswrapper[2573]: I0706 14:11:03.923115 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g67s9\" (UniqueName: \"kubernetes.io/projected/d992b78c-842b-4207-bc1c-b9b29fbfd7c1-kube-api-access-g67s9\") on node \"ip-10-0-138-163.ec2.internal\" DevicePath \"\"" Jul 06 14:11:03.923121 ip-10-0-138-163 kubenswrapper[2573]: I0706 14:11:03.923125 2573 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d992b78c-842b-4207-bc1c-b9b29fbfd7c1-maas-api-tls\") on node \"ip-10-0-138-163.ec2.internal\" DevicePath \"\"" Jul 06 14:11:04.754239 ip-10-0-138-163 kubenswrapper[2573]: I0706 14:11:04.754166 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-b-7e06f0-7dcf989869-g8d4g" Jul 06 14:11:04.780327 ip-10-0-138-163 kubenswrapper[2573]: I0706 14:11:04.780291 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-inf-b-7e06f0-7dcf989869-g8d4g"] Jul 06 14:11:04.785963 ip-10-0-138-163 kubenswrapper[2573]: I0706 14:11:04.785939 2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-inf-b-7e06f0-7dcf989869-g8d4g"] Jul 06 14:11:05.161364 ip-10-0-138-163 kubenswrapper[2573]: I0706 14:11:05.161280 2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d992b78c-842b-4207-bc1c-b9b29fbfd7c1" path="/var/lib/kubelet/pods/d992b78c-842b-4207-bc1c-b9b29fbfd7c1/volumes" Jul 06 14:11:12.870970 ip-10-0-138-163 kubenswrapper[2573]: I0706 14:11:12.870935 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-api-a-c711a5-56d67d5dd5-82jrx"] Jul 06 14:11:12.871458 ip-10-0-138-163 kubenswrapper[2573]: I0706 14:11:12.871281 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d992b78c-842b-4207-bc1c-b9b29fbfd7c1" containerName="maas-api" Jul 06 14:11:12.871458 ip-10-0-138-163 kubenswrapper[2573]: I0706 14:11:12.871294 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="d992b78c-842b-4207-bc1c-b9b29fbfd7c1" containerName="maas-api" Jul 06 14:11:12.871458 ip-10-0-138-163 kubenswrapper[2573]: I0706 14:11:12.871367 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="d992b78c-842b-4207-bc1c-b9b29fbfd7c1" containerName="maas-api" Jul 06 14:11:12.874473 ip-10-0-138-163 kubenswrapper[2573]: I0706 14:11:12.874458 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-a-c711a5-56d67d5dd5-82jrx" Jul 06 14:11:12.879309 ip-10-0-138-163 kubenswrapper[2573]: I0706 14:11:12.879287 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-hq6cd\"" Jul 06 14:11:12.879729 ip-10-0-138-163 kubenswrapper[2573]: I0706 14:11:12.879713 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-api-a-c711a5-serving-cert\"" Jul 06 14:11:12.903259 ip-10-0-138-163 kubenswrapper[2573]: I0706 14:11:12.903232 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-api-a-c711a5-56d67d5dd5-82jrx"] Jul 06 14:11:13.003425 ip-10-0-138-163 kubenswrapper[2573]: I0706 14:11:13.003390 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0189adf5-e11e-4c05-8288-3a69b885e5aa-openshift-service-ca\") pod \"maas-api-e2e-api-a-c711a5-56d67d5dd5-82jrx\" (UID: \"0189adf5-e11e-4c05-8288-3a69b885e5aa\") " pod="opendatahub/maas-api-e2e-api-a-c711a5-56d67d5dd5-82jrx" Jul 06 14:11:13.003425 ip-10-0-138-163 kubenswrapper[2573]: I0706 14:11:13.003436 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-swznt\" (UniqueName: \"kubernetes.io/projected/0189adf5-e11e-4c05-8288-3a69b885e5aa-kube-api-access-swznt\") pod \"maas-api-e2e-api-a-c711a5-56d67d5dd5-82jrx\" (UID: \"0189adf5-e11e-4c05-8288-3a69b885e5aa\") " pod="opendatahub/maas-api-e2e-api-a-c711a5-56d67d5dd5-82jrx" Jul 06 14:11:13.003646 ip-10-0-138-163 kubenswrapper[2573]: I0706 14:11:13.003473 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0189adf5-e11e-4c05-8288-3a69b885e5aa-maas-api-tls\") pod \"maas-api-e2e-api-a-c711a5-56d67d5dd5-82jrx\" (UID: \"0189adf5-e11e-4c05-8288-3a69b885e5aa\") " pod="opendatahub/maas-api-e2e-api-a-c711a5-56d67d5dd5-82jrx" Jul 06 14:11:13.104874 ip-10-0-138-163 kubenswrapper[2573]: I0706 14:11:13.104837 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0189adf5-e11e-4c05-8288-3a69b885e5aa-openshift-service-ca\") pod \"maas-api-e2e-api-a-c711a5-56d67d5dd5-82jrx\" (UID: \"0189adf5-e11e-4c05-8288-3a69b885e5aa\") " pod="opendatahub/maas-api-e2e-api-a-c711a5-56d67d5dd5-82jrx" Jul 06 14:11:13.105092 ip-10-0-138-163 kubenswrapper[2573]: I0706 14:11:13.104882 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-swznt\" (UniqueName: \"kubernetes.io/projected/0189adf5-e11e-4c05-8288-3a69b885e5aa-kube-api-access-swznt\") pod \"maas-api-e2e-api-a-c711a5-56d67d5dd5-82jrx\" (UID: \"0189adf5-e11e-4c05-8288-3a69b885e5aa\") " pod="opendatahub/maas-api-e2e-api-a-c711a5-56d67d5dd5-82jrx" Jul 06 14:11:13.105092 ip-10-0-138-163 kubenswrapper[2573]: I0706 14:11:13.105013 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0189adf5-e11e-4c05-8288-3a69b885e5aa-maas-api-tls\") pod \"maas-api-e2e-api-a-c711a5-56d67d5dd5-82jrx\" (UID: \"0189adf5-e11e-4c05-8288-3a69b885e5aa\") " pod="opendatahub/maas-api-e2e-api-a-c711a5-56d67d5dd5-82jrx" Jul 06 14:11:13.105582 ip-10-0-138-163 kubenswrapper[2573]: I0706 14:11:13.105555 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0189adf5-e11e-4c05-8288-3a69b885e5aa-openshift-service-ca\") pod \"maas-api-e2e-api-a-c711a5-56d67d5dd5-82jrx\" (UID: \"0189adf5-e11e-4c05-8288-3a69b885e5aa\") " pod="opendatahub/maas-api-e2e-api-a-c711a5-56d67d5dd5-82jrx" Jul 06 14:11:13.107404 ip-10-0-138-163 kubenswrapper[2573]: I0706 14:11:13.107388 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0189adf5-e11e-4c05-8288-3a69b885e5aa-maas-api-tls\") pod \"maas-api-e2e-api-a-c711a5-56d67d5dd5-82jrx\" (UID: \"0189adf5-e11e-4c05-8288-3a69b885e5aa\") " pod="opendatahub/maas-api-e2e-api-a-c711a5-56d67d5dd5-82jrx" Jul 06 14:11:13.118371 ip-10-0-138-163 kubenswrapper[2573]: I0706 14:11:13.118346 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-swznt\" (UniqueName: \"kubernetes.io/projected/0189adf5-e11e-4c05-8288-3a69b885e5aa-kube-api-access-swznt\") pod \"maas-api-e2e-api-a-c711a5-56d67d5dd5-82jrx\" (UID: \"0189adf5-e11e-4c05-8288-3a69b885e5aa\") " pod="opendatahub/maas-api-e2e-api-a-c711a5-56d67d5dd5-82jrx" Jul 06 14:11:13.184169 ip-10-0-138-163 kubenswrapper[2573]: I0706 14:11:13.184089 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-a-c711a5-56d67d5dd5-82jrx" Jul 06 14:11:13.348618 ip-10-0-138-163 kubenswrapper[2573]: I0706 14:11:13.348587 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-api-a-c711a5-56d67d5dd5-82jrx"] Jul 06 14:11:13.349906 ip-10-0-138-163 kubenswrapper[2573]: W0706 14:11:13.349881 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0189adf5_e11e_4c05_8288_3a69b885e5aa.slice/crio-45c21cb3bd62156e3eb3c49154fe78da6df4fbe106cd45e8251d42d057680177 WatchSource:0}: Error finding container 45c21cb3bd62156e3eb3c49154fe78da6df4fbe106cd45e8251d42d057680177: Status 404 returned error can't find the container with id 45c21cb3bd62156e3eb3c49154fe78da6df4fbe106cd45e8251d42d057680177 Jul 06 14:11:13.793543 ip-10-0-138-163 kubenswrapper[2573]: I0706 14:11:13.793508 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-a-c711a5-56d67d5dd5-82jrx" event={"ID":"0189adf5-e11e-4c05-8288-3a69b885e5aa","Type":"ContainerStarted","Data":"45c21cb3bd62156e3eb3c49154fe78da6df4fbe106cd45e8251d42d057680177"} Jul 06 14:11:14.798576 ip-10-0-138-163 kubenswrapper[2573]: I0706 14:11:14.798542 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-a-c711a5-56d67d5dd5-82jrx" event={"ID":"0189adf5-e11e-4c05-8288-3a69b885e5aa","Type":"ContainerStarted","Data":"145e021f8274b12693413c44804fe9700d85135d620083d10b2e1610ed40e479"} Jul 06 14:11:14.798966 ip-10-0-138-163 kubenswrapper[2573]: I0706 14:11:14.798663 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-api-a-c711a5-56d67d5dd5-82jrx" Jul 06 14:11:14.825139 ip-10-0-138-163 kubenswrapper[2573]: I0706 14:11:14.825088 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-api-a-c711a5-56d67d5dd5-82jrx" podStartSLOduration=2.437640837 podStartE2EDuration="2.825071629s" totalImagesPullingTime="387.430792ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:11:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:11:14.824954914 +0000 UTC m=+1892.201553873" watchObservedRunningTime="2026-07-06 14:11:14.825071629 +0000 UTC m=+1892.201670623" Jul 06 14:11:20.660526 ip-10-0-138-163 kubenswrapper[2573]: I0706 14:11:20.660496 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-api-b-d5c8cc-696577476-fqg26"] Jul 06 14:11:20.664258 ip-10-0-138-163 kubenswrapper[2573]: I0706 14:11:20.664239 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-b-d5c8cc-696577476-fqg26" Jul 06 14:11:20.666700 ip-10-0-138-163 kubenswrapper[2573]: I0706 14:11:20.666669 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-api-b-d5c8cc-serving-cert\"" Jul 06 14:11:20.673549 ip-10-0-138-163 kubenswrapper[2573]: I0706 14:11:20.673529 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-api-b-d5c8cc-696577476-fqg26"] Jul 06 14:11:20.776156 ip-10-0-138-163 kubenswrapper[2573]: I0706 14:11:20.776123 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1668efb8-8f01-4358-98d9-85f3e169d891-openshift-service-ca\") pod \"maas-api-e2e-api-b-d5c8cc-696577476-fqg26\" (UID: \"1668efb8-8f01-4358-98d9-85f3e169d891\") " pod="opendatahub/maas-api-e2e-api-b-d5c8cc-696577476-fqg26" Jul 06 14:11:20.776156 ip-10-0-138-163 kubenswrapper[2573]: I0706 14:11:20.776159 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wwnwk\" (UniqueName: \"kubernetes.io/projected/1668efb8-8f01-4358-98d9-85f3e169d891-kube-api-access-wwnwk\") pod \"maas-api-e2e-api-b-d5c8cc-696577476-fqg26\" (UID: \"1668efb8-8f01-4358-98d9-85f3e169d891\") " pod="opendatahub/maas-api-e2e-api-b-d5c8cc-696577476-fqg26" Jul 06 14:11:20.776343 ip-10-0-138-163 kubenswrapper[2573]: I0706 14:11:20.776259 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1668efb8-8f01-4358-98d9-85f3e169d891-maas-api-tls\") pod \"maas-api-e2e-api-b-d5c8cc-696577476-fqg26\" (UID: \"1668efb8-8f01-4358-98d9-85f3e169d891\") " pod="opendatahub/maas-api-e2e-api-b-d5c8cc-696577476-fqg26" Jul 06 14:11:20.809206 ip-10-0-138-163 kubenswrapper[2573]: I0706 14:11:20.809177 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-api-a-c711a5-56d67d5dd5-82jrx" Jul 06 14:11:20.877868 ip-10-0-138-163 kubenswrapper[2573]: I0706 14:11:20.877835 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1668efb8-8f01-4358-98d9-85f3e169d891-maas-api-tls\") pod \"maas-api-e2e-api-b-d5c8cc-696577476-fqg26\" (UID: \"1668efb8-8f01-4358-98d9-85f3e169d891\") " pod="opendatahub/maas-api-e2e-api-b-d5c8cc-696577476-fqg26" Jul 06 14:11:20.878081 ip-10-0-138-163 kubenswrapper[2573]: I0706 14:11:20.877909 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1668efb8-8f01-4358-98d9-85f3e169d891-openshift-service-ca\") pod \"maas-api-e2e-api-b-d5c8cc-696577476-fqg26\" (UID: \"1668efb8-8f01-4358-98d9-85f3e169d891\") " pod="opendatahub/maas-api-e2e-api-b-d5c8cc-696577476-fqg26" Jul 06 14:11:20.878081 ip-10-0-138-163 kubenswrapper[2573]: I0706 14:11:20.877947 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wwnwk\" (UniqueName: \"kubernetes.io/projected/1668efb8-8f01-4358-98d9-85f3e169d891-kube-api-access-wwnwk\") pod \"maas-api-e2e-api-b-d5c8cc-696577476-fqg26\" (UID: \"1668efb8-8f01-4358-98d9-85f3e169d891\") " pod="opendatahub/maas-api-e2e-api-b-d5c8cc-696577476-fqg26" Jul 06 14:11:20.878081 ip-10-0-138-163 kubenswrapper[2573]: E0706 14:11:20.878007 2573 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-api-b-d5c8cc-serving-cert: secret "maas-api-e2e-api-b-d5c8cc-serving-cert" not found Jul 06 14:11:20.878300 ip-10-0-138-163 kubenswrapper[2573]: E0706 14:11:20.878118 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1668efb8-8f01-4358-98d9-85f3e169d891-maas-api-tls podName:1668efb8-8f01-4358-98d9-85f3e169d891 nodeName:}" failed. No retries permitted until 2026-07-06 14:11:21.378098196 +0000 UTC m=+1898.754697151 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/1668efb8-8f01-4358-98d9-85f3e169d891-maas-api-tls") pod "maas-api-e2e-api-b-d5c8cc-696577476-fqg26" (UID: "1668efb8-8f01-4358-98d9-85f3e169d891") : secret "maas-api-e2e-api-b-d5c8cc-serving-cert" not found Jul 06 14:11:20.878775 ip-10-0-138-163 kubenswrapper[2573]: I0706 14:11:20.878750 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1668efb8-8f01-4358-98d9-85f3e169d891-openshift-service-ca\") pod \"maas-api-e2e-api-b-d5c8cc-696577476-fqg26\" (UID: \"1668efb8-8f01-4358-98d9-85f3e169d891\") " pod="opendatahub/maas-api-e2e-api-b-d5c8cc-696577476-fqg26" Jul 06 14:11:20.894577 ip-10-0-138-163 kubenswrapper[2573]: I0706 14:11:20.894550 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wwnwk\" (UniqueName: \"kubernetes.io/projected/1668efb8-8f01-4358-98d9-85f3e169d891-kube-api-access-wwnwk\") pod \"maas-api-e2e-api-b-d5c8cc-696577476-fqg26\" (UID: \"1668efb8-8f01-4358-98d9-85f3e169d891\") " pod="opendatahub/maas-api-e2e-api-b-d5c8cc-696577476-fqg26" Jul 06 14:11:21.383651 ip-10-0-138-163 kubenswrapper[2573]: I0706 14:11:21.383617 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1668efb8-8f01-4358-98d9-85f3e169d891-maas-api-tls\") pod \"maas-api-e2e-api-b-d5c8cc-696577476-fqg26\" (UID: \"1668efb8-8f01-4358-98d9-85f3e169d891\") " pod="opendatahub/maas-api-e2e-api-b-d5c8cc-696577476-fqg26" Jul 06 14:11:21.385935 ip-10-0-138-163 kubenswrapper[2573]: I0706 14:11:21.385911 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1668efb8-8f01-4358-98d9-85f3e169d891-maas-api-tls\") pod \"maas-api-e2e-api-b-d5c8cc-696577476-fqg26\" (UID: \"1668efb8-8f01-4358-98d9-85f3e169d891\") " pod="opendatahub/maas-api-e2e-api-b-d5c8cc-696577476-fqg26" Jul 06 14:11:21.575805 ip-10-0-138-163 kubenswrapper[2573]: I0706 14:11:21.575772 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-b-d5c8cc-696577476-fqg26" Jul 06 14:11:21.709867 ip-10-0-138-163 kubenswrapper[2573]: I0706 14:11:21.709836 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-api-b-d5c8cc-696577476-fqg26"] Jul 06 14:11:21.712849 ip-10-0-138-163 kubenswrapper[2573]: W0706 14:11:21.712825 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1668efb8_8f01_4358_98d9_85f3e169d891.slice/crio-a6faff147ec5b86773d63feaf80bb433166d831d0aef96c8ec1239fd4e5eaab3 WatchSource:0}: Error finding container a6faff147ec5b86773d63feaf80bb433166d831d0aef96c8ec1239fd4e5eaab3: Status 404 returned error can't find the container with id a6faff147ec5b86773d63feaf80bb433166d831d0aef96c8ec1239fd4e5eaab3 Jul 06 14:11:21.830940 ip-10-0-138-163 kubenswrapper[2573]: I0706 14:11:21.830906 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-b-d5c8cc-696577476-fqg26" event={"ID":"1668efb8-8f01-4358-98d9-85f3e169d891","Type":"ContainerStarted","Data":"a6faff147ec5b86773d63feaf80bb433166d831d0aef96c8ec1239fd4e5eaab3"} Jul 06 14:11:22.841916 ip-10-0-138-163 kubenswrapper[2573]: I0706 14:11:22.841882 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-b-d5c8cc-696577476-fqg26" event={"ID":"1668efb8-8f01-4358-98d9-85f3e169d891","Type":"ContainerStarted","Data":"1ebb8f186093ebfcbd424a5a524f4eee04c450312cd21b7a237edff2e0c9af6e"} Jul 06 14:11:22.842365 ip-10-0-138-163 kubenswrapper[2573]: I0706 14:11:22.841983 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-api-b-d5c8cc-696577476-fqg26" Jul 06 14:11:22.864291 ip-10-0-138-163 kubenswrapper[2573]: I0706 14:11:22.864228 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-api-b-d5c8cc-696577476-fqg26" podStartSLOduration=2.424810832 podStartE2EDuration="2.864210559s" totalImagesPullingTime="439.399727ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:11:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:11:22.862778674 +0000 UTC m=+1900.239377635" watchObservedRunningTime="2026-07-06 14:11:22.864210559 +0000 UTC m=+1900.240809523" Jul 06 14:11:28.852489 ip-10-0-138-163 kubenswrapper[2573]: I0706 14:11:28.852457 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-api-b-d5c8cc-696577476-fqg26" Jul 06 14:11:33.913060 ip-10-0-138-163 kubenswrapper[2573]: I0706 14:11:33.911225 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-api-a-c711a5-56d67d5dd5-82jrx"] Jul 06 14:11:33.913060 ip-10-0-138-163 kubenswrapper[2573]: I0706 14:11:33.911538 2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-api-a-c711a5-56d67d5dd5-82jrx" podUID="0189adf5-e11e-4c05-8288-3a69b885e5aa" containerName="maas-api" containerID="cri-o://145e021f8274b12693413c44804fe9700d85135d620083d10b2e1610ed40e479" gracePeriod=30 Jul 06 14:11:34.156333 ip-10-0-138-163 kubenswrapper[2573]: I0706 14:11:34.156313 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-a-c711a5-56d67d5dd5-82jrx" Jul 06 14:11:34.182078 ip-10-0-138-163 kubenswrapper[2573]: I0706 14:11:34.181995 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0189adf5-e11e-4c05-8288-3a69b885e5aa-openshift-service-ca\") pod \"0189adf5-e11e-4c05-8288-3a69b885e5aa\" (UID: \"0189adf5-e11e-4c05-8288-3a69b885e5aa\") " Jul 06 14:11:34.182078 ip-10-0-138-163 kubenswrapper[2573]: I0706 14:11:34.182055 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0189adf5-e11e-4c05-8288-3a69b885e5aa-maas-api-tls\") pod \"0189adf5-e11e-4c05-8288-3a69b885e5aa\" (UID: \"0189adf5-e11e-4c05-8288-3a69b885e5aa\") " Jul 06 14:11:34.182273 ip-10-0-138-163 kubenswrapper[2573]: I0706 14:11:34.182088 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-swznt\" (UniqueName: \"kubernetes.io/projected/0189adf5-e11e-4c05-8288-3a69b885e5aa-kube-api-access-swznt\") pod \"0189adf5-e11e-4c05-8288-3a69b885e5aa\" (UID: \"0189adf5-e11e-4c05-8288-3a69b885e5aa\") " Jul 06 14:11:34.182375 ip-10-0-138-163 kubenswrapper[2573]: I0706 14:11:34.182338 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0189adf5-e11e-4c05-8288-3a69b885e5aa-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "0189adf5-e11e-4c05-8288-3a69b885e5aa" (UID: "0189adf5-e11e-4c05-8288-3a69b885e5aa"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 14:11:34.184115 ip-10-0-138-163 kubenswrapper[2573]: I0706 14:11:34.184091 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0189adf5-e11e-4c05-8288-3a69b885e5aa-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "0189adf5-e11e-4c05-8288-3a69b885e5aa" (UID: "0189adf5-e11e-4c05-8288-3a69b885e5aa"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 14:11:34.184215 ip-10-0-138-163 kubenswrapper[2573]: I0706 14:11:34.184128 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0189adf5-e11e-4c05-8288-3a69b885e5aa-kube-api-access-swznt" (OuterVolumeSpecName: "kube-api-access-swznt") pod "0189adf5-e11e-4c05-8288-3a69b885e5aa" (UID: "0189adf5-e11e-4c05-8288-3a69b885e5aa"). InnerVolumeSpecName "kube-api-access-swznt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 14:11:34.282722 ip-10-0-138-163 kubenswrapper[2573]: I0706 14:11:34.282693 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-swznt\" (UniqueName: \"kubernetes.io/projected/0189adf5-e11e-4c05-8288-3a69b885e5aa-kube-api-access-swznt\") on node \"ip-10-0-138-163.ec2.internal\" DevicePath \"\"" Jul 06 14:11:34.282722 ip-10-0-138-163 kubenswrapper[2573]: I0706 14:11:34.282718 2573 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0189adf5-e11e-4c05-8288-3a69b885e5aa-openshift-service-ca\") on node \"ip-10-0-138-163.ec2.internal\" DevicePath \"\"" Jul 06 14:11:34.282722 ip-10-0-138-163 kubenswrapper[2573]: I0706 14:11:34.282727 2573 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0189adf5-e11e-4c05-8288-3a69b885e5aa-maas-api-tls\") on node \"ip-10-0-138-163.ec2.internal\" DevicePath \"\"" Jul 06 14:11:34.897477 ip-10-0-138-163 kubenswrapper[2573]: I0706 14:11:34.897440 2573 generic.go:356] "Generic (PLEG): container finished" podID="0189adf5-e11e-4c05-8288-3a69b885e5aa" containerID="145e021f8274b12693413c44804fe9700d85135d620083d10b2e1610ed40e479" exitCode=0 Jul 06 14:11:34.897645 ip-10-0-138-163 kubenswrapper[2573]: I0706 14:11:34.897488 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-a-c711a5-56d67d5dd5-82jrx" Jul 06 14:11:34.897645 ip-10-0-138-163 kubenswrapper[2573]: I0706 14:11:34.897524 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-a-c711a5-56d67d5dd5-82jrx" event={"ID":"0189adf5-e11e-4c05-8288-3a69b885e5aa","Type":"ContainerDied","Data":"145e021f8274b12693413c44804fe9700d85135d620083d10b2e1610ed40e479"} Jul 06 14:11:34.897645 ip-10-0-138-163 kubenswrapper[2573]: I0706 14:11:34.897579 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-a-c711a5-56d67d5dd5-82jrx" event={"ID":"0189adf5-e11e-4c05-8288-3a69b885e5aa","Type":"ContainerDied","Data":"45c21cb3bd62156e3eb3c49154fe78da6df4fbe106cd45e8251d42d057680177"} Jul 06 14:11:34.897645 ip-10-0-138-163 kubenswrapper[2573]: I0706 14:11:34.897602 2573 scope.go:117] "RemoveContainer" containerID="145e021f8274b12693413c44804fe9700d85135d620083d10b2e1610ed40e479" Jul 06 14:11:34.905979 ip-10-0-138-163 kubenswrapper[2573]: I0706 14:11:34.905964 2573 scope.go:117] "RemoveContainer" containerID="145e021f8274b12693413c44804fe9700d85135d620083d10b2e1610ed40e479" Jul 06 14:11:34.906233 ip-10-0-138-163 kubenswrapper[2573]: E0706 14:11:34.906215 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"145e021f8274b12693413c44804fe9700d85135d620083d10b2e1610ed40e479\": container with ID starting with 145e021f8274b12693413c44804fe9700d85135d620083d10b2e1610ed40e479 not found: ID does not exist" containerID="145e021f8274b12693413c44804fe9700d85135d620083d10b2e1610ed40e479" Jul 06 14:11:34.906289 ip-10-0-138-163 kubenswrapper[2573]: I0706 14:11:34.906240 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"145e021f8274b12693413c44804fe9700d85135d620083d10b2e1610ed40e479"} err="failed to get container status \"145e021f8274b12693413c44804fe9700d85135d620083d10b2e1610ed40e479\": rpc error: code = NotFound desc = could not find container \"145e021f8274b12693413c44804fe9700d85135d620083d10b2e1610ed40e479\": container with ID starting with 145e021f8274b12693413c44804fe9700d85135d620083d10b2e1610ed40e479 not found: ID does not exist" Jul 06 14:11:34.930116 ip-10-0-138-163 kubenswrapper[2573]: I0706 14:11:34.930090 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-api-a-c711a5-56d67d5dd5-82jrx"] Jul 06 14:11:34.939844 ip-10-0-138-163 kubenswrapper[2573]: I0706 14:11:34.939819 2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-api-a-c711a5-56d67d5dd5-82jrx"] Jul 06 14:11:35.161558 ip-10-0-138-163 kubenswrapper[2573]: I0706 14:11:35.161490 2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0189adf5-e11e-4c05-8288-3a69b885e5aa" path="/var/lib/kubelet/pods/0189adf5-e11e-4c05-8288-3a69b885e5aa/volumes" Jul 06 14:11:41.554771 ip-10-0-138-163 kubenswrapper[2573]: I0706 14:11:41.554735 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-api-b-d5c8cc-696577476-fqg26"] Jul 06 14:11:41.555247 ip-10-0-138-163 kubenswrapper[2573]: I0706 14:11:41.554976 2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-api-b-d5c8cc-696577476-fqg26" podUID="1668efb8-8f01-4358-98d9-85f3e169d891" containerName="maas-api" containerID="cri-o://1ebb8f186093ebfcbd424a5a524f4eee04c450312cd21b7a237edff2e0c9af6e" gracePeriod=30 Jul 06 14:11:41.804623 ip-10-0-138-163 kubenswrapper[2573]: I0706 14:11:41.804596 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-b-d5c8cc-696577476-fqg26" Jul 06 14:11:41.848851 ip-10-0-138-163 kubenswrapper[2573]: I0706 14:11:41.848778 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1668efb8-8f01-4358-98d9-85f3e169d891-openshift-service-ca\") pod \"1668efb8-8f01-4358-98d9-85f3e169d891\" (UID: \"1668efb8-8f01-4358-98d9-85f3e169d891\") " Jul 06 14:11:41.848851 ip-10-0-138-163 kubenswrapper[2573]: I0706 14:11:41.848832 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wwnwk\" (UniqueName: \"kubernetes.io/projected/1668efb8-8f01-4358-98d9-85f3e169d891-kube-api-access-wwnwk\") pod \"1668efb8-8f01-4358-98d9-85f3e169d891\" (UID: \"1668efb8-8f01-4358-98d9-85f3e169d891\") " Jul 06 14:11:41.849024 ip-10-0-138-163 kubenswrapper[2573]: I0706 14:11:41.848888 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1668efb8-8f01-4358-98d9-85f3e169d891-maas-api-tls\") pod \"1668efb8-8f01-4358-98d9-85f3e169d891\" (UID: \"1668efb8-8f01-4358-98d9-85f3e169d891\") " Jul 06 14:11:41.849244 ip-10-0-138-163 kubenswrapper[2573]: I0706 14:11:41.849214 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1668efb8-8f01-4358-98d9-85f3e169d891-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "1668efb8-8f01-4358-98d9-85f3e169d891" (UID: "1668efb8-8f01-4358-98d9-85f3e169d891"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 14:11:41.850862 ip-10-0-138-163 kubenswrapper[2573]: I0706 14:11:41.850838 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1668efb8-8f01-4358-98d9-85f3e169d891-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "1668efb8-8f01-4358-98d9-85f3e169d891" (UID: "1668efb8-8f01-4358-98d9-85f3e169d891"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 14:11:41.850990 ip-10-0-138-163 kubenswrapper[2573]: I0706 14:11:41.850900 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1668efb8-8f01-4358-98d9-85f3e169d891-kube-api-access-wwnwk" (OuterVolumeSpecName: "kube-api-access-wwnwk") pod "1668efb8-8f01-4358-98d9-85f3e169d891" (UID: "1668efb8-8f01-4358-98d9-85f3e169d891"). InnerVolumeSpecName "kube-api-access-wwnwk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 14:11:41.929909 ip-10-0-138-163 kubenswrapper[2573]: I0706 14:11:41.929878 2573 generic.go:356] "Generic (PLEG): container finished" podID="1668efb8-8f01-4358-98d9-85f3e169d891" containerID="1ebb8f186093ebfcbd424a5a524f4eee04c450312cd21b7a237edff2e0c9af6e" exitCode=0 Jul 06 14:11:41.930077 ip-10-0-138-163 kubenswrapper[2573]: I0706 14:11:41.929920 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-b-d5c8cc-696577476-fqg26" Jul 06 14:11:41.930077 ip-10-0-138-163 kubenswrapper[2573]: I0706 14:11:41.929931 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-b-d5c8cc-696577476-fqg26" event={"ID":"1668efb8-8f01-4358-98d9-85f3e169d891","Type":"ContainerDied","Data":"1ebb8f186093ebfcbd424a5a524f4eee04c450312cd21b7a237edff2e0c9af6e"} Jul 06 14:11:41.930077 ip-10-0-138-163 kubenswrapper[2573]: I0706 14:11:41.929978 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-b-d5c8cc-696577476-fqg26" event={"ID":"1668efb8-8f01-4358-98d9-85f3e169d891","Type":"ContainerDied","Data":"a6faff147ec5b86773d63feaf80bb433166d831d0aef96c8ec1239fd4e5eaab3"} Jul 06 14:11:41.930077 ip-10-0-138-163 kubenswrapper[2573]: I0706 14:11:41.930001 2573 scope.go:117] "RemoveContainer" containerID="1ebb8f186093ebfcbd424a5a524f4eee04c450312cd21b7a237edff2e0c9af6e" Jul 06 14:11:41.938270 ip-10-0-138-163 kubenswrapper[2573]: I0706 14:11:41.938253 2573 scope.go:117] "RemoveContainer" containerID="1ebb8f186093ebfcbd424a5a524f4eee04c450312cd21b7a237edff2e0c9af6e" Jul 06 14:11:41.938527 ip-10-0-138-163 kubenswrapper[2573]: E0706 14:11:41.938501 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1ebb8f186093ebfcbd424a5a524f4eee04c450312cd21b7a237edff2e0c9af6e\": container with ID starting with 1ebb8f186093ebfcbd424a5a524f4eee04c450312cd21b7a237edff2e0c9af6e not found: ID does not exist" containerID="1ebb8f186093ebfcbd424a5a524f4eee04c450312cd21b7a237edff2e0c9af6e" Jul 06 14:11:41.938577 ip-10-0-138-163 kubenswrapper[2573]: I0706 14:11:41.938539 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1ebb8f186093ebfcbd424a5a524f4eee04c450312cd21b7a237edff2e0c9af6e"} err="failed to get container status \"1ebb8f186093ebfcbd424a5a524f4eee04c450312cd21b7a237edff2e0c9af6e\": rpc error: code = NotFound desc = could not find container \"1ebb8f186093ebfcbd424a5a524f4eee04c450312cd21b7a237edff2e0c9af6e\": container with ID starting with 1ebb8f186093ebfcbd424a5a524f4eee04c450312cd21b7a237edff2e0c9af6e not found: ID does not exist" Jul 06 14:11:41.950472 ip-10-0-138-163 kubenswrapper[2573]: I0706 14:11:41.950446 2573 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1668efb8-8f01-4358-98d9-85f3e169d891-openshift-service-ca\") on node \"ip-10-0-138-163.ec2.internal\" DevicePath \"\"" Jul 06 14:11:41.950472 ip-10-0-138-163 kubenswrapper[2573]: I0706 14:11:41.950472 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wwnwk\" (UniqueName: \"kubernetes.io/projected/1668efb8-8f01-4358-98d9-85f3e169d891-kube-api-access-wwnwk\") on node \"ip-10-0-138-163.ec2.internal\" DevicePath \"\"" Jul 06 14:11:41.950612 ip-10-0-138-163 kubenswrapper[2573]: I0706 14:11:41.950482 2573 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1668efb8-8f01-4358-98d9-85f3e169d891-maas-api-tls\") on node \"ip-10-0-138-163.ec2.internal\" DevicePath \"\"" Jul 06 14:11:41.953474 ip-10-0-138-163 kubenswrapper[2573]: I0706 14:11:41.953450 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-api-b-d5c8cc-696577476-fqg26"] Jul 06 14:11:41.957558 ip-10-0-138-163 kubenswrapper[2573]: I0706 14:11:41.957538 2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-api-b-d5c8cc-696577476-fqg26"] Jul 06 14:11:43.163136 ip-10-0-138-163 kubenswrapper[2573]: I0706 14:11:43.163103 2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1668efb8-8f01-4358-98d9-85f3e169d891" path="/var/lib/kubelet/pods/1668efb8-8f01-4358-98d9-85f3e169d891/volumes" Jul 06 14:11:51.898518 ip-10-0-138-163 kubenswrapper[2573]: I0706 14:11:51.898470 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-shared-a-973328-78b795cf54-495nw"] Jul 06 14:11:51.899769 ip-10-0-138-163 kubenswrapper[2573]: I0706 14:11:51.899743 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1668efb8-8f01-4358-98d9-85f3e169d891" containerName="maas-api" Jul 06 14:11:51.899893 ip-10-0-138-163 kubenswrapper[2573]: I0706 14:11:51.899882 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="1668efb8-8f01-4358-98d9-85f3e169d891" containerName="maas-api" Jul 06 14:11:51.899989 ip-10-0-138-163 kubenswrapper[2573]: I0706 14:11:51.899979 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0189adf5-e11e-4c05-8288-3a69b885e5aa" containerName="maas-api" Jul 06 14:11:51.900123 ip-10-0-138-163 kubenswrapper[2573]: I0706 14:11:51.900112 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="0189adf5-e11e-4c05-8288-3a69b885e5aa" containerName="maas-api" Jul 06 14:11:51.900371 ip-10-0-138-163 kubenswrapper[2573]: I0706 14:11:51.900359 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="0189adf5-e11e-4c05-8288-3a69b885e5aa" containerName="maas-api" Jul 06 14:11:51.900473 ip-10-0-138-163 kubenswrapper[2573]: I0706 14:11:51.900463 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="1668efb8-8f01-4358-98d9-85f3e169d891" containerName="maas-api" Jul 06 14:11:51.904498 ip-10-0-138-163 kubenswrapper[2573]: I0706 14:11:51.904473 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-a-973328-78b795cf54-495nw" Jul 06 14:11:51.907082 ip-10-0-138-163 kubenswrapper[2573]: I0706 14:11:51.907059 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-shared-a-973328-serving-cert\"" Jul 06 14:11:51.907166 ip-10-0-138-163 kubenswrapper[2573]: I0706 14:11:51.907148 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-hq6cd\"" Jul 06 14:11:51.910778 ip-10-0-138-163 kubenswrapper[2573]: I0706 14:11:51.910747 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-shared-a-973328-78b795cf54-495nw"] Jul 06 14:11:52.038537 ip-10-0-138-163 kubenswrapper[2573]: I0706 14:11:52.038506 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/aa42a99c-b4c2-428f-ad1f-df1310ed2e71-maas-api-tls\") pod \"maas-api-e2e-shared-a-973328-78b795cf54-495nw\" (UID: \"aa42a99c-b4c2-428f-ad1f-df1310ed2e71\") " pod="opendatahub/maas-api-e2e-shared-a-973328-78b795cf54-495nw" Jul 06 14:11:52.038734 ip-10-0-138-163 kubenswrapper[2573]: I0706 14:11:52.038561 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4svmt\" (UniqueName: \"kubernetes.io/projected/aa42a99c-b4c2-428f-ad1f-df1310ed2e71-kube-api-access-4svmt\") pod \"maas-api-e2e-shared-a-973328-78b795cf54-495nw\" (UID: \"aa42a99c-b4c2-428f-ad1f-df1310ed2e71\") " pod="opendatahub/maas-api-e2e-shared-a-973328-78b795cf54-495nw" Jul 06 14:11:52.038734 ip-10-0-138-163 kubenswrapper[2573]: I0706 14:11:52.038591 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/aa42a99c-b4c2-428f-ad1f-df1310ed2e71-openshift-service-ca\") pod \"maas-api-e2e-shared-a-973328-78b795cf54-495nw\" (UID: \"aa42a99c-b4c2-428f-ad1f-df1310ed2e71\") " pod="opendatahub/maas-api-e2e-shared-a-973328-78b795cf54-495nw" Jul 06 14:11:52.139141 ip-10-0-138-163 kubenswrapper[2573]: I0706 14:11:52.139107 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4svmt\" (UniqueName: \"kubernetes.io/projected/aa42a99c-b4c2-428f-ad1f-df1310ed2e71-kube-api-access-4svmt\") pod \"maas-api-e2e-shared-a-973328-78b795cf54-495nw\" (UID: \"aa42a99c-b4c2-428f-ad1f-df1310ed2e71\") " pod="opendatahub/maas-api-e2e-shared-a-973328-78b795cf54-495nw" Jul 06 14:11:52.139323 ip-10-0-138-163 kubenswrapper[2573]: I0706 14:11:52.139168 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/aa42a99c-b4c2-428f-ad1f-df1310ed2e71-openshift-service-ca\") pod \"maas-api-e2e-shared-a-973328-78b795cf54-495nw\" (UID: \"aa42a99c-b4c2-428f-ad1f-df1310ed2e71\") " pod="opendatahub/maas-api-e2e-shared-a-973328-78b795cf54-495nw" Jul 06 14:11:52.139323 ip-10-0-138-163 kubenswrapper[2573]: I0706 14:11:52.139241 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/aa42a99c-b4c2-428f-ad1f-df1310ed2e71-maas-api-tls\") pod \"maas-api-e2e-shared-a-973328-78b795cf54-495nw\" (UID: \"aa42a99c-b4c2-428f-ad1f-df1310ed2e71\") " pod="opendatahub/maas-api-e2e-shared-a-973328-78b795cf54-495nw" Jul 06 14:11:52.139448 ip-10-0-138-163 kubenswrapper[2573]: E0706 14:11:52.139344 2573 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-shared-a-973328-serving-cert: secret "maas-api-e2e-shared-a-973328-serving-cert" not found Jul 06 14:11:52.139448 ip-10-0-138-163 kubenswrapper[2573]: E0706 14:11:52.139425 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aa42a99c-b4c2-428f-ad1f-df1310ed2e71-maas-api-tls podName:aa42a99c-b4c2-428f-ad1f-df1310ed2e71 nodeName:}" failed. No retries permitted until 2026-07-06 14:11:52.639401003 +0000 UTC m=+1930.015999955 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/aa42a99c-b4c2-428f-ad1f-df1310ed2e71-maas-api-tls") pod "maas-api-e2e-shared-a-973328-78b795cf54-495nw" (UID: "aa42a99c-b4c2-428f-ad1f-df1310ed2e71") : secret "maas-api-e2e-shared-a-973328-serving-cert" not found Jul 06 14:11:52.139845 ip-10-0-138-163 kubenswrapper[2573]: I0706 14:11:52.139827 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/aa42a99c-b4c2-428f-ad1f-df1310ed2e71-openshift-service-ca\") pod \"maas-api-e2e-shared-a-973328-78b795cf54-495nw\" (UID: \"aa42a99c-b4c2-428f-ad1f-df1310ed2e71\") " pod="opendatahub/maas-api-e2e-shared-a-973328-78b795cf54-495nw" Jul 06 14:11:52.147365 ip-10-0-138-163 kubenswrapper[2573]: I0706 14:11:52.147343 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4svmt\" (UniqueName: \"kubernetes.io/projected/aa42a99c-b4c2-428f-ad1f-df1310ed2e71-kube-api-access-4svmt\") pod \"maas-api-e2e-shared-a-973328-78b795cf54-495nw\" (UID: \"aa42a99c-b4c2-428f-ad1f-df1310ed2e71\") " pod="opendatahub/maas-api-e2e-shared-a-973328-78b795cf54-495nw" Jul 06 14:11:52.643819 ip-10-0-138-163 kubenswrapper[2573]: I0706 14:11:52.643762 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/aa42a99c-b4c2-428f-ad1f-df1310ed2e71-maas-api-tls\") pod \"maas-api-e2e-shared-a-973328-78b795cf54-495nw\" (UID: \"aa42a99c-b4c2-428f-ad1f-df1310ed2e71\") " pod="opendatahub/maas-api-e2e-shared-a-973328-78b795cf54-495nw" Jul 06 14:11:52.646240 ip-10-0-138-163 kubenswrapper[2573]: I0706 14:11:52.646214 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/aa42a99c-b4c2-428f-ad1f-df1310ed2e71-maas-api-tls\") pod \"maas-api-e2e-shared-a-973328-78b795cf54-495nw\" (UID: \"aa42a99c-b4c2-428f-ad1f-df1310ed2e71\") " pod="opendatahub/maas-api-e2e-shared-a-973328-78b795cf54-495nw" Jul 06 14:11:52.815978 ip-10-0-138-163 kubenswrapper[2573]: I0706 14:11:52.815939 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-a-973328-78b795cf54-495nw" Jul 06 14:11:52.948947 ip-10-0-138-163 kubenswrapper[2573]: I0706 14:11:52.948870 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-shared-a-973328-78b795cf54-495nw"] Jul 06 14:11:52.951595 ip-10-0-138-163 kubenswrapper[2573]: W0706 14:11:52.951567 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaa42a99c_b4c2_428f_ad1f_df1310ed2e71.slice/crio-29ce71d2d3e7faf6d7d10b00fd47771dd344da6466e0effe1d660b37c374f1c0 WatchSource:0}: Error finding container 29ce71d2d3e7faf6d7d10b00fd47771dd344da6466e0effe1d660b37c374f1c0: Status 404 returned error can't find the container with id 29ce71d2d3e7faf6d7d10b00fd47771dd344da6466e0effe1d660b37c374f1c0 Jul 06 14:11:52.978219 ip-10-0-138-163 kubenswrapper[2573]: I0706 14:11:52.978181 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-a-973328-78b795cf54-495nw" event={"ID":"aa42a99c-b4c2-428f-ad1f-df1310ed2e71","Type":"ContainerStarted","Data":"29ce71d2d3e7faf6d7d10b00fd47771dd344da6466e0effe1d660b37c374f1c0"} Jul 06 14:11:53.985154 ip-10-0-138-163 kubenswrapper[2573]: I0706 14:11:53.985123 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-a-973328-78b795cf54-495nw" event={"ID":"aa42a99c-b4c2-428f-ad1f-df1310ed2e71","Type":"ContainerStarted","Data":"a68447c734206382a5ea474e8944c41c793f5b05bd6e8539dc853bd4a4cc3633"} Jul 06 14:11:53.985539 ip-10-0-138-163 kubenswrapper[2573]: I0706 14:11:53.985188 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-shared-a-973328-78b795cf54-495nw" Jul 06 14:11:54.003623 ip-10-0-138-163 kubenswrapper[2573]: I0706 14:11:54.003578 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-shared-a-973328-78b795cf54-495nw" podStartSLOduration=2.483966831 podStartE2EDuration="3.003562013s" totalImagesPullingTime="519.595182ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:11:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:11:54.0018841 +0000 UTC m=+1931.378483062" watchObservedRunningTime="2026-07-06 14:11:54.003562013 +0000 UTC m=+1931.380160972" Jul 06 14:11:59.994424 ip-10-0-138-163 kubenswrapper[2573]: I0706 14:11:59.994393 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-shared-a-973328-78b795cf54-495nw" Jul 06 14:12:00.210146 ip-10-0-138-163 kubenswrapper[2573]: I0706 14:12:00.210118 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-shared-b-35c041-646c4fc947-rkdfb"] Jul 06 14:12:00.213561 ip-10-0-138-163 kubenswrapper[2573]: I0706 14:12:00.213539 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-b-35c041-646c4fc947-rkdfb" Jul 06 14:12:00.215712 ip-10-0-138-163 kubenswrapper[2573]: I0706 14:12:00.215690 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-shared-b-35c041-serving-cert\"" Jul 06 14:12:00.225723 ip-10-0-138-163 kubenswrapper[2573]: I0706 14:12:00.225700 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-shared-b-35c041-646c4fc947-rkdfb"] Jul 06 14:12:00.312992 ip-10-0-138-163 kubenswrapper[2573]: I0706 14:12:00.312898 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tpb7g\" (UniqueName: \"kubernetes.io/projected/3f3e02b9-14e7-48b2-9e8e-800ba5c0e4a1-kube-api-access-tpb7g\") pod \"maas-api-e2e-shared-b-35c041-646c4fc947-rkdfb\" (UID: \"3f3e02b9-14e7-48b2-9e8e-800ba5c0e4a1\") " pod="opendatahub/maas-api-e2e-shared-b-35c041-646c4fc947-rkdfb" Jul 06 14:12:00.312992 ip-10-0-138-163 kubenswrapper[2573]: I0706 14:12:00.312955 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3f3e02b9-14e7-48b2-9e8e-800ba5c0e4a1-openshift-service-ca\") pod \"maas-api-e2e-shared-b-35c041-646c4fc947-rkdfb\" (UID: \"3f3e02b9-14e7-48b2-9e8e-800ba5c0e4a1\") " pod="opendatahub/maas-api-e2e-shared-b-35c041-646c4fc947-rkdfb" Jul 06 14:12:00.313232 ip-10-0-138-163 kubenswrapper[2573]: I0706 14:12:00.313104 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3f3e02b9-14e7-48b2-9e8e-800ba5c0e4a1-maas-api-tls\") pod \"maas-api-e2e-shared-b-35c041-646c4fc947-rkdfb\" (UID: \"3f3e02b9-14e7-48b2-9e8e-800ba5c0e4a1\") " pod="opendatahub/maas-api-e2e-shared-b-35c041-646c4fc947-rkdfb" Jul 06 14:12:00.414287 ip-10-0-138-163 kubenswrapper[2573]: I0706 14:12:00.414252 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3f3e02b9-14e7-48b2-9e8e-800ba5c0e4a1-maas-api-tls\") pod \"maas-api-e2e-shared-b-35c041-646c4fc947-rkdfb\" (UID: \"3f3e02b9-14e7-48b2-9e8e-800ba5c0e4a1\") " pod="opendatahub/maas-api-e2e-shared-b-35c041-646c4fc947-rkdfb" Jul 06 14:12:00.414439 ip-10-0-138-163 kubenswrapper[2573]: I0706 14:12:00.414336 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tpb7g\" (UniqueName: \"kubernetes.io/projected/3f3e02b9-14e7-48b2-9e8e-800ba5c0e4a1-kube-api-access-tpb7g\") pod \"maas-api-e2e-shared-b-35c041-646c4fc947-rkdfb\" (UID: \"3f3e02b9-14e7-48b2-9e8e-800ba5c0e4a1\") " pod="opendatahub/maas-api-e2e-shared-b-35c041-646c4fc947-rkdfb" Jul 06 14:12:00.414439 ip-10-0-138-163 kubenswrapper[2573]: I0706 14:12:00.414380 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3f3e02b9-14e7-48b2-9e8e-800ba5c0e4a1-openshift-service-ca\") pod \"maas-api-e2e-shared-b-35c041-646c4fc947-rkdfb\" (UID: \"3f3e02b9-14e7-48b2-9e8e-800ba5c0e4a1\") " pod="opendatahub/maas-api-e2e-shared-b-35c041-646c4fc947-rkdfb" Jul 06 14:12:00.414439 ip-10-0-138-163 kubenswrapper[2573]: E0706 14:12:00.414409 2573 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-shared-b-35c041-serving-cert: secret "maas-api-e2e-shared-b-35c041-serving-cert" not found Jul 06 14:12:00.414585 ip-10-0-138-163 kubenswrapper[2573]: E0706 14:12:00.414473 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3f3e02b9-14e7-48b2-9e8e-800ba5c0e4a1-maas-api-tls podName:3f3e02b9-14e7-48b2-9e8e-800ba5c0e4a1 nodeName:}" failed. No retries permitted until 2026-07-06 14:12:00.914452579 +0000 UTC m=+1938.291051519 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/3f3e02b9-14e7-48b2-9e8e-800ba5c0e4a1-maas-api-tls") pod "maas-api-e2e-shared-b-35c041-646c4fc947-rkdfb" (UID: "3f3e02b9-14e7-48b2-9e8e-800ba5c0e4a1") : secret "maas-api-e2e-shared-b-35c041-serving-cert" not found Jul 06 14:12:00.414990 ip-10-0-138-163 kubenswrapper[2573]: I0706 14:12:00.414972 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3f3e02b9-14e7-48b2-9e8e-800ba5c0e4a1-openshift-service-ca\") pod \"maas-api-e2e-shared-b-35c041-646c4fc947-rkdfb\" (UID: \"3f3e02b9-14e7-48b2-9e8e-800ba5c0e4a1\") " pod="opendatahub/maas-api-e2e-shared-b-35c041-646c4fc947-rkdfb" Jul 06 14:12:00.425498 ip-10-0-138-163 kubenswrapper[2573]: I0706 14:12:00.425477 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tpb7g\" (UniqueName: \"kubernetes.io/projected/3f3e02b9-14e7-48b2-9e8e-800ba5c0e4a1-kube-api-access-tpb7g\") pod \"maas-api-e2e-shared-b-35c041-646c4fc947-rkdfb\" (UID: \"3f3e02b9-14e7-48b2-9e8e-800ba5c0e4a1\") " pod="opendatahub/maas-api-e2e-shared-b-35c041-646c4fc947-rkdfb" Jul 06 14:12:00.920411 ip-10-0-138-163 kubenswrapper[2573]: I0706 14:12:00.920378 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3f3e02b9-14e7-48b2-9e8e-800ba5c0e4a1-maas-api-tls\") pod \"maas-api-e2e-shared-b-35c041-646c4fc947-rkdfb\" (UID: \"3f3e02b9-14e7-48b2-9e8e-800ba5c0e4a1\") " pod="opendatahub/maas-api-e2e-shared-b-35c041-646c4fc947-rkdfb" Jul 06 14:12:00.923002 ip-10-0-138-163 kubenswrapper[2573]: I0706 14:12:00.922977 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3f3e02b9-14e7-48b2-9e8e-800ba5c0e4a1-maas-api-tls\") pod \"maas-api-e2e-shared-b-35c041-646c4fc947-rkdfb\" (UID: \"3f3e02b9-14e7-48b2-9e8e-800ba5c0e4a1\") " pod="opendatahub/maas-api-e2e-shared-b-35c041-646c4fc947-rkdfb" Jul 06 14:12:01.123874 ip-10-0-138-163 kubenswrapper[2573]: I0706 14:12:01.123844 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-b-35c041-646c4fc947-rkdfb" Jul 06 14:12:01.259537 ip-10-0-138-163 kubenswrapper[2573]: I0706 14:12:01.259500 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-shared-b-35c041-646c4fc947-rkdfb"] Jul 06 14:12:01.262831 ip-10-0-138-163 kubenswrapper[2573]: W0706 14:12:01.262807 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3f3e02b9_14e7_48b2_9e8e_800ba5c0e4a1.slice/crio-22e0dc64716219ce1102498edd90f81651b40defea6578c449cb0145a0c2caeb WatchSource:0}: Error finding container 22e0dc64716219ce1102498edd90f81651b40defea6578c449cb0145a0c2caeb: Status 404 returned error can't find the container with id 22e0dc64716219ce1102498edd90f81651b40defea6578c449cb0145a0c2caeb Jul 06 14:12:02.020162 ip-10-0-138-163 kubenswrapper[2573]: I0706 14:12:02.020134 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-b-35c041-646c4fc947-rkdfb" event={"ID":"3f3e02b9-14e7-48b2-9e8e-800ba5c0e4a1","Type":"ContainerStarted","Data":"22885c827115030cbf8d064d9c96fca68358d653bd42f573cf038895d2dedc1c"} Jul 06 14:12:02.020295 ip-10-0-138-163 kubenswrapper[2573]: I0706 14:12:02.020182 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-b-35c041-646c4fc947-rkdfb" event={"ID":"3f3e02b9-14e7-48b2-9e8e-800ba5c0e4a1","Type":"ContainerStarted","Data":"22e0dc64716219ce1102498edd90f81651b40defea6578c449cb0145a0c2caeb"} Jul 06 14:12:02.020295 ip-10-0-138-163 kubenswrapper[2573]: I0706 14:12:02.020237 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-shared-b-35c041-646c4fc947-rkdfb" Jul 06 14:12:02.039267 ip-10-0-138-163 kubenswrapper[2573]: I0706 14:12:02.039208 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-shared-b-35c041-646c4fc947-rkdfb" podStartSLOduration=1.673951158 podStartE2EDuration="2.039195602s" totalImagesPullingTime="365.244444ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:12:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:12:02.03763025 +0000 UTC m=+1939.414229219" watchObservedRunningTime="2026-07-06 14:12:02.039195602 +0000 UTC m=+1939.415794561" Jul 06 14:12:08.029927 ip-10-0-138-163 kubenswrapper[2573]: I0706 14:12:08.029898 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-shared-b-35c041-646c4fc947-rkdfb" Jul 06 14:14:43.185460 ip-10-0-138-163 kubenswrapper[2573]: I0706 14:14:43.185429 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-z2f98_66e76252-8877-403e-9c30-e56ec0013c24/console-operator/1.log" Jul 06 14:14:43.187116 ip-10-0-138-163 kubenswrapper[2573]: I0706 14:14:43.187092 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-z2f98_66e76252-8877-403e-9c30-e56ec0013c24/console-operator/1.log" Jul 06 14:15:00.132229 ip-10-0-138-163 kubenswrapper[2573]: I0706 14:15:00.132191 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-shared-b-35c041-29722455-vlsbr"] Jul 06 14:15:00.135708 ip-10-0-138-163 kubenswrapper[2573]: I0706 14:15:00.135687 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-e2e-shared-b-35c041-29722455-vlsbr" Jul 06 14:15:00.146980 ip-10-0-138-163 kubenswrapper[2573]: I0706 14:15:00.146957 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-shared-b-35c041-29722455-vlsbr"] Jul 06 14:15:00.197385 ip-10-0-138-163 kubenswrapper[2573]: I0706 14:15:00.197344 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-svbt6\" (UniqueName: \"kubernetes.io/projected/3ce7000d-6cc6-47ad-8156-d31ddde8927b-kube-api-access-svbt6\") pod \"maas-api-key-cleanup-e2e-shared-b-35c041-29722455-vlsbr\" (UID: \"3ce7000d-6cc6-47ad-8156-d31ddde8927b\") " pod="opendatahub/maas-api-key-cleanup-e2e-shared-b-35c041-29722455-vlsbr" Jul 06 14:15:00.298105 ip-10-0-138-163 kubenswrapper[2573]: I0706 14:15:00.298075 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-svbt6\" (UniqueName: \"kubernetes.io/projected/3ce7000d-6cc6-47ad-8156-d31ddde8927b-kube-api-access-svbt6\") pod \"maas-api-key-cleanup-e2e-shared-b-35c041-29722455-vlsbr\" (UID: \"3ce7000d-6cc6-47ad-8156-d31ddde8927b\") " pod="opendatahub/maas-api-key-cleanup-e2e-shared-b-35c041-29722455-vlsbr" Jul 06 14:15:00.306562 ip-10-0-138-163 kubenswrapper[2573]: I0706 14:15:00.306537 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-svbt6\" (UniqueName: \"kubernetes.io/projected/3ce7000d-6cc6-47ad-8156-d31ddde8927b-kube-api-access-svbt6\") pod \"maas-api-key-cleanup-e2e-shared-b-35c041-29722455-vlsbr\" (UID: \"3ce7000d-6cc6-47ad-8156-d31ddde8927b\") " pod="opendatahub/maas-api-key-cleanup-e2e-shared-b-35c041-29722455-vlsbr" Jul 06 14:15:00.445955 ip-10-0-138-163 kubenswrapper[2573]: I0706 14:15:00.445871 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-e2e-shared-b-35c041-29722455-vlsbr" Jul 06 14:15:00.572408 ip-10-0-138-163 kubenswrapper[2573]: I0706 14:15:00.572385 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-shared-b-35c041-29722455-vlsbr"] Jul 06 14:15:00.574804 ip-10-0-138-163 kubenswrapper[2573]: W0706 14:15:00.574775 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3ce7000d_6cc6_47ad_8156_d31ddde8927b.slice/crio-8b3525ce1f10fea176a53841e5feabc394048cc84f74c2adb52c1b5bcde99153 WatchSource:0}: Error finding container 8b3525ce1f10fea176a53841e5feabc394048cc84f74c2adb52c1b5bcde99153: Status 404 returned error can't find the container with id 8b3525ce1f10fea176a53841e5feabc394048cc84f74c2adb52c1b5bcde99153 Jul 06 14:15:00.576752 ip-10-0-138-163 kubenswrapper[2573]: I0706 14:15:00.576735 2573 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 06 14:15:00.774730 ip-10-0-138-163 kubenswrapper[2573]: I0706 14:15:00.774697 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-e2e-shared-b-35c041-29722455-vlsbr" event={"ID":"3ce7000d-6cc6-47ad-8156-d31ddde8927b","Type":"ContainerStarted","Data":"8b3525ce1f10fea176a53841e5feabc394048cc84f74c2adb52c1b5bcde99153"} Jul 06 14:15:03.790017 ip-10-0-138-163 kubenswrapper[2573]: I0706 14:15:03.789929 2573 generic.go:356] "Generic (PLEG): container finished" podID="3ce7000d-6cc6-47ad-8156-d31ddde8927b" containerID="30d1031f51aab0b14f24da34e0a989160e16bcca793232429dba698f498267a5" exitCode=0 Jul 06 14:15:03.790382 ip-10-0-138-163 kubenswrapper[2573]: I0706 14:15:03.790017 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-e2e-shared-b-35c041-29722455-vlsbr" event={"ID":"3ce7000d-6cc6-47ad-8156-d31ddde8927b","Type":"ContainerDied","Data":"30d1031f51aab0b14f24da34e0a989160e16bcca793232429dba698f498267a5"} Jul 06 14:15:04.922960 ip-10-0-138-163 kubenswrapper[2573]: I0706 14:15:04.922938 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-e2e-shared-b-35c041-29722455-vlsbr" Jul 06 14:15:05.045991 ip-10-0-138-163 kubenswrapper[2573]: I0706 14:15:05.045903 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-svbt6\" (UniqueName: \"kubernetes.io/projected/3ce7000d-6cc6-47ad-8156-d31ddde8927b-kube-api-access-svbt6\") pod \"3ce7000d-6cc6-47ad-8156-d31ddde8927b\" (UID: \"3ce7000d-6cc6-47ad-8156-d31ddde8927b\") " Jul 06 14:15:05.047890 ip-10-0-138-163 kubenswrapper[2573]: I0706 14:15:05.047864 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3ce7000d-6cc6-47ad-8156-d31ddde8927b-kube-api-access-svbt6" (OuterVolumeSpecName: "kube-api-access-svbt6") pod "3ce7000d-6cc6-47ad-8156-d31ddde8927b" (UID: "3ce7000d-6cc6-47ad-8156-d31ddde8927b"). InnerVolumeSpecName "kube-api-access-svbt6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 14:15:05.147393 ip-10-0-138-163 kubenswrapper[2573]: I0706 14:15:05.147365 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-svbt6\" (UniqueName: \"kubernetes.io/projected/3ce7000d-6cc6-47ad-8156-d31ddde8927b-kube-api-access-svbt6\") on node \"ip-10-0-138-163.ec2.internal\" DevicePath \"\"" Jul 06 14:15:05.799538 ip-10-0-138-163 kubenswrapper[2573]: I0706 14:15:05.799509 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-e2e-shared-b-35c041-29722455-vlsbr" Jul 06 14:15:05.799835 ip-10-0-138-163 kubenswrapper[2573]: I0706 14:15:05.799542 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-e2e-shared-b-35c041-29722455-vlsbr" event={"ID":"3ce7000d-6cc6-47ad-8156-d31ddde8927b","Type":"ContainerDied","Data":"8b3525ce1f10fea176a53841e5feabc394048cc84f74c2adb52c1b5bcde99153"} Jul 06 14:15:05.799835 ip-10-0-138-163 kubenswrapper[2573]: I0706 14:15:05.799585 2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8b3525ce1f10fea176a53841e5feabc394048cc84f74c2adb52c1b5bcde99153" Jul 06 14:15:43.228026 ip-10-0-138-163 kubenswrapper[2573]: I0706 14:15:43.227956 2573 scope.go:117] "RemoveContainer" containerID="e049d3afe8d8875833516db8fa9338e594af7175476f0e7f5e0d89e6ce0c5be8" Jul 06 14:18:05.782091 ip-10-0-138-163 kubenswrapper[2573]: I0706 14:18:05.782060 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-shared-a-973328-78b795cf54-495nw"] Jul 06 14:18:05.784691 ip-10-0-138-163 kubenswrapper[2573]: I0706 14:18:05.782296 2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-shared-a-973328-78b795cf54-495nw" podUID="aa42a99c-b4c2-428f-ad1f-df1310ed2e71" containerName="maas-api" containerID="cri-o://a68447c734206382a5ea474e8944c41c793f5b05bd6e8539dc853bd4a4cc3633" gracePeriod=30 Jul 06 14:18:06.224582 ip-10-0-138-163 kubenswrapper[2573]: I0706 14:18:06.224557 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-a-973328-78b795cf54-495nw" Jul 06 14:18:06.317871 ip-10-0-138-163 kubenswrapper[2573]: I0706 14:18:06.317793 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4svmt\" (UniqueName: \"kubernetes.io/projected/aa42a99c-b4c2-428f-ad1f-df1310ed2e71-kube-api-access-4svmt\") pod \"aa42a99c-b4c2-428f-ad1f-df1310ed2e71\" (UID: \"aa42a99c-b4c2-428f-ad1f-df1310ed2e71\") " Jul 06 14:18:06.317871 ip-10-0-138-163 kubenswrapper[2573]: I0706 14:18:06.317859 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/aa42a99c-b4c2-428f-ad1f-df1310ed2e71-openshift-service-ca\") pod \"aa42a99c-b4c2-428f-ad1f-df1310ed2e71\" (UID: \"aa42a99c-b4c2-428f-ad1f-df1310ed2e71\") " Jul 06 14:18:06.318078 ip-10-0-138-163 kubenswrapper[2573]: I0706 14:18:06.317887 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/aa42a99c-b4c2-428f-ad1f-df1310ed2e71-maas-api-tls\") pod \"aa42a99c-b4c2-428f-ad1f-df1310ed2e71\" (UID: \"aa42a99c-b4c2-428f-ad1f-df1310ed2e71\") " Jul 06 14:18:06.318269 ip-10-0-138-163 kubenswrapper[2573]: I0706 14:18:06.318246 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/aa42a99c-b4c2-428f-ad1f-df1310ed2e71-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "aa42a99c-b4c2-428f-ad1f-df1310ed2e71" (UID: "aa42a99c-b4c2-428f-ad1f-df1310ed2e71"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 14:18:06.319821 ip-10-0-138-163 kubenswrapper[2573]: I0706 14:18:06.319794 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aa42a99c-b4c2-428f-ad1f-df1310ed2e71-kube-api-access-4svmt" (OuterVolumeSpecName: "kube-api-access-4svmt") pod "aa42a99c-b4c2-428f-ad1f-df1310ed2e71" (UID: "aa42a99c-b4c2-428f-ad1f-df1310ed2e71"). InnerVolumeSpecName "kube-api-access-4svmt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 14:18:06.319978 ip-10-0-138-163 kubenswrapper[2573]: I0706 14:18:06.319955 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/aa42a99c-b4c2-428f-ad1f-df1310ed2e71-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "aa42a99c-b4c2-428f-ad1f-df1310ed2e71" (UID: "aa42a99c-b4c2-428f-ad1f-df1310ed2e71"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 14:18:06.418525 ip-10-0-138-163 kubenswrapper[2573]: I0706 14:18:06.418489 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4svmt\" (UniqueName: \"kubernetes.io/projected/aa42a99c-b4c2-428f-ad1f-df1310ed2e71-kube-api-access-4svmt\") on node \"ip-10-0-138-163.ec2.internal\" DevicePath \"\"" Jul 06 14:18:06.418525 ip-10-0-138-163 kubenswrapper[2573]: I0706 14:18:06.418520 2573 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/aa42a99c-b4c2-428f-ad1f-df1310ed2e71-openshift-service-ca\") on node \"ip-10-0-138-163.ec2.internal\" DevicePath \"\"" Jul 06 14:18:06.418525 ip-10-0-138-163 kubenswrapper[2573]: I0706 14:18:06.418534 2573 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/aa42a99c-b4c2-428f-ad1f-df1310ed2e71-maas-api-tls\") on node \"ip-10-0-138-163.ec2.internal\" DevicePath \"\"" Jul 06 14:18:06.586452 ip-10-0-138-163 kubenswrapper[2573]: I0706 14:18:06.586365 2573 generic.go:356] "Generic (PLEG): container finished" podID="aa42a99c-b4c2-428f-ad1f-df1310ed2e71" containerID="a68447c734206382a5ea474e8944c41c793f5b05bd6e8539dc853bd4a4cc3633" exitCode=0 Jul 06 14:18:06.586452 ip-10-0-138-163 kubenswrapper[2573]: I0706 14:18:06.586414 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-a-973328-78b795cf54-495nw" Jul 06 14:18:06.586631 ip-10-0-138-163 kubenswrapper[2573]: I0706 14:18:06.586446 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-a-973328-78b795cf54-495nw" event={"ID":"aa42a99c-b4c2-428f-ad1f-df1310ed2e71","Type":"ContainerDied","Data":"a68447c734206382a5ea474e8944c41c793f5b05bd6e8539dc853bd4a4cc3633"} Jul 06 14:18:06.586631 ip-10-0-138-163 kubenswrapper[2573]: I0706 14:18:06.586502 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-a-973328-78b795cf54-495nw" event={"ID":"aa42a99c-b4c2-428f-ad1f-df1310ed2e71","Type":"ContainerDied","Data":"29ce71d2d3e7faf6d7d10b00fd47771dd344da6466e0effe1d660b37c374f1c0"} Jul 06 14:18:06.586631 ip-10-0-138-163 kubenswrapper[2573]: I0706 14:18:06.586528 2573 scope.go:117] "RemoveContainer" containerID="a68447c734206382a5ea474e8944c41c793f5b05bd6e8539dc853bd4a4cc3633" Jul 06 14:18:06.600400 ip-10-0-138-163 kubenswrapper[2573]: I0706 14:18:06.600375 2573 scope.go:117] "RemoveContainer" containerID="a68447c734206382a5ea474e8944c41c793f5b05bd6e8539dc853bd4a4cc3633" Jul 06 14:18:06.600733 ip-10-0-138-163 kubenswrapper[2573]: E0706 14:18:06.600709 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a68447c734206382a5ea474e8944c41c793f5b05bd6e8539dc853bd4a4cc3633\": container with ID starting with a68447c734206382a5ea474e8944c41c793f5b05bd6e8539dc853bd4a4cc3633 not found: ID does not exist" containerID="a68447c734206382a5ea474e8944c41c793f5b05bd6e8539dc853bd4a4cc3633" Jul 06 14:18:06.600800 ip-10-0-138-163 kubenswrapper[2573]: I0706 14:18:06.600741 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a68447c734206382a5ea474e8944c41c793f5b05bd6e8539dc853bd4a4cc3633"} err="failed to get container status \"a68447c734206382a5ea474e8944c41c793f5b05bd6e8539dc853bd4a4cc3633\": rpc error: code = NotFound desc = could not find container \"a68447c734206382a5ea474e8944c41c793f5b05bd6e8539dc853bd4a4cc3633\": container with ID starting with a68447c734206382a5ea474e8944c41c793f5b05bd6e8539dc853bd4a4cc3633 not found: ID does not exist" Jul 06 14:18:06.615936 ip-10-0-138-163 kubenswrapper[2573]: I0706 14:18:06.615904 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-shared-a-973328-78b795cf54-495nw"] Jul 06 14:18:06.621785 ip-10-0-138-163 kubenswrapper[2573]: I0706 14:18:06.621754 2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-shared-a-973328-78b795cf54-495nw"] Jul 06 14:18:07.161149 ip-10-0-138-163 kubenswrapper[2573]: I0706 14:18:07.161117 2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="aa42a99c-b4c2-428f-ad1f-df1310ed2e71" path="/var/lib/kubelet/pods/aa42a99c-b4c2-428f-ad1f-df1310ed2e71/volumes" Jul 06 14:18:49.567617 ip-10-0-138-163 kubenswrapper[2573]: I0706 14:18:49.567581 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-shared-b-35c041-646c4fc947-rkdfb"] Jul 06 14:18:49.568032 ip-10-0-138-163 kubenswrapper[2573]: I0706 14:18:49.567829 2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-shared-b-35c041-646c4fc947-rkdfb" podUID="3f3e02b9-14e7-48b2-9e8e-800ba5c0e4a1" containerName="maas-api" containerID="cri-o://22885c827115030cbf8d064d9c96fca68358d653bd42f573cf038895d2dedc1c" gracePeriod=30 Jul 06 14:18:49.594563 ip-10-0-138-163 kubenswrapper[2573]: I0706 14:18:49.594538 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-shared-b-35c041-29722455-vlsbr"] Jul 06 14:18:49.597447 ip-10-0-138-163 kubenswrapper[2573]: I0706 14:18:49.597425 2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-shared-b-35c041-29722455-vlsbr"] Jul 06 14:18:49.774280 ip-10-0-138-163 kubenswrapper[2573]: I0706 14:18:49.774247 2573 generic.go:356] "Generic (PLEG): container finished" podID="3f3e02b9-14e7-48b2-9e8e-800ba5c0e4a1" containerID="22885c827115030cbf8d064d9c96fca68358d653bd42f573cf038895d2dedc1c" exitCode=0 Jul 06 14:18:49.774421 ip-10-0-138-163 kubenswrapper[2573]: I0706 14:18:49.774331 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-b-35c041-646c4fc947-rkdfb" event={"ID":"3f3e02b9-14e7-48b2-9e8e-800ba5c0e4a1","Type":"ContainerDied","Data":"22885c827115030cbf8d064d9c96fca68358d653bd42f573cf038895d2dedc1c"} Jul 06 14:18:49.807643 ip-10-0-138-163 kubenswrapper[2573]: I0706 14:18:49.807621 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-b-35c041-646c4fc947-rkdfb" Jul 06 14:18:49.994017 ip-10-0-138-163 kubenswrapper[2573]: I0706 14:18:49.993989 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3f3e02b9-14e7-48b2-9e8e-800ba5c0e4a1-maas-api-tls\") pod \"3f3e02b9-14e7-48b2-9e8e-800ba5c0e4a1\" (UID: \"3f3e02b9-14e7-48b2-9e8e-800ba5c0e4a1\") " Jul 06 14:18:49.994214 ip-10-0-138-163 kubenswrapper[2573]: I0706 14:18:49.994075 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tpb7g\" (UniqueName: \"kubernetes.io/projected/3f3e02b9-14e7-48b2-9e8e-800ba5c0e4a1-kube-api-access-tpb7g\") pod \"3f3e02b9-14e7-48b2-9e8e-800ba5c0e4a1\" (UID: \"3f3e02b9-14e7-48b2-9e8e-800ba5c0e4a1\") " Jul 06 14:18:49.994214 ip-10-0-138-163 kubenswrapper[2573]: I0706 14:18:49.994097 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3f3e02b9-14e7-48b2-9e8e-800ba5c0e4a1-openshift-service-ca\") pod \"3f3e02b9-14e7-48b2-9e8e-800ba5c0e4a1\" (UID: \"3f3e02b9-14e7-48b2-9e8e-800ba5c0e4a1\") " Jul 06 14:18:49.994484 ip-10-0-138-163 kubenswrapper[2573]: I0706 14:18:49.994457 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3f3e02b9-14e7-48b2-9e8e-800ba5c0e4a1-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "3f3e02b9-14e7-48b2-9e8e-800ba5c0e4a1" (UID: "3f3e02b9-14e7-48b2-9e8e-800ba5c0e4a1"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 14:18:49.996124 ip-10-0-138-163 kubenswrapper[2573]: I0706 14:18:49.996099 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3f3e02b9-14e7-48b2-9e8e-800ba5c0e4a1-kube-api-access-tpb7g" (OuterVolumeSpecName: "kube-api-access-tpb7g") pod "3f3e02b9-14e7-48b2-9e8e-800ba5c0e4a1" (UID: "3f3e02b9-14e7-48b2-9e8e-800ba5c0e4a1"). InnerVolumeSpecName "kube-api-access-tpb7g". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 14:18:49.996201 ip-10-0-138-163 kubenswrapper[2573]: I0706 14:18:49.996102 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3f3e02b9-14e7-48b2-9e8e-800ba5c0e4a1-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "3f3e02b9-14e7-48b2-9e8e-800ba5c0e4a1" (UID: "3f3e02b9-14e7-48b2-9e8e-800ba5c0e4a1"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 14:18:50.095605 ip-10-0-138-163 kubenswrapper[2573]: I0706 14:18:50.095564 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tpb7g\" (UniqueName: \"kubernetes.io/projected/3f3e02b9-14e7-48b2-9e8e-800ba5c0e4a1-kube-api-access-tpb7g\") on node \"ip-10-0-138-163.ec2.internal\" DevicePath \"\"" Jul 06 14:18:50.095605 ip-10-0-138-163 kubenswrapper[2573]: I0706 14:18:50.095601 2573 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3f3e02b9-14e7-48b2-9e8e-800ba5c0e4a1-openshift-service-ca\") on node \"ip-10-0-138-163.ec2.internal\" DevicePath \"\"" Jul 06 14:18:50.095605 ip-10-0-138-163 kubenswrapper[2573]: I0706 14:18:50.095612 2573 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3f3e02b9-14e7-48b2-9e8e-800ba5c0e4a1-maas-api-tls\") on node \"ip-10-0-138-163.ec2.internal\" DevicePath \"\"" Jul 06 14:18:50.779646 ip-10-0-138-163 kubenswrapper[2573]: I0706 14:18:50.779613 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-b-35c041-646c4fc947-rkdfb" event={"ID":"3f3e02b9-14e7-48b2-9e8e-800ba5c0e4a1","Type":"ContainerDied","Data":"22e0dc64716219ce1102498edd90f81651b40defea6578c449cb0145a0c2caeb"} Jul 06 14:18:50.780029 ip-10-0-138-163 kubenswrapper[2573]: I0706 14:18:50.779665 2573 scope.go:117] "RemoveContainer" containerID="22885c827115030cbf8d064d9c96fca68358d653bd42f573cf038895d2dedc1c" Jul 06 14:18:50.780029 ip-10-0-138-163 kubenswrapper[2573]: I0706 14:18:50.779622 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-b-35c041-646c4fc947-rkdfb" Jul 06 14:18:50.808604 ip-10-0-138-163 kubenswrapper[2573]: I0706 14:18:50.808551 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-shared-b-35c041-646c4fc947-rkdfb"] Jul 06 14:18:50.810007 ip-10-0-138-163 kubenswrapper[2573]: I0706 14:18:50.809986 2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-shared-b-35c041-646c4fc947-rkdfb"] Jul 06 14:18:51.161839 ip-10-0-138-163 kubenswrapper[2573]: I0706 14:18:51.161767 2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3ce7000d-6cc6-47ad-8156-d31ddde8927b" path="/var/lib/kubelet/pods/3ce7000d-6cc6-47ad-8156-d31ddde8927b/volumes" Jul 06 14:18:51.162150 ip-10-0-138-163 kubenswrapper[2573]: I0706 14:18:51.162138 2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3f3e02b9-14e7-48b2-9e8e-800ba5c0e4a1" path="/var/lib/kubelet/pods/3f3e02b9-14e7-48b2-9e8e-800ba5c0e4a1/volumes" Jul 06 14:19:02.003223 ip-10-0-138-163 kubenswrapper[2573]: I0706 14:19:02.003195 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6b559b5dcd-2dcwx_217f821e-464b-4836-bfa5-dedc084766aa/copy-manifests/0.log" Jul 06 14:19:02.015951 ip-10-0-138-163 kubenswrapper[2573]: I0706 14:19:02.015929 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6b559b5dcd-2dcwx_217f821e-464b-4836-bfa5-dedc084766aa/manager/0.log" Jul 06 14:19:04.297229 ip-10-0-138-163 kubenswrapper[2573]: I0706 14:19:04.297198 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-8pcn8_d132a906-a57c-47db-8177-6199c9504fdd/manager/0.log" Jul 06 14:19:05.009156 ip-10-0-138-163 kubenswrapper[2573]: I0706 14:19:05.009123 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-2jljx_aad3bb1b-0bac-4b96-b020-2612138bf4af/discovery/0.log" Jul 06 14:19:06.066612 ip-10-0-138-163 kubenswrapper[2573]: I0706 14:19:06.066586 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-75drf_9122ec9e-ca2b-4219-bc77-a2a2a9ad216e/main/0.log" Jul 06 14:19:06.289265 ip-10-0-138-163 kubenswrapper[2573]: I0706 14:19:06.289241 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-nmlnd_3866d780-1d99-4970-9037-703646c500c8/main/0.log" Jul 06 14:19:06.520333 ip-10-0-138-163 kubenswrapper[2573]: I0706 14:19:06.520311 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-4fmdp_b4da1c2b-12cf-4ffd-a0e3-2c46b23132a9/main/0.log" Jul 06 14:19:13.813204 ip-10-0-138-163 kubenswrapper[2573]: I0706 14:19:13.813171 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-hsn8z_038d9ebd-ecce-4e27-bc8b-e661a606932e/global-pull-secret-syncer/0.log" Jul 06 14:19:13.938722 ip-10-0-138-163 kubenswrapper[2573]: I0706 14:19:13.938697 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-9r5x9_e4db2c9b-0534-4fda-a860-1457816e7a88/konnectivity-agent/0.log" Jul 06 14:19:14.047494 ip-10-0-138-163 kubenswrapper[2573]: I0706 14:19:14.047464 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-138-163.ec2.internal_e455a0f97ea051574dbd820a3603ff90/haproxy/0.log" Jul 06 14:19:19.409468 ip-10-0-138-163 kubenswrapper[2573]: I0706 14:19:19.409434 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-8pcn8_d132a906-a57c-47db-8177-6199c9504fdd/manager/0.log" Jul 06 14:19:21.652019 ip-10-0-138-163 kubenswrapper[2573]: I0706 14:19:21.651990 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-64786d9cbb-lgttx_628d0eab-eceb-4062-a2bc-8072b21babd1/cluster-monitoring-operator/0.log" Jul 06 14:19:21.770650 ip-10-0-138-163 kubenswrapper[2573]: I0706 14:19:21.770626 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-dd759cc5c-l856l_cc75af9b-11c1-49b4-b911-68bb3d314a48/metrics-server/0.log" Jul 06 14:19:21.831263 ip-10-0-138-163 kubenswrapper[2573]: I0706 14:19:21.831239 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-nnrkt_c5ec9ee7-8508-41c8-9889-cb371ba85bee/node-exporter/0.log" Jul 06 14:19:21.853376 ip-10-0-138-163 kubenswrapper[2573]: I0706 14:19:21.853356 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-nnrkt_c5ec9ee7-8508-41c8-9889-cb371ba85bee/kube-rbac-proxy/0.log" Jul 06 14:19:21.874433 ip-10-0-138-163 kubenswrapper[2573]: I0706 14:19:21.874412 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-nnrkt_c5ec9ee7-8508-41c8-9889-cb371ba85bee/init-textfile/0.log" Jul 06 14:19:22.178626 ip-10-0-138-163 kubenswrapper[2573]: I0706 14:19:22.178560 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_5214fbb1-153b-4e09-9af9-4543cee383fd/prometheus/0.log" Jul 06 14:19:22.201744 ip-10-0-138-163 kubenswrapper[2573]: I0706 14:19:22.201720 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_5214fbb1-153b-4e09-9af9-4543cee383fd/config-reloader/0.log" Jul 06 14:19:22.223332 ip-10-0-138-163 kubenswrapper[2573]: I0706 14:19:22.223314 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_5214fbb1-153b-4e09-9af9-4543cee383fd/thanos-sidecar/0.log" Jul 06 14:19:22.246530 ip-10-0-138-163 kubenswrapper[2573]: I0706 14:19:22.246510 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_5214fbb1-153b-4e09-9af9-4543cee383fd/kube-rbac-proxy-web/0.log" Jul 06 14:19:22.270171 ip-10-0-138-163 kubenswrapper[2573]: I0706 14:19:22.270153 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_5214fbb1-153b-4e09-9af9-4543cee383fd/kube-rbac-proxy/0.log" Jul 06 14:19:22.293374 ip-10-0-138-163 kubenswrapper[2573]: I0706 14:19:22.293355 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_5214fbb1-153b-4e09-9af9-4543cee383fd/kube-rbac-proxy-thanos/0.log" Jul 06 14:19:22.317504 ip-10-0-138-163 kubenswrapper[2573]: I0706 14:19:22.317487 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_5214fbb1-153b-4e09-9af9-4543cee383fd/init-config-reloader/0.log" Jul 06 14:19:24.363975 ip-10-0-138-163 kubenswrapper[2573]: I0706 14:19:24.363938 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-8kwcr/perf-node-gather-daemonset-j8bgr"] Jul 06 14:19:24.364363 ip-10-0-138-163 kubenswrapper[2573]: I0706 14:19:24.364247 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3f3e02b9-14e7-48b2-9e8e-800ba5c0e4a1" containerName="maas-api" Jul 06 14:19:24.364363 ip-10-0-138-163 kubenswrapper[2573]: I0706 14:19:24.364258 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="3f3e02b9-14e7-48b2-9e8e-800ba5c0e4a1" containerName="maas-api" Jul 06 14:19:24.364363 ip-10-0-138-163 kubenswrapper[2573]: I0706 14:19:24.364277 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aa42a99c-b4c2-428f-ad1f-df1310ed2e71" containerName="maas-api" Jul 06 14:19:24.364363 ip-10-0-138-163 kubenswrapper[2573]: I0706 14:19:24.364282 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="aa42a99c-b4c2-428f-ad1f-df1310ed2e71" containerName="maas-api" Jul 06 14:19:24.364363 ip-10-0-138-163 kubenswrapper[2573]: I0706 14:19:24.364291 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3ce7000d-6cc6-47ad-8156-d31ddde8927b" containerName="cleanup" Jul 06 14:19:24.364363 ip-10-0-138-163 kubenswrapper[2573]: I0706 14:19:24.364298 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="3ce7000d-6cc6-47ad-8156-d31ddde8927b" containerName="cleanup" Jul 06 14:19:24.364363 ip-10-0-138-163 kubenswrapper[2573]: I0706 14:19:24.364345 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="3f3e02b9-14e7-48b2-9e8e-800ba5c0e4a1" containerName="maas-api" Jul 06 14:19:24.364363 ip-10-0-138-163 kubenswrapper[2573]: I0706 14:19:24.364352 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="aa42a99c-b4c2-428f-ad1f-df1310ed2e71" containerName="maas-api" Jul 06 14:19:24.364363 ip-10-0-138-163 kubenswrapper[2573]: I0706 14:19:24.364358 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="3ce7000d-6cc6-47ad-8156-d31ddde8927b" containerName="cleanup" Jul 06 14:19:24.367787 ip-10-0-138-163 kubenswrapper[2573]: I0706 14:19:24.367766 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-8kwcr/perf-node-gather-daemonset-j8bgr" Jul 06 14:19:24.370377 ip-10-0-138-163 kubenswrapper[2573]: I0706 14:19:24.370356 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-8kwcr\"/\"kube-root-ca.crt\"" Jul 06 14:19:24.370473 ip-10-0-138-163 kubenswrapper[2573]: I0706 14:19:24.370356 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-8kwcr\"/\"default-dockercfg-tv44x\"" Jul 06 14:19:24.371012 ip-10-0-138-163 kubenswrapper[2573]: I0706 14:19:24.370995 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-8kwcr\"/\"openshift-service-ca.crt\"" Jul 06 14:19:24.377654 ip-10-0-138-163 kubenswrapper[2573]: I0706 14:19:24.377634 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-8kwcr/perf-node-gather-daemonset-j8bgr"] Jul 06 14:19:24.484654 ip-10-0-138-163 kubenswrapper[2573]: I0706 14:19:24.484623 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/cab36c17-c198-435d-9c4c-a3b1a3f46d65-podres\") pod \"perf-node-gather-daemonset-j8bgr\" (UID: \"cab36c17-c198-435d-9c4c-a3b1a3f46d65\") " pod="openshift-must-gather-8kwcr/perf-node-gather-daemonset-j8bgr" Jul 06 14:19:24.484654 ip-10-0-138-163 kubenswrapper[2573]: I0706 14:19:24.484657 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g2kg5\" (UniqueName: \"kubernetes.io/projected/cab36c17-c198-435d-9c4c-a3b1a3f46d65-kube-api-access-g2kg5\") pod \"perf-node-gather-daemonset-j8bgr\" (UID: \"cab36c17-c198-435d-9c4c-a3b1a3f46d65\") " pod="openshift-must-gather-8kwcr/perf-node-gather-daemonset-j8bgr" Jul 06 14:19:24.484864 ip-10-0-138-163 kubenswrapper[2573]: I0706 14:19:24.484738 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/cab36c17-c198-435d-9c4c-a3b1a3f46d65-lib-modules\") pod \"perf-node-gather-daemonset-j8bgr\" (UID: \"cab36c17-c198-435d-9c4c-a3b1a3f46d65\") " pod="openshift-must-gather-8kwcr/perf-node-gather-daemonset-j8bgr" Jul 06 14:19:24.484864 ip-10-0-138-163 kubenswrapper[2573]: I0706 14:19:24.484764 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/cab36c17-c198-435d-9c4c-a3b1a3f46d65-proc\") pod \"perf-node-gather-daemonset-j8bgr\" (UID: \"cab36c17-c198-435d-9c4c-a3b1a3f46d65\") " pod="openshift-must-gather-8kwcr/perf-node-gather-daemonset-j8bgr" Jul 06 14:19:24.484864 ip-10-0-138-163 kubenswrapper[2573]: I0706 14:19:24.484796 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cab36c17-c198-435d-9c4c-a3b1a3f46d65-sys\") pod \"perf-node-gather-daemonset-j8bgr\" (UID: \"cab36c17-c198-435d-9c4c-a3b1a3f46d65\") " pod="openshift-must-gather-8kwcr/perf-node-gather-daemonset-j8bgr" Jul 06 14:19:24.585566 ip-10-0-138-163 kubenswrapper[2573]: I0706 14:19:24.585537 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/cab36c17-c198-435d-9c4c-a3b1a3f46d65-lib-modules\") pod \"perf-node-gather-daemonset-j8bgr\" (UID: \"cab36c17-c198-435d-9c4c-a3b1a3f46d65\") " pod="openshift-must-gather-8kwcr/perf-node-gather-daemonset-j8bgr" Jul 06 14:19:24.585713 ip-10-0-138-163 kubenswrapper[2573]: I0706 14:19:24.585572 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/cab36c17-c198-435d-9c4c-a3b1a3f46d65-proc\") pod \"perf-node-gather-daemonset-j8bgr\" (UID: \"cab36c17-c198-435d-9c4c-a3b1a3f46d65\") " pod="openshift-must-gather-8kwcr/perf-node-gather-daemonset-j8bgr" Jul 06 14:19:24.585713 ip-10-0-138-163 kubenswrapper[2573]: I0706 14:19:24.585601 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cab36c17-c198-435d-9c4c-a3b1a3f46d65-sys\") pod \"perf-node-gather-daemonset-j8bgr\" (UID: \"cab36c17-c198-435d-9c4c-a3b1a3f46d65\") " pod="openshift-must-gather-8kwcr/perf-node-gather-daemonset-j8bgr" Jul 06 14:19:24.585713 ip-10-0-138-163 kubenswrapper[2573]: I0706 14:19:24.585647 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/cab36c17-c198-435d-9c4c-a3b1a3f46d65-podres\") pod \"perf-node-gather-daemonset-j8bgr\" (UID: \"cab36c17-c198-435d-9c4c-a3b1a3f46d65\") " pod="openshift-must-gather-8kwcr/perf-node-gather-daemonset-j8bgr" Jul 06 14:19:24.585713 ip-10-0-138-163 kubenswrapper[2573]: I0706 14:19:24.585670 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g2kg5\" (UniqueName: \"kubernetes.io/projected/cab36c17-c198-435d-9c4c-a3b1a3f46d65-kube-api-access-g2kg5\") pod \"perf-node-gather-daemonset-j8bgr\" (UID: \"cab36c17-c198-435d-9c4c-a3b1a3f46d65\") " pod="openshift-must-gather-8kwcr/perf-node-gather-daemonset-j8bgr" Jul 06 14:19:24.585713 ip-10-0-138-163 kubenswrapper[2573]: I0706 14:19:24.585681 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/cab36c17-c198-435d-9c4c-a3b1a3f46d65-proc\") pod \"perf-node-gather-daemonset-j8bgr\" (UID: \"cab36c17-c198-435d-9c4c-a3b1a3f46d65\") " pod="openshift-must-gather-8kwcr/perf-node-gather-daemonset-j8bgr" Jul 06 14:19:24.585873 ip-10-0-138-163 kubenswrapper[2573]: I0706 14:19:24.585712 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/cab36c17-c198-435d-9c4c-a3b1a3f46d65-lib-modules\") pod \"perf-node-gather-daemonset-j8bgr\" (UID: \"cab36c17-c198-435d-9c4c-a3b1a3f46d65\") " pod="openshift-must-gather-8kwcr/perf-node-gather-daemonset-j8bgr" Jul 06 14:19:24.585873 ip-10-0-138-163 kubenswrapper[2573]: I0706 14:19:24.585746 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cab36c17-c198-435d-9c4c-a3b1a3f46d65-sys\") pod \"perf-node-gather-daemonset-j8bgr\" (UID: \"cab36c17-c198-435d-9c4c-a3b1a3f46d65\") " pod="openshift-must-gather-8kwcr/perf-node-gather-daemonset-j8bgr" Jul 06 14:19:24.585873 ip-10-0-138-163 kubenswrapper[2573]: I0706 14:19:24.585830 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/cab36c17-c198-435d-9c4c-a3b1a3f46d65-podres\") pod \"perf-node-gather-daemonset-j8bgr\" (UID: \"cab36c17-c198-435d-9c4c-a3b1a3f46d65\") " pod="openshift-must-gather-8kwcr/perf-node-gather-daemonset-j8bgr" Jul 06 14:19:24.593764 ip-10-0-138-163 kubenswrapper[2573]: I0706 14:19:24.593742 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g2kg5\" (UniqueName: \"kubernetes.io/projected/cab36c17-c198-435d-9c4c-a3b1a3f46d65-kube-api-access-g2kg5\") pod \"perf-node-gather-daemonset-j8bgr\" (UID: \"cab36c17-c198-435d-9c4c-a3b1a3f46d65\") " pod="openshift-must-gather-8kwcr/perf-node-gather-daemonset-j8bgr" Jul 06 14:19:24.604085 ip-10-0-138-163 kubenswrapper[2573]: I0706 14:19:24.604066 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-z2f98_66e76252-8877-403e-9c30-e56ec0013c24/console-operator/1.log" Jul 06 14:19:24.608999 ip-10-0-138-163 kubenswrapper[2573]: I0706 14:19:24.608985 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-z2f98_66e76252-8877-403e-9c30-e56ec0013c24/console-operator/2.log" Jul 06 14:19:24.677803 ip-10-0-138-163 kubenswrapper[2573]: I0706 14:19:24.677741 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-8kwcr/perf-node-gather-daemonset-j8bgr" Jul 06 14:19:24.803227 ip-10-0-138-163 kubenswrapper[2573]: I0706 14:19:24.803201 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-8kwcr/perf-node-gather-daemonset-j8bgr"] Jul 06 14:19:24.805949 ip-10-0-138-163 kubenswrapper[2573]: W0706 14:19:24.805916 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podcab36c17_c198_435d_9c4c_a3b1a3f46d65.slice/crio-7e4282de4201adfd5135204aba23ff2e905ec936328d59f7aa10833cdc462fb5 WatchSource:0}: Error finding container 7e4282de4201adfd5135204aba23ff2e905ec936328d59f7aa10833cdc462fb5: Status 404 returned error can't find the container with id 7e4282de4201adfd5135204aba23ff2e905ec936328d59f7aa10833cdc462fb5 Jul 06 14:19:24.926298 ip-10-0-138-163 kubenswrapper[2573]: I0706 14:19:24.926263 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-8kwcr/perf-node-gather-daemonset-j8bgr" event={"ID":"cab36c17-c198-435d-9c4c-a3b1a3f46d65","Type":"ContainerStarted","Data":"7e758d5f21a4d9b653e3fbcab387a6ced7d8afc025a0c764e3c49ec9461534b0"} Jul 06 14:19:24.926459 ip-10-0-138-163 kubenswrapper[2573]: I0706 14:19:24.926314 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-8kwcr/perf-node-gather-daemonset-j8bgr" event={"ID":"cab36c17-c198-435d-9c4c-a3b1a3f46d65","Type":"ContainerStarted","Data":"7e4282de4201adfd5135204aba23ff2e905ec936328d59f7aa10833cdc462fb5"} Jul 06 14:19:24.926459 ip-10-0-138-163 kubenswrapper[2573]: I0706 14:19:24.926376 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-8kwcr/perf-node-gather-daemonset-j8bgr" Jul 06 14:19:24.942313 ip-10-0-138-163 kubenswrapper[2573]: I0706 14:19:24.942215 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-8kwcr/perf-node-gather-daemonset-j8bgr" podStartSLOduration=0.942196175 podStartE2EDuration="942.196175ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 14:19:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:19:24.941348624 +0000 UTC m=+2382.317947587" watchObservedRunningTime="2026-07-06 14:19:24.942196175 +0000 UTC m=+2382.318795138" Jul 06 14:19:26.960227 ip-10-0-138-163 kubenswrapper[2573]: I0706 14:19:26.960198 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-cm7lv_87c92d36-2646-4a77-a03a-27190066fbfe/dns/0.log" Jul 06 14:19:26.984563 ip-10-0-138-163 kubenswrapper[2573]: I0706 14:19:26.984536 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-cm7lv_87c92d36-2646-4a77-a03a-27190066fbfe/kube-rbac-proxy/0.log" Jul 06 14:19:27.149877 ip-10-0-138-163 kubenswrapper[2573]: I0706 14:19:27.149846 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-5qvhz_c3396eac-840e-41a5-9639-a78c864904af/dns-node-resolver/0.log" Jul 06 14:19:27.787915 ip-10-0-138-163 kubenswrapper[2573]: I0706 14:19:27.787885 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-8flhb_1e9a1360-d243-4b99-9dbe-b37d77b43a78/node-ca/0.log" Jul 06 14:19:29.007899 ip-10-0-138-163 kubenswrapper[2573]: I0706 14:19:29.007868 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-2jljx_aad3bb1b-0bac-4b96-b020-2612138bf4af/discovery/0.log" Jul 06 14:19:30.061489 ip-10-0-138-163 kubenswrapper[2573]: I0706 14:19:30.061464 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-6j4hj_523ff6ed-d67a-4ac2-8b8c-985f3fe16845/serve-healthcheck-canary/0.log" Jul 06 14:19:30.662438 ip-10-0-138-163 kubenswrapper[2573]: I0706 14:19:30.662395 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-22trx_369661c8-e355-4b66-a939-dcf92753f0e6/kube-rbac-proxy/0.log" Jul 06 14:19:30.686613 ip-10-0-138-163 kubenswrapper[2573]: I0706 14:19:30.686589 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-22trx_369661c8-e355-4b66-a939-dcf92753f0e6/exporter/0.log" Jul 06 14:19:30.707342 ip-10-0-138-163 kubenswrapper[2573]: I0706 14:19:30.707321 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-22trx_369661c8-e355-4b66-a939-dcf92753f0e6/extractor/0.log" Jul 06 14:19:30.939389 ip-10-0-138-163 kubenswrapper[2573]: I0706 14:19:30.939316 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-8kwcr/perf-node-gather-daemonset-j8bgr" Jul 06 14:19:33.936281 ip-10-0-138-163 kubenswrapper[2573]: I0706 14:19:33.936250 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6b559b5dcd-2dcwx_217f821e-464b-4836-bfa5-dedc084766aa/manager/0.log" Jul 06 14:19:33.958793 ip-10-0-138-163 kubenswrapper[2573]: I0706 14:19:33.958772 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6b559b5dcd-2dcwx_217f821e-464b-4836-bfa5-dedc084766aa/copy-manifests/0.log" Jul 06 14:19:35.523738 ip-10-0-138-163 kubenswrapper[2573]: I0706 14:19:35.523704 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-2jljx_aad3bb1b-0bac-4b96-b020-2612138bf4af/discovery/0.log" Jul 06 14:19:35.637436 ip-10-0-138-163 kubenswrapper[2573]: I0706 14:19:35.637403 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-6ff5df8b5c-j8vsf_8e0788aa-0444-4aee-90ef-cd6fca201177/manager/0.log" Jul 06 14:19:37.051857 ip-10-0-138-163 kubenswrapper[2573]: I0706 14:19:37.051828 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-2jljx_aad3bb1b-0bac-4b96-b020-2612138bf4af/discovery/0.log"